[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:11:53.660413 31814 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.31.17.190:36023
I20260709 13:11:53.661989 31814 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:11:53.663110 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:53.680583 31821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:53.680603 31823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:53.682082 31814 server_base.cc:1061] running on GCE node
W20260709 13:11:53.680922 31820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:54.875967 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:54.876272 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:54.876489 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602714876466 us; error 0 us; skew 500 ppm
I20260709 13:11:54.877343 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:54.883774 31814 webserver.cc:533] Webserver started at http://127.31.17.190:36741/ using document root <none> and password file <none>
I20260709 13:11:54.884649 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:54.884894 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:54.885360 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:54.891185 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/master-0-root/instance:
uuid: "6d7eff394b0440e7aa73665fcd5f210e"
format_stamp: "Formatted at 2026-07-09 13:11:54 on dist-test-slave-zhw8"
I20260709 13:11:54.899092 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:11:54.904886 31829 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:54.906109 31814 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.005s
I20260709 13:11:54.906533 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/master-0-root
uuid: "6d7eff394b0440e7aa73665fcd5f210e"
format_stamp: "Formatted at 2026-07-09 13:11:54 on dist-test-slave-zhw8"
I20260709 13:11:54.907019 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:54.961367 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:54.963011 31814 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:11:54.963541 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:55.042083 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.190:36023
I20260709 13:11:55.042176 31880 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.190:36023 every 8 connection(s)
I20260709 13:11:55.050587 31881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:55.072505 31881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e: Bootstrap starting.
I20260709 13:11:55.078550 31881 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:55.080401 31881 log.cc:826] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e: Log is configured to *not* fsync() on all Append() calls
I20260709 13:11:55.084968 31881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e: No bootstrap required, opened a new log
I20260709 13:11:55.105469 31881 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d7eff394b0440e7aa73665fcd5f210e" member_type: VOTER }
I20260709 13:11:55.106019 31881 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:55.106220 31881 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d7eff394b0440e7aa73665fcd5f210e, State: Initialized, Role: FOLLOWER
I20260709 13:11:55.107144 31881 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d7eff394b0440e7aa73665fcd5f210e" member_type: VOTER }
I20260709 13:11:55.107702 31881 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:55.107945 31881 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:55.108222 31881 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:55.112308 31881 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d7eff394b0440e7aa73665fcd5f210e" member_type: VOTER }
I20260709 13:11:55.113042 31881 leader_election.cc:304] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d7eff394b0440e7aa73665fcd5f210e; no voters: 
I20260709 13:11:55.114771 31881 leader_election.cc:290] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:55.115211 31884 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:55.117871 31884 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [term 1 LEADER]: Becoming Leader. State: Replica: 6d7eff394b0440e7aa73665fcd5f210e, State: Running, Role: LEADER
I20260709 13:11:55.118806 31884 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d7eff394b0440e7aa73665fcd5f210e" member_type: VOTER }
I20260709 13:11:55.119894 31881 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:55.129194 31885 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d7eff394b0440e7aa73665fcd5f210e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d7eff394b0440e7aa73665fcd5f210e" member_type: VOTER } }
I20260709 13:11:55.129443 31886 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d7eff394b0440e7aa73665fcd5f210e. Latest consensus state: current_term: 1 leader_uuid: "6d7eff394b0440e7aa73665fcd5f210e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d7eff394b0440e7aa73665fcd5f210e" member_type: VOTER } }
I20260709 13:11:55.130054 31886 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:55.130971 31885 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:55.133770 31893 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:55.145105 31893 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:55.147831 31814 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:55.162817 31893 catalog_manager.cc:1383] Generated new cluster ID: b83b8ea2ca4b4db9aece2704dd369308
I20260709 13:11:55.163133 31893 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:55.199543 31893 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:55.201617 31893 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:55.221330 31893 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e: Generated new TSK 0
I20260709 13:11:55.222440 31893 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:55.279083 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:55.287642 31903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:55.289156 31904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:55.293167 31906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:55.293216 31814 server_base.cc:1061] running on GCE node
I20260709 13:11:55.294116 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:55.294364 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:55.294574 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602715294556 us; error 0 us; skew 500 ppm
I20260709 13:11:55.295186 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:55.299815 31814 webserver.cc:533] Webserver started at http://127.31.17.129:37541/ using document root <none> and password file <none>
I20260709 13:11:55.300420 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:55.300650 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:55.300951 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:55.302098 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/ts-0-root/instance:
uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
format_stamp: "Formatted at 2026-07-09 13:11:55 on dist-test-slave-zhw8"
I20260709 13:11:55.308087 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:11:55.312783 31911 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:55.313622 31814 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.003s
I20260709 13:11:55.313913 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/ts-0-root
uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
format_stamp: "Formatted at 2026-07-09 13:11:55 on dist-test-slave-zhw8"
I20260709 13:11:55.314220 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:55.333396 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:55.334854 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:55.337790 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:55.342468 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:55.342705 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:55.343030 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:55.343192 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:55.454028 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.129:45791
I20260709 13:11:55.454114 31973 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.129:45791 every 8 connection(s)
I20260709 13:11:55.461361 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:55.474411 31978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:55.476918 31979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:55.482971 31981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:55.489197 31814 server_base.cc:1061] running on GCE node
I20260709 13:11:55.490432 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:55.490738 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:55.490976 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602715490957 us; error 0 us; skew 500 ppm
I20260709 13:11:55.491873 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:55.495709 31814 webserver.cc:533] Webserver started at http://127.31.17.130:43503/ using document root <none> and password file <none>
I20260709 13:11:55.495903 31974 heartbeater.cc:344] Connected to a master server at 127.31.17.190:36023
I20260709 13:11:55.496421 31974 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:55.496444 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:55.496793 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:55.497179 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:55.497514 31974 heartbeater.cc:507] Master 127.31.17.190:36023 requested a full tablet report, sending...
I20260709 13:11:55.498745 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/ts-1-root/instance:
uuid: "ee8e497c603c41a890b1f792efcd1755"
format_stamp: "Formatted at 2026-07-09 13:11:55 on dist-test-slave-zhw8"
I20260709 13:11:55.500416 31846 ts_manager.cc:194] Registered new tserver with Master: c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791)
I20260709 13:11:55.502523 31846 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52008
I20260709 13:11:55.506381 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:11:55.512190 31986 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:55.513077 31814 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:11:55.513424 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/ts-1-root
uuid: "ee8e497c603c41a890b1f792efcd1755"
format_stamp: "Formatted at 2026-07-09 13:11:55 on dist-test-slave-zhw8"
I20260709 13:11:55.513796 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:55.541458 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:55.542795 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:55.545358 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:55.548873 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:55.549062 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:55.549363 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:55.549501 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:55.650406 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.130:42471
I20260709 13:11:55.650586 32048 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.130:42471 every 8 connection(s)
I20260709 13:11:55.662247 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:55.670397 32052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:55.671985 32053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:55.675086 32049 heartbeater.cc:344] Connected to a master server at 127.31.17.190:36023
I20260709 13:11:55.675623 32049 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:55.676807 32049 heartbeater.cc:507] Master 127.31.17.190:36023 requested a full tablet report, sending...
I20260709 13:11:55.679080 31814 server_base.cc:1061] running on GCE node
I20260709 13:11:55.679682 31846 ts_manager.cc:194] Registered new tserver with Master: ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
W20260709 13:11:55.680408 32055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:55.681452 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:11:55.681442 31846 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52022
W20260709 13:11:55.682372 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:55.682588 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602715682567 us; error 0 us; skew 500 ppm
I20260709 13:11:55.683333 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:55.686128 31814 webserver.cc:533] Webserver started at http://127.31.17.131:34819/ using document root <none> and password file <none>
I20260709 13:11:55.686594 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:55.686805 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:55.687067 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:55.688160 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/ts-2-root/instance:
uuid: "8f27676195a74c97bfe9385963ccf1ab"
format_stamp: "Formatted at 2026-07-09 13:11:55 on dist-test-slave-zhw8"
I20260709 13:11:55.692821 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:11:55.696280 32060 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:55.697105 31814 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:55.697410 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/ts-2-root
uuid: "8f27676195a74c97bfe9385963ccf1ab"
format_stamp: "Formatted at 2026-07-09 13:11:55 on dist-test-slave-zhw8"
I20260709 13:11:55.697742 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602713491408-31814-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:55.714076 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:55.715368 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:55.717577 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:55.720074 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:55.720414 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:55.720736 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:55.720918 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:55.813696 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.131:33109
I20260709 13:11:55.813851 32122 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.131:33109 every 8 connection(s)
I20260709 13:11:55.829218 32123 heartbeater.cc:344] Connected to a master server at 127.31.17.190:36023
I20260709 13:11:55.829583 32123 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:55.830370 32123 heartbeater.cc:507] Master 127.31.17.190:36023 requested a full tablet report, sending...
I20260709 13:11:55.832302 31846 ts_manager.cc:194] Registered new tserver with Master: 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:55.832435 31814 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013867116s
I20260709 13:11:55.833626 31846 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52028
I20260709 13:11:55.886654 31846 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52032:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:55.890621 31846 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:56.004222 32088 tablet_service.cc:1511] Processing CreateTablet for tablet 9879c8cb78ea4b109ced91e5e6967f01 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:56.004329 32087 tablet_service.cc:1511] Processing CreateTablet for tablet c75d483672bc4444a2c3fc3fc4f60d08 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:56.006377 32088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9879c8cb78ea4b109ced91e5e6967f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.009279 32086 tablet_service.cc:1511] Processing CreateTablet for tablet 1b42a0943214410a828474fa1d08a8f4 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:56.016700 32087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75d483672bc4444a2c3fc3fc4f60d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.016070 32013 tablet_service.cc:1511] Processing CreateTablet for tablet c75d483672bc4444a2c3fc3fc4f60d08 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:56.019275 32013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75d483672bc4444a2c3fc3fc4f60d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.018515 32014 tablet_service.cc:1511] Processing CreateTablet for tablet 9879c8cb78ea4b109ced91e5e6967f01 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:56.024597 32086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b42a0943214410a828474fa1d08a8f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.025429 32085 tablet_service.cc:1511] Processing CreateTablet for tablet 94d9f9fdffc84924823feb0b8cb0f642 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:56.021353 32012 tablet_service.cc:1511] Processing CreateTablet for tablet 1b42a0943214410a828474fa1d08a8f4 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:56.023792 32011 tablet_service.cc:1511] Processing CreateTablet for tablet 94d9f9fdffc84924823feb0b8cb0f642 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:56.030884 32014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9879c8cb78ea4b109ced91e5e6967f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.031726 32085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d9f9fdffc84924823feb0b8cb0f642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.035614 32010 tablet_service.cc:1511] Processing CreateTablet for tablet c549793d21804ed08151cbf68646a6f1 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:56.038976 32011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d9f9fdffc84924823feb0b8cb0f642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.040872 32010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c549793d21804ed08151cbf68646a6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.044559 32012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b42a0943214410a828474fa1d08a8f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.052857 32084 tablet_service.cc:1511] Processing CreateTablet for tablet c549793d21804ed08151cbf68646a6f1 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:56.056648 32084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c549793d21804ed08151cbf68646a6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.067669 31939 tablet_service.cc:1511] Processing CreateTablet for tablet 9879c8cb78ea4b109ced91e5e6967f01 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:11:56.076699 31937 tablet_service.cc:1511] Processing CreateTablet for tablet 1b42a0943214410a828474fa1d08a8f4 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:11:56.076149 31935 tablet_service.cc:1511] Processing CreateTablet for tablet c549793d21804ed08151cbf68646a6f1 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:11:56.071596 31938 tablet_service.cc:1511] Processing CreateTablet for tablet c75d483672bc4444a2c3fc3fc4f60d08 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:11:56.091770 32009 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef5ce785a304c28965be6f6a334d641 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:56.093232 32009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef5ce785a304c28965be6f6a334d641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.089632 31937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b42a0943214410a828474fa1d08a8f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.095583 31934 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef5ce785a304c28965be6f6a334d641 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:56.075537 31936 tablet_service.cc:1511] Processing CreateTablet for tablet 94d9f9fdffc84924823feb0b8cb0f642 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:11:56.110548 31935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c549793d21804ed08151cbf68646a6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.117061 31938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75d483672bc4444a2c3fc3fc4f60d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.123153 31939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9879c8cb78ea4b109ced91e5e6967f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.126204 31936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d9f9fdffc84924823feb0b8cb0f642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.128942 31934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef5ce785a304c28965be6f6a334d641. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:56.136437 31894 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:56.141163 32083 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef5ce785a304c28965be6f6a334d641 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:11:56.142618 32083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef5ce785a304c28965be6f6a334d641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.142474 31933 tablet_service.cc:1511] Processing CreateTablet for tablet 63c6827346dc409180eaf80f8ab513a2 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:56.143853 31933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63c6827346dc409180eaf80f8ab513a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.148547 32141 tablet_bootstrap.cc:492] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab: Bootstrap starting.
I20260709 13:11:56.158812 32141 tablet_bootstrap.cc:654] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.168506 32008 tablet_service.cc:1511] Processing CreateTablet for tablet 63c6827346dc409180eaf80f8ab513a2 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:56.170368 32008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63c6827346dc409180eaf80f8ab513a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.173480 32084 tablet_service.cc:1511] Processing CreateTablet for tablet 63c6827346dc409180eaf80f8ab513a2 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:11:56.174777 32084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63c6827346dc409180eaf80f8ab513a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.182973 31932 tablet_service.cc:1511] Processing CreateTablet for tablet 3bf720c8bcce449888097f89cc4c5f54 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:56.184333 31932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf720c8bcce449888097f89cc4c5f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.224823 32010 tablet_service.cc:1511] Processing CreateTablet for tablet 3bf720c8bcce449888097f89cc4c5f54 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:56.230832 32141 tablet_bootstrap.cc:492] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab: No bootstrap required, opened a new log
I20260709 13:11:56.231402 32141 ts_tablet_manager.cc:1403] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab: Time spent bootstrapping tablet: real 0.083s	user 0.019s	sys 0.021s
I20260709 13:11:56.230796 32010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf720c8bcce449888097f89cc4c5f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.240428 32009 tablet_service.cc:1511] Processing CreateTablet for tablet 5c970435dcf84bfa86e60f84827b713b (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:56.241075 31937 tablet_service.cc:1511] Processing CreateTablet for tablet 5c970435dcf84bfa86e60f84827b713b (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:56.241789 32009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c970435dcf84bfa86e60f84827b713b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.241735 32085 tablet_service.cc:1511] Processing CreateTablet for tablet 5c970435dcf84bfa86e60f84827b713b (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:11:56.242242 31937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c970435dcf84bfa86e60f84827b713b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.242945 32085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c970435dcf84bfa86e60f84827b713b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.246863 32086 tablet_service.cc:1511] Processing CreateTablet for tablet 3bf720c8bcce449888097f89cc4c5f54 (DEFAULT_TABLE table=test-workload [id=50250943b63348158d06327d2a4617a4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:11:56.248332 32144 tablet_bootstrap.cc:492] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c: Bootstrap starting.
I20260709 13:11:56.249378 32086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf720c8bcce449888097f89cc4c5f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:56.254163 32141 raft_consensus.cc:359] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:11:56.255007 32141 raft_consensus.cc:385] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.256186 32141 raft_consensus.cc:740] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.267403 32141 consensus_queue.cc:260] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:11:56.274112 32144 tablet_bootstrap.cc:654] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.279767 32143 tablet_bootstrap.cc:492] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755: Bootstrap starting.
I20260709 13:11:56.295789 32123 heartbeater.cc:499] Master 127.31.17.190:36023 was elected leader, sending a full tablet report...
I20260709 13:11:56.303627 32143 tablet_bootstrap.cc:654] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.304454 32141 ts_tablet_manager.cc:1434] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.004s
I20260709 13:11:56.306620 32141 tablet_bootstrap.cc:492] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab: Bootstrap starting.
W20260709 13:11:56.323664 32124 tablet.cc:2406] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:11:56.326582 32143 tablet_bootstrap.cc:492] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755: No bootstrap required, opened a new log
I20260709 13:11:56.327064 32143 ts_tablet_manager.cc:1403] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.011s
I20260709 13:11:56.329885 32144 tablet_bootstrap.cc:492] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c: No bootstrap required, opened a new log
I20260709 13:11:56.330410 32144 ts_tablet_manager.cc:1403] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.000s
I20260709 13:11:56.331367 32143 raft_consensus.cc:359] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.332202 32143 raft_consensus.cc:385] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.332499 32143 raft_consensus.cc:740] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.333228 32143 consensus_queue.cc:260] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.333482 32144 raft_consensus.cc:359] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.334278 32144 raft_consensus.cc:385] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.334997 32141 tablet_bootstrap.cc:654] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.334889 32144 raft_consensus.cc:740] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.337703 32144 consensus_queue.cc:260] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.342737 31974 heartbeater.cc:499] Master 127.31.17.190:36023 was elected leader, sending a full tablet report...
I20260709 13:11:56.344084 32144 ts_tablet_manager.cc:1434] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
I20260709 13:11:56.345358 32144 tablet_bootstrap.cc:492] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c: Bootstrap starting.
I20260709 13:11:56.352563 32049 heartbeater.cc:499] Master 127.31.17.190:36023 was elected leader, sending a full tablet report...
I20260709 13:11:56.353093 32143 ts_tablet_manager.cc:1434] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.012s
I20260709 13:11:56.354260 32143 tablet_bootstrap.cc:492] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755: Bootstrap starting.
I20260709 13:11:56.355306 32141 tablet_bootstrap.cc:492] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab: No bootstrap required, opened a new log
I20260709 13:11:56.355691 32144 tablet_bootstrap.cc:654] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.355839 32141 ts_tablet_manager.cc:1403] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.014s
I20260709 13:11:56.360627 32141 raft_consensus.cc:359] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.361111 32141 raft_consensus.cc:385] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.361189 32143 tablet_bootstrap.cc:654] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.361323 32141 raft_consensus.cc:740] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.364364 32141 consensus_queue.cc:260] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.368285 32144 tablet_bootstrap.cc:492] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c: No bootstrap required, opened a new log
I20260709 13:11:56.368732 32144 ts_tablet_manager.cc:1403] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.004s
I20260709 13:11:56.371433 32141 ts_tablet_manager.cc:1434] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:11:56.372184 32144 raft_consensus.cc:359] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.372948 32144 raft_consensus.cc:385] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.373278 32144 raft_consensus.cc:740] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.372685 32141 tablet_bootstrap.cc:492] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab: Bootstrap starting.
I20260709 13:11:56.374111 32144 consensus_queue.cc:260] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.376473 32144 ts_tablet_manager.cc:1434] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:11:56.377384 32144 tablet_bootstrap.cc:492] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c: Bootstrap starting.
I20260709 13:11:56.381974 32141 tablet_bootstrap.cc:654] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.383872 32144 tablet_bootstrap.cc:654] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.404109 32148 raft_consensus.cc:493] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.404712 32148 raft_consensus.cc:515] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.415197 32143 tablet_bootstrap.cc:492] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755: No bootstrap required, opened a new log
I20260709 13:11:56.415724 32143 ts_tablet_manager.cc:1403] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.013s
I20260709 13:11:56.419536 32143 raft_consensus.cc:359] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.420506 32143 raft_consensus.cc:385] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.420781 32148 leader_election.cc:290] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:56.420854 32143 raft_consensus.cc:740] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.421336 32141 tablet_bootstrap.cc:492] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab: No bootstrap required, opened a new log
I20260709 13:11:56.421854 32141 ts_tablet_manager.cc:1403] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.020s
I20260709 13:11:56.421916 32143 consensus_queue.cc:260] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.424774 32141 raft_consensus.cc:359] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.425537 32141 raft_consensus.cc:385] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.427613 32143 ts_tablet_manager.cc:1434] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:11:56.428722 32143 tablet_bootstrap.cc:492] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755: Bootstrap starting.
I20260709 13:11:56.425871 32141 raft_consensus.cc:740] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.430166 32141 consensus_queue.cc:260] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.432368 32141 ts_tablet_manager.cc:1434] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:11:56.433755 32141 tablet_bootstrap.cc:492] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab: Bootstrap starting.
I20260709 13:11:56.443747 32141 tablet_bootstrap.cc:654] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.446686 32144 tablet_bootstrap.cc:492] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c: No bootstrap required, opened a new log
I20260709 13:11:56.447180 32144 ts_tablet_manager.cc:1403] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.012s
I20260709 13:11:56.450279 32144 raft_consensus.cc:359] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.451004 32144 raft_consensus.cc:385] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.451385 32144 raft_consensus.cc:740] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.451258 32143 tablet_bootstrap.cc:654] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.452220 32144 consensus_queue.cc:260] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.464563 32143 tablet_bootstrap.cc:492] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755: No bootstrap required, opened a new log
I20260709 13:11:56.465046 32143 ts_tablet_manager.cc:1403] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.004s
I20260709 13:11:56.465595 32144 ts_tablet_manager.cc:1434] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:11:56.466500 32144 tablet_bootstrap.cc:492] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c: Bootstrap starting.
I20260709 13:11:56.467749 32141 tablet_bootstrap.cc:492] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab: No bootstrap required, opened a new log
I20260709 13:11:56.468264 32141 ts_tablet_manager.cc:1403] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.010s
I20260709 13:11:56.470978 32141 raft_consensus.cc:359] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.471737 32141 raft_consensus.cc:385] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.472090 32141 raft_consensus.cc:740] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.472975 32141 consensus_queue.cc:260] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.475448 32141 ts_tablet_manager.cc:1434] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:56.476442 32141 tablet_bootstrap.cc:492] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab: Bootstrap starting.
I20260709 13:11:56.478006 31949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d9f9fdffc84924823feb0b8cb0f642" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" is_pre_election: true
W20260709 13:11:56.482283 31987 leader_election.cc:343] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:56.482841 32144 tablet_bootstrap.cc:654] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.483305 32145 raft_consensus.cc:493] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.483803 32145 raft_consensus.cc:515] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.486729 32145 leader_election.cc:290] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:11:56.483114 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d9f9fdffc84924823feb0b8cb0f642" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f27676195a74c97bfe9385963ccf1ab" is_pre_election: true
W20260709 13:11:56.490877 31988 leader_election.cc:343] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:56.491390 31988 leader_election.cc:304] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8e497c603c41a890b1f792efcd1755; no voters: 8f27676195a74c97bfe9385963ccf1ab, c5768f9b99f540aaa88e4bc85f939c8c
I20260709 13:11:56.492367 32141 tablet_bootstrap.cc:654] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.493000 32148 raft_consensus.cc:2749] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:56.479772 32143 raft_consensus.cc:359] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.495128 32143 raft_consensus.cc:385] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.495582 32143 raft_consensus.cc:740] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.496479 32143 consensus_queue.cc:260] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.499286 32143 ts_tablet_manager.cc:1434] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:11:56.500615 32143 tablet_bootstrap.cc:492] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755: Bootstrap starting.
I20260709 13:11:56.507285 32143 tablet_bootstrap.cc:654] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.508576 32144 tablet_bootstrap.cc:492] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c: No bootstrap required, opened a new log
I20260709 13:11:56.509155 32144 ts_tablet_manager.cc:1403] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c: Time spent bootstrapping tablet: real 0.043s	user 0.007s	sys 0.011s
I20260709 13:11:56.512485 32150 raft_consensus.cc:493] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.515916 32150 raft_consensus.cc:515] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.516247 32144 raft_consensus.cc:359] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.516944 32144 raft_consensus.cc:385] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.517242 32144 raft_consensus.cc:740] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.518623 32150 leader_election.cc:290] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:56.517958 32144 consensus_queue.cc:260] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.529836 32144 ts_tablet_manager.cc:1434] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:11:56.531113 32144 tablet_bootstrap.cc:492] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c: Bootstrap starting.
I20260709 13:11:56.540563 31949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef5ce785a304c28965be6f6a334d641" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" is_pre_election: true
W20260709 13:11:56.547050 32061 leader_election.cc:343] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:56.543895 32150 raft_consensus.cc:493] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.548952 32150 raft_consensus.cc:515] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.553294 32150 leader_election.cc:290] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:56.554348 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef5ce785a304c28965be6f6a334d641" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755" is_pre_election: true
I20260709 13:11:56.555765 32024 raft_consensus.cc:2468] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 0.
I20260709 13:11:56.555967 32141 tablet_bootstrap.cc:492] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab: No bootstrap required, opened a new log
I20260709 13:11:56.556924 32141 ts_tablet_manager.cc:1403] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.015s
I20260709 13:11:56.558781 32063 leader_election.cc:304] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, ee8e497c603c41a890b1f792efcd1755; no voters: c5768f9b99f540aaa88e4bc85f939c8c
I20260709 13:11:56.560885 32145 raft_consensus.cc:2804] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:56.561251 32145 raft_consensus.cc:493] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.561436 32143 tablet_bootstrap.cc:492] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755: No bootstrap required, opened a new log
I20260709 13:11:56.561592 32145 raft_consensus.cc:3060] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.561961 32143 ts_tablet_manager.cc:1403] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755: Time spent bootstrapping tablet: real 0.062s	user 0.017s	sys 0.020s
I20260709 13:11:56.565285 32141 raft_consensus.cc:359] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.571347 32141 raft_consensus.cc:385] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.581585 32141 raft_consensus.cc:740] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.585644 32141 consensus_queue.cc:260] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.585989 32143 raft_consensus.cc:359] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:11:56.588642 32143 raft_consensus.cc:385] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.592860 32143 raft_consensus.cc:740] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.592865 32145 raft_consensus.cc:515] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.593894 32143 consensus_queue.cc:260] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:11:56.592314 32144 tablet_bootstrap.cc:654] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.597729 31949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef5ce785a304c28965be6f6a334d641" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:11:56.601303 32167 raft_consensus.cc:493] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:56.601971 32061 leader_election.cc:343] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:56.601996 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf720c8bcce449888097f89cc4c5f54" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755" is_pre_election: true
W20260709 13:11:56.604697 31914 leader_election.cc:343] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:56.602950 32023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b42a0943214410a828474fa1d08a8f4" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755" is_pre_election: true
W20260709 13:11:56.609191 31914 leader_election.cc:343] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:56.609510 32023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef5ce785a304c28965be6f6a334d641" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:11:56.605708 32145 leader_election.cc:290] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:11:56.610240 32023 raft_consensus.cc:3060] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.615772 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf720c8bcce449888097f89cc4c5f54" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f27676195a74c97bfe9385963ccf1ab" is_pre_election: true
I20260709 13:11:56.617434 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b42a0943214410a828474fa1d08a8f4" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f27676195a74c97bfe9385963ccf1ab" is_pre_election: true
I20260709 13:11:56.619033 32143 ts_tablet_manager.cc:1434] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.001s
W20260709 13:11:56.619098 31913 leader_election.cc:343] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:56.601792 32167 raft_consensus.cc:515] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.620630 32168 raft_consensus.cc:493] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.620584 31913 leader_election.cc:304] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5768f9b99f540aaa88e4bc85f939c8c; no voters: 8f27676195a74c97bfe9385963ccf1ab, ee8e497c603c41a890b1f792efcd1755
I20260709 13:11:56.621582 32141 ts_tablet_manager.cc:1434] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab: Time spent starting tablet: real 0.064s	user 0.012s	sys 0.010s
W20260709 13:11:56.622394 31913 leader_election.cc:343] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:56.622814 31913 leader_election.cc:304] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5768f9b99f540aaa88e4bc85f939c8c; no voters: 8f27676195a74c97bfe9385963ccf1ab, ee8e497c603c41a890b1f792efcd1755
I20260709 13:11:56.623348 32141 tablet_bootstrap.cc:492] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab: Bootstrap starting.
I20260709 13:11:56.621992 32143 tablet_bootstrap.cc:492] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755: Bootstrap starting.
I20260709 13:11:56.622025 32150 raft_consensus.cc:2749] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:56.626417 32150 raft_consensus.cc:2749] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:56.625811 32168 raft_consensus.cc:515] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:11:56.629451 32150 raft_consensus.cc:493] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.631289 32150 raft_consensus.cc:515] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.631850 31949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549793d21804ed08151cbf68646a6f1" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" is_pre_election: true
I20260709 13:11:56.632412 31949 raft_consensus.cc:2468] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 0.
I20260709 13:11:56.637243 32061 leader_election.cc:304] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, c5768f9b99f540aaa88e4bc85f939c8c; no voters: 
I20260709 13:11:56.637995 32150 leader_election.cc:290] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:56.641805 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549793d21804ed08151cbf68646a6f1" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755" is_pre_election: true
I20260709 13:11:56.643622 32024 raft_consensus.cc:2468] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5768f9b99f540aaa88e4bc85f939c8c in term 0.
I20260709 13:11:56.645144 32168 leader_election.cc:290] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:11:56.645258 31914 leader_election.cc:304] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5768f9b99f540aaa88e4bc85f939c8c, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:11:56.645747 31949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" is_pre_election: true
I20260709 13:11:56.647184 32148 raft_consensus.cc:493] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.647297 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755" is_pre_election: true
W20260709 13:11:56.647395 32061 leader_election.cc:343] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:56.647751 32148 raft_consensus.cc:515] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:11:56.648128 32150 raft_consensus.cc:2804] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:56.649703 32150 raft_consensus.cc:493] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.652143 32150 raft_consensus.cc:3060] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.652693 32023 raft_consensus.cc:2468] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 1.
I20260709 13:11:56.655328 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549793d21804ed08151cbf68646a6f1" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f27676195a74c97bfe9385963ccf1ab" is_pre_election: true
I20260709 13:11:56.657209 32148 leader_election.cc:290] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109), c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791)
I20260709 13:11:56.655884 32063 leader_election.cc:304] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, ee8e497c603c41a890b1f792efcd1755; no voters: c5768f9b99f540aaa88e4bc85f939c8c
I20260709 13:11:56.652413 32168 raft_consensus.cc:493] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.659282 31949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" is_pre_election: true
I20260709 13:11:56.660006 32169 raft_consensus.cc:2804] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:56.660290 32145 raft_consensus.cc:2804] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:56.660425 32169 raft_consensus.cc:493] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.659104 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f27676195a74c97bfe9385963ccf1ab" is_pre_election: true
I20260709 13:11:56.653657 32024 raft_consensus.cc:2468] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 0.
I20260709 13:11:56.659492 32168 raft_consensus.cc:515] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
W20260709 13:11:56.661759 31987 leader_election.cc:343] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:56.660862 32169 raft_consensus.cc:3060] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.662739 32097 raft_consensus.cc:2468] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 0.
I20260709 13:11:56.665535 31988 leader_election.cc:304] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, ee8e497c603c41a890b1f792efcd1755; no voters: c5768f9b99f540aaa88e4bc85f939c8c
I20260709 13:11:56.666527 32148 raft_consensus.cc:2804] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:56.666925 32148 raft_consensus.cc:493] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.667361 32148 raft_consensus.cc:3060] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.669371 32168 leader_election.cc:290] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:11:56.669559 32063 leader_election.cc:304] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, ee8e497c603c41a890b1f792efcd1755; no voters: c5768f9b99f540aaa88e4bc85f939c8c
I20260709 13:11:56.670791 32023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549793d21804ed08151cbf68646a6f1" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755" is_pre_election: true
I20260709 13:11:56.674142 31949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63c6827346dc409180eaf80f8ab513a2" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" is_pre_election: true
I20260709 13:11:56.675146 31949 raft_consensus.cc:2468] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 0.
I20260709 13:11:56.675674 32150 raft_consensus.cc:515] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.678830 32144 tablet_bootstrap.cc:492] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c: No bootstrap required, opened a new log
I20260709 13:11:56.679325 32144 ts_tablet_manager.cc:1403] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c: Time spent bootstrapping tablet: real 0.149s	user 0.014s	sys 0.020s
I20260709 13:11:56.674475 32168 raft_consensus.cc:2804] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:56.676482 32061 leader_election.cc:304] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, c5768f9b99f540aaa88e4bc85f939c8c; no voters: 
I20260709 13:11:56.685444 32168 raft_consensus.cc:493] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.687316 32023 raft_consensus.cc:2468] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 0.
I20260709 13:11:56.685887 32168 raft_consensus.cc:3060] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.670524 32167 leader_election.cc:290] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:11:56.690111 32167 raft_consensus.cc:2804] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:56.690661 32167 raft_consensus.cc:493] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.691197 32167 raft_consensus.cc:3060] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.691007 32144 raft_consensus.cc:359] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.691829 32144 raft_consensus.cc:385] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.692142 32144 raft_consensus.cc:740] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.692397 32141 tablet_bootstrap.cc:654] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.695629 32145 raft_consensus.cc:697] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Becoming Leader. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Running, Role: LEADER
I20260709 13:11:56.703294 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549793d21804ed08151cbf68646a6f1" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:11:56.730094 32023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63c6827346dc409180eaf80f8ab513a2" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755" is_pre_election: true
I20260709 13:11:56.731539 32024 raft_consensus.cc:3060] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:56.731596 32063 leader_election.cc:343] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:56.732405 32150 leader_election.cc:290] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 1 election: Requested vote from peers ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:56.735666 32143 tablet_bootstrap.cc:654] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.699229 32144 consensus_queue.cc:260] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.727820 32169 raft_consensus.cc:515] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.708127 32145 consensus_queue.cc:237] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.737687 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549793d21804ed08151cbf68646a6f1" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:11:56.736981 32168 raft_consensus.cc:515] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:11:56.741087 32098 raft_consensus.cc:2393] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5768f9b99f540aaa88e4bc85f939c8c in current term 1: Already voted for candidate 8f27676195a74c97bfe9385963ccf1ab in this term.
I20260709 13:11:56.745074 32148 raft_consensus.cc:515] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:11:56.752362 32144 ts_tablet_manager.cc:1434] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c: Time spent starting tablet: real 0.073s	user 0.014s	sys 0.000s
I20260709 13:11:56.756743 32148 leader_election.cc:290] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 election: Requested vote from peers 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109), c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791)
I20260709 13:11:56.756551 32169 leader_election.cc:290] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:11:56.759111 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:11:56.758927 31949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549793d21804ed08151cbf68646a6f1" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:11:56.762048 32144 tablet_bootstrap.cc:492] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c: Bootstrap starting.
I20260709 13:11:56.762874 32098 raft_consensus.cc:2393] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ee8e497c603c41a890b1f792efcd1755 in current term 1: Already voted for candidate 8f27676195a74c97bfe9385963ccf1ab in this term.
I20260709 13:11:56.761869 32168 leader_election.cc:290] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:11:56.762833 32023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549793d21804ed08151cbf68646a6f1" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:11:56.767520 31949 raft_consensus.cc:2393] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8f27676195a74c97bfe9385963ccf1ab in current term 1: Already voted for candidate c5768f9b99f540aaa88e4bc85f939c8c in this term.
I20260709 13:11:56.764394 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:11:56.764839 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:11:56.769418 32022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:11:56.771848 32022 raft_consensus.cc:2393] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8f27676195a74c97bfe9385963ccf1ab in current term 1: Already voted for candidate ee8e497c603c41a890b1f792efcd1755 in this term.
W20260709 13:11:56.775619 31987 leader_election.cc:343] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:56.779836 32167 raft_consensus.cc:515] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.781966 32143 tablet_bootstrap.cc:492] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755: No bootstrap required, opened a new log
I20260709 13:11:56.783066 32168 raft_consensus.cc:493] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.781876 32061 leader_election.cc:304] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab; no voters: c5768f9b99f540aaa88e4bc85f939c8c, ee8e497c603c41a890b1f792efcd1755
I20260709 13:11:56.782980 31987 leader_election.cc:304] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8e497c603c41a890b1f792efcd1755; no voters: 8f27676195a74c97bfe9385963ccf1ab, c5768f9b99f540aaa88e4bc85f939c8c
I20260709 13:11:56.784420 32143 ts_tablet_manager.cc:1403] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755: Time spent bootstrapping tablet: real 0.163s	user 0.007s	sys 0.016s
I20260709 13:11:56.789913 32148 raft_consensus.cc:2749] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:56.790316 32024 raft_consensus.cc:2468] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5768f9b99f540aaa88e4bc85f939c8c in term 1.
W20260709 13:11:56.790561 32061 leader_election.cc:343] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:56.791065 32061 leader_election.cc:304] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab; no voters: c5768f9b99f540aaa88e4bc85f939c8c, ee8e497c603c41a890b1f792efcd1755
I20260709 13:11:56.789687 32145 raft_consensus.cc:2749] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:56.788659 32168 raft_consensus.cc:515] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.792028 32169 raft_consensus.cc:2749] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:56.791599 31914 leader_election.cc:304] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5768f9b99f540aaa88e4bc85f939c8c, ee8e497c603c41a890b1f792efcd1755; no voters: 8f27676195a74c97bfe9385963ccf1ab
I20260709 13:11:56.792919 32141 tablet_bootstrap.cc:492] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab: No bootstrap required, opened a new log
I20260709 13:11:56.793120 32167 leader_election.cc:290] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:11:56.793442 32141 ts_tablet_manager.cc:1403] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab: Time spent bootstrapping tablet: real 0.170s	user 0.021s	sys 0.020s
I20260709 13:11:56.793550 32150 raft_consensus.cc:2804] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:56.794162 32168 leader_election.cc:290] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:11:56.794721 32150 raft_consensus.cc:697] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 LEADER]: Becoming Leader. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Running, Role: LEADER
I20260709 13:11:56.795583 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63c6827346dc409180eaf80f8ab513a2" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:11:56.796627 31947 raft_consensus.cc:3060] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:56.797772 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63c6827346dc409180eaf80f8ab513a2" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:11:56.797618 31949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" is_pre_election: true
I20260709 13:11:56.797013 32150 consensus_queue.cc:237] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.799631 32022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755" is_pre_election: true
W20260709 13:11:56.803146 32061 leader_election.cc:343] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:56.803148 32063 leader_election.cc:343] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:56.806465 32144 tablet_bootstrap.cc:654] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:56.805454 32063 leader_election.cc:343] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:56.807488 32063 leader_election.cc:304] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab; no voters: c5768f9b99f540aaa88e4bc85f939c8c, ee8e497c603c41a890b1f792efcd1755
I20260709 13:11:56.807886 32143 raft_consensus.cc:359] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.808760 32143 raft_consensus.cc:385] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.809238 32143 raft_consensus.cc:740] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.809178 32168 raft_consensus.cc:2749] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:56.808424 32141 raft_consensus.cc:359] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.809964 32141 raft_consensus.cc:385] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.817252 32141 raft_consensus.cc:740] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.818485 31947 raft_consensus.cc:2468] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 1.
I20260709 13:11:56.810341 32143 consensus_queue.cc:260] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.819701 32141 consensus_queue.cc:260] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.820348 32061 leader_election.cc:304] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, c5768f9b99f540aaa88e4bc85f939c8c; no voters: ee8e497c603c41a890b1f792efcd1755
I20260709 13:11:56.821542 32168 raft_consensus.cc:2804] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:56.822099 32168 raft_consensus.cc:697] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Becoming Leader. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Running, Role: LEADER
I20260709 13:11:56.822592 32141 ts_tablet_manager.cc:1434] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.006s
I20260709 13:11:56.822903 32168 consensus_queue.cc:237] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.823621 32141 tablet_bootstrap.cc:492] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab: Bootstrap starting.
I20260709 13:11:56.825302 32143 ts_tablet_manager.cc:1434] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.009s
I20260709 13:11:56.826265 32143 tablet_bootstrap.cc:492] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755: Bootstrap starting.
I20260709 13:11:56.833143 32141 tablet_bootstrap.cc:654] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.837823 32143 tablet_bootstrap.cc:654] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.847175 32143 tablet_bootstrap.cc:492] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755: No bootstrap required, opened a new log
I20260709 13:11:56.847754 32143 ts_tablet_manager.cc:1403] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.006s
I20260709 13:11:56.849206 31846 catalog_manager.cc:5697] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131). New cstate: current_term: 1 leader_uuid: "8f27676195a74c97bfe9385963ccf1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:56.850705 32143 raft_consensus.cc:359] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.851436 32143 raft_consensus.cc:385] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.851739 32143 raft_consensus.cc:740] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.852815 32143 consensus_queue.cc:260] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.855669 32143 ts_tablet_manager.cc:1434] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:11:56.856690 32143 tablet_bootstrap.cc:492] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755: Bootstrap starting.
I20260709 13:11:56.857007 31845 catalog_manager.cc:5697] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c reported cstate change: term changed from 0 to 1, leader changed from <none> to c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129). New cstate: current_term: 1 leader_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:56.862432 32144 tablet_bootstrap.cc:492] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c: No bootstrap required, opened a new log
I20260709 13:11:56.863109 32144 ts_tablet_manager.cc:1403] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c: Time spent bootstrapping tablet: real 0.104s	user 0.013s	sys 0.010s
I20260709 13:11:56.866216 32144 raft_consensus.cc:359] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.867129 32144 raft_consensus.cc:385] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.867509 32144 raft_consensus.cc:740] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.868314 32144 consensus_queue.cc:260] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.870848 32144 ts_tablet_manager.cc:1434] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:56.874071 32144 tablet_bootstrap.cc:492] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c: Bootstrap starting.
I20260709 13:11:56.875725 32141 tablet_bootstrap.cc:492] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab: No bootstrap required, opened a new log
I20260709 13:11:56.876358 32141 ts_tablet_manager.cc:1403] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab: Time spent bootstrapping tablet: real 0.053s	user 0.030s	sys 0.007s
I20260709 13:11:56.878436 32143 tablet_bootstrap.cc:654] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.881907 32144 tablet_bootstrap.cc:654] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.885371 32141 raft_consensus.cc:359] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.886374 32141 raft_consensus.cc:385] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.886878 32141 raft_consensus.cc:740] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.887900 32141 consensus_queue.cc:260] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.890949 32141 ts_tablet_manager.cc:1434] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 13:11:56.892362 32141 tablet_bootstrap.cc:492] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab: Bootstrap starting.
I20260709 13:11:56.895591 32144 tablet_bootstrap.cc:492] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c: No bootstrap required, opened a new log
I20260709 13:11:56.896186 32144 ts_tablet_manager.cc:1403] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.008s
I20260709 13:11:56.899850 32144 raft_consensus.cc:359] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:11:56.900650 32143 tablet_bootstrap.cc:492] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755: No bootstrap required, opened a new log
I20260709 13:11:56.900600 32144 raft_consensus.cc:385] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.901162 32143 ts_tablet_manager.cc:1403] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.005s
I20260709 13:11:56.901090 32144 raft_consensus.cc:740] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.902231 32144 consensus_queue.cc:260] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:11:56.903460 32141 tablet_bootstrap.cc:654] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.904052 32143 raft_consensus.cc:359] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.904781 32143 raft_consensus.cc:385] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.904956 32144 ts_tablet_manager.cc:1434] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:11:56.905125 32143 raft_consensus.cc:740] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.906064 32144 tablet_bootstrap.cc:492] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c: Bootstrap starting.
I20260709 13:11:56.905882 32143 consensus_queue.cc:260] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.908433 32143 ts_tablet_manager.cc:1434] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:11:56.909409 32143 tablet_bootstrap.cc:492] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755: Bootstrap starting.
I20260709 13:11:56.913319 32144 tablet_bootstrap.cc:654] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.923301 32141 tablet_bootstrap.cc:492] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab: No bootstrap required, opened a new log
I20260709 13:11:56.924057 32141 ts_tablet_manager.cc:1403] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.005s
I20260709 13:11:56.929137 32141 raft_consensus.cc:359] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.930511 32141 raft_consensus.cc:385] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.931054 32141 raft_consensus.cc:740] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.932307 32141 consensus_queue.cc:260] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.933667 32143 tablet_bootstrap.cc:654] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.935446 32141 ts_tablet_manager.cc:1434] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:11:56.936841 32141 tablet_bootstrap.cc:492] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab: Bootstrap starting.
I20260709 13:11:56.943732 32144 tablet_bootstrap.cc:492] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c: No bootstrap required, opened a new log
I20260709 13:11:56.944242 32144 ts_tablet_manager.cc:1403] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.000s
I20260709 13:11:56.946661 32144 raft_consensus.cc:359] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.947343 32144 raft_consensus.cc:385] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.947616 32144 raft_consensus.cc:740] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.948236 32144 consensus_queue.cc:260] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.950482 32144 ts_tablet_manager.cc:1434] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:11:56.950726 32168 raft_consensus.cc:493] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.951329 32144 tablet_bootstrap.cc:492] T 5c970435dcf84bfa86e60f84827b713b P c5768f9b99f540aaa88e4bc85f939c8c: Bootstrap starting.
I20260709 13:11:56.951174 32168 raft_consensus.cc:515] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.953560 32168 leader_election.cc:290] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:11:56.955183 32022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c970435dcf84bfa86e60f84827b713b" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755" is_pre_election: true
I20260709 13:11:56.956683 32144 tablet_bootstrap.cc:654] T 5c970435dcf84bfa86e60f84827b713b P c5768f9b99f540aaa88e4bc85f939c8c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.957146 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c970435dcf84bfa86e60f84827b713b" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" is_pre_election: true
I20260709 13:11:56.957731 32143 tablet_bootstrap.cc:492] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755: No bootstrap required, opened a new log
I20260709 13:11:56.958144 32143 ts_tablet_manager.cc:1403] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.000s
W20260709 13:11:56.958461 32063 leader_election.cc:343] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:56.960242 32061 leader_election.cc:343] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:56.960664 32061 leader_election.cc:304] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab; no voters: c5768f9b99f540aaa88e4bc85f939c8c, ee8e497c603c41a890b1f792efcd1755
I20260709 13:11:56.960978 32143 raft_consensus.cc:359] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.961747 32143 raft_consensus.cc:385] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.962086 32143 raft_consensus.cc:740] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.962903 32143 consensus_queue.cc:260] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.964660 32168 raft_consensus.cc:2749] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:56.965381 32143 ts_tablet_manager.cc:1434] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:56.966710 32143 tablet_bootstrap.cc:492] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755: Bootstrap starting.
I20260709 13:11:56.964308 31842 catalog_manager.cc:5697] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131). New cstate: current_term: 1 leader_uuid: "8f27676195a74c97bfe9385963ccf1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:56.973052 32143 tablet_bootstrap.cc:654] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.984997 32141 tablet_bootstrap.cc:654] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:56.990908 32143 tablet_bootstrap.cc:492] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755: No bootstrap required, opened a new log
I20260709 13:11:56.991395 32143 ts_tablet_manager.cc:1403] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.000s
I20260709 13:11:56.991957 32141 tablet_bootstrap.cc:492] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab: No bootstrap required, opened a new log
I20260709 13:11:56.992404 32141 ts_tablet_manager.cc:1403] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.000s
I20260709 13:11:56.994033 32143 raft_consensus.cc:359] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.995132 32141 raft_consensus.cc:359] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.995869 32141 raft_consensus.cc:385] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.994796 32143 raft_consensus.cc:385] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:56.996158 32141 raft_consensus.cc:740] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.996281 32143 raft_consensus.cc:740] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Initialized, Role: FOLLOWER
I20260709 13:11:56.996870 32141 consensus_queue.cc:260] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.997604 32143 consensus_queue.cc:260] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:56.999480 32141 ts_tablet_manager.cc:1434] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:57.001448 32144 tablet_bootstrap.cc:492] T 5c970435dcf84bfa86e60f84827b713b P c5768f9b99f540aaa88e4bc85f939c8c: No bootstrap required, opened a new log
I20260709 13:11:57.001889 32144 ts_tablet_manager.cc:1403] T 5c970435dcf84bfa86e60f84827b713b P c5768f9b99f540aaa88e4bc85f939c8c: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.017s
I20260709 13:11:57.004616 32144 raft_consensus.cc:359] T 5c970435dcf84bfa86e60f84827b713b P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:57.005270 32144 raft_consensus.cc:385] T 5c970435dcf84bfa86e60f84827b713b P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:57.005537 32144 raft_consensus.cc:740] T 5c970435dcf84bfa86e60f84827b713b P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Initialized, Role: FOLLOWER
I20260709 13:11:57.006188 32144 consensus_queue.cc:260] T 5c970435dcf84bfa86e60f84827b713b P c5768f9b99f540aaa88e4bc85f939c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:57.008384 32143 ts_tablet_manager.cc:1434] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 13:11:57.013263 32150 raft_consensus.cc:493] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.013936 32150 raft_consensus.cc:515] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:11:57.016100 32150 leader_election.cc:290] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:11:57.017597 32022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755" is_pre_election: true
I20260709 13:11:57.018100 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f27676195a74c97bfe9385963ccf1ab" is_pre_election: true
I20260709 13:11:57.018399 32022 raft_consensus.cc:2393] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5768f9b99f540aaa88e4bc85f939c8c in current term 1: Already voted for candidate ee8e497c603c41a890b1f792efcd1755 in this term.
I20260709 13:11:57.018774 32144 ts_tablet_manager.cc:1434] T 5c970435dcf84bfa86e60f84827b713b P c5768f9b99f540aaa88e4bc85f939c8c: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:11:57.018865 32098 raft_consensus.cc:2393] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5768f9b99f540aaa88e4bc85f939c8c in current term 1: Already voted for candidate 8f27676195a74c97bfe9385963ccf1ab in this term.
I20260709 13:11:57.020233 31913 leader_election.cc:304] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5768f9b99f540aaa88e4bc85f939c8c; no voters: 8f27676195a74c97bfe9385963ccf1ab, ee8e497c603c41a890b1f792efcd1755
I20260709 13:11:57.021286 32150 raft_consensus.cc:3060] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.027799 32150 raft_consensus.cc:2749] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:57.041693 32148 raft_consensus.cc:493] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.042273 32148 raft_consensus.cc:515] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:57.044423 32148 leader_election.cc:290] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:57.045200 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c970435dcf84bfa86e60f84827b713b" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" is_pre_election: true
I20260709 13:11:57.045454 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c970435dcf84bfa86e60f84827b713b" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f27676195a74c97bfe9385963ccf1ab" is_pre_election: true
I20260709 13:11:57.045851 31947 raft_consensus.cc:2468] T 5c970435dcf84bfa86e60f84827b713b P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 0.
I20260709 13:11:57.046132 32098 raft_consensus.cc:2468] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 0.
I20260709 13:11:57.047111 31987 leader_election.cc:304] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5768f9b99f540aaa88e4bc85f939c8c, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:11:57.047958 32148 raft_consensus.cc:2804] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:57.048310 32148 raft_consensus.cc:493] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.048586 32148 raft_consensus.cc:3060] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.052069 32168 raft_consensus.cc:493] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.052546 32168 raft_consensus.cc:515] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:57.053458 32148 raft_consensus.cc:515] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:57.054790 32168 leader_election.cc:290] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:11:57.055575 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d9f9fdffc84924823feb0b8cb0f642" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" is_pre_election: true
I20260709 13:11:57.055868 32148 leader_election.cc:290] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:57.056034 31949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c970435dcf84bfa86e60f84827b713b" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:11:57.056209 31947 raft_consensus.cc:2468] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 0.
I20260709 13:11:57.056555 31949 raft_consensus.cc:3060] T 5c970435dcf84bfa86e60f84827b713b P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.057472 32061 leader_election.cc:304] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, c5768f9b99f540aaa88e4bc85f939c8c; no voters: 
I20260709 13:11:57.058611 32168 raft_consensus.cc:2804] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:57.058825 32022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d9f9fdffc84924823feb0b8cb0f642" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755" is_pre_election: true
I20260709 13:11:57.059486 32022 raft_consensus.cc:2468] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 0.
I20260709 13:11:57.059546 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c970435dcf84bfa86e60f84827b713b" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:11:57.060232 32098 raft_consensus.cc:3060] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.062674 31949 raft_consensus.cc:2468] T 5c970435dcf84bfa86e60f84827b713b P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 1.
I20260709 13:11:57.063613 31987 leader_election.cc:304] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5768f9b99f540aaa88e4bc85f939c8c, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:11:57.064258 32148 raft_consensus.cc:2804] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:57.065307 32148 raft_consensus.cc:697] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 1 LEADER]: Becoming Leader. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:11:57.066444 32148 consensus_queue.cc:237] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:57.066852 32098 raft_consensus.cc:2468] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 1.
I20260709 13:11:57.058986 32168 raft_consensus.cc:493] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.082175 32168 raft_consensus.cc:3060] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.084355 31845 catalog_manager.cc:5697] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8e497c603c41a890b1f792efcd1755 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "ee8e497c603c41a890b1f792efcd1755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:57.085304 32148 raft_consensus.cc:493] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.085816 32148 raft_consensus.cc:515] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:57.088744 32148 leader_election.cc:290] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:57.089802 32168 raft_consensus.cc:515] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:57.090348 31949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63c6827346dc409180eaf80f8ab513a2" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" is_pre_election: true
I20260709 13:11:57.091125 31949 raft_consensus.cc:2393] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee8e497c603c41a890b1f792efcd1755 in current term 1: Already voted for candidate 8f27676195a74c97bfe9385963ccf1ab in this term.
I20260709 13:11:57.092075 32168 leader_election.cc:290] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:11:57.093216 31949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d9f9fdffc84924823feb0b8cb0f642" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:11:57.093351 32022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d9f9fdffc84924823feb0b8cb0f642" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:11:57.093775 31949 raft_consensus.cc:3060] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.093842 32022 raft_consensus.cc:3060] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.088964 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63c6827346dc409180eaf80f8ab513a2" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f27676195a74c97bfe9385963ccf1ab" is_pre_election: true
I20260709 13:11:57.096112 31988 leader_election.cc:304] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8e497c603c41a890b1f792efcd1755; no voters: 8f27676195a74c97bfe9385963ccf1ab, c5768f9b99f540aaa88e4bc85f939c8c
I20260709 13:11:57.097292 32194 raft_consensus.cc:493] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.097779 32148 raft_consensus.cc:3060] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.097721 32194 raft_consensus.cc:515] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:57.101804 31949 raft_consensus.cc:2468] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 1.
I20260709 13:11:57.102512 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b42a0943214410a828474fa1d08a8f4" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" is_pre_election: true
I20260709 13:11:57.103168 31947 raft_consensus.cc:2468] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 0.
I20260709 13:11:57.104101 32194 leader_election.cc:290] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:57.104485 32061 leader_election.cc:304] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, c5768f9b99f540aaa88e4bc85f939c8c; no voters: 
I20260709 13:11:57.104854 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b42a0943214410a828474fa1d08a8f4" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f27676195a74c97bfe9385963ccf1ab" is_pre_election: true
I20260709 13:11:57.105456 32098 raft_consensus.cc:2468] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 0.
I20260709 13:11:57.105854 31987 leader_election.cc:304] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5768f9b99f540aaa88e4bc85f939c8c, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:11:57.106664 32194 raft_consensus.cc:2804] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:57.107455 32148 raft_consensus.cc:2749] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:57.108510 32194 raft_consensus.cc:493] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.107920 32022 raft_consensus.cc:2468] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 1.
I20260709 13:11:57.108904 32194 raft_consensus.cc:3060] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.110287 32168 raft_consensus.cc:2804] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:57.110826 32168 raft_consensus.cc:697] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Becoming Leader. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Running, Role: LEADER
I20260709 13:11:57.111681 32168 consensus_queue.cc:237] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:57.115703 32194 raft_consensus.cc:515] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:57.118585 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b42a0943214410a828474fa1d08a8f4" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:11:57.119134 31947 raft_consensus.cc:3060] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.119222 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b42a0943214410a828474fa1d08a8f4" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:11:57.119833 32098 raft_consensus.cc:3060] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.120127 31845 catalog_manager.cc:5697] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131). New cstate: current_term: 1 leader_uuid: "8f27676195a74c97bfe9385963ccf1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:57.123391 32194 leader_election.cc:290] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:57.126660 32098 raft_consensus.cc:2468] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 1.
I20260709 13:11:57.127883 31988 leader_election.cc:304] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:11:57.128261 31947 raft_consensus.cc:2468] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 1.
I20260709 13:11:57.128844 32194 raft_consensus.cc:2804] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:57.129312 32194 raft_consensus.cc:697] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 1 LEADER]: Becoming Leader. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:11:57.130100 32194 consensus_queue.cc:237] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
W20260709 13:11:57.138444 31894 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:57.138935 32194 raft_consensus.cc:493] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.139297 32168 consensus_queue.cc:1048] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.139430 32194 raft_consensus.cc:515] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:57.140894 31845 catalog_manager.cc:5697] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8e497c603c41a890b1f792efcd1755 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "ee8e497c603c41a890b1f792efcd1755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:57.142227 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" is_pre_election: true
I20260709 13:11:57.143652 31947 raft_consensus.cc:2468] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 0.
I20260709 13:11:57.144863 31987 leader_election.cc:304] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5768f9b99f540aaa88e4bc85f939c8c, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:11:57.145869 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f27676195a74c97bfe9385963ccf1ab" is_pre_election: true
I20260709 13:11:57.146485 32098 raft_consensus.cc:2468] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 0.
I20260709 13:11:57.142392 32194 leader_election.cc:290] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:57.148263 32194 raft_consensus.cc:2804] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:57.148602 32194 raft_consensus.cc:493] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.148932 32194 raft_consensus.cc:3060] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.156654 32194 raft_consensus.cc:515] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:57.159304 32194 leader_election.cc:290] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:57.161196 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:11:57.162129 32098 raft_consensus.cc:3060] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.165215 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:11:57.165783 31947 raft_consensus.cc:3060] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.166152 31949 raft_consensus.cc:3060] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.178766 32169 consensus_queue.cc:1048] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:57.186517 32098 raft_consensus.cc:2468] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 1.
I20260709 13:11:57.188037 31988 leader_election.cc:304] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:11:57.189142 32194 raft_consensus.cc:2804] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:57.189373 31947 raft_consensus.cc:2468] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 1.
I20260709 13:11:57.189755 32194 raft_consensus.cc:697] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 1 LEADER]: Becoming Leader. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:11:57.190935 32194 consensus_queue.cc:237] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:57.201431 32168 raft_consensus.cc:493] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.201912 32168 raft_consensus.cc:515] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:57.204192 32168 leader_election.cc:290] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:11:57.205971 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf720c8bcce449888097f89cc4c5f54" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" is_pre_election: true
I20260709 13:11:57.206066 32022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf720c8bcce449888097f89cc4c5f54" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755" is_pre_election: true
I20260709 13:11:57.206643 31948 raft_consensus.cc:2468] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 0.
I20260709 13:11:57.206840 32022 raft_consensus.cc:2468] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 0.
I20260709 13:11:57.207818 32061 leader_election.cc:304] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, c5768f9b99f540aaa88e4bc85f939c8c; no voters: 
I20260709 13:11:57.208504 31845 catalog_manager.cc:5697] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8e497c603c41a890b1f792efcd1755 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "ee8e497c603c41a890b1f792efcd1755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:57.210047 32168 raft_consensus.cc:2804] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:57.210424 32168 raft_consensus.cc:493] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.210767 32168 raft_consensus.cc:3060] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.217342 32168 raft_consensus.cc:515] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:57.219494 32168 leader_election.cc:290] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:11:57.220793 32022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf720c8bcce449888097f89cc4c5f54" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:11:57.221449 32022 raft_consensus.cc:3060] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.221570 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf720c8bcce449888097f89cc4c5f54" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:11:57.222267 31948 raft_consensus.cc:3060] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:57.226583 32022 raft_consensus.cc:2468] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 1.
I20260709 13:11:57.227545 32063 leader_election.cc:304] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:11:57.228220 32168 raft_consensus.cc:2804] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:57.228658 32168 raft_consensus.cc:697] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Becoming Leader. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Running, Role: LEADER
I20260709 13:11:57.229308 31948 raft_consensus.cc:2468] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 1.
I20260709 13:11:57.229434 32168 consensus_queue.cc:237] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:57.237450 31845 catalog_manager.cc:5697] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131). New cstate: current_term: 1 leader_uuid: "8f27676195a74c97bfe9385963ccf1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:57.298051 32168 consensus_queue.cc:1048] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.301060 32150 consensus_queue.cc:1048] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.313037 32167 consensus_queue.cc:1048] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.325747 32150 consensus_queue.cc:1048] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.563724 32194 consensus_queue.cc:1048] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.570560 32194 consensus_queue.cc:1048] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.577732 32194 consensus_queue.cc:1048] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.578548 32148 consensus_queue.cc:1048] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.659921 32167 consensus_queue.cc:1048] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.672094 32169 consensus_queue.cc:1048] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.682487 32148 consensus_queue.cc:1048] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.694440 32169 consensus_queue.cc:1048] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.707409 32148 consensus_queue.cc:1048] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:57.721918 32168 consensus_queue.cc:1048] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:11:58.140498 31894 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:58.657109 32168 raft_consensus.cc:493] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.657554 32168 raft_consensus.cc:515] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:11:58.659192 32168 leader_election.cc:290] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:11:58.660347 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" is_pre_election: true
I20260709 13:11:58.660425 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755" is_pre_election: true
I20260709 13:11:58.660949 31947 raft_consensus.cc:2468] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 1.
I20260709 13:11:58.661029 32024 raft_consensus.cc:2468] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 1.
I20260709 13:11:58.662010 32061 leader_election.cc:304] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, c5768f9b99f540aaa88e4bc85f939c8c; no voters: 
I20260709 13:11:58.662672 32168 raft_consensus.cc:2804] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:58.662961 32168 raft_consensus.cc:493] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.663244 32168 raft_consensus.cc:3060] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.667686 32168 raft_consensus.cc:515] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:11:58.669806 32168 leader_election.cc:290] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 2 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:11:58.670114 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:11:58.670457 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:11:58.670851 31947 raft_consensus.cc:3060] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.671088 32024 raft_consensus.cc:3060] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.675902 31947 raft_consensus.cc:2468] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 2.
I20260709 13:11:58.675920 32024 raft_consensus.cc:2468] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 2.
I20260709 13:11:58.676949 32063 leader_election.cc:304] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:11:58.677590 32168 raft_consensus.cc:2804] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:58.677956 32168 raft_consensus.cc:697] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 2 LEADER]: Becoming Leader. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Running, Role: LEADER
I20260709 13:11:58.678619 32168 consensus_queue.cc:237] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:11:58.685351 31845 catalog_manager.cc:5697] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab reported cstate change: term changed from 0 to 2, leader changed from <none> to 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131). New cstate: current_term: 2 leader_uuid: "8f27676195a74c97bfe9385963ccf1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:58.712530 32098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01"
dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
mode: GRACEFUL
new_leader_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
 from {username='slave'} at 127.0.0.1:41380
I20260709 13:11:58.713286 32098 raft_consensus.cc:606] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 2 LEADER]: Received request to transfer leadership to TS c5768f9b99f540aaa88e4bc85f939c8c
I20260709 13:11:58.725695 32024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08"
dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
mode: GRACEFUL
new_leader_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
 from {username='slave'} at 127.0.0.1:57698
I20260709 13:11:58.726200 32024 raft_consensus.cc:606] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 1 LEADER]: Received request to transfer leadership to TS c5768f9b99f540aaa88e4bc85f939c8c
I20260709 13:11:58.731050 32024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b42a0943214410a828474fa1d08a8f4"
dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
mode: GRACEFUL
new_leader_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
 from {username='slave'} at 127.0.0.1:57698
I20260709 13:11:58.731611 32024 raft_consensus.cc:606] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 1 LEADER]: Received request to transfer leadership to TS c5768f9b99f540aaa88e4bc85f939c8c
I20260709 13:11:58.736306 32098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94d9f9fdffc84924823feb0b8cb0f642"
dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
mode: GRACEFUL
new_leader_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
 from {username='slave'} at 127.0.0.1:41380
I20260709 13:11:58.736805 32098 raft_consensus.cc:606] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Received request to transfer leadership to TS c5768f9b99f540aaa88e4bc85f939c8c
I20260709 13:11:58.749159 31947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c549793d21804ed08151cbf68646a6f1"
dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
mode: GRACEFUL
new_leader_uuid: "ee8e497c603c41a890b1f792efcd1755"
 from {username='slave'} at 127.0.0.1:47130
I20260709 13:11:58.749616 31947 raft_consensus.cc:606] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 LEADER]: Received request to transfer leadership to TS ee8e497c603c41a890b1f792efcd1755
I20260709 13:11:58.754297 32098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ef5ce785a304c28965be6f6a334d641"
dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
mode: GRACEFUL
new_leader_uuid: "ee8e497c603c41a890b1f792efcd1755"
 from {username='slave'} at 127.0.0.1:41380
I20260709 13:11:58.754805 32098 raft_consensus.cc:606] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Received request to transfer leadership to TS ee8e497c603c41a890b1f792efcd1755
I20260709 13:11:58.759445 32098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63c6827346dc409180eaf80f8ab513a2"
dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
mode: GRACEFUL
new_leader_uuid: "ee8e497c603c41a890b1f792efcd1755"
 from {username='slave'} at 127.0.0.1:41380
I20260709 13:11:58.759927 32098 raft_consensus.cc:606] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Received request to transfer leadership to TS ee8e497c603c41a890b1f792efcd1755
I20260709 13:11:58.764460 32098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bf720c8bcce449888097f89cc4c5f54"
dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
mode: GRACEFUL
new_leader_uuid: "ee8e497c603c41a890b1f792efcd1755"
 from {username='slave'} at 127.0.0.1:41380
I20260709 13:11:58.764962 32098 raft_consensus.cc:606] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Received request to transfer leadership to TS ee8e497c603c41a890b1f792efcd1755
I20260709 13:11:58.769371 32024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c970435dcf84bfa86e60f84827b713b"
dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
mode: GRACEFUL
new_leader_uuid: "8f27676195a74c97bfe9385963ccf1ab"
 from {username='slave'} at 127.0.0.1:57698
I20260709 13:11:58.769956 32024 raft_consensus.cc:606] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 1 LEADER]: Received request to transfer leadership to TS 8f27676195a74c97bfe9385963ccf1ab
I20260709 13:11:58.772715 32223 raft_consensus.cc:993] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab: : Instructing follower ee8e497c603c41a890b1f792efcd1755 to start an election
I20260709 13:11:58.773151 32168 raft_consensus.cc:1081] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Signalling peer ee8e497c603c41a890b1f792efcd1755 to start an election
I20260709 13:11:58.774642 32024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ef5ce785a304c28965be6f6a334d641"
dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
 from {username='slave'} at 127.0.0.1:34242
I20260709 13:11:58.775120 32024 raft_consensus.cc:493] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:58.775483 32024 raft_consensus.cc:3060] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.779851 32024 raft_consensus.cc:515] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:58.781066 32202 raft_consensus.cc:993] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755: : Instructing follower c5768f9b99f540aaa88e4bc85f939c8c to start an election
I20260709 13:11:58.781559 32194 raft_consensus.cc:1081] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 1 LEADER]: Signalling peer c5768f9b99f540aaa88e4bc85f939c8c to start an election
I20260709 13:11:58.781901 32024 leader_election.cc:290] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 2 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:58.783133 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef5ce785a304c28965be6f6a334d641" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:11:58.783207 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef5ce785a304c28965be6f6a334d641" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:11:58.783787 31947 raft_consensus.cc:3060] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.783879 32098 raft_consensus.cc:3055] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:58.784318 32098 raft_consensus.cc:740] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Running, Role: LEADER
I20260709 13:11:58.784216 31948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b42a0943214410a828474fa1d08a8f4"
dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
 from {username='slave'} at 127.0.0.1:46200
I20260709 13:11:58.784873 31948 raft_consensus.cc:493] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:58.785224 31948 raft_consensus.cc:3060] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.785164 32098 consensus_queue.cc:260] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:58.786604 32098 raft_consensus.cc:3060] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.788719 31947 raft_consensus.cc:2468] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 2.
I20260709 13:11:58.789654 31987 leader_election.cc:304] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5768f9b99f540aaa88e4bc85f939c8c, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:11:58.790315 32194 raft_consensus.cc:2804] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:58.790736 32194 raft_consensus.cc:697] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Becoming Leader. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:11:58.791560 32194 consensus_queue.cc:237] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:58.791903 31948 raft_consensus.cc:515] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:58.792941 32098 raft_consensus.cc:2468] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 2.
I20260709 13:11:58.794011 31948 leader_election.cc:290] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 2 election: Requested vote from peers ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:58.795493 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b42a0943214410a828474fa1d08a8f4" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:11:58.795493 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b42a0943214410a828474fa1d08a8f4" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:11:58.796226 32097 raft_consensus.cc:3060] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.796300 32024 raft_consensus.cc:3055] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:58.796696 32024 raft_consensus.cc:740] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:11:58.797655 32024 consensus_queue.cc:260] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:58.798861 32024 raft_consensus.cc:3060] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.799559 31845 catalog_manager.cc:5697] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 reported cstate change: term changed from 1 to 2, leader changed from 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131) to ee8e497c603c41a890b1f792efcd1755 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "ee8e497c603c41a890b1f792efcd1755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:58.803400 32097 raft_consensus.cc:2468] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5768f9b99f540aaa88e4bc85f939c8c in term 2.
I20260709 13:11:58.804584 31913 leader_election.cc:304] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, c5768f9b99f540aaa88e4bc85f939c8c; no voters: 
I20260709 13:11:58.805367 32210 raft_consensus.cc:2804] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:58.805564 32024 raft_consensus.cc:2468] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5768f9b99f540aaa88e4bc85f939c8c in term 2.
I20260709 13:11:58.807439 32210 raft_consensus.cc:697] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 LEADER]: Becoming Leader. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Running, Role: LEADER
I20260709 13:11:58.808261 32210 consensus_queue.cc:237] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:58.814747 31845 catalog_manager.cc:5697] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c reported cstate change: term changed from 1 to 2, leader changed from ee8e497c603c41a890b1f792efcd1755 (127.31.17.130) to c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129). New cstate: current_term: 2 leader_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:58.906906 32223 raft_consensus.cc:993] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab: : Instructing follower ee8e497c603c41a890b1f792efcd1755 to start an election
I20260709 13:11:58.907392 32168 raft_consensus.cc:1081] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Signalling peer ee8e497c603c41a890b1f792efcd1755 to start an election
I20260709 13:11:58.909050 32024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63c6827346dc409180eaf80f8ab513a2"
dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
 from {username='slave'} at 127.0.0.1:34242
I20260709 13:11:58.909549 32024 raft_consensus.cc:493] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:58.909855 32024 raft_consensus.cc:3060] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.914227 32024 raft_consensus.cc:515] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:58.915952 32024 leader_election.cc:290] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 2 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:58.916925 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63c6827346dc409180eaf80f8ab513a2" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:11:58.917030 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63c6827346dc409180eaf80f8ab513a2" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:11:58.917594 31948 raft_consensus.cc:3060] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.917639 32097 raft_consensus.cc:3055] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:58.918078 32097 raft_consensus.cc:740] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Running, Role: LEADER
I20260709 13:11:58.918910 32097 consensus_queue.cc:260] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:58.920122 32097 raft_consensus.cc:3060] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.924484 31948 raft_consensus.cc:2468] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 2.
I20260709 13:11:58.925598 31987 leader_election.cc:304] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5768f9b99f540aaa88e4bc85f939c8c, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:11:58.926296 32194 raft_consensus.cc:2804] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:58.926370 32097 raft_consensus.cc:2468] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 2.
I20260709 13:11:58.926729 32194 raft_consensus.cc:697] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Becoming Leader. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:11:58.927657 32194 consensus_queue.cc:237] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:58.934288 32202 raft_consensus.cc:993] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755: : Instructing follower c5768f9b99f540aaa88e4bc85f939c8c to start an election
I20260709 13:11:58.934080 31845 catalog_manager.cc:5697] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 reported cstate change: term changed from 1 to 2, leader changed from 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131) to ee8e497c603c41a890b1f792efcd1755 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "ee8e497c603c41a890b1f792efcd1755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:58.934705 32194 raft_consensus.cc:1081] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 1 LEADER]: Signalling peer c5768f9b99f540aaa88e4bc85f939c8c to start an election
I20260709 13:11:58.936183 31948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08"
dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
 from {username='slave'} at 127.0.0.1:46200
I20260709 13:11:58.936645 31948 raft_consensus.cc:493] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:58.936926 31948 raft_consensus.cc:3060] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.942109 31948 raft_consensus.cc:515] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:58.943826 31948 leader_election.cc:290] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 2 election: Requested vote from peers ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:58.944540 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:11:58.945102 32024 raft_consensus.cc:3055] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:58.945013 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:11:58.945457 32024 raft_consensus.cc:740] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:11:58.945678 32097 raft_consensus.cc:3060] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.946245 32024 consensus_queue.cc:260] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:58.947463 32024 raft_consensus.cc:3060] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.950554 32097 raft_consensus.cc:2468] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5768f9b99f540aaa88e4bc85f939c8c in term 2.
I20260709 13:11:58.951484 31913 leader_election.cc:304] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, c5768f9b99f540aaa88e4bc85f939c8c; no voters: 
I20260709 13:11:58.952127 32210 raft_consensus.cc:2804] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:58.952610 32210 raft_consensus.cc:697] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 LEADER]: Becoming Leader. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Running, Role: LEADER
I20260709 13:11:58.952555 32024 raft_consensus.cc:2468] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5768f9b99f540aaa88e4bc85f939c8c in term 2.
I20260709 13:11:58.953632 32210 consensus_queue.cc:237] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:58.960389 31845 catalog_manager.cc:5697] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c reported cstate change: term changed from 1 to 2, leader changed from ee8e497c603c41a890b1f792efcd1755 (127.31.17.130) to c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129). New cstate: current_term: 2 leader_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:58.986378 32223 raft_consensus.cc:993] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab: : Instructing follower ee8e497c603c41a890b1f792efcd1755 to start an election
I20260709 13:11:58.986810 32168 raft_consensus.cc:1081] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Signalling peer ee8e497c603c41a890b1f792efcd1755 to start an election
I20260709 13:11:58.988399 32024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bf720c8bcce449888097f89cc4c5f54"
dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
 from {username='slave'} at 127.0.0.1:34242
I20260709 13:11:58.988888 32024 raft_consensus.cc:493] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:58.989187 32024 raft_consensus.cc:3060] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.993631 32024 raft_consensus.cc:515] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:58.995298 32024 leader_election.cc:290] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 2 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:58.996033 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf720c8bcce449888097f89cc4c5f54" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:11:58.996265 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf720c8bcce449888097f89cc4c5f54" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:11:58.996598 31948 raft_consensus.cc:3060] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.996834 32097 raft_consensus.cc:3055] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:58.997195 32097 raft_consensus.cc:740] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Running, Role: LEADER
I20260709 13:11:58.997876 32097 consensus_queue.cc:260] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:58.998737 32097 raft_consensus.cc:3060] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:59.001327 31948 raft_consensus.cc:2468] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 2.
I20260709 13:11:59.002298 31987 leader_election.cc:304] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5768f9b99f540aaa88e4bc85f939c8c, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:11:59.002960 32194 raft_consensus.cc:2804] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:59.003368 32097 raft_consensus.cc:2468] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 2.
I20260709 13:11:59.003378 32194 raft_consensus.cc:697] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Becoming Leader. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:11:59.004475 32194 consensus_queue.cc:237] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:59.011219 31845 catalog_manager.cc:5697] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 reported cstate change: term changed from 1 to 2, leader changed from 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131) to ee8e497c603c41a890b1f792efcd1755 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "ee8e497c603c41a890b1f792efcd1755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.067912 31948 raft_consensus.cc:1275] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Refusing update from remote peer 8f27676195a74c97bfe9385963ccf1ab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:59.069291 32168 consensus_queue.cc:1048] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:59.075696 32223 raft_consensus.cc:993] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab: : Instructing follower c5768f9b99f540aaa88e4bc85f939c8c to start an election
I20260709 13:11:59.076290 32168 raft_consensus.cc:1081] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 2 LEADER]: Signalling peer c5768f9b99f540aaa88e4bc85f939c8c to start an election
I20260709 13:11:59.077939 31947 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01"
dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
 from {username='slave'} at 127.0.0.1:46208
I20260709 13:11:59.080982 31947 raft_consensus.cc:493] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:59.081394 31947 raft_consensus.cc:3060] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:59.083050 32024 raft_consensus.cc:1275] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Refusing update from remote peer 8f27676195a74c97bfe9385963ccf1ab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:59.084968 32240 consensus_queue.cc:1048] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:59.088351 31947 raft_consensus.cc:515] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:11:59.093762 31947 leader_election.cc:290] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 3 election: Requested vote from peers 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:11:59.093887 32202 raft_consensus.cc:993] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755: : Instructing follower 8f27676195a74c97bfe9385963ccf1ab to start an election
I20260709 13:11:59.094326 32202 raft_consensus.cc:1081] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 1 LEADER]: Signalling peer 8f27676195a74c97bfe9385963ccf1ab to start an election
I20260709 13:11:59.095520 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:11:59.095726 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:11:59.096107 32024 raft_consensus.cc:3060] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:59.096239 32097 raft_consensus.cc:3055] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:59.096635 32097 raft_consensus.cc:740] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Running, Role: LEADER
I20260709 13:11:59.097343 32097 consensus_queue.cc:260] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:11:59.098344 32097 raft_consensus.cc:3060] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:59.100575 32098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c970435dcf84bfa86e60f84827b713b"
dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
 from {username='slave'} at 127.0.0.1:56408
I20260709 13:11:59.101123 32098 raft_consensus.cc:493] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:59.101513 32098 raft_consensus.cc:3060] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:59.103802 32024 raft_consensus.cc:2468] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5768f9b99f540aaa88e4bc85f939c8c in term 3.
I20260709 13:11:59.104177 32097 raft_consensus.cc:2468] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5768f9b99f540aaa88e4bc85f939c8c in term 3.
I20260709 13:11:59.104882 31914 leader_election.cc:304] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5768f9b99f540aaa88e4bc85f939c8c, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:11:59.106272 32210 raft_consensus.cc:2804] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:59.106753 32210 raft_consensus.cc:697] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 LEADER]: Becoming Leader. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Running, Role: LEADER
I20260709 13:11:59.107620 32210 consensus_queue.cc:237] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:11:59.107450 32098 raft_consensus.cc:515] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:59.112743 32098 leader_election.cc:290] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 2 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:11:59.113976 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c970435dcf84bfa86e60f84827b713b" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:11:59.113523 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c970435dcf84bfa86e60f84827b713b" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:11:59.115028 31844 catalog_manager.cc:5697] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c reported cstate change: term changed from 2 to 3, leader changed from 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131) to c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129). New cstate: current_term: 3 leader_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.117245 32024 raft_consensus.cc:3055] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:59.117619 32024 raft_consensus.cc:740] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:11:59.118516 32024 consensus_queue.cc:260] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:59.119762 32024 raft_consensus.cc:3060] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:59.125157 32024 raft_consensus.cc:2468] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 2.
I20260709 13:11:59.125960 32063 leader_election.cc:304] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, ee8e497c603c41a890b1f792efcd1755; no voters: c5768f9b99f540aaa88e4bc85f939c8c
I20260709 13:11:59.126585 32240 raft_consensus.cc:2804] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:59.126965 32240 raft_consensus.cc:697] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [term 2 LEADER]: Becoming Leader. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Running, Role: LEADER
I20260709 13:11:59.127728 32240 consensus_queue.cc:237] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:59.135005 31844 catalog_manager.cc:5697] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab reported cstate change: term changed from 1 to 2, leader changed from ee8e497c603c41a890b1f792efcd1755 (127.31.17.130) to 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131). New cstate: current_term: 2 leader_uuid: "8f27676195a74c97bfe9385963ccf1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:59.155628 32234 raft_consensus.cc:993] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c: : Instructing follower ee8e497c603c41a890b1f792efcd1755 to start an election
I20260709 13:11:59.156066 32210 raft_consensus.cc:1081] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 LEADER]: Signalling peer ee8e497c603c41a890b1f792efcd1755 to start an election
I20260709 13:11:59.157439 32024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c549793d21804ed08151cbf68646a6f1"
dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
 from {username='slave'} at 127.0.0.1:34256
I20260709 13:11:59.157907 32024 raft_consensus.cc:493] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:59.158219 32024 raft_consensus.cc:3060] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:59.162688 32024 raft_consensus.cc:515] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:59.164388 32024 leader_election.cc:290] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 2 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:59.165227 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549793d21804ed08151cbf68646a6f1" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:11:59.165400 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549793d21804ed08151cbf68646a6f1" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:11:59.165704 31947 raft_consensus.cc:3055] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:59.165902 32098 raft_consensus.cc:3060] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:59.166025 31947 raft_consensus.cc:740] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Running, Role: LEADER
I20260709 13:11:59.166828 31947 consensus_queue.cc:260] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:59.167796 31947 raft_consensus.cc:3060] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:59.170634 32098 raft_consensus.cc:2468] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 2.
I20260709 13:11:59.171636 31988 leader_election.cc:304] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:11:59.172370 32202 raft_consensus.cc:2804] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:59.172577 31947 raft_consensus.cc:2468] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 2.
I20260709 13:11:59.172847 32202 raft_consensus.cc:697] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Becoming Leader. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:11:59.173678 32202 consensus_queue.cc:237] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:59.180255 31844 catalog_manager.cc:5697] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 reported cstate change: term changed from 1 to 2, leader changed from c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129) to ee8e497c603c41a890b1f792efcd1755 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "ee8e497c603c41a890b1f792efcd1755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.239086 32098 raft_consensus.cc:1275] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Refusing update from remote peer ee8e497c603c41a890b1f792efcd1755: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:59.240341 32202 consensus_queue.cc:1048] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:59.248710 31947 raft_consensus.cc:1275] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Refusing update from remote peer ee8e497c603c41a890b1f792efcd1755: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:59.251685 32248 consensus_queue.cc:1048] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:59.266929 32168 raft_consensus.cc:993] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab: : Instructing follower c5768f9b99f540aaa88e4bc85f939c8c to start an election
I20260709 13:11:59.267359 32240 raft_consensus.cc:1081] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Signalling peer c5768f9b99f540aaa88e4bc85f939c8c to start an election
I20260709 13:11:59.268676 31947 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94d9f9fdffc84924823feb0b8cb0f642"
dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
 from {username='slave'} at 127.0.0.1:46208
I20260709 13:11:59.269096 31947 raft_consensus.cc:493] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:59.269351 31947 raft_consensus.cc:3060] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:59.273643 31947 raft_consensus.cc:515] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:59.275219 31947 leader_election.cc:290] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 2 election: Requested vote from peers ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:11:59.276000 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d9f9fdffc84924823feb0b8cb0f642" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:11:59.276288 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d9f9fdffc84924823feb0b8cb0f642" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:11:59.276547 32024 raft_consensus.cc:3060] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:59.276808 32098 raft_consensus.cc:3055] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:59.277125 32098 raft_consensus.cc:740] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Running, Role: LEADER
I20260709 13:11:59.277760 32098 consensus_queue.cc:260] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:59.278600 32098 raft_consensus.cc:3060] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:59.281360 32024 raft_consensus.cc:2468] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5768f9b99f540aaa88e4bc85f939c8c in term 2.
I20260709 13:11:59.282383 31914 leader_election.cc:304] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5768f9b99f540aaa88e4bc85f939c8c, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:11:59.283159 32210 raft_consensus.cc:2804] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:59.283329 32098 raft_consensus.cc:2468] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5768f9b99f540aaa88e4bc85f939c8c in term 2.
I20260709 13:11:59.283656 32210 raft_consensus.cc:697] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 LEADER]: Becoming Leader. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Running, Role: LEADER
I20260709 13:11:59.284468 32210 consensus_queue.cc:237] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:11:59.290967 31845 catalog_manager.cc:5697] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c reported cstate change: term changed from 1 to 2, leader changed from 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131) to c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129). New cstate: current_term: 2 leader_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.336680 32024 raft_consensus.cc:1275] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Refusing update from remote peer c5768f9b99f540aaa88e4bc85f939c8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:59.337924 32210 consensus_queue.cc:1048] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:59.346517 32098 raft_consensus.cc:1275] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Refusing update from remote peer c5768f9b99f540aaa88e4bc85f939c8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:59.348162 32252 consensus_queue.cc:1048] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:59.403568 31947 raft_consensus.cc:1275] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Refusing update from remote peer ee8e497c603c41a890b1f792efcd1755: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:59.404737 32248 consensus_queue.cc:1048] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:59.413465 32098 raft_consensus.cc:1275] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Refusing update from remote peer ee8e497c603c41a890b1f792efcd1755: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:59.414989 32202 consensus_queue.cc:1048] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:59.417057 32024 raft_consensus.cc:1275] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Refusing update from remote peer c5768f9b99f540aaa88e4bc85f939c8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:59.418422 32252 consensus_queue.cc:1048] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:59.430239 32098 raft_consensus.cc:1275] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Refusing update from remote peer c5768f9b99f540aaa88e4bc85f939c8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:59.431958 32252 consensus_queue.cc:1048] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:59.522601 32098 raft_consensus.cc:1275] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Refusing update from remote peer ee8e497c603c41a890b1f792efcd1755: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:59.523972 32202 consensus_queue.cc:1048] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:59.531474 31947 raft_consensus.cc:1275] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Refusing update from remote peer ee8e497c603c41a890b1f792efcd1755: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:59.533106 32260 consensus_queue.cc:1048] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:59.564687 32098 raft_consensus.cc:1275] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Refusing update from remote peer c5768f9b99f540aaa88e4bc85f939c8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:59.565860 32252 consensus_queue.cc:1048] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:59.572927 32024 raft_consensus.cc:1275] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Refusing update from remote peer c5768f9b99f540aaa88e4bc85f939c8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:59.574712 32210 consensus_queue.cc:1048] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:59.619951 32024 raft_consensus.cc:1275] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Refusing update from remote peer 8f27676195a74c97bfe9385963ccf1ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:59.621377 32098 raft_consensus.cc:1275] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Refusing update from remote peer ee8e497c603c41a890b1f792efcd1755: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:59.621169 32240 consensus_queue.cc:1048] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:59.623422 32260 consensus_queue.cc:1048] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:59.636262 31947 raft_consensus.cc:3060] T 5c970435dcf84bfa86e60f84827b713b P c5768f9b99f540aaa88e4bc85f939c8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:59.640796 31948 raft_consensus.cc:1275] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Refusing update from remote peer ee8e497c603c41a890b1f792efcd1755: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:59.642349 32194 consensus_queue.cc:1048] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:59.650738 31947 raft_consensus.cc:1275] T 5c970435dcf84bfa86e60f84827b713b P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Refusing update from remote peer 8f27676195a74c97bfe9385963ccf1ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:59.652287 32168 consensus_queue.cc:1048] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:59.813071 32098 raft_consensus.cc:1275] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Refusing update from remote peer c5768f9b99f540aaa88e4bc85f939c8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:59.814373 32210 consensus_queue.cc:1048] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:59.824489 32024 raft_consensus.cc:1275] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Refusing update from remote peer c5768f9b99f540aaa88e4bc85f939c8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:59.826675 32252 consensus_queue.cc:1048] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:01.803417 31814 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:12:01.804347 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:01.827709 32024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bf720c8bcce449888097f89cc4c5f54"
dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
mode: GRACEFUL
new_leader_uuid: "8f27676195a74c97bfe9385963ccf1ab"
 from {username='slave'} at 127.0.0.1:57712
I20260709 13:12:01.828325 32024 raft_consensus.cc:606] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Received request to transfer leadership to TS 8f27676195a74c97bfe9385963ccf1ab
I20260709 13:12:01.839787 31948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08"
dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
mode: GRACEFUL
new_leader_uuid: "8f27676195a74c97bfe9385963ccf1ab"
 from {username='slave'} at 127.0.0.1:47138
I20260709 13:12:01.840402 31948 raft_consensus.cc:606] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 LEADER]: Received request to transfer leadership to TS 8f27676195a74c97bfe9385963ccf1ab
I20260709 13:12:01.841634 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:01.842155 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:02.237442 32274 raft_consensus.cc:993] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755: : Instructing follower 8f27676195a74c97bfe9385963ccf1ab to start an election
I20260709 13:12:02.237946 32202 raft_consensus.cc:1081] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Signalling peer 8f27676195a74c97bfe9385963ccf1ab to start an election
I20260709 13:12:02.239426 32098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bf720c8bcce449888097f89cc4c5f54"
dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
 from {username='slave'} at 127.0.0.1:56408
I20260709 13:12:02.239809 32098 raft_consensus.cc:493] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:02.240041 32098 raft_consensus.cc:3060] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:02.244242 32098 raft_consensus.cc:515] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:02.245803 32098 leader_election.cc:290] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 3 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:12:02.246690 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf720c8bcce449888097f89cc4c5f54" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:12:02.246971 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf720c8bcce449888097f89cc4c5f54" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:12:02.247381 31948 raft_consensus.cc:3060] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:02.247517 32024 raft_consensus.cc:3055] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:02.247888 32024 raft_consensus.cc:740] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:12:02.248739 32024 consensus_queue.cc:260] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:02.249971 32024 raft_consensus.cc:3060] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:02.254840 31948 raft_consensus.cc:2468] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 3.
I20260709 13:12:02.256258 32061 leader_election.cc:304] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, c5768f9b99f540aaa88e4bc85f939c8c; no voters: 
I20260709 13:12:02.256665 32024 raft_consensus.cc:2468] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 3.
I20260709 13:12:02.257012 32269 raft_consensus.cc:2804] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:02.258220 32269 raft_consensus.cc:697] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 3 LEADER]: Becoming Leader. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Running, Role: LEADER
I20260709 13:12:02.258903 32269 consensus_queue.cc:237] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:02.265898 31845 catalog_manager.cc:5697] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab reported cstate change: term changed from 2 to 3, leader changed from ee8e497c603c41a890b1f792efcd1755 (127.31.17.130) to 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131). New cstate: current_term: 3 leader_uuid: "8f27676195a74c97bfe9385963ccf1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:02.310060 32270 raft_consensus.cc:993] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c: : Instructing follower 8f27676195a74c97bfe9385963ccf1ab to start an election
I20260709 13:12:02.310488 32281 raft_consensus.cc:1081] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 LEADER]: Signalling peer 8f27676195a74c97bfe9385963ccf1ab to start an election
I20260709 13:12:02.312033 32098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08"
dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
 from {username='slave'} at 127.0.0.1:56410
I20260709 13:12:02.312510 32098 raft_consensus.cc:493] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:02.312783 32098 raft_consensus.cc:3060] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:02.317005 32098 raft_consensus.cc:515] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:02.318361 32098 leader_election.cc:290] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 3 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:12:02.319329 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:12:02.319409 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:12:02.319890 31948 raft_consensus.cc:3055] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:02.319939 32024 raft_consensus.cc:3060] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:02.320216 31948 raft_consensus.cc:740] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Running, Role: LEADER
I20260709 13:12:02.320900 31948 consensus_queue.cc:260] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:02.321857 31948 raft_consensus.cc:3060] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:02.324286 32024 raft_consensus.cc:2468] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 3.
I20260709 13:12:02.325295 32063 leader_election.cc:304] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:12:02.325949 32269 raft_consensus.cc:2804] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:02.326388 32269 raft_consensus.cc:697] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 3 LEADER]: Becoming Leader. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Running, Role: LEADER
I20260709 13:12:02.326488 31948 raft_consensus.cc:2468] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 3.
I20260709 13:12:02.327239 32269 consensus_queue.cc:237] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:02.333544 31845 catalog_manager.cc:5697] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab reported cstate change: term changed from 2 to 3, leader changed from c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129) to 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131). New cstate: current_term: 3 leader_uuid: "8f27676195a74c97bfe9385963ccf1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:02.657053 32024 raft_consensus.cc:1275] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Refusing update from remote peer 8f27676195a74c97bfe9385963ccf1ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:02.658334 32269 consensus_queue.cc:1048] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:02.670310 31948 raft_consensus.cc:1275] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Refusing update from remote peer 8f27676195a74c97bfe9385963ccf1ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:02.672497 32284 consensus_queue.cc:1048] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:02.773419 32022 raft_consensus.cc:1275] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Refusing update from remote peer 8f27676195a74c97bfe9385963ccf1ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:02.774663 32284 consensus_queue.cc:1048] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:02.783078 31948 raft_consensus.cc:1275] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Refusing update from remote peer 8f27676195a74c97bfe9385963ccf1ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:02.784915 32275 consensus_queue.cc:1048] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:02.843012 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:02.852854 31948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01"
dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
mode: GRACEFUL
new_leader_uuid: "ee8e497c603c41a890b1f792efcd1755"
 from {username='slave'} at 127.0.0.1:47130
I20260709 13:12:02.853403 31948 raft_consensus.cc:606] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 LEADER]: Received request to transfer leadership to TS ee8e497c603c41a890b1f792efcd1755
I20260709 13:12:02.858194 32098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08"
dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
mode: GRACEFUL
new_leader_uuid: "ee8e497c603c41a890b1f792efcd1755"
 from {username='slave'} at 127.0.0.1:41380
I20260709 13:12:02.858673 32098 raft_consensus.cc:606] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 3 LEADER]: Received request to transfer leadership to TS ee8e497c603c41a890b1f792efcd1755
I20260709 13:12:02.863204 31948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b42a0943214410a828474fa1d08a8f4"
dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
mode: GRACEFUL
new_leader_uuid: "ee8e497c603c41a890b1f792efcd1755"
 from {username='slave'} at 127.0.0.1:47130
I20260709 13:12:02.863787 31948 raft_consensus.cc:606] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 LEADER]: Received request to transfer leadership to TS ee8e497c603c41a890b1f792efcd1755
I20260709 13:12:02.868598 31948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94d9f9fdffc84924823feb0b8cb0f642"
dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
mode: GRACEFUL
new_leader_uuid: "ee8e497c603c41a890b1f792efcd1755"
 from {username='slave'} at 127.0.0.1:47130
I20260709 13:12:02.869105 31948 raft_consensus.cc:606] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 LEADER]: Received request to transfer leadership to TS ee8e497c603c41a890b1f792efcd1755
I20260709 13:12:02.881351 32098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bf720c8bcce449888097f89cc4c5f54"
dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
mode: GRACEFUL
new_leader_uuid: "ee8e497c603c41a890b1f792efcd1755"
 from {username='slave'} at 127.0.0.1:41380
I20260709 13:12:02.881863 32098 raft_consensus.cc:606] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 3 LEADER]: Received request to transfer leadership to TS ee8e497c603c41a890b1f792efcd1755
I20260709 13:12:03.000834 32291 raft_consensus.cc:993] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c: : Instructing follower ee8e497c603c41a890b1f792efcd1755 to start an election
I20260709 13:12:03.001274 32291 raft_consensus.cc:1081] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 LEADER]: Signalling peer ee8e497c603c41a890b1f792efcd1755 to start an election
I20260709 13:12:03.003115 32022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94d9f9fdffc84924823feb0b8cb0f642"
dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
 from {username='slave'} at 127.0.0.1:34256
I20260709 13:12:03.003684 32022 raft_consensus.cc:493] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:03.003968 32022 raft_consensus.cc:3060] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:03.008715 32022 raft_consensus.cc:515] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:03.010234 32022 leader_election.cc:290] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 3 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:12:03.011294 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d9f9fdffc84924823feb0b8cb0f642" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:12:03.011346 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d9f9fdffc84924823feb0b8cb0f642" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:12:03.011993 31948 raft_consensus.cc:3055] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:03.012013 32098 raft_consensus.cc:3060] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:03.012398 31948 raft_consensus.cc:740] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Running, Role: LEADER
I20260709 13:12:03.013070 31948 consensus_queue.cc:260] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:03.013953 31948 raft_consensus.cc:3060] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:03.016422 32098 raft_consensus.cc:2468] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 3.
I20260709 13:12:03.017403 31988 leader_election.cc:304] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:12:03.018088 32202 raft_consensus.cc:2804] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:03.018785 31948 raft_consensus.cc:2468] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 3.
I20260709 13:12:03.019107 32202 raft_consensus.cc:697] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [term 3 LEADER]: Becoming Leader. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:12:03.019881 32202 consensus_queue.cc:237] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:03.027004 31845 catalog_manager.cc:5697] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 reported cstate change: term changed from 2 to 3, leader changed from c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129) to ee8e497c603c41a890b1f792efcd1755 (127.31.17.130). New cstate: current_term: 3 leader_uuid: "ee8e497c603c41a890b1f792efcd1755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:03.133510 32281 raft_consensus.cc:993] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c: : Instructing follower ee8e497c603c41a890b1f792efcd1755 to start an election
I20260709 13:12:03.133960 32291 raft_consensus.cc:1081] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 LEADER]: Signalling peer ee8e497c603c41a890b1f792efcd1755 to start an election
I20260709 13:12:03.135710 32022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b42a0943214410a828474fa1d08a8f4"
dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
 from {username='slave'} at 127.0.0.1:34256
I20260709 13:12:03.136149 32022 raft_consensus.cc:493] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:03.136413 32022 raft_consensus.cc:3060] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:03.141626 32022 raft_consensus.cc:515] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:03.143154 32022 leader_election.cc:290] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 3 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:12:03.144212 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b42a0943214410a828474fa1d08a8f4" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:12:03.144265 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b42a0943214410a828474fa1d08a8f4" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:12:03.144806 31948 raft_consensus.cc:3055] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:03.144938 32098 raft_consensus.cc:3060] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:03.145099 31948 raft_consensus.cc:740] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Running, Role: LEADER
I20260709 13:12:03.145826 31948 consensus_queue.cc:260] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:03.146911 31948 raft_consensus.cc:3060] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:03.148895 32269 raft_consensus.cc:993] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab: : Instructing follower ee8e497c603c41a890b1f792efcd1755 to start an election
I20260709 13:12:03.149341 32275 raft_consensus.cc:1081] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 3 LEADER]: Signalling peer ee8e497c603c41a890b1f792efcd1755 to start an election
I20260709 13:12:03.150244 32098 raft_consensus.cc:2468] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 3.
I20260709 13:12:03.150913 32022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bf720c8bcce449888097f89cc4c5f54"
dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
 from {username='slave'} at 127.0.0.1:34242
I20260709 13:12:03.151136 31988 leader_election.cc:304] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:12:03.151475 32022 raft_consensus.cc:493] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:03.151873 32022 raft_consensus.cc:3060] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:03.151976 32202 raft_consensus.cc:2804] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:03.152506 32202 raft_consensus.cc:697] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 3 LEADER]: Becoming Leader. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:12:03.152715 31948 raft_consensus.cc:2468] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 3.
I20260709 13:12:03.153311 32202 consensus_queue.cc:237] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:03.157370 32022 raft_consensus.cc:515] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:03.159498 32022 leader_election.cc:290] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 4 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:12:03.159991 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf720c8bcce449888097f89cc4c5f54" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:12:03.160512 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf720c8bcce449888097f89cc4c5f54" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:12:03.160524 31948 raft_consensus.cc:3060] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:03.160313 31845 catalog_manager.cc:5697] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 reported cstate change: term changed from 2 to 3, leader changed from c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129) to ee8e497c603c41a890b1f792efcd1755 (127.31.17.130). New cstate: current_term: 3 leader_uuid: "ee8e497c603c41a890b1f792efcd1755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:03.161068 32098 raft_consensus.cc:3055] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:03.161370 32098 raft_consensus.cc:740] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Running, Role: LEADER
I20260709 13:12:03.162038 32098 consensus_queue.cc:260] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:03.163019 32098 raft_consensus.cc:3060] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:03.166325 31948 raft_consensus.cc:2468] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 4.
I20260709 13:12:03.166989 32098 raft_consensus.cc:2468] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 4.
I20260709 13:12:03.167398 31987 leader_election.cc:304] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5768f9b99f540aaa88e4bc85f939c8c, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:12:03.168161 32202 raft_consensus.cc:2804] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:03.168597 32202 raft_consensus.cc:697] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 4 LEADER]: Becoming Leader. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:12:03.169270 32202 consensus_queue.cc:237] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:03.175123 31845 catalog_manager.cc:5697] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 reported cstate change: term changed from 3 to 4, leader changed from 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131) to ee8e497c603c41a890b1f792efcd1755 (127.31.17.130). New cstate: current_term: 4 leader_uuid: "ee8e497c603c41a890b1f792efcd1755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:03.205431 32269 raft_consensus.cc:993] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab: : Instructing follower ee8e497c603c41a890b1f792efcd1755 to start an election
I20260709 13:12:03.205854 32275 raft_consensus.cc:1081] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 3 LEADER]: Signalling peer ee8e497c603c41a890b1f792efcd1755 to start an election
I20260709 13:12:03.207252 32022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08"
dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
 from {username='slave'} at 127.0.0.1:34242
I20260709 13:12:03.207862 32022 raft_consensus.cc:493] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:03.208214 32022 raft_consensus.cc:3060] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:03.213249 32022 raft_consensus.cc:515] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:03.214915 32022 leader_election.cc:290] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 4 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:12:03.215859 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:12:03.215739 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:12:03.216429 32098 raft_consensus.cc:3055] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:03.216455 31948 raft_consensus.cc:3060] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:03.216843 32098 raft_consensus.cc:740] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Running, Role: LEADER
I20260709 13:12:03.217626 32098 consensus_queue.cc:260] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:03.218660 32098 raft_consensus.cc:3060] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:03.222563 31948 raft_consensus.cc:2468] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 4.
I20260709 13:12:03.223716 31987 leader_election.cc:304] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5768f9b99f540aaa88e4bc85f939c8c, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:12:03.224390 32098 raft_consensus.cc:2468] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 4.
I20260709 13:12:03.224426 32202 raft_consensus.cc:2804] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:03.224998 32202 raft_consensus.cc:697] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 4 LEADER]: Becoming Leader. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:12:03.225809 32202 consensus_queue.cc:237] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:03.231817 31845 catalog_manager.cc:5697] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 reported cstate change: term changed from 3 to 4, leader changed from 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131) to ee8e497c603c41a890b1f792efcd1755 (127.31.17.130). New cstate: current_term: 4 leader_uuid: "ee8e497c603c41a890b1f792efcd1755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:03.233289 32281 raft_consensus.cc:993] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c: : Instructing follower ee8e497c603c41a890b1f792efcd1755 to start an election
I20260709 13:12:03.233780 32291 raft_consensus.cc:1081] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 LEADER]: Signalling peer ee8e497c603c41a890b1f792efcd1755 to start an election
I20260709 13:12:03.235455 32022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01"
dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
 from {username='slave'} at 127.0.0.1:34256
I20260709 13:12:03.236291 32022 raft_consensus.cc:493] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:03.236785 32022 raft_consensus.cc:3060] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:03.242401 32022 raft_consensus.cc:515] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:12:03.244069 32022 leader_election.cc:290] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 4 election: Requested vote from peers 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109), c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791)
I20260709 13:12:03.245399 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:12:03.245260 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9879c8cb78ea4b109ced91e5e6967f01" candidate_uuid: "ee8e497c603c41a890b1f792efcd1755" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:12:03.245970 31948 raft_consensus.cc:3055] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:03.246313 32098 raft_consensus.cc:3060] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:03.246603 31948 raft_consensus.cc:740] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Running, Role: LEADER
I20260709 13:12:03.247494 31948 consensus_queue.cc:260] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:12:03.248782 31948 raft_consensus.cc:3060] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:03.251682 32098 raft_consensus.cc:2468] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 4.
I20260709 13:12:03.252687 31988 leader_election.cc:304] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, ee8e497c603c41a890b1f792efcd1755; no voters: 
I20260709 13:12:03.253124 31948 raft_consensus.cc:2468] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8e497c603c41a890b1f792efcd1755 in term 4.
I20260709 13:12:03.253374 32202 raft_consensus.cc:2804] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:03.253839 32202 raft_consensus.cc:697] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 4 LEADER]: Becoming Leader. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:12:03.254598 32202 consensus_queue.cc:237] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } }
I20260709 13:12:03.261348 31845 catalog_manager.cc:5697] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 reported cstate change: term changed from 3 to 4, leader changed from c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129) to ee8e497c603c41a890b1f792efcd1755 (127.31.17.130). New cstate: current_term: 4 leader_uuid: "ee8e497c603c41a890b1f792efcd1755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:03.433419 31948 raft_consensus.cc:1275] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Refusing update from remote peer ee8e497c603c41a890b1f792efcd1755: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:03.434734 32202 consensus_queue.cc:1048] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:03.443533 32098 raft_consensus.cc:1275] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Refusing update from remote peer ee8e497c603c41a890b1f792efcd1755: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:03.444962 32301 consensus_queue.cc:1048] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:03.585372 32098 raft_consensus.cc:1275] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 4 FOLLOWER]: Refusing update from remote peer ee8e497c603c41a890b1f792efcd1755: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:03.586588 32301 consensus_queue.cc:1048] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:03.595844 31948 raft_consensus.cc:1275] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 4 FOLLOWER]: Refusing update from remote peer ee8e497c603c41a890b1f792efcd1755: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:03.597102 32301 consensus_queue.cc:1048] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:03.655170 32098 raft_consensus.cc:1275] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 4 FOLLOWER]: Refusing update from remote peer ee8e497c603c41a890b1f792efcd1755: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:03.656549 32301 consensus_queue.cc:1048] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:03.663360 31948 raft_consensus.cc:1275] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 4 FOLLOWER]: Refusing update from remote peer ee8e497c603c41a890b1f792efcd1755: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:03.665055 32301 consensus_queue.cc:1048] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:03.719017 31948 raft_consensus.cc:1275] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 4 FOLLOWER]: Refusing update from remote peer ee8e497c603c41a890b1f792efcd1755: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:03.721109 31947 raft_consensus.cc:1275] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Refusing update from remote peer ee8e497c603c41a890b1f792efcd1755: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:03.720924 32301 consensus_queue.cc:1048] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:03.722785 32292 consensus_queue.cc:1048] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:03.734428 32098 raft_consensus.cc:1275] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 4 FOLLOWER]: Refusing update from remote peer ee8e497c603c41a890b1f792efcd1755: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:03.741593 32098 raft_consensus.cc:1275] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Refusing update from remote peer ee8e497c603c41a890b1f792efcd1755: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:03.741909 32202 consensus_queue.cc:1048] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:03.745874 32292 consensus_queue.cc:1048] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:05.886492 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:05.895013 32022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ef5ce785a304c28965be6f6a334d641"
dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
mode: GRACEFUL
new_leader_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
 from {username='slave'} at 127.0.0.1:57712
I20260709 13:12:05.895644 32022 raft_consensus.cc:606] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Received request to transfer leadership to TS c5768f9b99f540aaa88e4bc85f939c8c
I20260709 13:12:05.898056 32022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b42a0943214410a828474fa1d08a8f4"
dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
mode: GRACEFUL
new_leader_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
 from {username='slave'} at 127.0.0.1:57712
I20260709 13:12:05.898566 32022 raft_consensus.cc:606] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 3 LEADER]: Received request to transfer leadership to TS c5768f9b99f540aaa88e4bc85f939c8c
I20260709 13:12:05.901077 32022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63c6827346dc409180eaf80f8ab513a2"
dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
mode: GRACEFUL
new_leader_uuid: "8f27676195a74c97bfe9385963ccf1ab"
 from {username='slave'} at 127.0.0.1:57712
I20260709 13:12:05.901613 32022 raft_consensus.cc:606] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Received request to transfer leadership to TS 8f27676195a74c97bfe9385963ccf1ab
I20260709 13:12:05.904089 32022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c549793d21804ed08151cbf68646a6f1"
dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
mode: GRACEFUL
new_leader_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
 from {username='slave'} at 127.0.0.1:57712
I20260709 13:12:05.904538 32022 raft_consensus.cc:606] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Received request to transfer leadership to TS c5768f9b99f540aaa88e4bc85f939c8c
I20260709 13:12:05.906738 32022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08"
dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
mode: GRACEFUL
new_leader_uuid: "8f27676195a74c97bfe9385963ccf1ab"
 from {username='slave'} at 127.0.0.1:57712
I20260709 13:12:05.907270 32022 raft_consensus.cc:606] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 4 LEADER]: Received request to transfer leadership to TS 8f27676195a74c97bfe9385963ccf1ab
I20260709 13:12:05.908473 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:05.909075 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:05.918460 32311 raft_consensus.cc:993] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755: : Instructing follower c5768f9b99f540aaa88e4bc85f939c8c to start an election
I20260709 13:12:05.918924 32292 raft_consensus.cc:1081] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Signalling peer c5768f9b99f540aaa88e4bc85f939c8c to start an election
I20260709 13:12:05.920274 31948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c549793d21804ed08151cbf68646a6f1"
dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
 from {username='slave'} at 127.0.0.1:46200
I20260709 13:12:05.920775 31948 raft_consensus.cc:493] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:05.921150 31948 raft_consensus.cc:3060] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:05.926048 31948 raft_consensus.cc:515] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:05.927492 31948 leader_election.cc:290] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 3 election: Requested vote from peers ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:12:05.928753 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549793d21804ed08151cbf68646a6f1" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:12:05.928799 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549793d21804ed08151cbf68646a6f1" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:12:05.929445 32098 raft_consensus.cc:3060] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:05.929490 32024 raft_consensus.cc:3055] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:05.929919 32024 raft_consensus.cc:740] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:12:05.930735 32024 consensus_queue.cc:260] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:05.931960 32024 raft_consensus.cc:3060] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:05.936182 32098 raft_consensus.cc:2468] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5768f9b99f540aaa88e4bc85f939c8c in term 3.
I20260709 13:12:05.937556 31913 leader_election.cc:304] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, c5768f9b99f540aaa88e4bc85f939c8c; no voters: 
I20260709 13:12:05.938346 32024 raft_consensus.cc:2468] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5768f9b99f540aaa88e4bc85f939c8c in term 3.
I20260709 13:12:05.939390 32312 raft_consensus.cc:2804] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:05.940387 32312 raft_consensus.cc:697] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 LEADER]: Becoming Leader. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Running, Role: LEADER
I20260709 13:12:05.941311 32312 consensus_queue.cc:237] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:05.948836 31842 catalog_manager.cc:5697] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c reported cstate change: term changed from 2 to 3, leader changed from ee8e497c603c41a890b1f792efcd1755 (127.31.17.130) to c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129). New cstate: current_term: 3 leader_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:06.054781 32311 raft_consensus.cc:993] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755: : Instructing follower c5768f9b99f540aaa88e4bc85f939c8c to start an election
I20260709 13:12:06.055274 32311 raft_consensus.cc:1081] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Signalling peer c5768f9b99f540aaa88e4bc85f939c8c to start an election
I20260709 13:12:06.056658 31948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ef5ce785a304c28965be6f6a334d641"
dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
 from {username='slave'} at 127.0.0.1:46200
I20260709 13:12:06.057104 31948 raft_consensus.cc:493] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:06.057387 31948 raft_consensus.cc:3060] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:06.062034 31948 raft_consensus.cc:515] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:06.063335 31948 leader_election.cc:290] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 3 election: Requested vote from peers ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:12:06.064143 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef5ce785a304c28965be6f6a334d641" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:12:06.064301 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef5ce785a304c28965be6f6a334d641" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:12:06.064730 32024 raft_consensus.cc:3055] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:06.064862 32098 raft_consensus.cc:3060] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:06.065018 32024 raft_consensus.cc:740] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:12:06.065734 32024 consensus_queue.cc:260] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:06.066545 32024 raft_consensus.cc:3060] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:06.069094 32098 raft_consensus.cc:2468] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5768f9b99f540aaa88e4bc85f939c8c in term 3.
I20260709 13:12:06.070051 31913 leader_election.cc:304] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, c5768f9b99f540aaa88e4bc85f939c8c; no voters: 
I20260709 13:12:06.070703 32024 raft_consensus.cc:2468] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5768f9b99f540aaa88e4bc85f939c8c in term 3.
I20260709 13:12:06.070756 32312 raft_consensus.cc:2804] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:06.071408 32312 raft_consensus.cc:697] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 LEADER]: Becoming Leader. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Running, Role: LEADER
I20260709 13:12:06.072232 32312 consensus_queue.cc:237] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:06.078696 31842 catalog_manager.cc:5697] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c reported cstate change: term changed from 2 to 3, leader changed from ee8e497c603c41a890b1f792efcd1755 (127.31.17.130) to c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129). New cstate: current_term: 3 leader_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:06.183851 32292 raft_consensus.cc:993] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755: : Instructing follower 8f27676195a74c97bfe9385963ccf1ab to start an election
I20260709 13:12:06.184286 32311 raft_consensus.cc:1081] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 4 LEADER]: Signalling peer 8f27676195a74c97bfe9385963ccf1ab to start an election
I20260709 13:12:06.185690 32098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08"
dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
 from {username='slave'} at 127.0.0.1:56408
I20260709 13:12:06.186124 32098 raft_consensus.cc:493] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:06.186594 32098 raft_consensus.cc:3060] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.191056 32098 raft_consensus.cc:515] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:06.192639 32098 leader_election.cc:290] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 5 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:12:06.193620 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:12:06.193796 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d483672bc4444a2c3fc3fc4f60d08" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:12:06.194191 31948 raft_consensus.cc:3060] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.194312 32024 raft_consensus.cc:3055] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:06.194653 32024 raft_consensus.cc:740] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:12:06.195416 32024 consensus_queue.cc:260] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:06.196319 32024 raft_consensus.cc:3060] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.198441 31948 raft_consensus.cc:2468] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 5.
I20260709 13:12:06.200016 32061 leader_election.cc:304] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, c5768f9b99f540aaa88e4bc85f939c8c; no voters: 
I20260709 13:12:06.200984 32275 raft_consensus.cc:2804] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:06.201920 32292 raft_consensus.cc:993] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755: : Instructing follower c5768f9b99f540aaa88e4bc85f939c8c to start an election
I20260709 13:12:06.202337 32292 raft_consensus.cc:1081] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 3 LEADER]: Signalling peer c5768f9b99f540aaa88e4bc85f939c8c to start an election
I20260709 13:12:06.202569 32275 raft_consensus.cc:697] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 5 LEADER]: Becoming Leader. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Running, Role: LEADER
I20260709 13:12:06.202885 32024 raft_consensus.cc:2468] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 5.
I20260709 13:12:06.203588 32275 consensus_queue.cc:237] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:06.204656 31948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b42a0943214410a828474fa1d08a8f4"
dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
 from {username='slave'} at 127.0.0.1:46200
I20260709 13:12:06.205205 31948 raft_consensus.cc:493] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:06.205523 31948 raft_consensus.cc:3060] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:06.211740 31948 raft_consensus.cc:515] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:06.213285 31948 leader_election.cc:290] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 4 election: Requested vote from peers ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471), 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131:33109)
I20260709 13:12:06.214111 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b42a0943214410a828474fa1d08a8f4" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:12:06.214623 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b42a0943214410a828474fa1d08a8f4" candidate_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
I20260709 13:12:06.214686 32024 raft_consensus.cc:3055] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:06.215204 32098 raft_consensus.cc:3060] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:06.215282 32024 raft_consensus.cc:740] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:12:06.216521 32024 consensus_queue.cc:260] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:06.216812 31842 catalog_manager.cc:5697] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab reported cstate change: term changed from 4 to 5, leader changed from ee8e497c603c41a890b1f792efcd1755 (127.31.17.130) to 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131). New cstate: current_term: 5 leader_uuid: "8f27676195a74c97bfe9385963ccf1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.217585 32024 raft_consensus.cc:3060] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:06.221637 32098 raft_consensus.cc:2468] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5768f9b99f540aaa88e4bc85f939c8c in term 4.
I20260709 13:12:06.222736 31913 leader_election.cc:304] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, c5768f9b99f540aaa88e4bc85f939c8c; no voters: 
I20260709 13:12:06.223534 32312 raft_consensus.cc:2804] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:06.223644 32024 raft_consensus.cc:2468] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5768f9b99f540aaa88e4bc85f939c8c in term 4.
I20260709 13:12:06.224035 32312 raft_consensus.cc:697] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 4 LEADER]: Becoming Leader. State: Replica: c5768f9b99f540aaa88e4bc85f939c8c, State: Running, Role: LEADER
I20260709 13:12:06.224823 32312 consensus_queue.cc:237] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:06.234323 31842 catalog_manager.cc:5697] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c reported cstate change: term changed from 3 to 4, leader changed from ee8e497c603c41a890b1f792efcd1755 (127.31.17.130) to c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129). New cstate: current_term: 4 leader_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:06.463471 32024 raft_consensus.cc:1275] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Refusing update from remote peer c5768f9b99f540aaa88e4bc85f939c8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:06.464819 32312 consensus_queue.cc:1048] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:06.475664 32098 raft_consensus.cc:1275] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Refusing update from remote peer c5768f9b99f540aaa88e4bc85f939c8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:06.477177 32313 consensus_queue.cc:1048] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:06.491065 32311 raft_consensus.cc:993] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755: : Instructing follower 8f27676195a74c97bfe9385963ccf1ab to start an election
I20260709 13:12:06.491680 32323 raft_consensus.cc:1081] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Signalling peer 8f27676195a74c97bfe9385963ccf1ab to start an election
I20260709 13:12:06.493312 32098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63c6827346dc409180eaf80f8ab513a2"
dest_uuid: "8f27676195a74c97bfe9385963ccf1ab"
 from {username='slave'} at 127.0.0.1:56408
I20260709 13:12:06.493736 32098 raft_consensus.cc:493] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:06.494014 32098 raft_consensus.cc:3060] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:06.497929 32098 raft_consensus.cc:515] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:06.499536 32098 leader_election.cc:290] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 3 election: Requested vote from peers c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791), ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471)
I20260709 13:12:06.500663 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63c6827346dc409180eaf80f8ab513a2" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ee8e497c603c41a890b1f792efcd1755"
I20260709 13:12:06.500756 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63c6827346dc409180eaf80f8ab513a2" candidate_uuid: "8f27676195a74c97bfe9385963ccf1ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5768f9b99f540aaa88e4bc85f939c8c"
I20260709 13:12:06.501181 32024 raft_consensus.cc:3055] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:06.501365 31948 raft_consensus.cc:3060] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:06.501453 32024 raft_consensus.cc:740] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee8e497c603c41a890b1f792efcd1755, State: Running, Role: LEADER
I20260709 13:12:06.502215 32024 consensus_queue.cc:260] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:06.503068 32024 raft_consensus.cc:3060] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:06.506001 31948 raft_consensus.cc:2468] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 3.
I20260709 13:12:06.506966 32061 leader_election.cc:304] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f27676195a74c97bfe9385963ccf1ab, c5768f9b99f540aaa88e4bc85f939c8c; no voters: 
I20260709 13:12:06.507146 32024 raft_consensus.cc:2468] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f27676195a74c97bfe9385963ccf1ab in term 3.
I20260709 13:12:06.507768 32275 raft_consensus.cc:2804] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:06.508245 32275 raft_consensus.cc:697] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 3 LEADER]: Becoming Leader. State: Replica: 8f27676195a74c97bfe9385963ccf1ab, State: Running, Role: LEADER
I20260709 13:12:06.508965 32275 consensus_queue.cc:237] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } }
I20260709 13:12:06.515682 31844 catalog_manager.cc:5697] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab reported cstate change: term changed from 2 to 3, leader changed from ee8e497c603c41a890b1f792efcd1755 (127.31.17.130) to 8f27676195a74c97bfe9385963ccf1ab (127.31.17.131). New cstate: current_term: 3 leader_uuid: "8f27676195a74c97bfe9385963ccf1ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.546245 32098 raft_consensus.cc:1275] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Refusing update from remote peer c5768f9b99f540aaa88e4bc85f939c8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:06.547463 32313 consensus_queue.cc:1048] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:06.555992 32024 raft_consensus.cc:1275] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Refusing update from remote peer c5768f9b99f540aaa88e4bc85f939c8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:06.557389 32313 consensus_queue.cc:1048] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:06.632042 31948 raft_consensus.cc:1275] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 5 FOLLOWER]: Refusing update from remote peer 8f27676195a74c97bfe9385963ccf1ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:06.633219 32275 consensus_queue.cc:1048] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5768f9b99f540aaa88e4bc85f939c8c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:06.641881 32024 raft_consensus.cc:1275] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 5 FOLLOWER]: Refusing update from remote peer 8f27676195a74c97bfe9385963ccf1ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:06.643427 32275 consensus_queue.cc:1048] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:06.650007 32022 raft_consensus.cc:1275] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 4 FOLLOWER]: Refusing update from remote peer c5768f9b99f540aaa88e4bc85f939c8c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:06.651687 32313 consensus_queue.cc:1048] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:06.652846 32098 raft_consensus.cc:1275] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab [term 4 FOLLOWER]: Refusing update from remote peer c5768f9b99f540aaa88e4bc85f939c8c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:06.654438 32313 consensus_queue.cc:1048] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f27676195a74c97bfe9385963ccf1ab" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:06.910081 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:06.915401 31814 tablet_server.cc:179] TabletServer@127.31.17.129:0 shutting down...
I20260709 13:12:06.939385 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:06.940163 31814 tablet_replica.cc:333] T 5c970435dcf84bfa86e60f84827b713b P c5768f9b99f540aaa88e4bc85f939c8c: stopping tablet replica
I20260709 13:12:06.940974 31814 raft_consensus.cc:2243] T 5c970435dcf84bfa86e60f84827b713b P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.941587 31814 raft_consensus.cc:2272] T 5c970435dcf84bfa86e60f84827b713b P c5768f9b99f540aaa88e4bc85f939c8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.944008 31814 tablet_replica.cc:333] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c: stopping tablet replica
I20260709 13:12:06.944499 31814 raft_consensus.cc:2243] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.944911 31814 raft_consensus.cc:2272] T 9879c8cb78ea4b109ced91e5e6967f01 P c5768f9b99f540aaa88e4bc85f939c8c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.946447 31814 tablet_replica.cc:333] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c: stopping tablet replica
I20260709 13:12:06.946965 31814 raft_consensus.cc:2243] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.947408 31814 raft_consensus.cc:2272] T c75d483672bc4444a2c3fc3fc4f60d08 P c5768f9b99f540aaa88e4bc85f939c8c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.949941 31814 tablet_replica.cc:333] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c: stopping tablet replica
I20260709 13:12:06.950451 31814 raft_consensus.cc:2243] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.950838 31814 raft_consensus.cc:2272] T 63c6827346dc409180eaf80f8ab513a2 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.952454 31814 tablet_replica.cc:333] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c: stopping tablet replica
I20260709 13:12:06.952939 31814 raft_consensus.cc:2243] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.953317 31814 raft_consensus.cc:2272] T 94d9f9fdffc84924823feb0b8cb0f642 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.955320 31814 tablet_replica.cc:333] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c: stopping tablet replica
I20260709 13:12:06.955823 31814 raft_consensus.cc:2243] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.956477 31814 raft_consensus.cc:2272] T 1b42a0943214410a828474fa1d08a8f4 P c5768f9b99f540aaa88e4bc85f939c8c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.958477 31814 tablet_replica.cc:333] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c: stopping tablet replica
I20260709 13:12:06.958947 31814 raft_consensus.cc:2243] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.959668 31814 raft_consensus.cc:2272] T 0ef5ce785a304c28965be6f6a334d641 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.961328 31814 tablet_replica.cc:333] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c: stopping tablet replica
I20260709 13:12:06.961771 31814 raft_consensus.cc:2243] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.962430 31814 raft_consensus.cc:2272] T c549793d21804ed08151cbf68646a6f1 P c5768f9b99f540aaa88e4bc85f939c8c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.964169 31814 tablet_replica.cc:333] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c: stopping tablet replica
I20260709 13:12:06.964588 31814 raft_consensus.cc:2243] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.964962 31814 raft_consensus.cc:2272] T 3bf720c8bcce449888097f89cc4c5f54 P c5768f9b99f540aaa88e4bc85f939c8c [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:06.967418 31987 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:12:06.970681 31987 consensus_peers.cc:597] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 -> Peer c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791): Couldn't send request to peer c5768f9b99f540aaa88e4bc85f939c8c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:07.056268 32024 raft_consensus.cc:1275] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Refusing update from remote peer 8f27676195a74c97bfe9385963ccf1ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:07.058135 32334 consensus_queue.cc:1048] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8e497c603c41a890b1f792efcd1755" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:12:07.103772 31987 consensus_peers.cc:597] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 -> Peer c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791): Couldn't send request to peer c5768f9b99f540aaa88e4bc85f939c8c. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45791: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:07.104442 31814 tablet_server.cc:196] TabletServer@127.31.17.129:0 shutdown complete.
W20260709 13:12:07.124027 32061 consensus_peers.cc:597] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab -> Peer c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791): Couldn't send request to peer c5768f9b99f540aaa88e4bc85f939c8c. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45791: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.124543 32061 consensus_peers.cc:597] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab -> Peer c5768f9b99f540aaa88e4bc85f939c8c (127.31.17.129:45791): Couldn't send request to peer c5768f9b99f540aaa88e4bc85f939c8c. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45791: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:07.129842 31814 tablet_server.cc:179] TabletServer@127.31.17.130:0 shutting down...
I20260709 13:12:07.156550 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:07.157213 31814 tablet_replica.cc:333] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755: stopping tablet replica
I20260709 13:12:07.157768 31814 raft_consensus.cc:2243] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:07.158488 31814 raft_consensus.cc:2272] T 3bf720c8bcce449888097f89cc4c5f54 P ee8e497c603c41a890b1f792efcd1755 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.160429 31814 tablet_replica.cc:333] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755: stopping tablet replica
I20260709 13:12:07.160928 31814 raft_consensus.cc:2243] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.161316 31814 raft_consensus.cc:2272] T 1b42a0943214410a828474fa1d08a8f4 P ee8e497c603c41a890b1f792efcd1755 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.163554 31814 tablet_replica.cc:333] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755: stopping tablet replica
I20260709 13:12:07.164031 31814 raft_consensus.cc:2243] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.164422 31814 raft_consensus.cc:2272] T 5c970435dcf84bfa86e60f84827b713b P ee8e497c603c41a890b1f792efcd1755 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.165961 31814 tablet_replica.cc:333] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755: stopping tablet replica
I20260709 13:12:07.166441 31814 raft_consensus.cc:2243] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:07.167125 31814 raft_consensus.cc:2272] T 9879c8cb78ea4b109ced91e5e6967f01 P ee8e497c603c41a890b1f792efcd1755 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.168700 31814 tablet_replica.cc:333] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755: stopping tablet replica
I20260709 13:12:07.169160 31814 raft_consensus.cc:2243] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.169557 31814 raft_consensus.cc:2272] T c75d483672bc4444a2c3fc3fc4f60d08 P ee8e497c603c41a890b1f792efcd1755 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.171444 31814 tablet_replica.cc:333] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755: stopping tablet replica
I20260709 13:12:07.171957 31814 raft_consensus.cc:2243] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:07.172621 31814 raft_consensus.cc:2272] T 94d9f9fdffc84924823feb0b8cb0f642 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.174211 31814 tablet_replica.cc:333] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755: stopping tablet replica
I20260709 13:12:07.174672 31814 raft_consensus.cc:2243] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.175036 31814 raft_consensus.cc:2272] T 63c6827346dc409180eaf80f8ab513a2 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.176800 31814 tablet_replica.cc:333] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755: stopping tablet replica
I20260709 13:12:07.177248 31814 raft_consensus.cc:2243] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.177619 31814 raft_consensus.cc:2272] T c549793d21804ed08151cbf68646a6f1 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.179410 31814 tablet_replica.cc:333] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755: stopping tablet replica
I20260709 13:12:07.179831 31814 raft_consensus.cc:2243] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.180203 31814 raft_consensus.cc:2272] T 0ef5ce785a304c28965be6f6a334d641 P ee8e497c603c41a890b1f792efcd1755 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.208420 31814 tablet_server.cc:196] TabletServer@127.31.17.130:0 shutdown complete.
W20260709 13:12:07.209615 32063 consensus_peers.cc:597] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab -> Peer ee8e497c603c41a890b1f792efcd1755 (127.31.17.130:42471): Couldn't send request to peer ee8e497c603c41a890b1f792efcd1755. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:42471: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:07.224982 31814 tablet_server.cc:179] TabletServer@127.31.17.131:0 shutting down...
I20260709 13:12:07.256275 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:07.256906 31814 tablet_replica.cc:333] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab: stopping tablet replica
I20260709 13:12:07.257490 31814 raft_consensus.cc:2243] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.257884 31814 raft_consensus.cc:2272] T 3bf720c8bcce449888097f89cc4c5f54 P 8f27676195a74c97bfe9385963ccf1ab [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.259599 31814 tablet_replica.cc:333] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab: stopping tablet replica
I20260709 13:12:07.260030 31814 raft_consensus.cc:2243] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.260353 31814 raft_consensus.cc:2272] T 1b42a0943214410a828474fa1d08a8f4 P 8f27676195a74c97bfe9385963ccf1ab [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.262521 31814 tablet_replica.cc:333] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab: stopping tablet replica
I20260709 13:12:07.262956 31814 raft_consensus.cc:2243] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.263357 31814 raft_consensus.cc:2272] T c549793d21804ed08151cbf68646a6f1 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.265331 31814 tablet_replica.cc:333] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab: stopping tablet replica
I20260709 13:12:07.265743 31814 raft_consensus.cc:2243] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.266072 31814 raft_consensus.cc:2272] T 0ef5ce785a304c28965be6f6a334d641 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.268044 31814 tablet_replica.cc:333] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab: stopping tablet replica
I20260709 13:12:07.268472 31814 raft_consensus.cc:2243] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.268797 31814 raft_consensus.cc:2272] T 94d9f9fdffc84924823feb0b8cb0f642 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.270154 31814 tablet_replica.cc:333] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab: stopping tablet replica
I20260709 13:12:07.270565 31814 raft_consensus.cc:2243] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:12:07.271180 31814 raft_consensus.cc:2272] T c75d483672bc4444a2c3fc3fc4f60d08 P 8f27676195a74c97bfe9385963ccf1ab [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.272986 31814 tablet_replica.cc:333] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab: stopping tablet replica
I20260709 13:12:07.273384 31814 raft_consensus.cc:2243] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:07.273968 31814 raft_consensus.cc:2272] T 63c6827346dc409180eaf80f8ab513a2 P 8f27676195a74c97bfe9385963ccf1ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.275739 31814 tablet_replica.cc:333] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab: stopping tablet replica
I20260709 13:12:07.276139 31814 raft_consensus.cc:2243] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:07.276747 31814 raft_consensus.cc:2272] T 5c970435dcf84bfa86e60f84827b713b P 8f27676195a74c97bfe9385963ccf1ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.278131 31814 tablet_replica.cc:333] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab: stopping tablet replica
I20260709 13:12:07.278512 31814 raft_consensus.cc:2243] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.278841 31814 raft_consensus.cc:2272] T 9879c8cb78ea4b109ced91e5e6967f01 P 8f27676195a74c97bfe9385963ccf1ab [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.303988 31814 tablet_server.cc:196] TabletServer@127.31.17.131:0 shutdown complete.
I20260709 13:12:07.319722 31814 master.cc:562] Master@127.31.17.190:36023 shutting down...
I20260709 13:12:07.469655 31814 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:07.470288 31814 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.470650 31814 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6d7eff394b0440e7aa73665fcd5f210e: stopping tablet replica
I20260709 13:12:07.492058 31814 master.cc:584] Master@127.31.17.190:36023 shutdown complete.
8f27676195a74c97bfe9385963ccf1ab  1
c5768f9b99f540aaa88e4bc85f939c8c  4
ee8e497c603c41a890b1f792efcd1755  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13872 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:12:07.530102 31814 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.31.17.190:40525
I20260709 13:12:07.531426 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:07.536921 32343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:07.537745 32344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:07.538930 32346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:07.539716 31814 server_base.cc:1061] running on GCE node
I20260709 13:12:07.540635 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:07.540874 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:07.541039 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602727541006 us; error 0 us; skew 500 ppm
I20260709 13:12:07.541602 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:07.544194 31814 webserver.cc:533] Webserver started at http://127.31.17.190:42647/ using document root <none> and password file <none>
I20260709 13:12:07.544728 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:07.544937 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:07.545240 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:07.546419 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/master-0-root/instance:
uuid: "89ed75bc09ef44d9968d71f510cc6952"
format_stamp: "Formatted at 2026-07-09 13:12:07 on dist-test-slave-zhw8"
I20260709 13:12:07.551210 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:12:07.554859 32351 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:07.555732 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:12:07.556053 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/master-0-root
uuid: "89ed75bc09ef44d9968d71f510cc6952"
format_stamp: "Formatted at 2026-07-09 13:12:07 on dist-test-slave-zhw8"
I20260709 13:12:07.556358 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:07.599108 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:07.600495 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:07.640813 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.190:40525
I20260709 13:12:07.640895 32402 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.190:40525 every 8 connection(s)
I20260709 13:12:07.644788 32403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.655134 32403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952: Bootstrap starting.
I20260709 13:12:07.660475 32403 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.664559 32403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952: No bootstrap required, opened a new log
I20260709 13:12:07.666625 32403 raft_consensus.cc:359] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89ed75bc09ef44d9968d71f510cc6952" member_type: VOTER }
I20260709 13:12:07.667021 32403 raft_consensus.cc:385] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.667480 32403 raft_consensus.cc:740] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ed75bc09ef44d9968d71f510cc6952, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.668181 32403 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89ed75bc09ef44d9968d71f510cc6952" member_type: VOTER }
I20260709 13:12:07.668632 32403 raft_consensus.cc:399] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:07.668859 32403 raft_consensus.cc:493] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:07.669127 32403 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.673147 32403 raft_consensus.cc:515] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89ed75bc09ef44d9968d71f510cc6952" member_type: VOTER }
I20260709 13:12:07.673646 32403 leader_election.cc:304] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 89ed75bc09ef44d9968d71f510cc6952; no voters: 
I20260709 13:12:07.674767 32403 leader_election.cc:290] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:07.675170 32406 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.676649 32406 raft_consensus.cc:697] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [term 1 LEADER]: Becoming Leader. State: Replica: 89ed75bc09ef44d9968d71f510cc6952, State: Running, Role: LEADER
I20260709 13:12:07.677364 32406 consensus_queue.cc:237] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89ed75bc09ef44d9968d71f510cc6952" member_type: VOTER }
I20260709 13:12:07.677582 32403 sys_catalog.cc:565] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:07.682127 32408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89ed75bc09ef44d9968d71f510cc6952. Latest consensus state: current_term: 1 leader_uuid: "89ed75bc09ef44d9968d71f510cc6952" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89ed75bc09ef44d9968d71f510cc6952" member_type: VOTER } }
I20260709 13:12:07.682359 32407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "89ed75bc09ef44d9968d71f510cc6952" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89ed75bc09ef44d9968d71f510cc6952" member_type: VOTER } }
I20260709 13:12:07.682862 32408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:07.683082 32407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:07.690646 32413 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:07.698518 32413 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:07.699501 31814 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:07.707480 32413 catalog_manager.cc:1383] Generated new cluster ID: 083158887674481cafe667ea7de4a985
I20260709 13:12:07.707836 32413 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:07.733700 32413 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:07.735109 32413 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:07.746857 32413 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952: Generated new TSK 0
I20260709 13:12:07.747542 32413 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:07.766034 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:07.772156 32424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:07.773061 32425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:07.774843 32427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:07.775393 31814 server_base.cc:1061] running on GCE node
I20260709 13:12:07.776127 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:07.776295 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:07.776439 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602727776428 us; error 0 us; skew 500 ppm
I20260709 13:12:07.776944 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:07.779434 31814 webserver.cc:533] Webserver started at http://127.31.17.129:46001/ using document root <none> and password file <none>
I20260709 13:12:07.779865 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:07.780020 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:07.780224 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:07.781195 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/ts-0-root/instance:
uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
format_stamp: "Formatted at 2026-07-09 13:12:07 on dist-test-slave-zhw8"
I20260709 13:12:07.785544 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:07.788892 32432 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:07.789821 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260709 13:12:07.790122 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/ts-0-root
uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
format_stamp: "Formatted at 2026-07-09 13:12:07 on dist-test-slave-zhw8"
I20260709 13:12:07.790382 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:07.823869 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:07.825088 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:07.826551 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:07.828778 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:07.829015 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:07.829293 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:07.829478 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:07.868966 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.129:42679
I20260709 13:12:07.869055 32494 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.129:42679 every 8 connection(s)
I20260709 13:12:07.873847 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:07.880854 32499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:07.883433 32500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:07.885154 32502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:07.885401 31814 server_base.cc:1061] running on GCE node
I20260709 13:12:07.886876 32495 heartbeater.cc:344] Connected to a master server at 127.31.17.190:40525
I20260709 13:12:07.886907 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:07.887392 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:07.887421 32495 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:07.887676 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602727887636 us; error 0 us; skew 500 ppm
I20260709 13:12:07.888281 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:07.888307 32495 heartbeater.cc:507] Master 127.31.17.190:40525 requested a full tablet report, sending...
I20260709 13:12:07.890801 32368 ts_manager.cc:194] Registered new tserver with Master: 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679)
I20260709 13:12:07.891491 31814 webserver.cc:533] Webserver started at http://127.31.17.130:36925/ using document root <none> and password file <none>
I20260709 13:12:07.892154 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:07.892398 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:07.892728 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:07.893334 32368 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59628
I20260709 13:12:07.894264 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/ts-1-root/instance:
uuid: "bc96f7a83162437fbb1098501e781191"
format_stamp: "Formatted at 2026-07-09 13:12:07 on dist-test-slave-zhw8"
I20260709 13:12:07.898765 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:12:07.902047 32507 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:07.902887 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:12:07.903200 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/ts-1-root
uuid: "bc96f7a83162437fbb1098501e781191"
format_stamp: "Formatted at 2026-07-09 13:12:07 on dist-test-slave-zhw8"
I20260709 13:12:07.903555 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:07.917315 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:07.918460 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:07.920109 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:07.922250 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:07.922475 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:07.922737 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:07.922919 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:07.961266 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.130:36525
I20260709 13:12:07.961361 32569 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.130:36525 every 8 connection(s)
I20260709 13:12:07.966073 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:07.973047 32573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:07.974609 32574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:07.976967 32576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:07.977138 31814 server_base.cc:1061] running on GCE node
I20260709 13:12:07.978286 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:07.978566 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:07.978749 32570 heartbeater.cc:344] Connected to a master server at 127.31.17.190:40525
I20260709 13:12:07.978847 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602727978824 us; error 0 us; skew 500 ppm
I20260709 13:12:07.979156 32570 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:07.979658 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:07.980041 32570 heartbeater.cc:507] Master 127.31.17.190:40525 requested a full tablet report, sending...
I20260709 13:12:07.982051 32368 ts_manager.cc:194] Registered new tserver with Master: bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525)
I20260709 13:12:07.982580 31814 webserver.cc:533] Webserver started at http://127.31.17.131:44685/ using document root <none> and password file <none>
I20260709 13:12:07.983203 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:07.983471 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:07.983762 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:07.983855 32368 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59644
I20260709 13:12:07.985180 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/ts-2-root/instance:
uuid: "1dc8afd75d694683b609ea9ea60b19c3"
format_stamp: "Formatted at 2026-07-09 13:12:07 on dist-test-slave-zhw8"
I20260709 13:12:07.989812 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:07.993162 32581 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:07.993991 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:12:07.994324 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/ts-2-root
uuid: "1dc8afd75d694683b609ea9ea60b19c3"
format_stamp: "Formatted at 2026-07-09 13:12:07 on dist-test-slave-zhw8"
I20260709 13:12:07.994619 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602713491408-31814-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:08.020758 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:08.021997 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:08.023569 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:08.025910 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:08.026110 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:08.026428 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:08.026582 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:08.072854 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.131:43251
I20260709 13:12:08.072942 32643 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.131:43251 every 8 connection(s)
I20260709 13:12:08.086584 32644 heartbeater.cc:344] Connected to a master server at 127.31.17.190:40525
I20260709 13:12:08.086982 32644 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:08.087800 32644 heartbeater.cc:507] Master 127.31.17.190:40525 requested a full tablet report, sending...
I20260709 13:12:08.089785 32368 ts_manager.cc:194] Registered new tserver with Master: 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:08.090739 31814 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.0147158s
I20260709 13:12:08.091374 32368 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59658
I20260709 13:12:08.115861 32368 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59672:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:08.118726 32368 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:08.195526 32535 tablet_service.cc:1511] Processing CreateTablet for tablet 9f094cd640c140cfab32b929d2db0eac (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:08.196970 32535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f094cd640c140cfab32b929d2db0eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.199668 32534 tablet_service.cc:1511] Processing CreateTablet for tablet 31723e80ad5a4f539c4d581d23f8ec25 (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:08.201105 32534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31723e80ad5a4f539c4d581d23f8ec25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.204809 32460 tablet_service.cc:1511] Processing CreateTablet for tablet 9f094cd640c140cfab32b929d2db0eac (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:08.205507 32532 tablet_service.cc:1511] Processing CreateTablet for tablet c977efa6b8154f1d8253ca9c59efbe17 (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:08.206144 32460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f094cd640c140cfab32b929d2db0eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.206795 32532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c977efa6b8154f1d8253ca9c59efbe17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.208424 32533 tablet_service.cc:1511] Processing CreateTablet for tablet 1006ed7eb6f94254bdc65be3b03bdf5c (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:08.209720 32533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1006ed7eb6f94254bdc65be3b03bdf5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.212464 32531 tablet_service.cc:1511] Processing CreateTablet for tablet e806bbbaef114dc79f5f192d4bba04dc (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:08.213764 32531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e806bbbaef114dc79f5f192d4bba04dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.214147 32459 tablet_service.cc:1511] Processing CreateTablet for tablet 31723e80ad5a4f539c4d581d23f8ec25 (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:08.216427 32458 tablet_service.cc:1511] Processing CreateTablet for tablet 1006ed7eb6f94254bdc65be3b03bdf5c (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:08.218672 32457 tablet_service.cc:1511] Processing CreateTablet for tablet c977efa6b8154f1d8253ca9c59efbe17 (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:08.220841 32456 tablet_service.cc:1511] Processing CreateTablet for tablet e806bbbaef114dc79f5f192d4bba04dc (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:08.222280 32459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31723e80ad5a4f539c4d581d23f8ec25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.223289 32659 tablet_bootstrap.cc:492] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191: Bootstrap starting.
I20260709 13:12:08.223627 32456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e806bbbaef114dc79f5f192d4bba04dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.227684 32457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c977efa6b8154f1d8253ca9c59efbe17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.229583 32458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1006ed7eb6f94254bdc65be3b03bdf5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.236428 32659 tablet_bootstrap.cc:654] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.244480 32659 tablet_bootstrap.cc:492] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191: No bootstrap required, opened a new log
I20260709 13:12:08.244963 32659 ts_tablet_manager.cc:1403] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:12:08.247895 32659 raft_consensus.cc:359] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.248739 32659 raft_consensus.cc:385] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.249161 32659 raft_consensus.cc:740] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc96f7a83162437fbb1098501e781191, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.250139 32659 consensus_queue.cc:260] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.255362 32661 tablet_bootstrap.cc:492] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c: Bootstrap starting.
I20260709 13:12:08.257474 32570 heartbeater.cc:499] Master 127.31.17.190:40525 was elected leader, sending a full tablet report...
I20260709 13:12:08.257956 32659 ts_tablet_manager.cc:1434] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.003s
I20260709 13:12:08.258844 32659 tablet_bootstrap.cc:492] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191: Bootstrap starting.
I20260709 13:12:08.262076 32661 tablet_bootstrap.cc:654] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.265127 32659 tablet_bootstrap.cc:654] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.276669 32609 tablet_service.cc:1511] Processing CreateTablet for tablet 9f094cd640c140cfab32b929d2db0eac (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:08.278474 32609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f094cd640c140cfab32b929d2db0eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.280844 32608 tablet_service.cc:1511] Processing CreateTablet for tablet 31723e80ad5a4f539c4d581d23f8ec25 (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:08.282645 32608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31723e80ad5a4f539c4d581d23f8ec25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.284700 32607 tablet_service.cc:1511] Processing CreateTablet for tablet 1006ed7eb6f94254bdc65be3b03bdf5c (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:08.286440 32607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1006ed7eb6f94254bdc65be3b03bdf5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.288549 32606 tablet_service.cc:1511] Processing CreateTablet for tablet c977efa6b8154f1d8253ca9c59efbe17 (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:08.290249 32606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c977efa6b8154f1d8253ca9c59efbe17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.313799 32661 tablet_bootstrap.cc:492] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c: No bootstrap required, opened a new log
I20260709 13:12:08.314234 32665 tablet_bootstrap.cc:492] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3: Bootstrap starting.
I20260709 13:12:08.314427 32661 ts_tablet_manager.cc:1403] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.039s
I20260709 13:12:08.314769 32659 tablet_bootstrap.cc:492] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191: No bootstrap required, opened a new log
I20260709 13:12:08.315260 32659 ts_tablet_manager.cc:1403] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191: Time spent bootstrapping tablet: real 0.057s	user 0.019s	sys 0.027s
I20260709 13:12:08.317613 32661 raft_consensus.cc:359] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.317916 32659 raft_consensus.cc:359] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.318514 32661 raft_consensus.cc:385] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.319043 32661 raft_consensus.cc:740] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.318655 32659 raft_consensus.cc:385] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.320048 32661 consensus_queue.cc:260] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.320848 32659 raft_consensus.cc:740] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc96f7a83162437fbb1098501e781191, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.321622 32659 consensus_queue.cc:260] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.323685 32659 ts_tablet_manager.cc:1434] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:12:08.323880 32457 tablet_service.cc:1511] Processing CreateTablet for tablet 38c12c0d44374defb0d3fe0772227282 (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:08.325117 32457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38c12c0d44374defb0d3fe0772227282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.326479 32659 tablet_bootstrap.cc:492] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191: Bootstrap starting.
I20260709 13:12:08.330883 32608 tablet_service.cc:1511] Processing CreateTablet for tablet e806bbbaef114dc79f5f192d4bba04dc (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:08.332614 32608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e806bbbaef114dc79f5f192d4bba04dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.332847 32659 tablet_bootstrap.cc:654] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.334405 32533 tablet_service.cc:1511] Processing CreateTablet for tablet 38c12c0d44374defb0d3fe0772227282 (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:08.335712 32533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38c12c0d44374defb0d3fe0772227282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.346498 32665 tablet_bootstrap.cc:654] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.351316 32605 tablet_service.cc:1511] Processing CreateTablet for tablet 38c12c0d44374defb0d3fe0772227282 (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:08.352644 32605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38c12c0d44374defb0d3fe0772227282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.358769 32665 tablet_bootstrap.cc:492] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3: No bootstrap required, opened a new log
I20260709 13:12:08.359382 32665 ts_tablet_manager.cc:1403] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.000s
I20260709 13:12:08.369156 32659 tablet_bootstrap.cc:492] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191: No bootstrap required, opened a new log
I20260709 13:12:08.369726 32659 ts_tablet_manager.cc:1403] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.005s
I20260709 13:12:08.371220 32495 heartbeater.cc:499] Master 127.31.17.190:40525 was elected leader, sending a full tablet report...
I20260709 13:12:08.371579 32665 raft_consensus.cc:359] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.372349 32665 raft_consensus.cc:385] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.372641 32665 raft_consensus.cc:740] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.373147 32661 ts_tablet_manager.cc:1434] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent starting tablet: real 0.058s	user 0.014s	sys 0.018s
I20260709 13:12:08.374104 32661 tablet_bootstrap.cc:492] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c: Bootstrap starting.
I20260709 13:12:08.374058 32665 consensus_queue.cc:260] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.380679 32659 raft_consensus.cc:359] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.381789 32659 raft_consensus.cc:385] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.386374 32659 raft_consensus.cc:740] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc96f7a83162437fbb1098501e781191, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.387488 32659 consensus_queue.cc:260] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.390152 32659 ts_tablet_manager.cc:1434] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:12:08.385950 32661 tablet_bootstrap.cc:654] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.392647 32659 tablet_bootstrap.cc:492] T 1006ed7eb6f94254bdc65be3b03bdf5c P bc96f7a83162437fbb1098501e781191: Bootstrap starting.
I20260709 13:12:08.400929 32659 tablet_bootstrap.cc:654] T 1006ed7eb6f94254bdc65be3b03bdf5c P bc96f7a83162437fbb1098501e781191: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.401661 32459 tablet_service.cc:1511] Processing CreateTablet for tablet 1f72b6b2d7c34762b21961e7ec8803f2 (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:08.403864 32531 tablet_service.cc:1511] Processing CreateTablet for tablet e40e6ab81f954bd290b342fd6a409f8e (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:08.404487 32459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f72b6b2d7c34762b21961e7ec8803f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.405462 32531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e40e6ab81f954bd290b342fd6a409f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.407483 32662 raft_consensus.cc:493] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.408039 32662 raft_consensus.cc:515] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.413125 32662 leader_election.cc:290] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:08.403388 32460 tablet_service.cc:1511] Processing CreateTablet for tablet e40e6ab81f954bd290b342fd6a409f8e (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:08.416294 32460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e40e6ab81f954bd290b342fd6a409f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.417532 32607 tablet_service.cc:1511] Processing CreateTablet for tablet e40e6ab81f954bd290b342fd6a409f8e (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:08.420030 32607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e40e6ab81f954bd290b342fd6a409f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.425630 32661 tablet_bootstrap.cc:492] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c: No bootstrap required, opened a new log
I20260709 13:12:08.426240 32661 ts_tablet_manager.cc:1403] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.009s
I20260709 13:12:08.427513 32619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31723e80ad5a4f539c4d581d23f8ec25" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3" is_pre_election: true
I20260709 13:12:08.428227 32619 raft_consensus.cc:2468] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 0.
I20260709 13:12:08.429644 32509 leader_election.cc:304] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:08.429720 32661 raft_consensus.cc:359] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.430501 32661 raft_consensus.cc:385] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.430716 32665 ts_tablet_manager.cc:1434] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.023s
I20260709 13:12:08.430648 32644 heartbeater.cc:499] Master 127.31.17.190:40525 was elected leader, sending a full tablet report...
I20260709 13:12:08.430912 32661 raft_consensus.cc:740] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.431871 32665 tablet_bootstrap.cc:492] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3: Bootstrap starting.
I20260709 13:12:08.431772 32661 consensus_queue.cc:260] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.434103 32661 ts_tablet_manager.cc:1434] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 13:12:08.435016 32661 tablet_bootstrap.cc:492] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c: Bootstrap starting.
I20260709 13:12:08.438486 32609 tablet_service.cc:1511] Processing CreateTablet for tablet 1f72b6b2d7c34762b21961e7ec8803f2 (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:08.439778 32609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f72b6b2d7c34762b21961e7ec8803f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.441263 32661 tablet_bootstrap.cc:654] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.443409 32662 raft_consensus.cc:2804] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.443786 32662 raft_consensus.cc:493] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.444149 32662 raft_consensus.cc:3060] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.449648 32665 tablet_bootstrap.cc:654] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.463341 32661 tablet_bootstrap.cc:492] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c: No bootstrap required, opened a new log
I20260709 13:12:08.464113 32661 ts_tablet_manager.cc:1403] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.010s
I20260709 13:12:08.458699 32457 tablet_service.cc:1511] Processing CreateTablet for tablet 97da594576c04f5c9770cbc44f926a9b (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:08.469657 32457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97da594576c04f5c9770cbc44f926a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.472265 32608 tablet_service.cc:1511] Processing CreateTablet for tablet 97da594576c04f5c9770cbc44f926a9b (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:08.473541 32608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97da594576c04f5c9770cbc44f926a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.480417 32661 raft_consensus.cc:359] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.483392 32661 raft_consensus.cc:385] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.484048 32661 raft_consensus.cc:740] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.484841 32661 consensus_queue.cc:260] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.490274 32659 tablet_bootstrap.cc:492] T 1006ed7eb6f94254bdc65be3b03bdf5c P bc96f7a83162437fbb1098501e781191: No bootstrap required, opened a new log
I20260709 13:12:08.490778 32659 ts_tablet_manager.cc:1403] T 1006ed7eb6f94254bdc65be3b03bdf5c P bc96f7a83162437fbb1098501e781191: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.000s
I20260709 13:12:08.487512 32459 tablet_service.cc:1511] Processing CreateTablet for tablet 1b1edc6149b44705b94fef53f6ec08bf (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:08.493925 32665 tablet_bootstrap.cc:492] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3: No bootstrap required, opened a new log
I20260709 13:12:08.494431 32665 ts_tablet_manager.cc:1403] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3: Time spent bootstrapping tablet: real 0.063s	user 0.007s	sys 0.007s
I20260709 13:12:08.494047 32531 tablet_service.cc:1511] Processing CreateTablet for tablet 1f72b6b2d7c34762b21961e7ec8803f2 (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:08.494216 32533 tablet_service.cc:1511] Processing CreateTablet for tablet 97da594576c04f5c9770cbc44f926a9b (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:08.495568 32531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f72b6b2d7c34762b21961e7ec8803f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.498309 32533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97da594576c04f5c9770cbc44f926a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.499042 32661 ts_tablet_manager.cc:1434] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.005s
I20260709 13:12:08.501091 32665 raft_consensus.cc:359] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.501447 32532 tablet_service.cc:1511] Processing CreateTablet for tablet 1b1edc6149b44705b94fef53f6ec08bf (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:08.501822 32665 raft_consensus.cc:385] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.502147 32665 raft_consensus.cc:740] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.502621 32532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b1edc6149b44705b94fef53f6ec08bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.502911 32665 consensus_queue.cc:260] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.505008 32662 raft_consensus.cc:515] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.508280 32662 leader_election.cc:290] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 election: Requested vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:08.509328 32619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31723e80ad5a4f539c4d581d23f8ec25" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
I20260709 13:12:08.510437 32619 raft_consensus.cc:3060] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.510178 32659 raft_consensus.cc:359] T 1006ed7eb6f94254bdc65be3b03bdf5c P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.511690 32659 raft_consensus.cc:385] T 1006ed7eb6f94254bdc65be3b03bdf5c P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.511900 32459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b1edc6149b44705b94fef53f6ec08bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.512037 32659 raft_consensus.cc:740] T 1006ed7eb6f94254bdc65be3b03bdf5c P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc96f7a83162437fbb1098501e781191, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.512866 32659 consensus_queue.cc:260] T 1006ed7eb6f94254bdc65be3b03bdf5c P bc96f7a83162437fbb1098501e781191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.515283 32659 ts_tablet_manager.cc:1434] T 1006ed7eb6f94254bdc65be3b03bdf5c P bc96f7a83162437fbb1098501e781191: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.000s
I20260709 13:12:08.515738 32666 raft_consensus.cc:493] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.516206 32666 raft_consensus.cc:515] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.517050 32665 ts_tablet_manager.cc:1434] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:12:08.518102 32665 tablet_bootstrap.cc:492] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3: Bootstrap starting.
I20260709 13:12:08.520922 32470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31723e80ad5a4f539c4d581d23f8ec25" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" is_pre_election: true
I20260709 13:12:08.521572 32470 raft_consensus.cc:2468] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 0.
I20260709 13:12:08.509627 32608 tablet_service.cc:1511] Processing CreateTablet for tablet 1b1edc6149b44705b94fef53f6ec08bf (DEFAULT_TABLE table=test-workload [id=7489fd814d30466e98c1be2649ffba75]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:08.522608 32666 leader_election.cc:290] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:08.526347 32661 tablet_bootstrap.cc:492] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c: Bootstrap starting.
I20260709 13:12:08.529289 32469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31723e80ad5a4f539c4d581d23f8ec25" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
I20260709 13:12:08.529979 32469 raft_consensus.cc:3060] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.532163 32659 tablet_bootstrap.cc:492] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191: Bootstrap starting.
I20260709 13:12:08.532491 32608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b1edc6149b44705b94fef53f6ec08bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.543041 32661 tablet_bootstrap.cc:654] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.548506 32665 tablet_bootstrap.cc:654] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.551949 32659 tablet_bootstrap.cc:654] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.552611 32469 raft_consensus.cc:2468] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 1.
I20260709 13:12:08.539295 32619 raft_consensus.cc:2468] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 1.
I20260709 13:12:08.573801 32509 leader_election.cc:304] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:08.575706 32545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1006ed7eb6f94254bdc65be3b03bdf5c" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc96f7a83162437fbb1098501e781191" is_pre_election: true
I20260709 13:12:08.576385 32545 raft_consensus.cc:2468] T 1006ed7eb6f94254bdc65be3b03bdf5c P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 0.
I20260709 13:12:08.577266 32662 raft_consensus.cc:2804] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.579811 32433 leader_election.cc:304] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6972b93dcc3f4e0b9ddb470b5b151c3c, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:08.580675 32666 raft_consensus.cc:2804] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.581157 32666 raft_consensus.cc:493] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.581578 32666 raft_consensus.cc:3060] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.593181 32669 raft_consensus.cc:493] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.594763 32669 raft_consensus.cc:515] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.596979 32661 tablet_bootstrap.cc:492] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c: No bootstrap required, opened a new log
I20260709 13:12:08.597468 32661 ts_tablet_manager.cc:1403] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent bootstrapping tablet: real 0.071s	user 0.019s	sys 0.012s
I20260709 13:12:08.599720 32669 leader_election.cc:290] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525)
I20260709 13:12:08.592052 32662 raft_consensus.cc:697] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 1 LEADER]: Becoming Leader. State: Replica: bc96f7a83162437fbb1098501e781191, State: Running, Role: LEADER
I20260709 13:12:08.602628 32662 consensus_queue.cc:237] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.612069 32665 tablet_bootstrap.cc:492] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3: No bootstrap required, opened a new log
I20260709 13:12:08.612571 32665 ts_tablet_manager.cc:1403] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.007s
I20260709 13:12:08.609966 32666 raft_consensus.cc:515] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.615469 32666 leader_election.cc:290] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 1 election: Requested vote from peers bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:08.609470 32661 raft_consensus.cc:359] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.616465 32661 raft_consensus.cc:385] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.616468 32665 raft_consensus.cc:359] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.616851 32545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1006ed7eb6f94254bdc65be3b03bdf5c" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc96f7a83162437fbb1098501e781191"
I20260709 13:12:08.617272 32665 raft_consensus.cc:385] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.617538 32545 raft_consensus.cc:3060] T 1006ed7eb6f94254bdc65be3b03bdf5c P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.617605 32665 raft_consensus.cc:740] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.618660 32659 tablet_bootstrap.cc:492] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191: No bootstrap required, opened a new log
I20260709 13:12:08.618570 32665 consensus_queue.cc:260] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.619135 32659 ts_tablet_manager.cc:1403] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.019s
I20260709 13:12:08.621206 32665 ts_tablet_manager.cc:1434] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:12:08.622156 32665 tablet_bootstrap.cc:492] T e806bbbaef114dc79f5f192d4bba04dc P 1dc8afd75d694683b609ea9ea60b19c3: Bootstrap starting.
I20260709 13:12:08.621840 32659 raft_consensus.cc:359] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.622525 32659 raft_consensus.cc:385] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.622812 32659 raft_consensus.cc:740] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc96f7a83162437fbb1098501e781191, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.623378 32666 raft_consensus.cc:493] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.623831 32666 raft_consensus.cc:515] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.625408 32545 raft_consensus.cc:2468] T 1006ed7eb6f94254bdc65be3b03bdf5c P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 1.
I20260709 13:12:08.616875 32661 raft_consensus.cc:740] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.623553 32659 consensus_queue.cc:260] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.627187 32661 consensus_queue.cc:260] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.627961 32433 leader_election.cc:304] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6972b93dcc3f4e0b9ddb470b5b151c3c, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:08.628691 32659 ts_tablet_manager.cc:1434] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:12:08.629712 32659 tablet_bootstrap.cc:492] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191: Bootstrap starting.
I20260709 13:12:08.631351 32545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c977efa6b8154f1d8253ca9c59efbe17" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc96f7a83162437fbb1098501e781191" is_pre_election: true
I20260709 13:12:08.632030 32545 raft_consensus.cc:2468] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 0.
I20260709 13:12:08.636492 32659 tablet_bootstrap.cc:654] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.641780 32619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1006ed7eb6f94254bdc65be3b03bdf5c" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3" is_pre_election: true
I20260709 13:12:08.642169 32618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1006ed7eb6f94254bdc65be3b03bdf5c" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
I20260709 13:12:08.643589 32545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c12c0d44374defb0d3fe0772227282" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc96f7a83162437fbb1098501e781191" is_pre_election: true
W20260709 13:12:08.643777 32434 leader_election.cc:343] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.644291 32545 raft_consensus.cc:2468] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dc8afd75d694683b609ea9ea60b19c3 in term 0.
W20260709 13:12:08.644702 32434 leader_election.cc:343] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.645648 32582 leader_election.cc:304] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:08.646595 32669 raft_consensus.cc:2804] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.646974 32669 raft_consensus.cc:493] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.647403 32669 raft_consensus.cc:3060] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.648460 32666 leader_election.cc:290] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:08.649621 32618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c977efa6b8154f1d8253ca9c59efbe17" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3" is_pre_election: true
I20260709 13:12:08.650384 32618 raft_consensus.cc:2468] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 0.
I20260709 13:12:08.650250 32367 catalog_manager.cc:5697] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc96f7a83162437fbb1098501e781191 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "bc96f7a83162437fbb1098501e781191" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.651625 32434 leader_election.cc:304] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, 6972b93dcc3f4e0b9ddb470b5b151c3c; no voters: 
I20260709 13:12:08.652222 32666 raft_consensus.cc:2804] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.652781 32666 raft_consensus.cc:697] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 LEADER]: Becoming Leader. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Running, Role: LEADER
I20260709 13:12:08.653851 32666 consensus_queue.cc:237] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.655557 32669 raft_consensus.cc:515] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.658712 32545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c12c0d44374defb0d3fe0772227282" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc96f7a83162437fbb1098501e781191"
I20260709 13:12:08.659294 32545 raft_consensus.cc:3060] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.660501 32665 tablet_bootstrap.cc:654] T e806bbbaef114dc79f5f192d4bba04dc P 1dc8afd75d694683b609ea9ea60b19c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.663348 32669 leader_election.cc:290] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 1 election: Requested vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525)
I20260709 13:12:08.667297 32662 raft_consensus.cc:493] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.667958 32662 raft_consensus.cc:515] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.670467 32545 raft_consensus.cc:2468] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc8afd75d694683b609ea9ea60b19c3 in term 1.
I20260709 13:12:08.671331 32469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f094cd640c140cfab32b929d2db0eac" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" is_pre_election: true
I20260709 13:12:08.671653 32582 leader_election.cc:304] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:08.672569 32669 raft_consensus.cc:2804] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.672760 32618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f094cd640c140cfab32b929d2db0eac" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3" is_pre_election: true
W20260709 13:12:08.672984 32433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:36525, user_credentials={real_user=slave}} blocked reactor thread for 45085.8us
I20260709 13:12:08.672012 32662 leader_election.cc:290] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
W20260709 13:12:08.674170 32509 leader_election.cc:343] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.671989 32469 raft_consensus.cc:2468] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 0.
I20260709 13:12:08.674877 32470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c12c0d44374defb0d3fe0772227282" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" is_pre_election: true
I20260709 13:12:08.675300 32661 ts_tablet_manager.cc:1434] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent starting tablet: real 0.078s	user 0.013s	sys 0.004s
I20260709 13:12:08.675346 32685 raft_consensus.cc:2804] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.675984 32511 leader_election.cc:304] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6972b93dcc3f4e0b9ddb470b5b151c3c, bc96f7a83162437fbb1098501e781191; no voters: 1dc8afd75d694683b609ea9ea60b19c3
I20260709 13:12:08.676419 32661 tablet_bootstrap.cc:492] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c: Bootstrap starting.
I20260709 13:12:08.676293 32470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c12c0d44374defb0d3fe0772227282" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
W20260709 13:12:08.677368 32585 leader_election.cc:343] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:08.678825 32585 leader_election.cc:343] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.678800 32669 raft_consensus.cc:697] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 LEADER]: Becoming Leader. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Running, Role: LEADER
I20260709 13:12:08.680410 32669 consensus_queue.cc:237] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.681311 32662 raft_consensus.cc:2804] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.681742 32662 raft_consensus.cc:493] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.685029 32365 catalog_manager.cc:5697] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129). New cstate: current_term: 1 leader_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.689059 32661 tablet_bootstrap.cc:654] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.682126 32685 raft_consensus.cc:493] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.690521 32662 raft_consensus.cc:3060] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.697080 32685 raft_consensus.cc:3060] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:08.708854 32416 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:08.713665 32665 tablet_bootstrap.cc:492] T e806bbbaef114dc79f5f192d4bba04dc P 1dc8afd75d694683b609ea9ea60b19c3: No bootstrap required, opened a new log
I20260709 13:12:08.714716 32665 ts_tablet_manager.cc:1403] T e806bbbaef114dc79f5f192d4bba04dc P 1dc8afd75d694683b609ea9ea60b19c3: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.001s
I20260709 13:12:08.714941 32365 catalog_manager.cc:5697] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "1dc8afd75d694683b609ea9ea60b19c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.719587 32659 tablet_bootstrap.cc:492] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191: No bootstrap required, opened a new log
I20260709 13:12:08.720090 32659 ts_tablet_manager.cc:1403] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191: Time spent bootstrapping tablet: real 0.091s	user 0.039s	sys 0.032s
I20260709 13:12:08.722951 32659 raft_consensus.cc:359] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.723670 32659 raft_consensus.cc:385] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.723978 32659 raft_consensus.cc:740] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc96f7a83162437fbb1098501e781191, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.724783 32659 consensus_queue.cc:260] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.724979 32662 raft_consensus.cc:515] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.727020 32662 leader_election.cc:290] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 election: Requested vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:08.727317 32659 ts_tablet_manager.cc:1434] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:08.728088 32659 tablet_bootstrap.cc:492] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191: Bootstrap starting.
I20260709 13:12:08.729367 32470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f094cd640c140cfab32b929d2db0eac" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
I20260709 13:12:08.730160 32470 raft_consensus.cc:3060] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.718773 32685 raft_consensus.cc:515] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.732789 32659 tablet_bootstrap.cc:654] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.734053 32545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c977efa6b8154f1d8253ca9c59efbe17" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc96f7a83162437fbb1098501e781191"
I20260709 13:12:08.734617 32545 raft_consensus.cc:3060] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.735419 32618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c977efa6b8154f1d8253ca9c59efbe17" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
I20260709 13:12:08.736099 32618 raft_consensus.cc:3060] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.736327 32619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f094cd640c140cfab32b929d2db0eac" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
W20260709 13:12:08.737660 32509 leader_election.cc:343] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.741460 32545 raft_consensus.cc:2468] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 1.
I20260709 13:12:08.742602 32433 leader_election.cc:304] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6972b93dcc3f4e0b9ddb470b5b151c3c, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:08.743494 32666 raft_consensus.cc:2804] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.744093 32666 raft_consensus.cc:697] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 LEADER]: Becoming Leader. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Running, Role: LEADER
I20260709 13:12:08.744998 32685 leader_election.cc:290] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 1 election: Requested vote from peers bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:08.744905 32666 consensus_queue.cc:237] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.746172 32659 tablet_bootstrap.cc:492] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191: No bootstrap required, opened a new log
I20260709 13:12:08.746693 32659 ts_tablet_manager.cc:1403] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191: Time spent bootstrapping tablet: real 0.019s	user 0.001s	sys 0.013s
I20260709 13:12:08.750514 32659 raft_consensus.cc:359] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.751230 32659 raft_consensus.cc:385] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.751549 32659 raft_consensus.cc:740] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc96f7a83162437fbb1098501e781191, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.744917 32618 raft_consensus.cc:2468] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 1.
I20260709 13:12:08.752416 32665 raft_consensus.cc:359] T e806bbbaef114dc79f5f192d4bba04dc P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.752702 32659 consensus_queue.cc:260] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.753497 32665 raft_consensus.cc:385] T e806bbbaef114dc79f5f192d4bba04dc P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.753911 32665 raft_consensus.cc:740] T e806bbbaef114dc79f5f192d4bba04dc P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.754859 32665 consensus_queue.cc:260] T e806bbbaef114dc79f5f192d4bba04dc P 1dc8afd75d694683b609ea9ea60b19c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.756336 32659 ts_tablet_manager.cc:1434] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:12:08.757313 32659 tablet_bootstrap.cc:492] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191: Bootstrap starting.
I20260709 13:12:08.757754 32665 ts_tablet_manager.cc:1434] T e806bbbaef114dc79f5f192d4bba04dc P 1dc8afd75d694683b609ea9ea60b19c3: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:12:08.762166 32659 tablet_bootstrap.cc:654] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.762686 32470 raft_consensus.cc:2468] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 1.
I20260709 13:12:08.764268 32511 leader_election.cc:304] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6972b93dcc3f4e0b9ddb470b5b151c3c, bc96f7a83162437fbb1098501e781191; no voters: 1dc8afd75d694683b609ea9ea60b19c3
I20260709 13:12:08.765713 32662 raft_consensus.cc:2804] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.766304 32662 raft_consensus.cc:697] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 1 LEADER]: Becoming Leader. State: Replica: bc96f7a83162437fbb1098501e781191, State: Running, Role: LEADER
I20260709 13:12:08.767422 32662 consensus_queue.cc:237] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.771313 32665 tablet_bootstrap.cc:492] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3: Bootstrap starting.
I20260709 13:12:08.772490 32365 catalog_manager.cc:5697] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129). New cstate: current_term: 1 leader_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.779031 32659 tablet_bootstrap.cc:492] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191: No bootstrap required, opened a new log
I20260709 13:12:08.779523 32659 ts_tablet_manager.cc:1403] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.013s
I20260709 13:12:08.780954 32661 tablet_bootstrap.cc:492] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c: No bootstrap required, opened a new log
I20260709 13:12:08.781484 32661 ts_tablet_manager.cc:1403] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent bootstrapping tablet: real 0.105s	user 0.027s	sys 0.029s
I20260709 13:12:08.782068 32659 raft_consensus.cc:359] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.782744 32659 raft_consensus.cc:385] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.783011 32659 raft_consensus.cc:740] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc96f7a83162437fbb1098501e781191, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.783687 32659 consensus_queue.cc:260] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.785454 32665 tablet_bootstrap.cc:654] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.785683 32659 ts_tablet_manager.cc:1434] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:12:08.787123 32659 tablet_bootstrap.cc:492] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191: Bootstrap starting.
I20260709 13:12:08.793748 32659 tablet_bootstrap.cc:654] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.785815 32661 raft_consensus.cc:359] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.795483 32661 raft_consensus.cc:385] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.796020 32661 raft_consensus.cc:740] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.796993 32661 consensus_queue.cc:260] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.800400 32680 raft_consensus.cc:493] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.800889 32680 raft_consensus.cc:515] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.802028 32661 ts_tablet_manager.cc:1434] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:12:08.804512 32618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40e6ab81f954bd290b342fd6a409f8e" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3" is_pre_election: true
W20260709 13:12:08.805717 32509 leader_election.cc:343] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.807129 32470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40e6ab81f954bd290b342fd6a409f8e" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" is_pre_election: true
W20260709 13:12:08.808542 32511 leader_election.cc:343] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.808990 32511 leader_election.cc:304] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc96f7a83162437fbb1098501e781191; no voters: 1dc8afd75d694683b609ea9ea60b19c3, 6972b93dcc3f4e0b9ddb470b5b151c3c
I20260709 13:12:08.803011 32680 leader_election.cc:290] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:08.810010 32680 raft_consensus.cc:2749] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.814275 32365 catalog_manager.cc:5697] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc96f7a83162437fbb1098501e781191 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "bc96f7a83162437fbb1098501e781191" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.803079 32661 tablet_bootstrap.cc:492] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c: Bootstrap starting.
I20260709 13:12:08.829021 32661 tablet_bootstrap.cc:654] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.835076 32665 tablet_bootstrap.cc:492] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3: No bootstrap required, opened a new log
I20260709 13:12:08.834959 32662 raft_consensus.cc:493] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.835755 32665 ts_tablet_manager.cc:1403] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.038s
I20260709 13:12:08.835650 32662 raft_consensus.cc:515] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.837092 32659 tablet_bootstrap.cc:492] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191: No bootstrap required, opened a new log
I20260709 13:12:08.837715 32659 ts_tablet_manager.cc:1403] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191: Time spent bootstrapping tablet: real 0.051s	user 0.035s	sys 0.012s
I20260709 13:12:08.839289 32661 tablet_bootstrap.cc:492] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c: No bootstrap required, opened a new log
I20260709 13:12:08.839182 32618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e806bbbaef114dc79f5f192d4bba04dc" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3" is_pre_election: true
I20260709 13:12:08.839990 32661 ts_tablet_manager.cc:1403] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent bootstrapping tablet: real 0.037s	user 0.003s	sys 0.009s
I20260709 13:12:08.839923 32618 raft_consensus.cc:2468] T e806bbbaef114dc79f5f192d4bba04dc P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 0.
I20260709 13:12:08.840351 32662 leader_election.cc:290] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:08.842830 32509 leader_election.cc:304] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:08.841073 32659 raft_consensus.cc:359] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.841521 32665 raft_consensus.cc:359] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.843683 32680 raft_consensus.cc:2804] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.843804 32665 raft_consensus.cc:385] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.844228 32680 raft_consensus.cc:493] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.844280 32665 raft_consensus.cc:740] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.844669 32680 raft_consensus.cc:3060] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.845166 32665 consensus_queue.cc:260] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.845451 32470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e806bbbaef114dc79f5f192d4bba04dc" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" is_pre_election: true
I20260709 13:12:08.845522 32661 raft_consensus.cc:359] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.846598 32661 raft_consensus.cc:385] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.846885 32661 raft_consensus.cc:740] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.847497 32665 ts_tablet_manager.cc:1434] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:12:08.847607 32661 consensus_queue.cc:260] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.848459 32665 tablet_bootstrap.cc:492] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3: Bootstrap starting.
I20260709 13:12:08.849725 32661 ts_tablet_manager.cc:1434] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:12:08.850670 32661 tablet_bootstrap.cc:492] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c: Bootstrap starting.
I20260709 13:12:08.851948 32680 raft_consensus.cc:515] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.855110 32665 tablet_bootstrap.cc:654] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.855062 32618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e806bbbaef114dc79f5f192d4bba04dc" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
I20260709 13:12:08.855541 32470 raft_consensus.cc:2468] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 0.
I20260709 13:12:08.855715 32618 raft_consensus.cc:3060] T e806bbbaef114dc79f5f192d4bba04dc P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.856832 32661 tablet_bootstrap.cc:654] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.862167 32618 raft_consensus.cc:2468] T e806bbbaef114dc79f5f192d4bba04dc P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 1.
I20260709 13:12:08.863394 32509 leader_election.cc:304] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:08.843700 32659 raft_consensus.cc:385] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.864396 32698 raft_consensus.cc:2804] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.865136 32680 leader_election.cc:290] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 election: Requested vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:08.865334 32698 raft_consensus.cc:697] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 1 LEADER]: Becoming Leader. State: Replica: bc96f7a83162437fbb1098501e781191, State: Running, Role: LEADER
I20260709 13:12:08.866575 32698 consensus_queue.cc:237] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.867584 32666 raft_consensus.cc:493] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.869342 32666 raft_consensus.cc:515] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.871130 32666 leader_election.cc:290] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:08.871882 32545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c12c0d44374defb0d3fe0772227282" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc96f7a83162437fbb1098501e781191" is_pre_election: true
I20260709 13:12:08.864727 32659 raft_consensus.cc:740] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc96f7a83162437fbb1098501e781191, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.872648 32545 raft_consensus.cc:2393] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in current term 1: Already voted for candidate 1dc8afd75d694683b609ea9ea60b19c3 in this term.
I20260709 13:12:08.872648 32470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e806bbbaef114dc79f5f192d4bba04dc" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
I20260709 13:12:08.873275 32470 raft_consensus.cc:3060] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.873006 32659 consensus_queue.cc:260] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.876132 32659 ts_tablet_manager.cc:1434] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.001s
I20260709 13:12:08.877075 32659 tablet_bootstrap.cc:492] T 1b1edc6149b44705b94fef53f6ec08bf P bc96f7a83162437fbb1098501e781191: Bootstrap starting.
I20260709 13:12:08.879510 32618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c12c0d44374defb0d3fe0772227282" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3" is_pre_election: true
I20260709 13:12:08.880872 32434 leader_election.cc:304] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6972b93dcc3f4e0b9ddb470b5b151c3c; no voters: 1dc8afd75d694683b609ea9ea60b19c3, bc96f7a83162437fbb1098501e781191
I20260709 13:12:08.881752 32661 tablet_bootstrap.cc:492] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c: No bootstrap required, opened a new log
I20260709 13:12:08.881970 32666 raft_consensus.cc:3060] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.882318 32661 ts_tablet_manager.cc:1403] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.000s
I20260709 13:12:08.883212 32698 raft_consensus.cc:493] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.883747 32698 raft_consensus.cc:515] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.885505 32659 tablet_bootstrap.cc:654] T 1b1edc6149b44705b94fef53f6ec08bf P bc96f7a83162437fbb1098501e781191: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.885440 32661 raft_consensus.cc:359] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.886349 32661 raft_consensus.cc:385] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.886706 32661 raft_consensus.cc:740] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.887169 32619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97da594576c04f5c9770cbc44f926a9b" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3" is_pre_election: true
I20260709 13:12:08.887578 32661 consensus_queue.cc:260] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
W20260709 13:12:08.888841 32509 leader_election.cc:343] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.889650 32698 leader_election.cc:290] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:08.889999 32661 ts_tablet_manager.cc:1434] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:12:08.882855 32665 tablet_bootstrap.cc:492] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3: No bootstrap required, opened a new log
I20260709 13:12:08.890868 32665 ts_tablet_manager.cc:1403] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.015s
I20260709 13:12:08.891213 32661 tablet_bootstrap.cc:492] T 97da594576c04f5c9770cbc44f926a9b P 6972b93dcc3f4e0b9ddb470b5b151c3c: Bootstrap starting.
I20260709 13:12:08.894980 32665 raft_consensus.cc:359] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.896071 32665 raft_consensus.cc:385] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.896505 32665 raft_consensus.cc:740] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.898221 32661 tablet_bootstrap.cc:654] T 97da594576c04f5c9770cbc44f926a9b P 6972b93dcc3f4e0b9ddb470b5b151c3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.897796 32665 consensus_queue.cc:260] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.906253 32665 ts_tablet_manager.cc:1434] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:12:08.907416 32665 tablet_bootstrap.cc:492] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3: Bootstrap starting.
I20260709 13:12:08.908254 32659 tablet_bootstrap.cc:492] T 1b1edc6149b44705b94fef53f6ec08bf P bc96f7a83162437fbb1098501e781191: No bootstrap required, opened a new log
I20260709 13:12:08.908779 32659 ts_tablet_manager.cc:1403] T 1b1edc6149b44705b94fef53f6ec08bf P bc96f7a83162437fbb1098501e781191: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.016s
I20260709 13:12:08.909787 32661 tablet_bootstrap.cc:492] T 97da594576c04f5c9770cbc44f926a9b P 6972b93dcc3f4e0b9ddb470b5b151c3c: No bootstrap required, opened a new log
I20260709 13:12:08.910260 32661 ts_tablet_manager.cc:1403] T 97da594576c04f5c9770cbc44f926a9b P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:12:08.911602 32659 raft_consensus.cc:359] T 1b1edc6149b44705b94fef53f6ec08bf P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.912386 32659 raft_consensus.cc:385] T 1b1edc6149b44705b94fef53f6ec08bf P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.912705 32659 raft_consensus.cc:740] T 1b1edc6149b44705b94fef53f6ec08bf P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc96f7a83162437fbb1098501e781191, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.912897 32661 raft_consensus.cc:359] T 97da594576c04f5c9770cbc44f926a9b P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.913779 32661 raft_consensus.cc:385] T 97da594576c04f5c9770cbc44f926a9b P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.913589 32659 consensus_queue.cc:260] T 1b1edc6149b44705b94fef53f6ec08bf P bc96f7a83162437fbb1098501e781191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.914126 32661 raft_consensus.cc:740] T 97da594576c04f5c9770cbc44f926a9b P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.914918 32661 consensus_queue.cc:260] T 97da594576c04f5c9770cbc44f926a9b P 6972b93dcc3f4e0b9ddb470b5b151c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.914229 32665 tablet_bootstrap.cc:654] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.916203 32659 ts_tablet_manager.cc:1434] T 1b1edc6149b44705b94fef53f6ec08bf P bc96f7a83162437fbb1098501e781191: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:08.917235 32661 ts_tablet_manager.cc:1434] T 97da594576c04f5c9770cbc44f926a9b P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:08.918125 32661 tablet_bootstrap.cc:492] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c: Bootstrap starting.
I20260709 13:12:08.918536 32367 catalog_manager.cc:5697] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc96f7a83162437fbb1098501e781191 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "bc96f7a83162437fbb1098501e781191" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.921967 32666 raft_consensus.cc:2749] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.924024 32661 tablet_bootstrap.cc:654] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.924084 32470 raft_consensus.cc:2468] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 1.
I20260709 13:12:08.928299 32469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97da594576c04f5c9770cbc44f926a9b" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" is_pre_election: true
I20260709 13:12:08.928529 32665 tablet_bootstrap.cc:492] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3: No bootstrap required, opened a new log
I20260709 13:12:08.929044 32469 raft_consensus.cc:2468] T 97da594576c04f5c9770cbc44f926a9b P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 0.
I20260709 13:12:08.929241 32665 ts_tablet_manager.cc:1403] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.004s
I20260709 13:12:08.930330 32511 leader_election.cc:304] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6972b93dcc3f4e0b9ddb470b5b151c3c, bc96f7a83162437fbb1098501e781191; no voters: 1dc8afd75d694683b609ea9ea60b19c3
I20260709 13:12:08.932377 32698 raft_consensus.cc:2804] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.932855 32698 raft_consensus.cc:493] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.933265 32698 raft_consensus.cc:3060] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.938231 32661 tablet_bootstrap.cc:492] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c: No bootstrap required, opened a new log
I20260709 13:12:08.938133 32665 raft_consensus.cc:359] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.938699 32661 ts_tablet_manager.cc:1403] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:12:08.938918 32665 raft_consensus.cc:385] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.939262 32665 raft_consensus.cc:740] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.940029 32665 consensus_queue.cc:260] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.940904 32698 raft_consensus.cc:515] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.941332 32661 raft_consensus.cc:359] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.942090 32661 raft_consensus.cc:385] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.942360 32665 ts_tablet_manager.cc:1434] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:08.942370 32661 raft_consensus.cc:740] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.943547 32665 tablet_bootstrap.cc:492] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3: Bootstrap starting.
I20260709 13:12:08.943509 32661 consensus_queue.cc:260] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.945551 32661 ts_tablet_manager.cc:1434] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:12:08.946538 32661 tablet_bootstrap.cc:492] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c: Bootstrap starting.
I20260709 13:12:08.950539 32665 tablet_bootstrap.cc:654] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.951473 32661 tablet_bootstrap.cc:654] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.958078 32661 tablet_bootstrap.cc:492] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c: No bootstrap required, opened a new log
I20260709 13:12:08.958614 32661 ts_tablet_manager.cc:1403] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.004s
I20260709 13:12:08.961421 32661 raft_consensus.cc:359] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.962244 32661 raft_consensus.cc:385] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.962625 32661 raft_consensus.cc:740] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.963717 32698 leader_election.cc:290] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 election: Requested vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:08.963817 32661 consensus_queue.cc:260] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.965571 32470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97da594576c04f5c9770cbc44f926a9b" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
I20260709 13:12:08.966189 32470 raft_consensus.cc:3060] T 97da594576c04f5c9770cbc44f926a9b P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.966557 32661 ts_tablet_manager.cc:1434] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:12:08.968046 32619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97da594576c04f5c9770cbc44f926a9b" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
W20260709 13:12:08.970891 32509 leader_election.cc:343] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.975358 32665 tablet_bootstrap.cc:492] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3: No bootstrap required, opened a new log
I20260709 13:12:08.975795 32665 ts_tablet_manager.cc:1403] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.013s
I20260709 13:12:08.975963 32470 raft_consensus.cc:2468] T 97da594576c04f5c9770cbc44f926a9b P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 1.
I20260709 13:12:08.978384 32511 leader_election.cc:304] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6972b93dcc3f4e0b9ddb470b5b151c3c, bc96f7a83162437fbb1098501e781191; no voters: 1dc8afd75d694683b609ea9ea60b19c3
I20260709 13:12:08.978746 32665 raft_consensus.cc:359] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.979171 32698 raft_consensus.cc:2804] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.979493 32665 raft_consensus.cc:385] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.979848 32665 raft_consensus.cc:740] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.979724 32698 raft_consensus.cc:697] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [term 1 LEADER]: Becoming Leader. State: Replica: bc96f7a83162437fbb1098501e781191, State: Running, Role: LEADER
I20260709 13:12:08.980484 32665 consensus_queue.cc:260] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.980648 32698 consensus_queue.cc:237] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.981870 32665 ts_tablet_manager.cc:1434] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:08.982652 32665 tablet_bootstrap.cc:492] T 97da594576c04f5c9770cbc44f926a9b P 1dc8afd75d694683b609ea9ea60b19c3: Bootstrap starting.
I20260709 13:12:08.988070 32665 tablet_bootstrap.cc:654] T 97da594576c04f5c9770cbc44f926a9b P 1dc8afd75d694683b609ea9ea60b19c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.988201 32367 catalog_manager.cc:5697] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc96f7a83162437fbb1098501e781191 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "bc96f7a83162437fbb1098501e781191" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.992686 32665 tablet_bootstrap.cc:492] T 97da594576c04f5c9770cbc44f926a9b P 1dc8afd75d694683b609ea9ea60b19c3: No bootstrap required, opened a new log
I20260709 13:12:08.993144 32665 ts_tablet_manager.cc:1403] T 97da594576c04f5c9770cbc44f926a9b P 1dc8afd75d694683b609ea9ea60b19c3: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:12:08.995605 32665 raft_consensus.cc:359] T 97da594576c04f5c9770cbc44f926a9b P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.996217 32665 raft_consensus.cc:385] T 97da594576c04f5c9770cbc44f926a9b P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.996533 32665 raft_consensus.cc:740] T 97da594576c04f5c9770cbc44f926a9b P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.997150 32665 consensus_queue.cc:260] T 97da594576c04f5c9770cbc44f926a9b P 1dc8afd75d694683b609ea9ea60b19c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:08.999002 32665 ts_tablet_manager.cc:1434] T 97da594576c04f5c9770cbc44f926a9b P 1dc8afd75d694683b609ea9ea60b19c3: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:12:08.999908 32665 tablet_bootstrap.cc:492] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3: Bootstrap starting.
I20260709 13:12:09.004484 32665 tablet_bootstrap.cc:654] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.008486 32665 tablet_bootstrap.cc:492] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3: No bootstrap required, opened a new log
I20260709 13:12:09.008962 32665 ts_tablet_manager.cc:1403] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3: Time spent bootstrapping tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:12:09.010823 32665 raft_consensus.cc:359] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.011343 32665 raft_consensus.cc:385] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.011541 32665 raft_consensus.cc:740] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.012055 32665 consensus_queue.cc:260] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.013381 32665 ts_tablet_manager.cc:1434] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:12:09.046995 32669 raft_consensus.cc:493] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.047477 32669 raft_consensus.cc:515] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.049069 32669 leader_election.cc:290] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525)
I20260709 13:12:09.049927 32470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40e6ab81f954bd290b342fd6a409f8e" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" is_pre_election: true
I20260709 13:12:09.050115 32545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40e6ab81f954bd290b342fd6a409f8e" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc96f7a83162437fbb1098501e781191" is_pre_election: true
I20260709 13:12:09.050454 32470 raft_consensus.cc:2468] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dc8afd75d694683b609ea9ea60b19c3 in term 0.
I20260709 13:12:09.050697 32545 raft_consensus.cc:2468] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dc8afd75d694683b609ea9ea60b19c3 in term 0.
I20260709 13:12:09.051554 32585 leader_election.cc:304] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, 6972b93dcc3f4e0b9ddb470b5b151c3c; no voters: 
I20260709 13:12:09.052323 32669 raft_consensus.cc:2804] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.052634 32669 raft_consensus.cc:493] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.052917 32669 raft_consensus.cc:3060] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.054339 32688 raft_consensus.cc:493] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.055024 32698 raft_consensus.cc:493] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.054754 32688 raft_consensus.cc:515] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.055523 32698 raft_consensus.cc:515] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.056967 32688 leader_election.cc:290] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525)
I20260709 13:12:09.057439 32698 leader_election.cc:290] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:09.058269 32470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" is_pre_election: true
I20260709 13:12:09.059068 32669 raft_consensus.cc:515] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.059387 32470 raft_consensus.cc:2468] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dc8afd75d694683b609ea9ea60b19c3 in term 0.
I20260709 13:12:09.059826 32469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" is_pre_election: true
I20260709 13:12:09.060473 32469 raft_consensus.cc:2468] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 0.
I20260709 13:12:09.061124 32669 leader_election.cc:290] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 1 election: Requested vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525)
I20260709 13:12:09.061789 32511 leader_election.cc:304] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6972b93dcc3f4e0b9ddb470b5b151c3c, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:09.061983 32619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3" is_pre_election: true
I20260709 13:12:09.062567 32619 raft_consensus.cc:2468] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 0.
I20260709 13:12:09.062740 32469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40e6ab81f954bd290b342fd6a409f8e" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
I20260709 13:12:09.063477 32469 raft_consensus.cc:3060] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.063647 32544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40e6ab81f954bd290b342fd6a409f8e" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc96f7a83162437fbb1098501e781191"
I20260709 13:12:09.063766 32585 leader_election.cc:304] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, 6972b93dcc3f4e0b9ddb470b5b151c3c; no voters: 
I20260709 13:12:09.062832 32545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc96f7a83162437fbb1098501e781191" is_pre_election: true
I20260709 13:12:09.064355 32544 raft_consensus.cc:3060] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.064735 32545 raft_consensus.cc:2468] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dc8afd75d694683b609ea9ea60b19c3 in term 0.
I20260709 13:12:09.064922 32669 raft_consensus.cc:2804] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.065429 32669 raft_consensus.cc:493] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.066071 32698 raft_consensus.cc:2804] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.066030 32666 raft_consensus.cc:493] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.066401 32669 raft_consensus.cc:3060] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.066617 32698 raft_consensus.cc:493] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.066751 32666 raft_consensus.cc:515] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.069034 32619 raft_consensus.cc:3060] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.069072 32666 leader_election.cc:290] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:09.071419 32545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1edc6149b44705b94fef53f6ec08bf" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc96f7a83162437fbb1098501e781191" is_pre_election: true
I20260709 13:12:09.072060 32545 raft_consensus.cc:2468] T 1b1edc6149b44705b94fef53f6ec08bf P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 0.
I20260709 13:12:09.072436 32618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1edc6149b44705b94fef53f6ec08bf" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3" is_pre_election: true
I20260709 13:12:09.072916 32469 raft_consensus.cc:2468] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc8afd75d694683b609ea9ea60b19c3 in term 1.
I20260709 13:12:09.073019 32618 raft_consensus.cc:2468] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 0.
I20260709 13:12:09.073203 32433 leader_election.cc:304] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6972b93dcc3f4e0b9ddb470b5b151c3c, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:09.067193 32698 raft_consensus.cc:3060] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.073918 32669 raft_consensus.cc:515] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.074397 32585 leader_election.cc:304] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, 6972b93dcc3f4e0b9ddb470b5b151c3c; no voters: 
I20260709 13:12:09.075423 32688 raft_consensus.cc:2804] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.075970 32666 raft_consensus.cc:2804] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.076427 32666 raft_consensus.cc:493] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.076822 32666 raft_consensus.cc:3060] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.077188 32469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
I20260709 13:12:09.077768 32469 raft_consensus.cc:3060] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.082803 32684 consensus_queue.cc:1048] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:09.083889 32666 raft_consensus.cc:515] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.084398 32469 raft_consensus.cc:2468] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc8afd75d694683b609ea9ea60b19c3 in term 1.
I20260709 13:12:09.085110 32544 raft_consensus.cc:2468] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc8afd75d694683b609ea9ea60b19c3 in term 1.
I20260709 13:12:09.086243 32666 leader_election.cc:290] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 1 election: Requested vote from peers bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:09.086923 32545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1edc6149b44705b94fef53f6ec08bf" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc96f7a83162437fbb1098501e781191"
I20260709 13:12:09.087543 32545 raft_consensus.cc:3060] T 1b1edc6149b44705b94fef53f6ec08bf P bc96f7a83162437fbb1098501e781191 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.087448 32617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1edc6149b44705b94fef53f6ec08bf" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
I20260709 13:12:09.088135 32617 raft_consensus.cc:3060] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.089063 32585 leader_election.cc:304] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, 6972b93dcc3f4e0b9ddb470b5b151c3c; no voters: 
I20260709 13:12:09.091634 32698 raft_consensus.cc:515] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.093086 32669 leader_election.cc:290] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 1 election: Requested vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525)
I20260709 13:12:09.094041 32669 raft_consensus.cc:2804] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.094518 32669 raft_consensus.cc:697] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 LEADER]: Becoming Leader. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Running, Role: LEADER
I20260709 13:12:09.094977 32545 raft_consensus.cc:2468] T 1b1edc6149b44705b94fef53f6ec08bf P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 1.
I20260709 13:12:09.095067 32543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc96f7a83162437fbb1098501e781191"
I20260709 13:12:09.095448 32669 consensus_queue.cc:237] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.096256 32543 raft_consensus.cc:2393] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1dc8afd75d694683b609ea9ea60b19c3 in current term 1: Already voted for candidate bc96f7a83162437fbb1098501e781191 in this term.
I20260709 13:12:09.096741 32433 leader_election.cc:304] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6972b93dcc3f4e0b9ddb470b5b151c3c, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:09.098026 32666 raft_consensus.cc:2804] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.098809 32666 raft_consensus.cc:697] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 LEADER]: Becoming Leader. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Running, Role: LEADER
I20260709 13:12:09.099746 32666 consensus_queue.cc:237] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.100597 32617 raft_consensus.cc:2468] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 1.
I20260709 13:12:09.102501 32469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
I20260709 13:12:09.103507 32469 raft_consensus.cc:2393] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bc96f7a83162437fbb1098501e781191 in current term 1: Already voted for candidate 1dc8afd75d694683b609ea9ea60b19c3 in this term.
I20260709 13:12:09.106582 32698 leader_election.cc:290] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 election: Requested vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:09.107579 32616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
I20260709 13:12:09.109310 32509 leader_election.cc:304] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc96f7a83162437fbb1098501e781191; no voters: 1dc8afd75d694683b609ea9ea60b19c3, 6972b93dcc3f4e0b9ddb470b5b151c3c
I20260709 13:12:09.110718 32698 raft_consensus.cc:2749] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.114264 32688 raft_consensus.cc:697] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 LEADER]: Becoming Leader. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Running, Role: LEADER
I20260709 13:12:09.115167 32712 raft_consensus.cc:493] T 97da594576c04f5c9770cbc44f926a9b P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.115190 32688 consensus_queue.cc:237] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.115058 32365 catalog_manager.cc:5697] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129). New cstate: current_term: 1 leader_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.115945 32712 raft_consensus.cc:515] T 97da594576c04f5c9770cbc44f926a9b P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.118530 32712 leader_election.cc:290] T 97da594576c04f5c9770cbc44f926a9b P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525)
I20260709 13:12:09.119426 32469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97da594576c04f5c9770cbc44f926a9b" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" is_pre_election: true
I20260709 13:12:09.120396 32469 raft_consensus.cc:2393] T 97da594576c04f5c9770cbc44f926a9b P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1dc8afd75d694683b609ea9ea60b19c3 in current term 1: Already voted for candidate bc96f7a83162437fbb1098501e781191 in this term.
I20260709 13:12:09.121857 32545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97da594576c04f5c9770cbc44f926a9b" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc96f7a83162437fbb1098501e781191" is_pre_election: true
I20260709 13:12:09.124454 32582 leader_election.cc:304] T 97da594576c04f5c9770cbc44f926a9b P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3; no voters: 6972b93dcc3f4e0b9ddb470b5b151c3c, bc96f7a83162437fbb1098501e781191
I20260709 13:12:09.126106 32712 raft_consensus.cc:3060] T 97da594576c04f5c9770cbc44f926a9b P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.134828 32712 raft_consensus.cc:2749] T 97da594576c04f5c9770cbc44f926a9b P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.139810 32365 catalog_manager.cc:5697] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "1dc8afd75d694683b609ea9ea60b19c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.142778 32685 consensus_queue.cc:1048] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:09.150363 32698 consensus_queue.cc:1048] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.160660 32365 catalog_manager.cc:5697] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "1dc8afd75d694683b609ea9ea60b19c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.161782 32662 consensus_queue.cc:1048] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.179504 32712 consensus_queue.cc:1048] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.189399 32685 consensus_queue.cc:1048] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.194944 32688 consensus_queue.cc:1048] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:09.202785 32727 consensus_queue.cc:1048] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:09.337029 32688 raft_consensus.cc:493] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.337510 32688 raft_consensus.cc:515] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.339326 32688 leader_election.cc:290] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525), 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679)
I20260709 13:12:09.340096 32544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f094cd640c140cfab32b929d2db0eac" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc96f7a83162437fbb1098501e781191" is_pre_election: true
I20260709 13:12:09.340381 32469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f094cd640c140cfab32b929d2db0eac" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" is_pre_election: true
I20260709 13:12:09.341296 32469 raft_consensus.cc:2393] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1dc8afd75d694683b609ea9ea60b19c3 in current term 1: Already voted for candidate bc96f7a83162437fbb1098501e781191 in this term.
I20260709 13:12:09.342110 32585 leader_election.cc:304] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3; no voters: 6972b93dcc3f4e0b9ddb470b5b151c3c, bc96f7a83162437fbb1098501e781191
I20260709 13:12:09.342749 32688 raft_consensus.cc:3060] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.348646 32688 raft_consensus.cc:2749] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.352188 32698 consensus_queue.cc:1048] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.362164 32544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f094cd640c140cfab32b929d2db0eac"
dest_uuid: "bc96f7a83162437fbb1098501e781191"
mode: GRACEFUL
new_leader_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
 from {username='slave'} at 127.0.0.1:52772
I20260709 13:12:09.362761 32544 raft_consensus.cc:606] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 1 LEADER]: Received request to transfer leadership to TS 6972b93dcc3f4e0b9ddb470b5b151c3c
I20260709 13:12:09.364327 32698 consensus_queue.cc:1048] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.369761 32544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31723e80ad5a4f539c4d581d23f8ec25"
dest_uuid: "bc96f7a83162437fbb1098501e781191"
mode: GRACEFUL
new_leader_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
 from {username='slave'} at 127.0.0.1:52772
I20260709 13:12:09.369781 32698 consensus_queue.cc:1048] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.370458 32544 raft_consensus.cc:606] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 1 LEADER]: Received request to transfer leadership to TS 6972b93dcc3f4e0b9ddb470b5b151c3c
I20260709 13:12:09.376233 32680 raft_consensus.cc:993] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191: : Instructing follower 6972b93dcc3f4e0b9ddb470b5b151c3c to start an election
I20260709 13:12:09.376655 32680 raft_consensus.cc:1081] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 1 LEADER]: Signalling peer 6972b93dcc3f4e0b9ddb470b5b151c3c to start an election
I20260709 13:12:09.380398 32469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f094cd640c140cfab32b929d2db0eac"
dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
 from {username='slave'} at 127.0.0.1:36634
I20260709 13:12:09.381049 32469 raft_consensus.cc:493] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:09.381425 32469 raft_consensus.cc:3060] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.385088 32698 consensus_queue.cc:1048] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.387141 32544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e806bbbaef114dc79f5f192d4bba04dc"
dest_uuid: "bc96f7a83162437fbb1098501e781191"
mode: GRACEFUL
new_leader_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
 from {username='slave'} at 127.0.0.1:52772
I20260709 13:12:09.387974 32544 raft_consensus.cc:606] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 1 LEADER]: Received request to transfer leadership to TS 6972b93dcc3f4e0b9ddb470b5b151c3c
I20260709 13:12:09.393199 32469 raft_consensus.cc:515] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.395619 32469 leader_election.cc:290] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 2 election: Requested vote from peers bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:09.397051 32619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f094cd640c140cfab32b929d2db0eac" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
I20260709 13:12:09.397629 32619 raft_consensus.cc:3060] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.399116 32544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f094cd640c140cfab32b929d2db0eac" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc96f7a83162437fbb1098501e781191"
I20260709 13:12:09.399878 32544 raft_consensus.cc:3055] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:09.400276 32544 raft_consensus.cc:740] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc96f7a83162437fbb1098501e781191, State: Running, Role: LEADER
I20260709 13:12:09.401448 32544 consensus_queue.cc:260] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.402894 32544 raft_consensus.cc:3060] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.410241 32662 raft_consensus.cc:993] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191: : Instructing follower 6972b93dcc3f4e0b9ddb470b5b151c3c to start an election
I20260709 13:12:09.410653 32662 raft_consensus.cc:1081] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 1 LEADER]: Signalling peer 6972b93dcc3f4e0b9ddb470b5b151c3c to start an election
I20260709 13:12:09.412511 32544 raft_consensus.cc:2468] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 2.
I20260709 13:12:09.413926 32433 leader_election.cc:304] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6972b93dcc3f4e0b9ddb470b5b151c3c, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:09.414970 32468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e806bbbaef114dc79f5f192d4bba04dc"
dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
 from {username='slave'} at 127.0.0.1:36634
I20260709 13:12:09.415748 32468 raft_consensus.cc:493] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:09.416181 32468 raft_consensus.cc:3060] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.421046 32619 raft_consensus.cc:2468] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 2.
I20260709 13:12:09.418161 32684 raft_consensus.cc:2804] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:09.424876 32684 raft_consensus.cc:697] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 LEADER]: Becoming Leader. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Running, Role: LEADER
I20260709 13:12:09.425892 32680 consensus_queue.cc:1048] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.425689 32684 consensus_queue.cc:237] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.431566 32698 consensus_queue.cc:1048] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:09.442893 32619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38c12c0d44374defb0d3fe0772227282"
dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
mode: GRACEFUL
new_leader_uuid: "bc96f7a83162437fbb1098501e781191"
 from {username='slave'} at 127.0.0.1:51424
I20260709 13:12:09.443476 32619 raft_consensus.cc:606] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 LEADER]: Received request to transfer leadership to TS bc96f7a83162437fbb1098501e781191
I20260709 13:12:09.442298 32468 raft_consensus.cc:515] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.452345 32619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e40e6ab81f954bd290b342fd6a409f8e"
dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
mode: GRACEFUL
new_leader_uuid: "bc96f7a83162437fbb1098501e781191"
 from {username='slave'} at 127.0.0.1:51424
I20260709 13:12:09.452845 32619 raft_consensus.cc:606] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 LEADER]: Received request to transfer leadership to TS bc96f7a83162437fbb1098501e781191
I20260709 13:12:09.452632 32544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e806bbbaef114dc79f5f192d4bba04dc" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc96f7a83162437fbb1098501e781191"
I20260709 13:12:09.453419 32544 raft_consensus.cc:3055] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:09.453827 32544 raft_consensus.cc:740] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc96f7a83162437fbb1098501e781191, State: Running, Role: LEADER
I20260709 13:12:09.454838 32544 consensus_queue.cc:260] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.458892 32619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2"
dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
mode: GRACEFUL
new_leader_uuid: "bc96f7a83162437fbb1098501e781191"
 from {username='slave'} at 127.0.0.1:51424
I20260709 13:12:09.459475 32619 raft_consensus.cc:606] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 LEADER]: Received request to transfer leadership to TS bc96f7a83162437fbb1098501e781191
I20260709 13:12:09.456238 32544 raft_consensus.cc:3060] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.462563 32366 catalog_manager.cc:5697] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c reported cstate change: term changed from 1 to 2, leader changed from bc96f7a83162437fbb1098501e781191 (127.31.17.130) to 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129). New cstate: current_term: 2 leader_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.468791 32468 leader_election.cc:290] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 2 election: Requested vote from peers bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:09.468887 32619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e806bbbaef114dc79f5f192d4bba04dc" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
I20260709 13:12:09.469513 32619 raft_consensus.cc:3060] T e806bbbaef114dc79f5f192d4bba04dc P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.474907 32544 raft_consensus.cc:2468] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 2.
I20260709 13:12:09.476257 32433 leader_election.cc:304] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6972b93dcc3f4e0b9ddb470b5b151c3c, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:09.477114 32684 raft_consensus.cc:2804] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:09.477577 32684 raft_consensus.cc:697] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 LEADER]: Becoming Leader. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Running, Role: LEADER
I20260709 13:12:09.478379 32684 consensus_queue.cc:237] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.483548 32619 raft_consensus.cc:2468] T e806bbbaef114dc79f5f192d4bba04dc P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 2.
I20260709 13:12:09.489537 32365 catalog_manager.cc:5697] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c reported cstate change: term changed from 1 to 2, leader changed from bc96f7a83162437fbb1098501e781191 (127.31.17.130) to 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129). New cstate: current_term: 2 leader_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.494479 32468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b1edc6149b44705b94fef53f6ec08bf"
dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
mode: GRACEFUL
new_leader_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
 from {username='slave'} at 127.0.0.1:47316
I20260709 13:12:09.495069 32468 raft_consensus.cc:606] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 LEADER]: Received request to transfer leadership to TS 1dc8afd75d694683b609ea9ea60b19c3
I20260709 13:12:09.501466 32688 consensus_queue.cc:1048] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.508376 32669 raft_consensus.cc:993] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3: : Instructing follower bc96f7a83162437fbb1098501e781191 to start an election
I20260709 13:12:09.508833 32669 raft_consensus.cc:1081] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 LEADER]: Signalling peer bc96f7a83162437fbb1098501e781191 to start an election
I20260709 13:12:09.510761 32545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e40e6ab81f954bd290b342fd6a409f8e"
dest_uuid: "bc96f7a83162437fbb1098501e781191"
 from {username='slave'} at 127.0.0.1:52764
I20260709 13:12:09.511612 32545 raft_consensus.cc:493] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:09.511997 32545 raft_consensus.cc:3060] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.514755 32688 consensus_queue.cc:1048] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.518719 32545 raft_consensus.cc:515] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.520848 32545 leader_election.cc:290] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 2 election: Requested vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:09.521916 32469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40e6ab81f954bd290b342fd6a409f8e" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
I20260709 13:12:09.523172 32619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40e6ab81f954bd290b342fd6a409f8e" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
I20260709 13:12:09.523736 32619 raft_consensus.cc:3055] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:09.523998 32619 raft_consensus.cc:740] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Running, Role: LEADER
I20260709 13:12:09.524616 32619 consensus_queue.cc:260] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.525439 32619 raft_consensus.cc:3060] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.530216 32619 raft_consensus.cc:2468] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 2.
I20260709 13:12:09.531448 32509 leader_election.cc:304] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, bc96f7a83162437fbb1098501e781191; no voters: 6972b93dcc3f4e0b9ddb470b5b151c3c
I20260709 13:12:09.532295 32662 raft_consensus.cc:2804] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:09.532716 32662 raft_consensus.cc:697] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 2 LEADER]: Becoming Leader. State: Replica: bc96f7a83162437fbb1098501e781191, State: Running, Role: LEADER
I20260709 13:12:09.533489 32662 consensus_queue.cc:237] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.540787 32367 catalog_manager.cc:5697] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 reported cstate change: term changed from 1 to 2, leader changed from 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131) to bc96f7a83162437fbb1098501e781191 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "bc96f7a83162437fbb1098501e781191" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.591545 32688 consensus_queue.cc:1048] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.601898 32713 consensus_queue.cc:1048] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.608103 32669 raft_consensus.cc:993] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3: : Instructing follower bc96f7a83162437fbb1098501e781191 to start an election
I20260709 13:12:09.608556 32669 raft_consensus.cc:1081] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 LEADER]: Signalling peer bc96f7a83162437fbb1098501e781191 to start an election
I20260709 13:12:09.610396 32713 raft_consensus.cc:993] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3: : Instructing follower bc96f7a83162437fbb1098501e781191 to start an election
I20260709 13:12:09.610567 32544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38c12c0d44374defb0d3fe0772227282"
dest_uuid: "bc96f7a83162437fbb1098501e781191"
 from {username='slave'} at 127.0.0.1:52764
I20260709 13:12:09.610788 32713 raft_consensus.cc:1081] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 LEADER]: Signalling peer bc96f7a83162437fbb1098501e781191 to start an election
I20260709 13:12:09.611326 32544 raft_consensus.cc:493] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:09.611740 32544 raft_consensus.cc:3060] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.612633 32545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2"
dest_uuid: "bc96f7a83162437fbb1098501e781191"
 from {username='slave'} at 127.0.0.1:52764
I20260709 13:12:09.613166 32545 raft_consensus.cc:493] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:09.613533 32545 raft_consensus.cc:3060] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.617533 32544 raft_consensus.cc:515] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.618359 32545 raft_consensus.cc:515] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.619066 32544 leader_election.cc:290] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 2 election: Requested vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:09.619939 32468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c12c0d44374defb0d3fe0772227282" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
I20260709 13:12:09.620059 32619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c12c0d44374defb0d3fe0772227282" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
I20260709 13:12:09.620502 32468 raft_consensus.cc:3060] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.620659 32619 raft_consensus.cc:3055] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:09.621070 32619 raft_consensus.cc:740] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Running, Role: LEADER
I20260709 13:12:09.621867 32619 consensus_queue.cc:260] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.622498 32469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
I20260709 13:12:09.623024 32469 raft_consensus.cc:3060] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.623087 32619 raft_consensus.cc:3060] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.622993 32618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
I20260709 13:12:09.623895 32618 raft_consensus.cc:3055] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:09.624225 32618 raft_consensus.cc:740] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Running, Role: LEADER
I20260709 13:12:09.625006 32618 consensus_queue.cc:260] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.626199 32618 raft_consensus.cc:3060] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.629940 32469 raft_consensus.cc:2468] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 2.
I20260709 13:12:09.630388 32619 raft_consensus.cc:2468] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 2.
I20260709 13:12:09.631006 32511 leader_election.cc:304] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6972b93dcc3f4e0b9ddb470b5b151c3c, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:09.621879 32545 leader_election.cc:290] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 2 election: Requested vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:09.631685 32509 leader_election.cc:304] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:09.631896 32662 raft_consensus.cc:2804] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:09.632516 32680 raft_consensus.cc:2804] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:09.632959 32680 raft_consensus.cc:697] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 2 LEADER]: Becoming Leader. State: Replica: bc96f7a83162437fbb1098501e781191, State: Running, Role: LEADER
I20260709 13:12:09.633371 32468 raft_consensus.cc:2468] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 2.
I20260709 13:12:09.633745 32680 consensus_queue.cc:237] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.634279 32618 raft_consensus.cc:2468] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 2.
I20260709 13:12:09.634786 32662 raft_consensus.cc:697] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 2 LEADER]: Becoming Leader. State: Replica: bc96f7a83162437fbb1098501e781191, State: Running, Role: LEADER
I20260709 13:12:09.635635 32662 consensus_queue.cc:237] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.640226 32365 catalog_manager.cc:5697] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 reported cstate change: term changed from 1 to 2, leader changed from 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131) to bc96f7a83162437fbb1098501e781191 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "bc96f7a83162437fbb1098501e781191" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.650960 32365 catalog_manager.cc:5697] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 reported cstate change: term changed from 1 to 2, leader changed from 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131) to bc96f7a83162437fbb1098501e781191 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "bc96f7a83162437fbb1098501e781191" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.676447 32727 consensus_queue.cc:1048] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.686429 32684 consensus_queue.cc:1048] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.694614 32666 raft_consensus.cc:993] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c: : Instructing follower 1dc8afd75d694683b609ea9ea60b19c3 to start an election
I20260709 13:12:09.695061 32684 raft_consensus.cc:1081] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 LEADER]: Signalling peer 1dc8afd75d694683b609ea9ea60b19c3 to start an election
I20260709 13:12:09.696424 32618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b1edc6149b44705b94fef53f6ec08bf"
dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
 from {username='slave'} at 127.0.0.1:56710
I20260709 13:12:09.696880 32618 raft_consensus.cc:493] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:09.697222 32618 raft_consensus.cc:3060] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.701684 32618 raft_consensus.cc:515] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.703243 32618 leader_election.cc:290] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 2 election: Requested vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525)
I20260709 13:12:09.704305 32468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1edc6149b44705b94fef53f6ec08bf" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
I20260709 13:12:09.704380 32545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1edc6149b44705b94fef53f6ec08bf" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc96f7a83162437fbb1098501e781191"
I20260709 13:12:09.705008 32468 raft_consensus.cc:3055] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:09.705055 32545 raft_consensus.cc:3060] T 1b1edc6149b44705b94fef53f6ec08bf P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.705456 32468 raft_consensus.cc:740] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Running, Role: LEADER
I20260709 13:12:09.706305 32468 consensus_queue.cc:260] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.707532 32468 raft_consensus.cc:3060] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.710186 32545 raft_consensus.cc:2468] T 1b1edc6149b44705b94fef53f6ec08bf P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc8afd75d694683b609ea9ea60b19c3 in term 2.
I20260709 13:12:09.711273 32582 leader_election.cc:304] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:09.711958 32713 raft_consensus.cc:2804] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:09.712409 32713 raft_consensus.cc:697] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 LEADER]: Becoming Leader. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Running, Role: LEADER
I20260709 13:12:09.713202 32713 consensus_queue.cc:237] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.714437 32468 raft_consensus.cc:2468] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc8afd75d694683b609ea9ea60b19c3 in term 2.
I20260709 13:12:09.716933 32698 raft_consensus.cc:993] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191: : Instructing follower 6972b93dcc3f4e0b9ddb470b5b151c3c to start an election
I20260709 13:12:09.717347 32698 raft_consensus.cc:1081] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 1 LEADER]: Signalling peer 6972b93dcc3f4e0b9ddb470b5b151c3c to start an election
I20260709 13:12:09.719592 32469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31723e80ad5a4f539c4d581d23f8ec25"
dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
 from {username='slave'} at 127.0.0.1:36634
I20260709 13:12:09.720108 32469 raft_consensus.cc:493] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:09.720480 32469 raft_consensus.cc:3060] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.721172 32365 catalog_manager.cc:5697] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 reported cstate change: term changed from 1 to 2, leader changed from 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129) to 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131). New cstate: current_term: 2 leader_uuid: "1dc8afd75d694683b609ea9ea60b19c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.726869 32469 raft_consensus.cc:515] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.728662 32469 leader_election.cc:290] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 2 election: Requested vote from peers bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:09.729548 32545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31723e80ad5a4f539c4d581d23f8ec25" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc96f7a83162437fbb1098501e781191"
I20260709 13:12:09.730072 32618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31723e80ad5a4f539c4d581d23f8ec25" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
I20260709 13:12:09.730170 32545 raft_consensus.cc:3055] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:09.730659 32545 raft_consensus.cc:740] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc96f7a83162437fbb1098501e781191, State: Running, Role: LEADER
I20260709 13:12:09.730654 32618 raft_consensus.cc:3060] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.731600 32545 consensus_queue.cc:260] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.732784 32545 raft_consensus.cc:3060] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.737639 32618 raft_consensus.cc:2468] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 2.
I20260709 13:12:09.738739 32434 leader_election.cc:304] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, 6972b93dcc3f4e0b9ddb470b5b151c3c; no voters: 
I20260709 13:12:09.739430 32545 raft_consensus.cc:2468] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 2.
I20260709 13:12:09.739568 32684 raft_consensus.cc:2804] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:09.740120 32684 raft_consensus.cc:697] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 LEADER]: Becoming Leader. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Running, Role: LEADER
I20260709 13:12:09.740909 32684 consensus_queue.cc:237] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:09.746619 32365 catalog_manager.cc:5697] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c reported cstate change: term changed from 1 to 2, leader changed from bc96f7a83162437fbb1098501e781191 (127.31.17.130) to 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129). New cstate: current_term: 2 leader_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.913764 32545 raft_consensus.cc:1275] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Refusing update from remote peer 6972b93dcc3f4e0b9ddb470b5b151c3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:09.915216 32684 consensus_queue.cc:1048] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:09.916808 32469 raft_consensus.cc:3060] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:09.918890 32618 raft_consensus.cc:1275] T e806bbbaef114dc79f5f192d4bba04dc P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Refusing update from remote peer 6972b93dcc3f4e0b9ddb470b5b151c3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:09.920146 32684 consensus_queue.cc:1048] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:09.925632 32469 raft_consensus.cc:1275] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Refusing update from remote peer bc96f7a83162437fbb1098501e781191: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:09.927042 32662 consensus_queue.cc:1048] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:09.936415 32618 raft_consensus.cc:1275] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Refusing update from remote peer bc96f7a83162437fbb1098501e781191: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:09.937928 32698 consensus_queue.cc:1048] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:09.984112 32545 raft_consensus.cc:1275] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Refusing update from remote peer 6972b93dcc3f4e0b9ddb470b5b151c3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:09.985395 32685 consensus_queue.cc:1048] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:09.993286 32618 raft_consensus.cc:1275] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Refusing update from remote peer 6972b93dcc3f4e0b9ddb470b5b151c3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:09.994730 32666 consensus_queue.cc:1048] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:10.140993 32618 raft_consensus.cc:1275] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Refusing update from remote peer bc96f7a83162437fbb1098501e781191: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:10.142218 32698 consensus_queue.cc:1048] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:10.149721 32468 raft_consensus.cc:1275] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Refusing update from remote peer bc96f7a83162437fbb1098501e781191: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:10.151871 32680 consensus_queue.cc:1048] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:10.164266 32468 raft_consensus.cc:1275] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Refusing update from remote peer 1dc8afd75d694683b609ea9ea60b19c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:10.165668 32713 consensus_queue.cc:1048] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:10.173300 32545 raft_consensus.cc:1275] T 1b1edc6149b44705b94fef53f6ec08bf P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Refusing update from remote peer 1dc8afd75d694683b609ea9ea60b19c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:10.173907 32544 raft_consensus.cc:1275] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Refusing update from remote peer 6972b93dcc3f4e0b9ddb470b5b151c3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:10.175887 32684 consensus_queue.cc:1048] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:10.177042 32713 consensus_queue.cc:1048] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:10.194155 32618 raft_consensus.cc:1275] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Refusing update from remote peer 6972b93dcc3f4e0b9ddb470b5b151c3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:10.195537 32685 consensus_queue.cc:1048] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:10.207285 32468 raft_consensus.cc:1275] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Refusing update from remote peer bc96f7a83162437fbb1098501e781191: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:10.208705 32746 consensus_queue.cc:1048] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:10.218603 32618 raft_consensus.cc:1275] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Refusing update from remote peer bc96f7a83162437fbb1098501e781191: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:10.220162 32746 consensus_queue.cc:1048] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:12.529125 31814 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:12:12.529861 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:12.552657 32468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31723e80ad5a4f539c4d581d23f8ec25"
dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
mode: GRACEFUL
new_leader_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
 from {username='slave'} at 127.0.0.1:47328
I20260709 13:12:12.553186 32468 raft_consensus.cc:606] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 LEADER]: Received request to transfer leadership to TS 1dc8afd75d694683b609ea9ea60b19c3
I20260709 13:12:12.555701 32468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c977efa6b8154f1d8253ca9c59efbe17"
dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
mode: GRACEFUL
new_leader_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
 from {username='slave'} at 127.0.0.1:47328
I20260709 13:12:12.556257 32468 raft_consensus.cc:606] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 LEADER]: Received request to transfer leadership to TS 1dc8afd75d694683b609ea9ea60b19c3
I20260709 13:12:12.557482 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:12.557984 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:12.673391 32753 raft_consensus.cc:993] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c: : Instructing follower 1dc8afd75d694683b609ea9ea60b19c3 to start an election
I20260709 13:12:12.673979 32727 raft_consensus.cc:1081] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 LEADER]: Signalling peer 1dc8afd75d694683b609ea9ea60b19c3 to start an election
I20260709 13:12:12.675560 32618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31723e80ad5a4f539c4d581d23f8ec25"
dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
 from {username='slave'} at 127.0.0.1:56710
I20260709 13:12:12.676039 32618 raft_consensus.cc:493] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:12.676385 32618 raft_consensus.cc:3060] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:12.680720 32618 raft_consensus.cc:515] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:12.682096 32618 leader_election.cc:290] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 3 election: Requested vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525)
I20260709 13:12:12.683099 32545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31723e80ad5a4f539c4d581d23f8ec25" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc96f7a83162437fbb1098501e781191"
I20260709 13:12:12.683125 32468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31723e80ad5a4f539c4d581d23f8ec25" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
I20260709 13:12:12.683753 32545 raft_consensus.cc:3060] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:12.683820 32468 raft_consensus.cc:3055] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:12.684223 32468 raft_consensus.cc:740] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Running, Role: LEADER
I20260709 13:12:12.684904 32468 consensus_queue.cc:260] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:12.685784 32468 raft_consensus.cc:3060] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:12.688700 32545 raft_consensus.cc:2468] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc8afd75d694683b609ea9ea60b19c3 in term 3.
I20260709 13:12:12.690678 32582 leader_election.cc:304] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:12.691432 32713 raft_consensus.cc:2804] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:12.691468 32468 raft_consensus.cc:2468] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc8afd75d694683b609ea9ea60b19c3 in term 3.
I20260709 13:12:12.692636 32713 raft_consensus.cc:697] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 LEADER]: Becoming Leader. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Running, Role: LEADER
I20260709 13:12:12.693336 32713 consensus_queue.cc:237] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:12.700537 32367 catalog_manager.cc:5697] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 reported cstate change: term changed from 2 to 3, leader changed from 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129) to 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131). New cstate: current_term: 3 leader_uuid: "1dc8afd75d694683b609ea9ea60b19c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:12.822932 32753 raft_consensus.cc:993] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c: : Instructing follower 1dc8afd75d694683b609ea9ea60b19c3 to start an election
I20260709 13:12:12.823426 32727 raft_consensus.cc:1081] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 LEADER]: Signalling peer 1dc8afd75d694683b609ea9ea60b19c3 to start an election
I20260709 13:12:12.824851 32618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c977efa6b8154f1d8253ca9c59efbe17"
dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
 from {username='slave'} at 127.0.0.1:56710
I20260709 13:12:12.825323 32618 raft_consensus.cc:493] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:12.825608 32618 raft_consensus.cc:3060] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:12.829455 32618 raft_consensus.cc:515] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:12.830914 32618 leader_election.cc:290] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 2 election: Requested vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525)
I20260709 13:12:12.831766 32468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c977efa6b8154f1d8253ca9c59efbe17" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
I20260709 13:12:12.832057 32545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c977efa6b8154f1d8253ca9c59efbe17" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc96f7a83162437fbb1098501e781191"
I20260709 13:12:12.832440 32468 raft_consensus.cc:3055] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:12.832589 32545 raft_consensus.cc:3060] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:12.832801 32468 raft_consensus.cc:740] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Running, Role: LEADER
I20260709 13:12:12.834164 32468 consensus_queue.cc:260] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:12.835698 32468 raft_consensus.cc:3060] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:12.841046 32545 raft_consensus.cc:2468] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc8afd75d694683b609ea9ea60b19c3 in term 2.
I20260709 13:12:12.842746 32582 leader_election.cc:304] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:12.843360 32468 raft_consensus.cc:2468] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc8afd75d694683b609ea9ea60b19c3 in term 2.
I20260709 13:12:12.843688 32713 raft_consensus.cc:2804] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:12.844269 32713 raft_consensus.cc:697] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 LEADER]: Becoming Leader. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Running, Role: LEADER
I20260709 13:12:12.845105 32713 consensus_queue.cc:237] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:12.852316 32367 catalog_manager.cc:5697] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 reported cstate change: term changed from 1 to 2, leader changed from 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129) to 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131). New cstate: current_term: 2 leader_uuid: "1dc8afd75d694683b609ea9ea60b19c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:13.210168 32468 raft_consensus.cc:1275] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 FOLLOWER]: Refusing update from remote peer 1dc8afd75d694683b609ea9ea60b19c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:13.211539 32713 consensus_queue.cc:1048] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:13.229992 32545 raft_consensus.cc:1275] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 3 FOLLOWER]: Refusing update from remote peer 1dc8afd75d694683b609ea9ea60b19c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:13.232442 32754 consensus_queue.cc:1048] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:13.267776 32468 raft_consensus.cc:1275] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Refusing update from remote peer 1dc8afd75d694683b609ea9ea60b19c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:13.268996 32764 consensus_queue.cc:1048] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:13.279122 32545 raft_consensus.cc:1275] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Refusing update from remote peer 1dc8afd75d694683b609ea9ea60b19c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:13.280424 32713 consensus_queue.cc:1048] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:13.558708 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:13.571727 32618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31723e80ad5a4f539c4d581d23f8ec25"
dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
mode: GRACEFUL
new_leader_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
 from {username='slave'} at 127.0.0.1:51424
I20260709 13:12:13.572235 32618 raft_consensus.cc:606] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 LEADER]: Received request to transfer leadership to TS 6972b93dcc3f4e0b9ddb470b5b151c3c
I20260709 13:12:13.580158 32618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c977efa6b8154f1d8253ca9c59efbe17"
dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
mode: GRACEFUL
new_leader_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
 from {username='slave'} at 127.0.0.1:51424
I20260709 13:12:13.580649 32618 raft_consensus.cc:606] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 LEADER]: Received request to transfer leadership to TS 6972b93dcc3f4e0b9ddb470b5b151c3c
I20260709 13:12:13.589020 32545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38c12c0d44374defb0d3fe0772227282"
dest_uuid: "bc96f7a83162437fbb1098501e781191"
mode: GRACEFUL
new_leader_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
 from {username='slave'} at 127.0.0.1:52772
I20260709 13:12:13.589507 32545 raft_consensus.cc:606] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 2 LEADER]: Received request to transfer leadership to TS 6972b93dcc3f4e0b9ddb470b5b151c3c
I20260709 13:12:13.594326 32545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e40e6ab81f954bd290b342fd6a409f8e"
dest_uuid: "bc96f7a83162437fbb1098501e781191"
mode: GRACEFUL
new_leader_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
 from {username='slave'} at 127.0.0.1:52772
I20260709 13:12:13.594835 32545 raft_consensus.cc:606] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 2 LEADER]: Received request to transfer leadership to TS 6972b93dcc3f4e0b9ddb470b5b151c3c
I20260709 13:12:13.600055 32545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2"
dest_uuid: "bc96f7a83162437fbb1098501e781191"
mode: GRACEFUL
new_leader_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
 from {username='slave'} at 127.0.0.1:52772
I20260709 13:12:13.600517 32545 raft_consensus.cc:606] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 2 LEADER]: Received request to transfer leadership to TS 6972b93dcc3f4e0b9ddb470b5b151c3c
I20260709 13:12:13.645782 32754 raft_consensus.cc:993] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3: : Instructing follower 6972b93dcc3f4e0b9ddb470b5b151c3c to start an election
I20260709 13:12:13.646248 32713 raft_consensus.cc:1081] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 LEADER]: Signalling peer 6972b93dcc3f4e0b9ddb470b5b151c3c to start an election
I20260709 13:12:13.647773 32468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31723e80ad5a4f539c4d581d23f8ec25"
dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
 from {username='slave'} at 127.0.0.1:47306
I20260709 13:12:13.648268 32468 raft_consensus.cc:493] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:13.648588 32468 raft_consensus.cc:3060] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:13.653172 32468 raft_consensus.cc:515] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:13.655211 32468 leader_election.cc:290] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 4 election: Requested vote from peers bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:13.656005 32545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31723e80ad5a4f539c4d581d23f8ec25" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bc96f7a83162437fbb1098501e781191"
I20260709 13:12:13.656284 32618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31723e80ad5a4f539c4d581d23f8ec25" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
I20260709 13:12:13.656612 32545 raft_consensus.cc:3060] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:13.656788 32618 raft_consensus.cc:3055] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:13.657151 32618 raft_consensus.cc:740] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Running, Role: LEADER
I20260709 13:12:13.657791 32618 consensus_queue.cc:260] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:13.658694 32618 raft_consensus.cc:3060] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:13.661540 32545 raft_consensus.cc:2468] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 4.
I20260709 13:12:13.662550 32433 leader_election.cc:304] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6972b93dcc3f4e0b9ddb470b5b151c3c, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:13.663044 32618 raft_consensus.cc:2468] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 4.
I20260709 13:12:13.663301 32727 raft_consensus.cc:2804] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:13.664317 32727 raft_consensus.cc:697] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 4 LEADER]: Becoming Leader. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Running, Role: LEADER
I20260709 13:12:13.665050 32727 consensus_queue.cc:237] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:13.670979 32368 catalog_manager.cc:5697] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c reported cstate change: term changed from 3 to 4, leader changed from 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131) to 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129). New cstate: current_term: 4 leader_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:13.757706 32754 raft_consensus.cc:993] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3: : Instructing follower 6972b93dcc3f4e0b9ddb470b5b151c3c to start an election
I20260709 13:12:13.759274 32754 raft_consensus.cc:1081] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 LEADER]: Signalling peer 6972b93dcc3f4e0b9ddb470b5b151c3c to start an election
I20260709 13:12:13.759539 32750 raft_consensus.cc:993] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191: : Instructing follower 6972b93dcc3f4e0b9ddb470b5b151c3c to start an election
I20260709 13:12:13.760478 32750 raft_consensus.cc:1081] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 2 LEADER]: Signalling peer 6972b93dcc3f4e0b9ddb470b5b151c3c to start an election
I20260709 13:12:13.761832 32469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c977efa6b8154f1d8253ca9c59efbe17"
dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
 from {username='slave'} at 127.0.0.1:47306
I20260709 13:12:13.762945 32470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e40e6ab81f954bd290b342fd6a409f8e"
dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
 from {username='slave'} at 127.0.0.1:36634
I20260709 13:12:13.763832 32470 raft_consensus.cc:493] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:13.764151 32470 raft_consensus.cc:3060] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:13.765519   307 raft_consensus.cc:993] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191: : Instructing follower 6972b93dcc3f4e0b9ddb470b5b151c3c to start an election
I20260709 13:12:13.766045 32750 raft_consensus.cc:1081] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 2 LEADER]: Signalling peer 6972b93dcc3f4e0b9ddb470b5b151c3c to start an election
I20260709 13:12:13.768191 32468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38c12c0d44374defb0d3fe0772227282"
dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
 from {username='slave'} at 127.0.0.1:36634
I20260709 13:12:13.768698 32468 raft_consensus.cc:493] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:13.769062 32468 raft_consensus.cc:3060] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:13.762945 32469 raft_consensus.cc:493] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:13.771579 32469 raft_consensus.cc:3060] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:13.774121 32470 raft_consensus.cc:515] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:13.777623 32468 raft_consensus.cc:515] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:13.779006 32545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40e6ab81f954bd290b342fd6a409f8e" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc96f7a83162437fbb1098501e781191"
I20260709 13:12:13.779796 32545 raft_consensus.cc:3055] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:13.780143 32469 raft_consensus.cc:515] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:13.780850 32468 leader_election.cc:290] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 3 election: Requested vote from peers bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:13.782716 32469 leader_election.cc:290] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 3 election: Requested vote from peers bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:13.784827 32619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c977efa6b8154f1d8253ca9c59efbe17" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
I20260709 13:12:13.785589 32619 raft_consensus.cc:3055] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:13.780230 32545 raft_consensus.cc:740] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc96f7a83162437fbb1098501e781191, State: Running, Role: LEADER
I20260709 13:12:13.785966 32619 raft_consensus.cc:740] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Running, Role: LEADER
I20260709 13:12:13.786870 32545 consensus_queue.cc:260] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:13.786983 32619 consensus_queue.cc:260] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:13.788391 32545 raft_consensus.cc:3060] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:13.788512 32619 raft_consensus.cc:3060] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:13.789244 32544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c12c0d44374defb0d3fe0772227282" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc96f7a83162437fbb1098501e781191"
I20260709 13:12:13.789847 32544 raft_consensus.cc:3055] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:13.790159 32544 raft_consensus.cc:740] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc96f7a83162437fbb1098501e781191, State: Running, Role: LEADER
I20260709 13:12:13.791839 32543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c977efa6b8154f1d8253ca9c59efbe17" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc96f7a83162437fbb1098501e781191"
I20260709 13:12:13.792654 32543 raft_consensus.cc:3060] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:13.793354 32618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c12c0d44374defb0d3fe0772227282" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
I20260709 13:12:13.793962 32618 raft_consensus.cc:3060] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:13.795909 32470 leader_election.cc:290] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 3 election: Requested vote from peers bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:13.796491 32544 consensus_queue.cc:260] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:13.797658 32545 raft_consensus.cc:2468] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 3.
I20260709 13:12:13.797674 32616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40e6ab81f954bd290b342fd6a409f8e" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
I20260709 13:12:13.798494 32544 raft_consensus.cc:3060] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:13.798768 32616 raft_consensus.cc:3060] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:13.800102 32433 leader_election.cc:304] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6972b93dcc3f4e0b9ddb470b5b151c3c, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:13.801376 32727 raft_consensus.cc:2804] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:13.801841 32727 raft_consensus.cc:697] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 LEADER]: Becoming Leader. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Running, Role: LEADER
I20260709 13:12:13.802879 32727 consensus_queue.cc:237] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:13.804392 32618 raft_consensus.cc:2468] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 3.
I20260709 13:12:13.805862 32434 leader_election.cc:304] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, 6972b93dcc3f4e0b9ddb470b5b151c3c; no voters: 
I20260709 13:12:13.806819   302 raft_consensus.cc:2804] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:13.807111 32616 raft_consensus.cc:2468] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 3.
I20260709 13:12:13.809592 32619 raft_consensus.cc:2468] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 3.
I20260709 13:12:13.811082 32434 leader_election.cc:304] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, 6972b93dcc3f4e0b9ddb470b5b151c3c; no voters: 
I20260709 13:12:13.811972 32727 raft_consensus.cc:2804] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:13.812559 32727 raft_consensus.cc:697] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 LEADER]: Becoming Leader. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Running, Role: LEADER
I20260709 13:12:13.813638 32727 consensus_queue.cc:237] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:13.819067 32543 raft_consensus.cc:2468] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 3.
I20260709 13:12:13.819489 32544 raft_consensus.cc:2468] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 3.
I20260709 13:12:13.819617 32368 catalog_manager.cc:5697] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c reported cstate change: term changed from 2 to 3, leader changed from bc96f7a83162437fbb1098501e781191 (127.31.17.130) to 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129). New cstate: current_term: 3 leader_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:13.821027   302 raft_consensus.cc:697] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 LEADER]: Becoming Leader. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Running, Role: LEADER
I20260709 13:12:13.822108   302 consensus_queue.cc:237] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:13.840245 32368 catalog_manager.cc:5697] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c reported cstate change: term changed from 2 to 3, leader changed from bc96f7a83162437fbb1098501e781191 (127.31.17.130) to 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129). New cstate: current_term: 3 leader_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:13.841699 32368 catalog_manager.cc:5697] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c reported cstate change: term changed from 2 to 3, leader changed from 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131) to 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129). New cstate: current_term: 3 leader_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:13.904536   307 raft_consensus.cc:993] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191: : Instructing follower 6972b93dcc3f4e0b9ddb470b5b151c3c to start an election
I20260709 13:12:13.904989   307 raft_consensus.cc:1081] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 2 LEADER]: Signalling peer 6972b93dcc3f4e0b9ddb470b5b151c3c to start an election
I20260709 13:12:13.906458 32470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2"
dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
 from {username='slave'} at 127.0.0.1:36634
I20260709 13:12:13.906915 32470 raft_consensus.cc:493] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:13.907181 32470 raft_consensus.cc:3060] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:13.913159 32470 raft_consensus.cc:515] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:13.914996 32470 leader_election.cc:290] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 3 election: Requested vote from peers bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:13.915630 32543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc96f7a83162437fbb1098501e781191"
I20260709 13:12:13.915968 32619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2" candidate_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
I20260709 13:12:13.916224 32543 raft_consensus.cc:3055] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:13.916567 32543 raft_consensus.cc:740] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc96f7a83162437fbb1098501e781191, State: Running, Role: LEADER
I20260709 13:12:13.916607 32619 raft_consensus.cc:3060] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:13.917315 32543 consensus_queue.cc:260] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:13.918254 32543 raft_consensus.cc:3060] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:13.921870 32619 raft_consensus.cc:2468] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 3.
I20260709 13:12:13.922860 32543 raft_consensus.cc:2468] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6972b93dcc3f4e0b9ddb470b5b151c3c in term 3.
I20260709 13:12:13.922952 32434 leader_election.cc:304] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, 6972b93dcc3f4e0b9ddb470b5b151c3c; no voters: 
I20260709 13:12:13.923931 32727 raft_consensus.cc:2804] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:13.924389 32727 raft_consensus.cc:697] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 LEADER]: Becoming Leader. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Running, Role: LEADER
I20260709 13:12:13.925235 32727 consensus_queue.cc:237] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:13.931874 32368 catalog_manager.cc:5697] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c reported cstate change: term changed from 2 to 3, leader changed from bc96f7a83162437fbb1098501e781191 (127.31.17.130) to 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129). New cstate: current_term: 3 leader_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:14.066416 32543 raft_consensus.cc:1275] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 4 FOLLOWER]: Refusing update from remote peer 6972b93dcc3f4e0b9ddb470b5b151c3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:14.067651 32727 consensus_queue.cc:1048] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:14.078907 32619 raft_consensus.cc:1275] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 4 FOLLOWER]: Refusing update from remote peer 6972b93dcc3f4e0b9ddb470b5b151c3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:14.080353   302 consensus_queue.cc:1048] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:14.191520 32619 raft_consensus.cc:1275] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 FOLLOWER]: Refusing update from remote peer 6972b93dcc3f4e0b9ddb470b5b151c3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:14.193029   302 consensus_queue.cc:1048] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:14.203954 32543 raft_consensus.cc:1275] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 3 FOLLOWER]: Refusing update from remote peer 6972b93dcc3f4e0b9ddb470b5b151c3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:14.205785   302 consensus_queue.cc:1048] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:14.301358 32543 raft_consensus.cc:1275] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [term 3 FOLLOWER]: Refusing update from remote peer 6972b93dcc3f4e0b9ddb470b5b151c3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:14.302696   302 consensus_queue.cc:1048] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:14.305580 32616 raft_consensus.cc:1275] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 FOLLOWER]: Refusing update from remote peer 6972b93dcc3f4e0b9ddb470b5b151c3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:14.307013   317 consensus_queue.cc:1048] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:14.314603 32619 raft_consensus.cc:1275] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 FOLLOWER]: Refusing update from remote peer 6972b93dcc3f4e0b9ddb470b5b151c3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:14.317512   309 consensus_queue.cc:1048] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:14.319618 32544 raft_consensus.cc:1275] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 3 FOLLOWER]: Refusing update from remote peer 6972b93dcc3f4e0b9ddb470b5b151c3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:14.324416   302 consensus_queue.cc:1048] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:14.362222 32543 raft_consensus.cc:1275] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 3 FOLLOWER]: Refusing update from remote peer 6972b93dcc3f4e0b9ddb470b5b151c3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:14.363022 32616 raft_consensus.cc:1275] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 FOLLOWER]: Refusing update from remote peer 6972b93dcc3f4e0b9ddb470b5b151c3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:14.363603   302 consensus_queue.cc:1048] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:14.364362   309 consensus_queue.cc:1048] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:16.608459 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:16.615897 32470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1006ed7eb6f94254bdc65be3b03bdf5c"
dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
mode: GRACEFUL
new_leader_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
 from {username='slave'} at 127.0.0.1:47328
I20260709 13:12:16.616420 32470 raft_consensus.cc:606] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 LEADER]: Received request to transfer leadership to TS 1dc8afd75d694683b609ea9ea60b19c3
I20260709 13:12:16.619009 32470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2"
dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
mode: GRACEFUL
new_leader_uuid: "bc96f7a83162437fbb1098501e781191"
 from {username='slave'} at 127.0.0.1:47328
I20260709 13:12:16.619581 32470 raft_consensus.cc:606] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 LEADER]: Received request to transfer leadership to TS bc96f7a83162437fbb1098501e781191
I20260709 13:12:16.621933 32470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38c12c0d44374defb0d3fe0772227282"
dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
mode: GRACEFUL
new_leader_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
 from {username='slave'} at 127.0.0.1:47328
I20260709 13:12:16.622366 32470 raft_consensus.cc:606] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 LEADER]: Received request to transfer leadership to TS 1dc8afd75d694683b609ea9ea60b19c3
I20260709 13:12:16.623293   327 raft_consensus.cc:993] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c: : Instructing follower bc96f7a83162437fbb1098501e781191 to start an election
I20260709 13:12:16.623765   326 raft_consensus.cc:1081] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 LEADER]: Signalling peer bc96f7a83162437fbb1098501e781191 to start an election
I20260709 13:12:16.624711 32470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c977efa6b8154f1d8253ca9c59efbe17"
dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
mode: GRACEFUL
new_leader_uuid: "bc96f7a83162437fbb1098501e781191"
 from {username='slave'} at 127.0.0.1:47328
I20260709 13:12:16.625294 32470 raft_consensus.cc:606] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 LEADER]: Received request to transfer leadership to TS bc96f7a83162437fbb1098501e781191
I20260709 13:12:16.625306 32543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2"
dest_uuid: "bc96f7a83162437fbb1098501e781191"
 from {username='slave'} at 127.0.0.1:58370
I20260709 13:12:16.625903 32543 raft_consensus.cc:493] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:16.626281 32543 raft_consensus.cc:3060] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:16.626556 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:12:16.626945 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:16.631358 32543 raft_consensus.cc:515] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:16.632990 32543 leader_election.cc:290] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 4 election: Requested vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:16.633780 32470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
I20260709 13:12:16.633980 32616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f72b6b2d7c34762b21961e7ec8803f2" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
I20260709 13:12:16.634455 32470 raft_consensus.cc:3055] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:16.634553 32616 raft_consensus.cc:3060] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:16.634848 32470 raft_consensus.cc:740] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Running, Role: LEADER
I20260709 13:12:16.635720 32470 consensus_queue.cc:260] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:16.636750 32470 raft_consensus.cc:3060] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:16.640725 32616 raft_consensus.cc:2468] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 4.
I20260709 13:12:16.642123 32509 leader_election.cc:304] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:16.642982   307 raft_consensus.cc:2804] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:16.643647 32470 raft_consensus.cc:2468] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 4.
I20260709 13:12:16.644130   307 raft_consensus.cc:697] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 4 LEADER]: Becoming Leader. State: Replica: bc96f7a83162437fbb1098501e781191, State: Running, Role: LEADER
I20260709 13:12:16.644937   307 consensus_queue.cc:237] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:16.652787 32367 catalog_manager.cc:5697] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 reported cstate change: term changed from 3 to 4, leader changed from 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129) to bc96f7a83162437fbb1098501e781191 (127.31.17.130). New cstate: current_term: 4 leader_uuid: "bc96f7a83162437fbb1098501e781191" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.708315   327 raft_consensus.cc:993] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c: : Instructing follower 1dc8afd75d694683b609ea9ea60b19c3 to start an election
I20260709 13:12:16.708756   326 raft_consensus.cc:1081] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 LEADER]: Signalling peer 1dc8afd75d694683b609ea9ea60b19c3 to start an election
I20260709 13:12:16.710132 32616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1006ed7eb6f94254bdc65be3b03bdf5c"
dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
 from {username='slave'} at 127.0.0.1:56710
I20260709 13:12:16.710592 32616 raft_consensus.cc:493] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:16.710958 32616 raft_consensus.cc:3060] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.715485 32616 raft_consensus.cc:515] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:16.717216 32616 leader_election.cc:290] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 2 election: Requested vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525)
I20260709 13:12:16.718019 32470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1006ed7eb6f94254bdc65be3b03bdf5c" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
I20260709 13:12:16.718346 32543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1006ed7eb6f94254bdc65be3b03bdf5c" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc96f7a83162437fbb1098501e781191"
I20260709 13:12:16.718668 32470 raft_consensus.cc:3055] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.718926 32543 raft_consensus.cc:3060] T 1006ed7eb6f94254bdc65be3b03bdf5c P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.719049 32470 raft_consensus.cc:740] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Running, Role: LEADER
I20260709 13:12:16.719909 32470 consensus_queue.cc:260] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:16.720834 32470 raft_consensus.cc:3060] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.723825 32543 raft_consensus.cc:2468] T 1006ed7eb6f94254bdc65be3b03bdf5c P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc8afd75d694683b609ea9ea60b19c3 in term 2.
I20260709 13:12:16.724982 32582 leader_election.cc:304] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:16.725688   321 raft_consensus.cc:2804] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.725824 32470 raft_consensus.cc:2468] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc8afd75d694683b609ea9ea60b19c3 in term 2.
I20260709 13:12:16.727115   321 raft_consensus.cc:697] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 LEADER]: Becoming Leader. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Running, Role: LEADER
I20260709 13:12:16.727941   321 consensus_queue.cc:237] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:16.735423 32367 catalog_manager.cc:5697] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3 reported cstate change: term changed from 1 to 2, leader changed from 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129) to 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131). New cstate: current_term: 2 leader_uuid: "1dc8afd75d694683b609ea9ea60b19c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:16.937701   327 raft_consensus.cc:993] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c: : Instructing follower 1dc8afd75d694683b609ea9ea60b19c3 to start an election
I20260709 13:12:16.938148   326 raft_consensus.cc:1081] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 LEADER]: Signalling peer 1dc8afd75d694683b609ea9ea60b19c3 to start an election
I20260709 13:12:16.939442 32619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38c12c0d44374defb0d3fe0772227282"
dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
 from {username='slave'} at 127.0.0.1:56710
I20260709 13:12:16.939827 32619 raft_consensus.cc:493] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:16.940114 32619 raft_consensus.cc:3060] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:16.944568 32619 raft_consensus.cc:515] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:16.945989 32619 leader_election.cc:290] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 4 election: Requested vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525)
I20260709 13:12:16.946826 32470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c12c0d44374defb0d3fe0772227282" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
I20260709 13:12:16.947085 32543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c12c0d44374defb0d3fe0772227282" candidate_uuid: "1dc8afd75d694683b609ea9ea60b19c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bc96f7a83162437fbb1098501e781191"
I20260709 13:12:16.947451 32470 raft_consensus.cc:3055] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:16.947624 32543 raft_consensus.cc:3060] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:16.947835 32470 raft_consensus.cc:740] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Running, Role: LEADER
I20260709 13:12:16.948655 32470 consensus_queue.cc:260] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:16.949802 32470 raft_consensus.cc:3060] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:16.954329 32543 raft_consensus.cc:2468] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc8afd75d694683b609ea9ea60b19c3 in term 4.
I20260709 13:12:16.955485 32582 leader_election.cc:304] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:16.956158   321 raft_consensus.cc:2804] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:16.956089 32470 raft_consensus.cc:2468] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dc8afd75d694683b609ea9ea60b19c3 in term 4.
I20260709 13:12:16.956730   321 raft_consensus.cc:697] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 4 LEADER]: Becoming Leader. State: Replica: 1dc8afd75d694683b609ea9ea60b19c3, State: Running, Role: LEADER
I20260709 13:12:16.957647   321 consensus_queue.cc:237] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:16.964632 32367 catalog_manager.cc:5697] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 reported cstate change: term changed from 3 to 4, leader changed from 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129) to 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131). New cstate: current_term: 4 leader_uuid: "1dc8afd75d694683b609ea9ea60b19c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:17.007745   327 raft_consensus.cc:993] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c: : Instructing follower bc96f7a83162437fbb1098501e781191 to start an election
I20260709 13:12:17.008222   326 raft_consensus.cc:1081] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 LEADER]: Signalling peer bc96f7a83162437fbb1098501e781191 to start an election
I20260709 13:12:17.009650 32543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c977efa6b8154f1d8253ca9c59efbe17"
dest_uuid: "bc96f7a83162437fbb1098501e781191"
 from {username='slave'} at 127.0.0.1:58370
I20260709 13:12:17.010123 32543 raft_consensus.cc:493] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:17.010412 32543 raft_consensus.cc:3060] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:17.015322 32543 raft_consensus.cc:515] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:17.017345 32543 leader_election.cc:290] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 4 election: Requested vote from peers 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679), 1dc8afd75d694683b609ea9ea60b19c3 (127.31.17.131:43251)
I20260709 13:12:17.018091 32470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c977efa6b8154f1d8253ca9c59efbe17" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c"
I20260709 13:12:17.018327 32619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c977efa6b8154f1d8253ca9c59efbe17" candidate_uuid: "bc96f7a83162437fbb1098501e781191" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1dc8afd75d694683b609ea9ea60b19c3"
I20260709 13:12:17.018679 32470 raft_consensus.cc:3055] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:17.018862 32619 raft_consensus.cc:3060] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:17.019088 32470 raft_consensus.cc:740] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6972b93dcc3f4e0b9ddb470b5b151c3c, State: Running, Role: LEADER
I20260709 13:12:17.019953 32470 consensus_queue.cc:260] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:17.021006 32470 raft_consensus.cc:3060] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:17.024014 32619 raft_consensus.cc:2468] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 4.
I20260709 13:12:17.025240 32509 leader_election.cc:304] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8afd75d694683b609ea9ea60b19c3, bc96f7a83162437fbb1098501e781191; no voters: 
I20260709 13:12:17.025929   307 raft_consensus.cc:2804] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:17.025934 32470 raft_consensus.cc:2468] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc96f7a83162437fbb1098501e781191 in term 4.
I20260709 13:12:17.026444   307 raft_consensus.cc:697] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [term 4 LEADER]: Becoming Leader. State: Replica: bc96f7a83162437fbb1098501e781191, State: Running, Role: LEADER
I20260709 13:12:17.027330   307 consensus_queue.cc:237] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } }
I20260709 13:12:17.033710 32367 catalog_manager.cc:5697] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 reported cstate change: term changed from 3 to 4, leader changed from 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129) to bc96f7a83162437fbb1098501e781191 (127.31.17.130). New cstate: current_term: 4 leader_uuid: "bc96f7a83162437fbb1098501e781191" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:17.069844 32470 raft_consensus.cc:1275] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 4 FOLLOWER]: Refusing update from remote peer bc96f7a83162437fbb1098501e781191: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:17.071091   307 consensus_queue.cc:1048] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:17.081844 32619 raft_consensus.cc:1275] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 4 FOLLOWER]: Refusing update from remote peer bc96f7a83162437fbb1098501e781191: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:17.083283   307 consensus_queue.cc:1048] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:17.194015 32543 raft_consensus.cc:1275] T 1006ed7eb6f94254bdc65be3b03bdf5c P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Refusing update from remote peer 1dc8afd75d694683b609ea9ea60b19c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.195148 32470 raft_consensus.cc:1275] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Refusing update from remote peer 1dc8afd75d694683b609ea9ea60b19c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.195356   321 consensus_queue.cc:1048] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.196517   334 consensus_queue.cc:1048] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.396165 32543 raft_consensus.cc:1275] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 4 FOLLOWER]: Refusing update from remote peer 1dc8afd75d694683b609ea9ea60b19c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:17.397442   346 consensus_queue.cc:1048] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc96f7a83162437fbb1098501e781191" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:17.407044 32470 raft_consensus.cc:1275] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 4 FOLLOWER]: Refusing update from remote peer 1dc8afd75d694683b609ea9ea60b19c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:17.408733   346 consensus_queue.cc:1048] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:17.493312 32470 raft_consensus.cc:1275] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 4 FOLLOWER]: Refusing update from remote peer bc96f7a83162437fbb1098501e781191: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:17.494499   307 consensus_queue.cc:1048] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6972b93dcc3f4e0b9ddb470b5b151c3c" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:17.502768 32619 raft_consensus.cc:1275] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 4 FOLLOWER]: Refusing update from remote peer bc96f7a83162437fbb1098501e781191: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:17.504691   328 consensus_queue.cc:1048] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8afd75d694683b609ea9ea60b19c3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:17.627753 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:17.634143 31814 tablet_server.cc:179] TabletServer@127.31.17.129:0 shutting down...
I20260709 13:12:17.662891 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:17.663750 31814 tablet_replica.cc:333] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c: stopping tablet replica
I20260709 13:12:17.664426 31814 raft_consensus.cc:2243] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.664943 31814 raft_consensus.cc:2272] T 1f72b6b2d7c34762b21961e7ec8803f2 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.667762 31814 tablet_replica.cc:333] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c: stopping tablet replica
I20260709 13:12:17.668356 31814 raft_consensus.cc:2243] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:12:17.668829   326 consensus_queue.cc:1175] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1dc8afd75d694683b609ea9ea60b19c3" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:12:17.669816 31814 raft_consensus.cc:2272] T e806bbbaef114dc79f5f192d4bba04dc P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.672061 31814 tablet_replica.cc:333] T 97da594576c04f5c9770cbc44f926a9b P 6972b93dcc3f4e0b9ddb470b5b151c3c: stopping tablet replica
I20260709 13:12:17.672657 31814 raft_consensus.cc:2243] T 97da594576c04f5c9770cbc44f926a9b P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.673105 31814 raft_consensus.cc:2272] T 97da594576c04f5c9770cbc44f926a9b P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.674916 31814 tablet_replica.cc:333] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c: stopping tablet replica
I20260709 13:12:17.675509 31814 raft_consensus.cc:2243] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.676021 31814 raft_consensus.cc:2272] T 38c12c0d44374defb0d3fe0772227282 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.678640 31814 tablet_replica.cc:333] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c: stopping tablet replica
I20260709 13:12:17.679347 31814 raft_consensus.cc:2243] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.680037 31814 raft_consensus.cc:2272] T e40e6ab81f954bd290b342fd6a409f8e P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.681618 31814 tablet_replica.cc:333] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c: stopping tablet replica
I20260709 13:12:17.682121 31814 raft_consensus.cc:2243] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.682819 31814 raft_consensus.cc:2272] T 9f094cd640c140cfab32b929d2db0eac P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.684725 31814 tablet_replica.cc:333] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c: stopping tablet replica
I20260709 13:12:17.685261 31814 raft_consensus.cc:2243] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.685946 31814 raft_consensus.cc:2272] T 31723e80ad5a4f539c4d581d23f8ec25 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.687597 31814 tablet_replica.cc:333] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c: stopping tablet replica
I20260709 13:12:17.688076 31814 raft_consensus.cc:2243] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.688457 31814 raft_consensus.cc:2272] T 1006ed7eb6f94254bdc65be3b03bdf5c P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.690510 31814 tablet_replica.cc:333] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c: stopping tablet replica
I20260709 13:12:17.690985 31814 raft_consensus.cc:2243] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.691458 31814 raft_consensus.cc:2272] T 1b1edc6149b44705b94fef53f6ec08bf P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.693131 31814 tablet_replica.cc:333] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c: stopping tablet replica
I20260709 13:12:17.693585 31814 raft_consensus.cc:2243] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.693959 31814 raft_consensus.cc:2272] T c977efa6b8154f1d8253ca9c59efbe17 P 6972b93dcc3f4e0b9ddb470b5b151c3c [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:17.710520 32511 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.17.129:42679: connect: Connection refused (error 111) [suppressed 4 similar messages]
I20260709 13:12:17.713732 31814 tablet_server.cc:196] TabletServer@127.31.17.129:0 shutdown complete.
W20260709 13:12:17.714785 32511 consensus_peers.cc:597] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 -> Peer 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679): Couldn't send request to peer 6972b93dcc3f4e0b9ddb470b5b151c3c. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:42679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.733242 31814 tablet_server.cc:179] TabletServer@127.31.17.130:0 shutting down...
I20260709 13:12:17.757884 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:17.758661 31814 tablet_replica.cc:333] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191: stopping tablet replica
I20260709 13:12:17.759323 31814 raft_consensus.cc:2243] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.760043 31814 raft_consensus.cc:2272] T 1f72b6b2d7c34762b21961e7ec8803f2 P bc96f7a83162437fbb1098501e781191 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.762004 31814 tablet_replica.cc:333] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191: stopping tablet replica
I20260709 13:12:17.762528 31814 raft_consensus.cc:2243] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.762965 31814 raft_consensus.cc:2272] T e806bbbaef114dc79f5f192d4bba04dc P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.764778 31814 tablet_replica.cc:333] T 1006ed7eb6f94254bdc65be3b03bdf5c P bc96f7a83162437fbb1098501e781191: stopping tablet replica
I20260709 13:12:17.765268 31814 raft_consensus.cc:2243] T 1006ed7eb6f94254bdc65be3b03bdf5c P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.765681 31814 raft_consensus.cc:2272] T 1006ed7eb6f94254bdc65be3b03bdf5c P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.768421 31814 tablet_replica.cc:333] T 1b1edc6149b44705b94fef53f6ec08bf P bc96f7a83162437fbb1098501e781191: stopping tablet replica
I20260709 13:12:17.768929 31814 raft_consensus.cc:2243] T 1b1edc6149b44705b94fef53f6ec08bf P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.769364 31814 raft_consensus.cc:2272] T 1b1edc6149b44705b94fef53f6ec08bf P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.770977 31814 tablet_replica.cc:333] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191: stopping tablet replica
I20260709 13:12:17.771521 31814 raft_consensus.cc:2243] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.772218 31814 raft_consensus.cc:2272] T c977efa6b8154f1d8253ca9c59efbe17 P bc96f7a83162437fbb1098501e781191 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.774217 31814 tablet_replica.cc:333] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191: stopping tablet replica
I20260709 13:12:17.774886 31814 raft_consensus.cc:2243] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.775842 31814 raft_consensus.cc:2272] T 97da594576c04f5c9770cbc44f926a9b P bc96f7a83162437fbb1098501e781191 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.777884 31814 tablet_replica.cc:333] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191: stopping tablet replica
I20260709 13:12:17.778640 31814 raft_consensus.cc:2243] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.779228 31814 raft_consensus.cc:2272] T 38c12c0d44374defb0d3fe0772227282 P bc96f7a83162437fbb1098501e781191 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:17.779282 32582 consensus_peers.cc:597] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3 -> Peer bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525): Couldn't send request to peer bc96f7a83162437fbb1098501e781191. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.781534 31814 tablet_replica.cc:333] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191: stopping tablet replica
I20260709 13:12:17.782095 31814 raft_consensus.cc:2243] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.782536 31814 raft_consensus.cc:2272] T e40e6ab81f954bd290b342fd6a409f8e P bc96f7a83162437fbb1098501e781191 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.784351 31814 tablet_replica.cc:333] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191: stopping tablet replica
I20260709 13:12:17.784845 31814 raft_consensus.cc:2243] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.785312 31814 raft_consensus.cc:2272] T 9f094cd640c140cfab32b929d2db0eac P bc96f7a83162437fbb1098501e781191 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.787111 31814 tablet_replica.cc:333] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191: stopping tablet replica
I20260709 13:12:17.787640 31814 raft_consensus.cc:2243] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.788112 31814 raft_consensus.cc:2272] T 31723e80ad5a4f539c4d581d23f8ec25 P bc96f7a83162437fbb1098501e781191 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:17.795882 32582 consensus_peers.cc:597] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 -> Peer bc96f7a83162437fbb1098501e781191 (127.31.17.130:36525): Couldn't send request to peer bc96f7a83162437fbb1098501e781191. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.819331 31814 tablet_server.cc:196] TabletServer@127.31.17.130:0 shutdown complete.
I20260709 13:12:17.839921 31814 tablet_server.cc:179] TabletServer@127.31.17.131:0 shutting down...
W20260709 13:12:17.853600 32585 consensus_peers.cc:597] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 -> Peer 6972b93dcc3f4e0b9ddb470b5b151c3c (127.31.17.129:42679): Couldn't send request to peer 6972b93dcc3f4e0b9ddb470b5b151c3c. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:42679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.866669 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:17.867547 31814 tablet_replica.cc:333] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3: stopping tablet replica
I20260709 13:12:17.868170 31814 raft_consensus.cc:2243] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.868690 31814 raft_consensus.cc:2272] T 1f72b6b2d7c34762b21961e7ec8803f2 P 1dc8afd75d694683b609ea9ea60b19c3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.870994 31814 tablet_replica.cc:333] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3: stopping tablet replica
I20260709 13:12:17.871627 31814 raft_consensus.cc:2243] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.872107 31814 raft_consensus.cc:2272] T e40e6ab81f954bd290b342fd6a409f8e P 1dc8afd75d694683b609ea9ea60b19c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.873872 31814 tablet_replica.cc:333] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3: stopping tablet replica
I20260709 13:12:17.874450 31814 raft_consensus.cc:2243] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.874910 31814 raft_consensus.cc:2272] T 9f094cd640c140cfab32b929d2db0eac P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.876647 31814 tablet_replica.cc:333] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3: stopping tablet replica
I20260709 13:12:17.877184 31814 raft_consensus.cc:2243] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.877918 31814 raft_consensus.cc:2272] T 1006ed7eb6f94254bdc65be3b03bdf5c P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.880067 31814 tablet_replica.cc:333] T e806bbbaef114dc79f5f192d4bba04dc P 1dc8afd75d694683b609ea9ea60b19c3: stopping tablet replica
I20260709 13:12:17.880615 31814 raft_consensus.cc:2243] T e806bbbaef114dc79f5f192d4bba04dc P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.881057 31814 raft_consensus.cc:2272] T e806bbbaef114dc79f5f192d4bba04dc P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.882754 31814 tablet_replica.cc:333] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3: stopping tablet replica
I20260709 13:12:17.883291 31814 raft_consensus.cc:2243] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.884102 31814 raft_consensus.cc:2272] T 1b1edc6149b44705b94fef53f6ec08bf P 1dc8afd75d694683b609ea9ea60b19c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.885982 31814 tablet_replica.cc:333] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3: stopping tablet replica
I20260709 13:12:17.886541 31814 raft_consensus.cc:2243] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.886965 31814 raft_consensus.cc:2272] T c977efa6b8154f1d8253ca9c59efbe17 P 1dc8afd75d694683b609ea9ea60b19c3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.889138 31814 tablet_replica.cc:333] T 97da594576c04f5c9770cbc44f926a9b P 1dc8afd75d694683b609ea9ea60b19c3: stopping tablet replica
I20260709 13:12:17.889701 31814 raft_consensus.cc:2243] T 97da594576c04f5c9770cbc44f926a9b P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.890132 31814 raft_consensus.cc:2272] T 97da594576c04f5c9770cbc44f926a9b P 1dc8afd75d694683b609ea9ea60b19c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.891973 31814 tablet_replica.cc:333] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3: stopping tablet replica
I20260709 13:12:17.892462 31814 raft_consensus.cc:2243] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.893219 31814 raft_consensus.cc:2272] T 38c12c0d44374defb0d3fe0772227282 P 1dc8afd75d694683b609ea9ea60b19c3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.895349 31814 tablet_replica.cc:333] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3: stopping tablet replica
I20260709 13:12:17.895834 31814 raft_consensus.cc:2243] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.896373 31814 raft_consensus.cc:2272] T 31723e80ad5a4f539c4d581d23f8ec25 P 1dc8afd75d694683b609ea9ea60b19c3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.925348 31814 tablet_server.cc:196] TabletServer@127.31.17.131:0 shutdown complete.
I20260709 13:12:17.943813 31814 master.cc:562] Master@127.31.17.190:40525 shutting down...
I20260709 13:12:17.963876 31814 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.964445 31814 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.964774 31814 tablet_replica.cc:333] T 00000000000000000000000000000000 P 89ed75bc09ef44d9968d71f510cc6952: stopping tablet replica
I20260709 13:12:17.985252 31814 master.cc:584] Master@127.31.17.190:40525 shutdown complete.
1dc8afd75d694683b609ea9ea60b19c3  1
6972b93dcc3f4e0b9ddb470b5b151c3c  5
bc96f7a83162437fbb1098501e781191  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10497 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:12:18.026995 31814 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.31.17.190:46835
I20260709 13:12:18.028224 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:18.033928   356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:18.034075   357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:18.034735   359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:18.035734 31814 server_base.cc:1061] running on GCE node
I20260709 13:12:18.036501 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:18.036688 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:18.036803 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602738036792 us; error 0 us; skew 500 ppm
I20260709 13:12:18.037310 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:18.039759 31814 webserver.cc:533] Webserver started at http://127.31.17.190:40285/ using document root <none> and password file <none>
I20260709 13:12:18.040189 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:18.040343 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:18.040560 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:18.041620 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/master-0-root/instance:
uuid: "958aa06b858546888f102fe85618915c"
format_stamp: "Formatted at 2026-07-09 13:12:18 on dist-test-slave-zhw8"
I20260709 13:12:18.046432 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:18.049707   364 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:18.050560 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:12:18.050915 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/master-0-root
uuid: "958aa06b858546888f102fe85618915c"
format_stamp: "Formatted at 2026-07-09 13:12:18 on dist-test-slave-zhw8"
I20260709 13:12:18.051204 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:18.076897 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:18.078151 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:18.118194 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.190:46835
I20260709 13:12:18.118299   415 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.190:46835 every 8 connection(s)
I20260709 13:12:18.122336   416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.132367   416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c: Bootstrap starting.
I20260709 13:12:18.137130   416 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:18.141302   416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c: No bootstrap required, opened a new log
I20260709 13:12:18.143579   416 raft_consensus.cc:359] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "958aa06b858546888f102fe85618915c" member_type: VOTER }
I20260709 13:12:18.143986   416 raft_consensus.cc:385] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:18.144194   416 raft_consensus.cc:740] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 958aa06b858546888f102fe85618915c, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.144801   416 consensus_queue.cc:260] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "958aa06b858546888f102fe85618915c" member_type: VOTER }
I20260709 13:12:18.145260   416 raft_consensus.cc:399] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:18.145478   416 raft_consensus.cc:493] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:18.145713   416 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:18.150166   416 raft_consensus.cc:515] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "958aa06b858546888f102fe85618915c" member_type: VOTER }
I20260709 13:12:18.150692   416 leader_election.cc:304] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 958aa06b858546888f102fe85618915c; no voters: 
I20260709 13:12:18.152148   416 leader_election.cc:290] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:18.152493   419 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:18.153947   419 raft_consensus.cc:697] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [term 1 LEADER]: Becoming Leader. State: Replica: 958aa06b858546888f102fe85618915c, State: Running, Role: LEADER
I20260709 13:12:18.154717   419 consensus_queue.cc:237] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "958aa06b858546888f102fe85618915c" member_type: VOTER }
I20260709 13:12:18.155445   416 sys_catalog.cc:565] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:18.159487   420 sys_catalog.cc:455] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "958aa06b858546888f102fe85618915c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "958aa06b858546888f102fe85618915c" member_type: VOTER } }
I20260709 13:12:18.160130   420 sys_catalog.cc:458] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:18.160327   421 sys_catalog.cc:455] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 958aa06b858546888f102fe85618915c. Latest consensus state: current_term: 1 leader_uuid: "958aa06b858546888f102fe85618915c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "958aa06b858546888f102fe85618915c" member_type: VOTER } }
I20260709 13:12:18.160966   421 sys_catalog.cc:458] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:18.166925   426 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:18.173005   426 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:18.174002 31814 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:18.182312   426 catalog_manager.cc:1383] Generated new cluster ID: 1f22f73095e0461e9882fef85c80ddb8
I20260709 13:12:18.182613   426 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:18.196681   426 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:18.197927   426 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:18.214711   426 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c: Generated new TSK 0
I20260709 13:12:18.215344   426 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:18.240447 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:18.246337   437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:18.247318   438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:18.249821 31814 server_base.cc:1061] running on GCE node
W20260709 13:12:18.249847   440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:18.250914 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:18.251099 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:18.251272 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602738251218 us; error 0 us; skew 500 ppm
I20260709 13:12:18.251946 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:18.254357 31814 webserver.cc:533] Webserver started at http://127.31.17.129:43259/ using document root <none> and password file <none>
I20260709 13:12:18.254801 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:18.254973 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:18.255177 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:18.256394 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-0-root/instance:
uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
format_stamp: "Formatted at 2026-07-09 13:12:18 on dist-test-slave-zhw8"
I20260709 13:12:18.260787 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:18.264005   446 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:18.264784 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:18.265144 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-0-root
uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
format_stamp: "Formatted at 2026-07-09 13:12:18 on dist-test-slave-zhw8"
I20260709 13:12:18.265413 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:18.278756 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:18.280048 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:18.281580 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:18.283805 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:18.284080 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:18.284430 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:18.284686 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:18.324055 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.129:45711
I20260709 13:12:18.324156   508 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.129:45711 every 8 connection(s)
I20260709 13:12:18.328753 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:18.337213   513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:18.338554   514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:18.341506   516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:18.342283 31814 server_base.cc:1061] running on GCE node
I20260709 13:12:18.343506 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:18.343729 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:18.343927 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602738343907 us; error 0 us; skew 500 ppm
I20260709 13:12:18.344624 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:18.347885 31814 webserver.cc:533] Webserver started at http://127.31.17.130:44419/ using document root <none> and password file <none>
I20260709 13:12:18.348074   509 heartbeater.cc:344] Connected to a master server at 127.31.17.190:46835
I20260709 13:12:18.348512   509 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:18.348521 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:18.348940 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:18.349241 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:18.349351   509 heartbeater.cc:507] Master 127.31.17.190:46835 requested a full tablet report, sending...
I20260709 13:12:18.350625 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-1-root/instance:
uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
format_stamp: "Formatted at 2026-07-09 13:12:18 on dist-test-slave-zhw8"
I20260709 13:12:18.351595   381 ts_manager.cc:194] Registered new tserver with Master: 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:12:18.353396   381 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46008
I20260709 13:12:18.355934 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:12:18.359741   521 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:18.360679 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 13:12:18.360991 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-1-root
uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
format_stamp: "Formatted at 2026-07-09 13:12:18 on dist-test-slave-zhw8"
I20260709 13:12:18.361321 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:18.394057 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:18.395210 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:18.397033 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:18.400668 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:18.400924 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:18.401201 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:18.401412 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:18.440881 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.130:41159
I20260709 13:12:18.441059   583 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.130:41159 every 8 connection(s)
I20260709 13:12:18.445501 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:18.452533   587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:18.454161   588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:18.457736   584 heartbeater.cc:344] Connected to a master server at 127.31.17.190:46835
I20260709 13:12:18.458105   584 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:18.458853   584 heartbeater.cc:507] Master 127.31.17.190:46835 requested a full tablet report, sending...
I20260709 13:12:18.460887   381 ts_manager.cc:194] Registered new tserver with Master: 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:18.461738 31814 server_base.cc:1061] running on GCE node
W20260709 13:12:18.462577   590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:18.462631   381 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46024
I20260709 13:12:18.463675 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:18.463908 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:18.464092 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602738464070 us; error 0 us; skew 500 ppm
I20260709 13:12:18.464625 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:18.466920 31814 webserver.cc:533] Webserver started at http://127.31.17.131:45575/ using document root <none> and password file <none>
I20260709 13:12:18.467574 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:18.467785 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:18.468077 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:18.469175 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-2-root/instance:
uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
format_stamp: "Formatted at 2026-07-09 13:12:18 on dist-test-slave-zhw8"
I20260709 13:12:18.473515 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:18.476781   595 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:18.477696 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:12:18.477943 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-2-root
uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
format_stamp: "Formatted at 2026-07-09 13:12:18 on dist-test-slave-zhw8"
I20260709 13:12:18.478178 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:18.495100 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:18.496318 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:18.497677 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:18.500311 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:18.500559 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:18.500823 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:18.500988 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:18.539774 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.131:36245
I20260709 13:12:18.539960   657 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.131:36245 every 8 connection(s)
I20260709 13:12:18.553229   658 heartbeater.cc:344] Connected to a master server at 127.31.17.190:46835
I20260709 13:12:18.553628   658 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:18.554319   658 heartbeater.cc:507] Master 127.31.17.190:46835 requested a full tablet report, sending...
I20260709 13:12:18.556207   381 ts_manager.cc:194] Registered new tserver with Master: 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:18.557229 31814 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014307705s
I20260709 13:12:18.557674   381 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48622
I20260709 13:12:18.582463   381 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48626:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:18.588734   381 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:18.790139   622 tablet_service.cc:1511] Processing CreateTablet for tablet 15f03a9828994cee972e513efbaaea6a (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:18.790510   623 tablet_service.cc:1511] Processing CreateTablet for tablet dbb5b767a04141fab4e7259cec37f6d7 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:18.791700   622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f03a9828994cee972e513efbaaea6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.795619   620 tablet_service.cc:1511] Processing CreateTablet for tablet 3c5452210928414da7920e467cc1fbda (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:18.795836   621 tablet_service.cc:1511] Processing CreateTablet for tablet ed6b89407f0e4ba28f232c121543a24e (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:18.796293   549 tablet_service.cc:1511] Processing CreateTablet for tablet dbb5b767a04141fab4e7259cec37f6d7 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:18.797367   620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5452210928414da7920e467cc1fbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.797540   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb5b767a04141fab4e7259cec37f6d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.797940   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb5b767a04141fab4e7259cec37f6d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.799222   619 tablet_service.cc:1511] Processing CreateTablet for tablet 67e346d318734aba97a45543ff4ad474 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:18.800563   619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67e346d318734aba97a45543ff4ad474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.800400   548 tablet_service.cc:1511] Processing CreateTablet for tablet 15f03a9828994cee972e513efbaaea6a (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:18.801640   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f03a9828994cee972e513efbaaea6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.804416   547 tablet_service.cc:1511] Processing CreateTablet for tablet ed6b89407f0e4ba28f232c121543a24e (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:18.804867   618 tablet_service.cc:1511] Processing CreateTablet for tablet 1e103c8f4a7e48599f7b9bb07071e6cc (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:18.805704   621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed6b89407f0e4ba28f232c121543a24e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.806463   618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e103c8f4a7e48599f7b9bb07071e6cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.806521   547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed6b89407f0e4ba28f232c121543a24e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.809917   546 tablet_service.cc:1511] Processing CreateTablet for tablet 3c5452210928414da7920e467cc1fbda (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:18.810575   617 tablet_service.cc:1511] Processing CreateTablet for tablet ad6d1c43240c46d49621e3a2fb49b972 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:18.811266   546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5452210928414da7920e467cc1fbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.811960   617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6d1c43240c46d49621e3a2fb49b972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.814020   545 tablet_service.cc:1511] Processing CreateTablet for tablet 67e346d318734aba97a45543ff4ad474 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:18.815600   545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67e346d318734aba97a45543ff4ad474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.817791   473 tablet_service.cc:1511] Processing CreateTablet for tablet 15f03a9828994cee972e513efbaaea6a (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:18.818199   472 tablet_service.cc:1511] Processing CreateTablet for tablet ed6b89407f0e4ba28f232c121543a24e (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:18.819178   473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f03a9828994cee972e513efbaaea6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.819880   468 tablet_service.cc:1511] Processing CreateTablet for tablet ad6d1c43240c46d49621e3a2fb49b972 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:18.820338   471 tablet_service.cc:1511] Processing CreateTablet for tablet 3c5452210928414da7920e467cc1fbda (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:18.821341   468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6d1c43240c46d49621e3a2fb49b972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.822633   470 tablet_service.cc:1511] Processing CreateTablet for tablet 67e346d318734aba97a45543ff4ad474 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:18.828354   470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67e346d318734aba97a45543ff4ad474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.824308   469 tablet_service.cc:1511] Processing CreateTablet for tablet 1e103c8f4a7e48599f7b9bb07071e6cc (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:18.832018   469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e103c8f4a7e48599f7b9bb07071e6cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.825960   467 tablet_service.cc:1511] Processing CreateTablet for tablet 9ade492740624caba667436aa666025c (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:18.836043   467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ade492740624caba667436aa666025c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.840382   673 tablet_bootstrap.cc:492] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:18.827061   474 tablet_service.cc:1511] Processing CreateTablet for tablet dbb5b767a04141fab4e7259cec37f6d7 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:18.849903   544 tablet_service.cc:1511] Processing CreateTablet for tablet 1e103c8f4a7e48599f7b9bb07071e6cc (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:18.850687   543 tablet_service.cc:1511] Processing CreateTablet for tablet ad6d1c43240c46d49621e3a2fb49b972 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:18.853387   544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e103c8f4a7e48599f7b9bb07071e6cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.854066   543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6d1c43240c46d49621e3a2fb49b972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.854468   623 tablet_service.cc:1511] Processing CreateTablet for tablet 9ade492740624caba667436aa666025c (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:18.856475   542 tablet_service.cc:1511] Processing CreateTablet for tablet 9ade492740624caba667436aa666025c (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:18.856160   472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed6b89407f0e4ba28f232c121543a24e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.857771   542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ade492740624caba667436aa666025c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.857818   474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb5b767a04141fab4e7259cec37f6d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.858445   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ade492740624caba667436aa666025c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.865849   468 tablet_service.cc:1511] Processing CreateTablet for tablet 304d1b96642140f19543be15d23a061c (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:18.867905   541 tablet_service.cc:1511] Processing CreateTablet for tablet 304d1b96642140f19543be15d23a061c (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:18.869767   541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304d1b96642140f19543be15d23a061c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.889802   540 tablet_service.cc:1511] Processing CreateTablet for tablet 01c3584d0546405ca79fa6b68e7468ec (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:18.884387   471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5452210928414da7920e467cc1fbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.903929   674 tablet_bootstrap.cc:492] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:18.904083   468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304d1b96642140f19543be15d23a061c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.906852   469 tablet_service.cc:1511] Processing CreateTablet for tablet 01c3584d0546405ca79fa6b68e7468ec (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:18.918169   540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01c3584d0546405ca79fa6b68e7468ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.924894   623 tablet_service.cc:1511] Processing CreateTablet for tablet 01c3584d0546405ca79fa6b68e7468ec (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:18.926250   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01c3584d0546405ca79fa6b68e7468ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.951489   469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01c3584d0546405ca79fa6b68e7468ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.955545   674 tablet_bootstrap.cc:654] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:18.971740   675 tablet_bootstrap.cc:492] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:18.972981   540 tablet_service.cc:1511] Processing CreateTablet for tablet 62cb9f12275c47c4989d775511376bdf (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:18.978206   540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cb9f12275c47c4989d775511376bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.990186   618 tablet_service.cc:1511] Processing CreateTablet for tablet 62cb9f12275c47c4989d775511376bdf (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:18.992002   618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cb9f12275c47c4989d775511376bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:18.998762   471 tablet_service.cc:1511] Processing CreateTablet for tablet 6fc289132926446d9594150727e08b0b (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:19.000010   471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc289132926446d9594150727e08b0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.002712   673 tablet_bootstrap.cc:654] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:18.975987   470 tablet_service.cc:1511] Processing CreateTablet for tablet 62cb9f12275c47c4989d775511376bdf (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:19.004415   470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cb9f12275c47c4989d775511376bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.012624   472 tablet_service.cc:1511] Processing CreateTablet for tablet 12fb4cc9b97f4bab8a7fad87dcdba73c (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:19.013928   472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12fb4cc9b97f4bab8a7fad87dcdba73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.017575   621 tablet_service.cc:1511] Processing CreateTablet for tablet 6fc289132926446d9594150727e08b0b (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:19.019539   621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc289132926446d9594150727e08b0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.020166   620 tablet_service.cc:1511] Processing CreateTablet for tablet 304d1b96642140f19543be15d23a061c (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:19.021610   620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304d1b96642140f19543be15d23a061c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.024686   548 tablet_service.cc:1511] Processing CreateTablet for tablet 6fc289132926446d9594150727e08b0b (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:19.025554   675 tablet_bootstrap.cc:654] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:19.026648   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc289132926446d9594150727e08b0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.028769   547 tablet_service.cc:1511] Processing CreateTablet for tablet 12fb4cc9b97f4bab8a7fad87dcdba73c (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:19.030731   547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12fb4cc9b97f4bab8a7fad87dcdba73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.037263   623 tablet_service.cc:1511] Processing CreateTablet for tablet 12fb4cc9b97f4bab8a7fad87dcdba73c (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:19.038686   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12fb4cc9b97f4bab8a7fad87dcdba73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.049535   674 tablet_bootstrap.cc:492] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:19.050145   674 ts_tablet_manager.cc:1403] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.146s	user 0.039s	sys 0.022s
I20260709 13:12:19.055401   674 raft_consensus.cc:359] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.056123   674 raft_consensus.cc:385] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.056401   674 raft_consensus.cc:740] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.056855   545 tablet_service.cc:1511] Processing CreateTablet for tablet c192fb76f82248d78ddc2aac1d721cd9 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:19.056504   469 tablet_service.cc:1511] Processing CreateTablet for tablet c192fb76f82248d78ddc2aac1d721cd9 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:19.057353   674 consensus_queue.cc:260] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.058188   545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c192fb76f82248d78ddc2aac1d721cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.058399   469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c192fb76f82248d78ddc2aac1d721cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.069432   619 tablet_service.cc:1511] Processing CreateTablet for tablet c192fb76f82248d78ddc2aac1d721cd9 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:19.071409   619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c192fb76f82248d78ddc2aac1d721cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.080245   673 tablet_bootstrap.cc:492] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:19.080879   673 ts_tablet_manager.cc:1403] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.241s	user 0.015s	sys 0.000s
I20260709 13:12:19.090567   471 tablet_service.cc:1511] Processing CreateTablet for tablet ef98285de93a4829880e7892e2b03e6a (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:19.091915   471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef98285de93a4829880e7892e2b03e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.102445   548 tablet_service.cc:1511] Processing CreateTablet for tablet ef98285de93a4829880e7892e2b03e6a (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:19.103965   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef98285de93a4829880e7892e2b03e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.109740   674 ts_tablet_manager.cc:1434] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.059s	user 0.027s	sys 0.010s
I20260709 13:12:19.109575   622 tablet_service.cc:1511] Processing CreateTablet for tablet ef98285de93a4829880e7892e2b03e6a (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:19.110459   509 heartbeater.cc:499] Master 127.31.17.190:46835 was elected leader, sending a full tablet report...
I20260709 13:12:19.110800   674 tablet_bootstrap.cc:492] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:19.110967   622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef98285de93a4829880e7892e2b03e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.112017   542 tablet_service.cc:1511] Processing CreateTablet for tablet eaf3f4dcd2994ae4b21fc89b93484482 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:19.113227   542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf3f4dcd2994ae4b21fc89b93484482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.120021   673 raft_consensus.cc:359] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } }
I20260709 13:12:19.120846   673 raft_consensus.cc:385] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.121212   673 raft_consensus.cc:740] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.122013   673 consensus_queue.cc:260] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } }
I20260709 13:12:19.131031   468 tablet_service.cc:1511] Processing CreateTablet for tablet eaf3f4dcd2994ae4b21fc89b93484482 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:19.132196   674 tablet_bootstrap.cc:654] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:19.132330   468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf3f4dcd2994ae4b21fc89b93484482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.144687   470 tablet_service.cc:1511] Processing CreateTablet for tablet 0ea38de651624cd48fa0e7a5a85467d5 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:19.146062   470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea38de651624cd48fa0e7a5a85467d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.132230   618 tablet_service.cc:1511] Processing CreateTablet for tablet eaf3f4dcd2994ae4b21fc89b93484482 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:19.149996   618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf3f4dcd2994ae4b21fc89b93484482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.176818   673 ts_tablet_manager.cc:1434] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.096s	user 0.009s	sys 0.007s
I20260709 13:12:19.177771   658 heartbeater.cc:499] Master 127.31.17.190:46835 was elected leader, sending a full tablet report...
I20260709 13:12:19.178190   673 tablet_bootstrap.cc:492] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:19.183859   675 tablet_bootstrap.cc:492] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:19.184515   675 ts_tablet_manager.cc:1403] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.213s	user 0.020s	sys 0.025s
W20260709 13:12:19.192646   429 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:19.194416   542 tablet_service.cc:1511] Processing CreateTablet for tablet 0ea38de651624cd48fa0e7a5a85467d5 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:19.195744   542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea38de651624cd48fa0e7a5a85467d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.201327   469 tablet_service.cc:1511] Processing CreateTablet for tablet 578ce25d78a849989220d2a8dcb91233 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:19.201828   674 tablet_bootstrap.cc:492] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:19.202431   674 ts_tablet_manager.cc:1403] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.092s	user 0.032s	sys 0.032s
I20260709 13:12:19.202885   469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 578ce25d78a849989220d2a8dcb91233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.205364   673 tablet_bootstrap.cc:654] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:19.208258   675 raft_consensus.cc:359] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.208999   675 raft_consensus.cc:385] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.209295   675 raft_consensus.cc:740] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.210091   548 tablet_service.cc:1511] Processing CreateTablet for tablet 578ce25d78a849989220d2a8dcb91233 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:19.211380   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 578ce25d78a849989220d2a8dcb91233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.211613   674 raft_consensus.cc:359] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.212343   674 raft_consensus.cc:385] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.212632   674 raft_consensus.cc:740] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.213366   674 consensus_queue.cc:260] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.214293   471 tablet_service.cc:1511] Processing CreateTablet for tablet 227b93e1b31e4b058d5ec1fc69bd6849 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:19.215663   471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 227b93e1b31e4b058d5ec1fc69bd6849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.215813   674 ts_tablet_manager.cc:1434] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:12:19.216701   674 tablet_bootstrap.cc:492] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:19.224350   623 tablet_service.cc:1511] Processing CreateTablet for tablet 578ce25d78a849989220d2a8dcb91233 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:19.210005   675 consensus_queue.cc:260] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.227538   621 tablet_service.cc:1511] Processing CreateTablet for tablet 0ea38de651624cd48fa0e7a5a85467d5 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:19.228945   621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea38de651624cd48fa0e7a5a85467d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.231621   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 578ce25d78a849989220d2a8dcb91233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.231781   674 tablet_bootstrap.cc:654] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:19.240406   547 tablet_service.cc:1511] Processing CreateTablet for tablet 227b93e1b31e4b058d5ec1fc69bd6849 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:19.241742   547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 227b93e1b31e4b058d5ec1fc69bd6849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.242166   618 tablet_service.cc:1511] Processing CreateTablet for tablet 227b93e1b31e4b058d5ec1fc69bd6849 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:19.243422   618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 227b93e1b31e4b058d5ec1fc69bd6849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.245913   679 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.246536   679 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.252554   545 tablet_service.cc:1511] Processing CreateTablet for tablet 82382f158074497a857b03f9f87f9e86 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:19.254509   545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82382f158074497a857b03f9f87f9e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.259761   622 tablet_service.cc:1511] Processing CreateTablet for tablet 82382f158074497a857b03f9f87f9e86 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:19.260512   679 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:19.261104   622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82382f158074497a857b03f9f87f9e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.262159   673 tablet_bootstrap.cc:492] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:19.262794   673 ts_tablet_manager.cc:1403] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.085s	user 0.007s	sys 0.004s
I20260709 13:12:19.278107   673 raft_consensus.cc:359] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.278889   673 raft_consensus.cc:385] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.279188   673 raft_consensus.cc:740] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.281572   673 consensus_queue.cc:260] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.286063   673 ts_tablet_manager.cc:1434] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:12:19.280351   675 ts_tablet_manager.cc:1434] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.095s	user 0.009s	sys 0.005s
I20260709 13:12:19.290171   584 heartbeater.cc:499] Master 127.31.17.190:46835 was elected leader, sending a full tablet report...
I20260709 13:12:19.291843   471 tablet_service.cc:1511] Processing CreateTablet for tablet 82382f158074497a857b03f9f87f9e86 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:19.293109   471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82382f158074497a857b03f9f87f9e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.309038   546 tablet_service.cc:1511] Processing CreateTablet for tablet d74f5d3a02ed490499ba666721531edc (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:19.309278   620 tablet_service.cc:1511] Processing CreateTablet for tablet d74f5d3a02ed490499ba666721531edc (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:19.291843   619 tablet_service.cc:1511] Processing CreateTablet for tablet 0a36746135a640a4916e9d4d974ce2b3 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:19.310532   620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d74f5d3a02ed490499ba666721531edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.311717   469 tablet_service.cc:1511] Processing CreateTablet for tablet 0a36746135a640a4916e9d4d974ce2b3 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:19.312108   674 tablet_bootstrap.cc:492] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:19.312609   674 ts_tablet_manager.cc:1403] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.096s	user 0.021s	sys 0.019s
I20260709 13:12:19.312913   469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a36746135a640a4916e9d4d974ce2b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.315285   546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d74f5d3a02ed490499ba666721531edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.315587   619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a36746135a640a4916e9d4d974ce2b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.315641   674 raft_consensus.cc:359] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.316458   674 raft_consensus.cc:385] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.316772   674 raft_consensus.cc:740] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.317484   674 consensus_queue.cc:260] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.325196   674 ts_tablet_manager.cc:1434] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:12:19.326264   674 tablet_bootstrap.cc:492] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:19.332918   674 tablet_bootstrap.cc:654] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:19.340075   548 tablet_service.cc:1511] Processing CreateTablet for tablet 0a36746135a640a4916e9d4d974ce2b3 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:19.337718   673 tablet_bootstrap.cc:492] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:19.341614   675 tablet_bootstrap.cc:492] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:19.347741   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a36746135a640a4916e9d4d974ce2b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.356412   470 tablet_service.cc:1511] Processing CreateTablet for tablet d74f5d3a02ed490499ba666721531edc (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:19.356761   468 tablet_service.cc:1511] Processing CreateTablet for tablet 3253e2dfadea481ea66147319ece61c5 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:19.357842   470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d74f5d3a02ed490499ba666721531edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.344056   547 tablet_service.cc:1511] Processing CreateTablet for tablet 3253e2dfadea481ea66147319ece61c5 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:19.359884   468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3253e2dfadea481ea66147319ece61c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.364197   472 tablet_service.cc:1511] Processing CreateTablet for tablet e4bd90dfa0b4483dae082de5ca5e77f0 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:19.364642   679 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.365502   472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4bd90dfa0b4483dae082de5ca5e77f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.365163   679 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.366295   620 tablet_service.cc:1511] Processing CreateTablet for tablet e4bd90dfa0b4483dae082de5ca5e77f0 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:19.367633   679 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:19.368306   620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4bd90dfa0b4483dae082de5ca5e77f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.370266   618 tablet_service.cc:1511] Processing CreateTablet for tablet 4ac2ec9819fa4c2193431a046e90dd6e (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:19.371479   618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ac2ec9819fa4c2193431a046e90dd6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.380579   673 tablet_bootstrap.cc:654] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:19.380340   623 tablet_service.cc:1511] Processing CreateTablet for tablet 3253e2dfadea481ea66147319ece61c5 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:19.381685   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3253e2dfadea481ea66147319ece61c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.384272   474 tablet_service.cc:1511] Processing CreateTablet for tablet 4ac2ec9819fa4c2193431a046e90dd6e (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:19.385576   474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ac2ec9819fa4c2193431a046e90dd6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.391968   542 tablet_service.cc:1511] Processing CreateTablet for tablet e4bd90dfa0b4483dae082de5ca5e77f0 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:19.359884   547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3253e2dfadea481ea66147319ece61c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.393247   542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4bd90dfa0b4483dae082de5ca5e77f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.384303   545 tablet_service.cc:1511] Processing CreateTablet for tablet 4ac2ec9819fa4c2193431a046e90dd6e (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:19.401335   545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ac2ec9819fa4c2193431a046e90dd6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.401669   679 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.402132   679 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.402329   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:19.403050   558 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:19.404130   679 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:19.405299   448 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:19.405207   541 tablet_service.cc:1511] Processing CreateTablet for tablet 44f95c82063d490481f1c94cc64f7311 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:19.401552   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:19.406508   541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f95c82063d490481f1c94cc64f7311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.407996   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:12:19.410418   448 leader_election.cc:343] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:19.412104   448 leader_election.cc:343] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:19.409891   679 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:19.415680   679 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.416110   679 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:19.416337   622 tablet_service.cc:1511] Processing CreateTablet for tablet 44f95c82063d490481f1c94cc64f7311 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:19.417744   622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f95c82063d490481f1c94cc64f7311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.421423   540 tablet_service.cc:1511] Processing CreateTablet for tablet df062554d8014455b179c819406964fb (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:19.422720   540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df062554d8014455b179c819406964fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.423410   617 tablet_service.cc:1511] Processing CreateTablet for tablet df062554d8014455b179c819406964fb (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:19.425417   617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df062554d8014455b179c819406964fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.444985   674 tablet_bootstrap.cc:492] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:19.445446   674 ts_tablet_manager.cc:1403] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.119s	user 0.007s	sys 0.010s
I20260709 13:12:19.448698   474 tablet_service.cc:1511] Processing CreateTablet for tablet 44f95c82063d490481f1c94cc64f7311 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:19.451541   474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f95c82063d490481f1c94cc64f7311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.451602   673 tablet_bootstrap.cc:492] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:19.452142   673 ts_tablet_manager.cc:1403] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.150s	user 0.003s	sys 0.009s
I20260709 13:12:19.455058   673 raft_consensus.cc:359] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.455781   673 raft_consensus.cc:385] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.455842   675 tablet_bootstrap.cc:654] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:19.456139   673 raft_consensus.cc:740] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.448880   674 raft_consensus.cc:359] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.457607   674 raft_consensus.cc:385] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.457942   674 raft_consensus.cc:740] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.458786   547 tablet_service.cc:1511] Processing CreateTablet for tablet 4e472c1c82c9467a9a5563d6b06e3b53 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:19.458952   674 consensus_queue.cc:260] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.458844   623 tablet_service.cc:1511] Processing CreateTablet for tablet 4e472c1c82c9467a9a5563d6b06e3b53 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:19.460767   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e472c1c82c9467a9a5563d6b06e3b53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.461068   471 tablet_service.cc:1511] Processing CreateTablet for tablet df062554d8014455b179c819406964fb (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:19.462364   471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df062554d8014455b179c819406964fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.460328   547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e472c1c82c9467a9a5563d6b06e3b53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.464224   546 tablet_service.cc:1511] Processing CreateTablet for tablet 99b1684e65e840ce8bcb13346b86d204 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:19.465682   546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b1684e65e840ce8bcb13346b86d204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.468662   673 consensus_queue.cc:260] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.470538   468 tablet_service.cc:1511] Processing CreateTablet for tablet 4e472c1c82c9467a9a5563d6b06e3b53 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:19.471830   468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e472c1c82c9467a9a5563d6b06e3b53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.478070   673 ts_tablet_manager.cc:1434] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.003s
I20260709 13:12:19.479086   673 tablet_bootstrap.cc:492] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:19.484911   679 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.487740   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:19.488317   559 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:19.492987   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:19.493685   633 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:19.493968   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:19.494606   617 tablet_service.cc:1511] Processing CreateTablet for tablet 99b1684e65e840ce8bcb13346b86d204 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:19.494913   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:19.495296   559 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:19.495913   617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b1684e65e840ce8bcb13346b86d204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.496587   448 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:19.497704   690 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:19.504947   674 ts_tablet_manager.cc:1434] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.059s	user 0.014s	sys 0.005s
I20260709 13:12:19.506326   472 tablet_service.cc:1511] Processing CreateTablet for tablet 99b1684e65e840ce8bcb13346b86d204 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:19.507982   472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b1684e65e840ce8bcb13346b86d204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.508721   679 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:19.514335   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:19.514160   544 tablet_service.cc:1511] Processing CreateTablet for tablet 54372ad9508c44d2824f4810f03a5081 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:19.516215   544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54372ad9508c44d2824f4810f03a5081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.527529   680 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.528087   680 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.528267   620 tablet_service.cc:1511] Processing CreateTablet for tablet 54372ad9508c44d2824f4810f03a5081 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:19.529597   620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54372ad9508c44d2824f4810f03a5081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.543295   674 tablet_bootstrap.cc:492] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:19.542994   546 tablet_service.cc:1511] Processing CreateTablet for tablet f221a3b77aba453e80c06e1de30b76aa (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:19.544307   546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f221a3b77aba453e80c06e1de30b76aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.544783   675 tablet_bootstrap.cc:492] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:19.545267   675 ts_tablet_manager.cc:1403] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.242s	user 0.006s	sys 0.006s
I20260709 13:12:19.547585   680 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:19.558907   447 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:12:19.560199   447 leader_election.cc:343] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:19.560670   679 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:19.560640   447 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:19.561115   679 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.561443   679 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:19.561789   447 leader_election.cc:343] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:19.562716   673 tablet_bootstrap.cc:654] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:19.562680   447 leader_election.cc:343] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:19.555855   675 raft_consensus.cc:359] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.566054   675 raft_consensus.cc:385] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.566344   675 raft_consensus.cc:740] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.555686   690 raft_consensus.cc:697] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:19.566879   540 tablet_service.cc:1511] Processing CreateTablet for tablet ec13b3c82acf4ef9a2eb79441f61a80d (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:19.580464   674 tablet_bootstrap.cc:654] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:19.580803   540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec13b3c82acf4ef9a2eb79441f61a80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.579636   691 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:19.591075   548 tablet_service.cc:1511] Processing CreateTablet for tablet 596735598d7c4404a9c62f5a3a6c475c (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:19.592516   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596735598d7c4404a9c62f5a3a6c475c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.576448   675 consensus_queue.cc:260] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.595355   547 tablet_service.cc:1511] Processing CreateTablet for tablet 5436dcd825914fdca953dd01eb60ec88 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:19.596101   690 consensus_queue.cc:237] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.596674   547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5436dcd825914fdca953dd01eb60ec88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.596383   470 tablet_service.cc:1511] Processing CreateTablet for tablet 54372ad9508c44d2824f4810f03a5081 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:19.597610   470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54372ad9508c44d2824f4810f03a5081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.600862   471 tablet_service.cc:1511] Processing CreateTablet for tablet ec13b3c82acf4ef9a2eb79441f61a80d (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:19.601047   468 tablet_service.cc:1511] Processing CreateTablet for tablet f221a3b77aba453e80c06e1de30b76aa (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:19.602084   471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec13b3c82acf4ef9a2eb79441f61a80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.604598   469 tablet_service.cc:1511] Processing CreateTablet for tablet 596735598d7c4404a9c62f5a3a6c475c (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:19.605225   473 tablet_service.cc:1511] Processing CreateTablet for tablet b5fe583d0f84434a92093dc2407b787f (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:19.605836   469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596735598d7c4404a9c62f5a3a6c475c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.606433   473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5fe583d0f84434a92093dc2407b787f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.607213   675 ts_tablet_manager.cc:1434] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.002s
I20260709 13:12:19.608312   467 tablet_service.cc:1511] Processing CreateTablet for tablet 5436dcd825914fdca953dd01eb60ec88 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:19.623512   468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f221a3b77aba453e80c06e1de30b76aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.624266   467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5436dcd825914fdca953dd01eb60ec88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.634562   675 tablet_bootstrap.cc:492] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:19.641709   620 tablet_service.cc:1511] Processing CreateTablet for tablet ec13b3c82acf4ef9a2eb79441f61a80d (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:19.644814   622 tablet_service.cc:1511] Processing CreateTablet for tablet 596735598d7c4404a9c62f5a3a6c475c (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:19.645843   620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec13b3c82acf4ef9a2eb79441f61a80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.646700   617 tablet_service.cc:1511] Processing CreateTablet for tablet f221a3b77aba453e80c06e1de30b76aa (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:19.646848   623 tablet_service.cc:1511] Processing CreateTablet for tablet 5436dcd825914fdca953dd01eb60ec88 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:19.650527   622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596735598d7c4404a9c62f5a3a6c475c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.660836   617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f221a3b77aba453e80c06e1de30b76aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.654014   680 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.661895   680 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } }
I20260709 13:12:19.663080   621 tablet_service.cc:1511] Processing CreateTablet for tablet b5fe583d0f84434a92093dc2407b787f (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:19.666136   621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5fe583d0f84434a92093dc2407b787f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.667917   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5436dcd825914fdca953dd01eb60ec88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.664543   680 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:19.576923   679 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.676678   679 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:19.677384   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:19.678022   559 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:19.681591   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:19.683065   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:12:19.684880   599 leader_election.cc:343] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:19.684962   559 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
W20260709 13:12:19.685708   599 leader_election.cc:343] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:19.686728   448 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:19.686882   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:19.687469   632 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:19.687613   679 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:19.690853   679 raft_consensus.cc:697] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:19.691702   679 consensus_queue.cc:237] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.694892   542 tablet_service.cc:1511] Processing CreateTablet for tablet 72b49b729462465a98ad914bf7ba3c10 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:19.696483   542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b49b729462465a98ad914bf7ba3c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.705124   675 tablet_bootstrap.cc:654] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:19.706156   541 tablet_service.cc:1511] Processing CreateTablet for tablet b5fe583d0f84434a92093dc2407b787f (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:19.722229   674 tablet_bootstrap.cc:492] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:19.722738   674 ts_tablet_manager.cc:1403] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.197s	user 0.040s	sys 0.023s
I20260709 13:12:19.724223   691 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.724457   473 tablet_service.cc:1511] Processing CreateTablet for tablet 18dea61d0790411c88602b2cfc2fbcdb (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:19.724699   691 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.726933   691 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:19.726791   618 tablet_service.cc:1511] Processing CreateTablet for tablet 72b49b729462465a98ad914bf7ba3c10 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:19.728124   618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b49b729462465a98ad914bf7ba3c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.728890   673 tablet_bootstrap.cc:492] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:19.729357   673 ts_tablet_manager.cc:1403] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.250s	user 0.032s	sys 0.036s
I20260709 13:12:19.731474   674 raft_consensus.cc:359] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.732209   674 raft_consensus.cc:385] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.732496   674 raft_consensus.cc:740] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.732445   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:19.733955   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:12:19.734349   448 leader_election.cc:343] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:19.725762   473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18dea61d0790411c88602b2cfc2fbcdb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:19.735378   447 leader_election.cc:343] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:19.735809   447 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:19.735667   673 raft_consensus.cc:359] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.736424   673 raft_consensus.cc:385] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.736753   673 raft_consensus.cc:740] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.737484   673 consensus_queue.cc:260] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.738303   691 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:19.741094   674 consensus_queue.cc:260] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.743355   674 ts_tablet_manager.cc:1434] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.008s
I20260709 13:12:19.744256   674 tablet_bootstrap.cc:492] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:19.744665   632 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:19.749992   541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5fe583d0f84434a92093dc2407b787f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.750587   674 tablet_bootstrap.cc:654] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:19.751832   474 tablet_service.cc:1511] Processing CreateTablet for tablet 72b49b729462465a98ad914bf7ba3c10 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:19.755436   474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b49b729462465a98ad914bf7ba3c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.759274   679 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.769060   472 tablet_service.cc:1511] Processing CreateTablet for tablet 049523b511884708bc0ac5adea131bc6 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:19.769641   544 tablet_service.cc:1511] Processing CreateTablet for tablet 049523b511884708bc0ac5adea131bc6 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:19.770361   472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049523b511884708bc0ac5adea131bc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.770802   544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049523b511884708bc0ac5adea131bc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.773538   379 catalog_manager.cc:5697] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:19.764986   679 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.777261   679 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:19.779461   673 ts_tablet_manager.cc:1434] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.004s
I20260709 13:12:19.779585   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:12:19.786707   448 leader_election.cc:343] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:19.780377   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:19.782701   619 tablet_service.cc:1511] Processing CreateTablet for tablet 049523b511884708bc0ac5adea131bc6 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:19.787542   680 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.787680   632 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:19.780526   621 tablet_service.cc:1511] Processing CreateTablet for tablet 18dea61d0790411c88602b2cfc2fbcdb (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:19.788075   680 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.789872   673 tablet_bootstrap.cc:492] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:19.786463   466 tablet_service.cc:1511] Processing CreateTablet for tablet 727ef43c64e147b3889a02b94ab53253 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:19.795591   466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 727ef43c64e147b3889a02b94ab53253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.790431   547 tablet_service.cc:1511] Processing CreateTablet for tablet 18dea61d0790411c88602b2cfc2fbcdb (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:19.788482   619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049523b511884708bc0ac5adea131bc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.791752   447 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:19.819164   679 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:19.819590   679 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.819923   679 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:19.819962   674 tablet_bootstrap.cc:492] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:19.820060   540 tablet_service.cc:1511] Processing CreateTablet for tablet 727ef43c64e147b3889a02b94ab53253 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:19.820613   674 ts_tablet_manager.cc:1403] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.077s	user 0.003s	sys 0.012s
I20260709 13:12:19.823390   621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18dea61d0790411c88602b2cfc2fbcdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.823922   674 raft_consensus.cc:359] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.824628   674 raft_consensus.cc:385] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.824903   674 raft_consensus.cc:740] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.827767   547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18dea61d0790411c88602b2cfc2fbcdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.828576   540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 727ef43c64e147b3889a02b94ab53253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.831725   673 tablet_bootstrap.cc:654] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:19.834530   674 consensus_queue.cc:260] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.837756   675 tablet_bootstrap.cc:492] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:19.838248   675 ts_tablet_manager.cc:1403] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.204s	user 0.010s	sys 0.005s
I20260709 13:12:19.841173   675 raft_consensus.cc:359] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.841866   675 raft_consensus.cc:385] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.842166   675 raft_consensus.cc:740] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.842974   675 consensus_queue.cc:260] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.844915   470 tablet_service.cc:1511] Processing CreateTablet for tablet cb12c292ec5d439b896dcc135d266150 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:19.847644   470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb12c292ec5d439b896dcc135d266150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.853250   617 tablet_service.cc:1511] Processing CreateTablet for tablet 727ef43c64e147b3889a02b94ab53253 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:19.854655   617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 727ef43c64e147b3889a02b94ab53253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.857312   674 ts_tablet_manager.cc:1434] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:12:19.853291   675 ts_tablet_manager.cc:1434] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:12:19.859915   623 tablet_service.cc:1511] Processing CreateTablet for tablet cb12c292ec5d439b896dcc135d266150 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:19.860788   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb12c292ec5d439b896dcc135d266150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.861948   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:19.862304   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:12:19.863744   597 leader_election.cc:343] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:19.864187   597 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:19.864240   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:19.865271   674 tablet_bootstrap.cc:492] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:19.865480   483 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:19.862676   542 tablet_service.cc:1511] Processing CreateTablet for tablet cb12c292ec5d439b896dcc135d266150 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:19.866760   599 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:19.864187   680 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:19.875473   548 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9a9d4a92fc4cadac1b3bf82763cfc0 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:19.880964   542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb12c292ec5d439b896dcc135d266150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.877904   680 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:19.899789   680 raft_consensus.cc:2804] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:19.900166   680 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.900493   680 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:19.904551   546 tablet_service.cc:1511] Processing CreateTablet for tablet 7b20e1b9bdf8473682b642fe0b3c0583 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:19.905812   546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b20e1b9bdf8473682b642fe0b3c0583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.903026   675 tablet_bootstrap.cc:492] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:19.918246   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9a9d4a92fc4cadac1b3bf82763cfc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.944589   549 tablet_service.cc:1511] Processing CreateTablet for tablet 372575938bbf471c935e1b39ba9e588f (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:19.945842   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372575938bbf471c935e1b39ba9e588f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.952083   473 tablet_service.cc:1511] Processing CreateTablet for tablet 372575938bbf471c935e1b39ba9e588f (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:19.952347   472 tablet_service.cc:1511] Processing CreateTablet for tablet 12805530d9a3471aa3d5b4c086cc454a (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:19.953397   473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372575938bbf471c935e1b39ba9e588f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.954276   467 tablet_service.cc:1511] Processing CreateTablet for tablet d37a8f9254954f1f9db70e23a26e512b (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:19.957165   467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d37a8f9254954f1f9db70e23a26e512b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.959976   545 tablet_service.cc:1511] Processing CreateTablet for tablet 12805530d9a3471aa3d5b4c086cc454a (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:19.961182   545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12805530d9a3471aa3d5b4c086cc454a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.962842   472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12805530d9a3471aa3d5b4c086cc454a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.931613   680 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.966864   680 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:19.970652   541 tablet_service.cc:1511] Processing CreateTablet for tablet d37a8f9254954f1f9db70e23a26e512b (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:19.972251   541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d37a8f9254954f1f9db70e23a26e512b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:19.937083   470 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9a9d4a92fc4cadac1b3bf82763cfc0 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:19.882216   679 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:19.935891   674 tablet_bootstrap.cc:654] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:19.984174   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 117496us
I20260709 13:12:19.995435   679 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:19.997828   673 tablet_bootstrap.cc:492] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:19.998955   673 ts_tablet_manager.cc:1403] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.209s	user 0.045s	sys 0.069s
I20260709 13:12:19.999289   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:19.999398   466 tablet_service.cc:1511] Processing CreateTablet for tablet 7b20e1b9bdf8473682b642fe0b3c0583 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:19.999887   483 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.004294   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:19.998955   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:20.005944   632 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.008229   471 tablet_service.cc:1511] Processing CreateTablet for tablet 9140b212cfde4d8d83cbe538fc50d88d (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 13:12:20.008258   448 leader_election.cc:343] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.012270   675 tablet_bootstrap.cc:654] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.011801   544 tablet_service.cc:1511] Processing CreateTablet for tablet 9140b212cfde4d8d83cbe538fc50d88d (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:20.013712   632 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:20.014988   447 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:20.016266   679 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.017948   679 raft_consensus.cc:697] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:20.016702   544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9140b212cfde4d8d83cbe538fc50d88d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.018841   679 consensus_queue.cc:237] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.020197   683 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.020650   483 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:20.020723   683 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.021993   599 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:20.024461   703 raft_consensus.cc:2804] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.024966   703 raft_consensus.cc:697] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:20.025805   703 consensus_queue.cc:237] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:19.986987   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 123393us
W20260709 13:12:20.036618   597 leader_election.cc:343] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.037084   597 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:20.024972   683 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:20.041254   705 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:20.044626   470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9a9d4a92fc4cadac1b3bf82763cfc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.045572   474 tablet_service.cc:1511] Processing CreateTablet for tablet 658ec34f01e349a4b86604b64fb8b9be (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:20.046836   474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 658ec34f01e349a4b86604b64fb8b9be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.047499   471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9140b212cfde4d8d83cbe538fc50d88d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.054122   466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b20e1b9bdf8473682b642fe0b3c0583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.073644   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:20.090673   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:20.096832   621 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9a9d4a92fc4cadac1b3bf82763cfc0 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:20.098213   621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9a9d4a92fc4cadac1b3bf82763cfc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.101763   469 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7fddd60ae54606847dc6f4111a7e30 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:20.103005   469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7fddd60ae54606847dc6f4111a7e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.102667   549 tablet_service.cc:1511] Processing CreateTablet for tablet 4d2f65eaa10d4428a49b5f1ed8b939f1 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:20.102717   673 raft_consensus.cc:359] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.103184   468 tablet_service.cc:1511] Processing CreateTablet for tablet 4d2f65eaa10d4428a49b5f1ed8b939f1 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:20.103626   673 raft_consensus.cc:385] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.104018   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2f65eaa10d4428a49b5f1ed8b939f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.104370   468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2f65eaa10d4428a49b5f1ed8b939f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.103951   673 raft_consensus.cc:740] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
W20260709 13:12:20.111342   447 consensus_peers.cc:597] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 -> Peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Couldn't send request to peer 50f7c2247be24f3685d7fbca7b6c71e3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:20.108541   547 tablet_service.cc:1511] Processing CreateTablet for tablet 658ec34f01e349a4b86604b64fb8b9be (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:20.115341   690 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.128098   673 consensus_queue.cc:260] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.123358   546 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7fddd60ae54606847dc6f4111a7e30 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:20.122663   620 tablet_service.cc:1511] Processing CreateTablet for tablet d37a8f9254954f1f9db70e23a26e512b (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:20.130668   620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d37a8f9254954f1f9db70e23a26e512b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.123718   622 tablet_service.cc:1511] Processing CreateTablet for tablet 372575938bbf471c935e1b39ba9e588f (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:20.128631   690 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.132076   622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372575938bbf471c935e1b39ba9e588f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.121017   619 tablet_service.cc:1511] Processing CreateTablet for tablet 12805530d9a3471aa3d5b4c086cc454a (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:20.135339   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:20.136050   619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12805530d9a3471aa3d5b4c086cc454a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:20.136904   448 leader_election.cc:343] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.137681   679 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:20.140671   690 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:20.141525   674 tablet_bootstrap.cc:492] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:20.141921   675 tablet_bootstrap.cc:492] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:20.142220   674 ts_tablet_manager.cc:1403] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.277s	user 0.011s	sys 0.005s
I20260709 13:12:20.142441   675 ts_tablet_manager.cc:1403] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.240s	user 0.011s	sys 0.008s
I20260709 13:12:20.142557   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:12:20.144208   447 leader_election.cc:343] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.129110   547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 658ec34f01e349a4b86604b64fb8b9be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.152819   703 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.153487   703 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.156098   623 tablet_service.cc:1511] Processing CreateTablet for tablet 9140b212cfde4d8d83cbe538fc50d88d (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:20.157109   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9140b212cfde4d8d83cbe538fc50d88d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.161160   675 raft_consensus.cc:359] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.162019   675 raft_consensus.cc:385] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.162345   675 raft_consensus.cc:740] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.163455   675 consensus_queue.cc:260] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.165880   675 ts_tablet_manager.cc:1434] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:12:20.166625   546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7fddd60ae54606847dc6f4111a7e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.175733   673 ts_tablet_manager.cc:1434] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.176s	user 0.008s	sys 0.002s
I20260709 13:12:20.176973   673 tablet_bootstrap.cc:492] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:20.144780   447 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:20.182401   679 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:20.188719   618 tablet_service.cc:1511] Processing CreateTablet for tablet 658ec34f01e349a4b86604b64fb8b9be (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:20.189029   616 tablet_service.cc:1511] Processing CreateTablet for tablet 4d2f65eaa10d4428a49b5f1ed8b939f1 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 13:12:20.189519   597 leader_election.cc:343] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.190227   618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 658ec34f01e349a4b86604b64fb8b9be. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:20.190430   597 leader_election.cc:343] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.190852   615 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7fddd60ae54606847dc6f4111a7e30 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:20.197582   615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7fddd60ae54606847dc6f4111a7e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.214771   679 consensus_queue.cc:1048] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:20.216223   616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2f65eaa10d4428a49b5f1ed8b939f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.170346   379 catalog_manager.cc:5697] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:20.220281   617 tablet_service.cc:1511] Processing CreateTablet for tablet 7b20e1b9bdf8473682b642fe0b3c0583 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 13:12:20.227717   429 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:20.231328   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:20.234532   470 tablet_service.cc:1511] Processing CreateTablet for tablet 70cfcc65b0e14d6cb141bc839a21b558 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:20.240263   542 tablet_service.cc:1511] Processing CreateTablet for tablet 70cfcc65b0e14d6cb141bc839a21b558 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:20.241652   471 tablet_service.cc:1511] Processing CreateTablet for tablet b1c23e2e725f4945b79fe36fc271ccc2 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:20.242277   542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70cfcc65b0e14d6cb141bc839a21b558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.226835   380 catalog_manager.cc:5697] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:20.248322   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:20.248498   679 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:20.247928   470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70cfcc65b0e14d6cb141bc839a21b558. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:20.251133   525 leader_election.cc:343] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.251641   617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b20e1b9bdf8473682b642fe0b3c0583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.253971   674 raft_consensus.cc:359] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.254776   674 raft_consensus.cc:385] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.263398   703 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:20.263130   545 tablet_service.cc:1511] Processing CreateTablet for tablet b1c23e2e725f4945b79fe36fc271ccc2 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:20.265146   545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c23e2e725f4945b79fe36fc271ccc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.264632   379 catalog_manager.cc:5697] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:20.230029   675 tablet_bootstrap.cc:492] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:20.269903   471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c23e2e725f4945b79fe36fc271ccc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.272380   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:20.255144   674 raft_consensus.cc:740] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.295765   674 consensus_queue.cc:260] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.298100   674 ts_tablet_manager.cc:1434] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.155s	user 0.008s	sys 0.000s
I20260709 13:12:20.285655   541 tablet_service.cc:1511] Processing CreateTablet for tablet 5153b5ac109e49b78fd24ec7f42e3c8e (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:20.299201   541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5153b5ac109e49b78fd24ec7f42e3c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.304126   674 tablet_bootstrap.cc:492] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:20.292699   673 tablet_bootstrap.cc:654] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.292527   619 tablet_service.cc:1511] Processing CreateTablet for tablet 70cfcc65b0e14d6cb141bc839a21b558 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:20.281736   597 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:20.305716   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:20.323181   703 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:20.306288   474 tablet_service.cc:1511] Processing CreateTablet for tablet d2131bd04d2d4f3da62d75b100a2aecd (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:20.306563   472 tablet_service.cc:1511] Processing CreateTablet for tablet 569fc6eae3e44f9db61c22838e11247d (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:20.313177   675 tablet_bootstrap.cc:654] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.288760   547 tablet_service.cc:1511] Processing CreateTablet for tablet d2131bd04d2d4f3da62d75b100a2aecd (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:20.321892   619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70cfcc65b0e14d6cb141bc839a21b558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.326638   547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2131bd04d2d4f3da62d75b100a2aecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.335417   474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2131bd04d2d4f3da62d75b100a2aecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.336293   472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 569fc6eae3e44f9db61c22838e11247d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.335902   546 tablet_service.cc:1511] Processing CreateTablet for tablet 569fc6eae3e44f9db61c22838e11247d (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 13:12:20.324882   522 leader_election.cc:343] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.346239   522 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:20.347468   683 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:20.347851   620 tablet_service.cc:1511] Processing CreateTablet for tablet b1c23e2e725f4945b79fe36fc271ccc2 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:20.349030   620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c23e2e725f4945b79fe36fc271ccc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.352623   473 tablet_service.cc:1511] Processing CreateTablet for tablet 6316a42e235d497f96a57da84ac62c84 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:20.353909   473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6316a42e235d497f96a57da84ac62c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.353981   621 tablet_service.cc:1511] Processing CreateTablet for tablet 5153b5ac109e49b78fd24ec7f42e3c8e (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:20.356036   623 tablet_service.cc:1511] Processing CreateTablet for tablet 569fc6eae3e44f9db61c22838e11247d (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:20.352627   622 tablet_service.cc:1511] Processing CreateTablet for tablet d2131bd04d2d4f3da62d75b100a2aecd (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:20.363817   621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5153b5ac109e49b78fd24ec7f42e3c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.378891   622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2131bd04d2d4f3da62d75b100a2aecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.384804   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 569fc6eae3e44f9db61c22838e11247d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:20.385783   715 log.cc:927] Time spent T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:12:20.378922   614 tablet_service.cc:1511] Processing CreateTablet for tablet 6316a42e235d497f96a57da84ac62c84 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:20.386881   542 tablet_service.cc:1511] Processing CreateTablet for tablet 093a5bf347e94e52af24456f0631abe3 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:20.388075   542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 093a5bf347e94e52af24456f0631abe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.393090   683 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.393577   683 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.394600   674 tablet_bootstrap.cc:654] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.359182   468 tablet_service.cc:1511] Processing CreateTablet for tablet 5153b5ac109e49b78fd24ec7f42e3c8e (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:20.399729   546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 569fc6eae3e44f9db61c22838e11247d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.404052   467 tablet_service.cc:1511] Processing CreateTablet for tablet 9108c5fc44794002b60442bd66404e6c (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:20.411620   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:20.413479   471 tablet_service.cc:1511] Processing CreateTablet for tablet 093a5bf347e94e52af24456f0631abe3 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:20.415726   547 tablet_service.cc:1511] Processing CreateTablet for tablet 6316a42e235d497f96a57da84ac62c84 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:20.417266   547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6316a42e235d497f96a57da84ac62c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.418797   471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 093a5bf347e94e52af24456f0631abe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.421612   616 tablet_service.cc:1511] Processing CreateTablet for tablet 093a5bf347e94e52af24456f0631abe3 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:20.422358   614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6316a42e235d497f96a57da84ac62c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.429482   616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 093a5bf347e94e52af24456f0631abe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.431495   673 tablet_bootstrap.cc:492] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:20.432037   673 ts_tablet_manager.cc:1403] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.255s	user 0.021s	sys 0.040s
I20260709 13:12:20.417434   483 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:20.442695   683 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:20.453912   467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9108c5fc44794002b60442bd66404e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.435142   673 raft_consensus.cc:359] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.464587   547 tablet_service.cc:1511] Processing CreateTablet for tablet 9108c5fc44794002b60442bd66404e6c (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:20.465937   547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9108c5fc44794002b60442bd66404e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.466413   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:12:20.468412   522 leader_election.cc:343] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.472559   468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5153b5ac109e49b78fd24ec7f42e3c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.479092   675 tablet_bootstrap.cc:492] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:20.479614   675 ts_tablet_manager.cc:1403] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.257s	user 0.016s	sys 0.024s
I20260709 13:12:20.491839   675 raft_consensus.cc:359] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.492558   675 raft_consensus.cc:385] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.492863   675 raft_consensus.cc:740] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.460191   673 raft_consensus.cc:385] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.495404   673 raft_consensus.cc:740] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.505462   673 consensus_queue.cc:260] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.507699   673 ts_tablet_manager.cc:1434] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.003s
I20260709 13:12:20.510838   673 tablet_bootstrap.cc:492] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
W20260709 13:12:20.503741   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 54757.6us
I20260709 13:12:20.513410   541 tablet_service.cc:1511] Processing CreateTablet for tablet ac7da405058744b49aee8b0adbc78189 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:20.513568   525 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:20.514478   683 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:20.514823   683 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.515143   683 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.527735   683 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.536244   541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac7da405058744b49aee8b0adbc78189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.539822   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:12:20.542874   522 leader_election.cc:343] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.546193   621 tablet_service.cc:1511] Processing CreateTablet for tablet ac7da405058744b49aee8b0adbc78189 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:20.547501   621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac7da405058744b49aee8b0adbc78189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.535161   683 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:20.552755   617 tablet_service.cc:1511] Processing CreateTablet for tablet 9108c5fc44794002b60442bd66404e6c (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:20.554101   617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9108c5fc44794002b60442bd66404e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.555217   673 tablet_bootstrap.cc:654] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.544064   675 consensus_queue.cc:260] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.563644   675 ts_tablet_manager.cc:1434] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.001s
I20260709 13:12:20.564606   675 tablet_bootstrap.cc:492] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:20.584120   474 tablet_service.cc:1511] Processing CreateTablet for tablet ac7da405058744b49aee8b0adbc78189 (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:20.588377   474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac7da405058744b49aee8b0adbc78189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.592769   674 tablet_bootstrap.cc:492] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:20.593254   674 ts_tablet_manager.cc:1403] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.289s	user 0.010s	sys 0.005s
I20260709 13:12:20.595806   674 raft_consensus.cc:359] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } }
W20260709 13:12:20.596448   597 consensus_peers.cc:597] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:20.596478   674 raft_consensus.cc:385] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.597221   674 raft_consensus.cc:740] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.597510   545 tablet_service.cc:1511] Processing CreateTablet for tablet b6c11587863a4a73ae8fca1c867e545d (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:20.597824   674 consensus_queue.cc:260] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } }
I20260709 13:12:20.598863   545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c11587863a4a73ae8fca1c867e545d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.600111   674 ts_tablet_manager.cc:1434] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:20.604784   631 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.605189   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:20.605818   483 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.606168   467 tablet_service.cc:1511] Processing CreateTablet for tablet b6c11587863a4a73ae8fca1c867e545d (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:20.607514   467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c11587863a4a73ae8fca1c867e545d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.610361   675 tablet_bootstrap.cc:654] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.615734   674 tablet_bootstrap.cc:492] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:20.616333   483 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:20.621008   525 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:20.621807   723 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.622311   723 raft_consensus.cc:697] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:20.623270   723 consensus_queue.cc:237] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.623793   726 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:12:20.632344   617 tablet_service.cc:1511] Processing CreateTablet for tablet b6c11587863a4a73ae8fca1c867e545d (DEFAULT_TABLE table=test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:20.631711   703 consensus_queue.cc:1048] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:12:20.644590   673 tablet_bootstrap.cc:492] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:20.656621   673 ts_tablet_manager.cc:1403] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.146s	user 0.019s	sys 0.003s
I20260709 13:12:20.659487   673 raft_consensus.cc:359] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.660161   673 raft_consensus.cc:385] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.660439   673 raft_consensus.cc:740] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.661325   674 tablet_bootstrap.cc:654] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.661160   673 consensus_queue.cc:260] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.653620   379 catalog_manager.cc:5697] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:20.664278   448 consensus_peers.cc:597] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:20.666446   673 ts_tablet_manager.cc:1434] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:12:20.671165   617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c11587863a4a73ae8fca1c867e545d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:20.673038   674 tablet_bootstrap.cc:492] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:20.673473   674 ts_tablet_manager.cc:1403] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.058s	user 0.004s	sys 0.007s
I20260709 13:12:20.673360   723 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.674050   723 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.676362   674 raft_consensus.cc:359] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.677196   674 raft_consensus.cc:385] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.677524   674 raft_consensus.cc:740] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.677702   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:20.678129   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:20.678381   484 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:20.678704   632 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:20.679556   703 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.680050   703 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.680423   522 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:20.681156   675 tablet_bootstrap.cc:492] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:20.681692   675 ts_tablet_manager.cc:1403] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.009s
I20260709 13:12:20.682017   723 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:20.682179   703 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:20.682619   683 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:20.688035   683 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.688421   683 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.691982   673 tablet_bootstrap.cc:492] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:20.695001   683 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.698272   673 tablet_bootstrap.cc:654] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.698076   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:20.698727   482 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.706322   482 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:20.707541   525 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:20.708371   723 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.678602   674 consensus_queue.cc:260] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.716044   674 ts_tablet_manager.cc:1434] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:12:20.716950   674 tablet_bootstrap.cc:492] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:20.721086   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:20.721699   631 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.684581   675 raft_consensus.cc:359] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } }
I20260709 13:12:20.685076   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:20.725948   675 raft_consensus.cc:385] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.726141   558 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:20.726346   675 raft_consensus.cc:740] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.727468   597 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:20.727151   675 consensus_queue.cc:260] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } }
I20260709 13:12:20.686463   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:20.728468   484 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:20.729756   726 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.730034   675 ts_tablet_manager.cc:1434] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:12:20.730235   726 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } }
I20260709 13:12:20.731057   675 tablet_bootstrap.cc:492] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:20.732065   726 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:20.732865   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:20.733588   705 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:20.733727   632 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:20.734376   683 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:20.732965   631 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:20.735901   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:20.736048   447 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:20.733125   723 raft_consensus.cc:697] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:20.736485   558 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:20.737510   726 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:20.737869   726 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.738206   726 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.739820   675 tablet_bootstrap.cc:654] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.740605   674 tablet_bootstrap.cc:654] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.744005   723 consensus_queue.cc:237] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.744647   726 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } }
I20260709 13:12:20.745620   675 tablet_bootstrap.cc:492] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:20.746138   675 ts_tablet_manager.cc:1403] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.006s
I20260709 13:12:20.747540   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:20.748136   631 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.748399   673 tablet_bootstrap.cc:492] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:20.748831   673 ts_tablet_manager.cc:1403] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.057s	user 0.007s	sys 0.015s
I20260709 13:12:20.748762   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:20.749436   558 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.749432   675 raft_consensus.cc:359] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.750404   675 raft_consensus.cc:385] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.750770   675 raft_consensus.cc:740] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.751425   673 raft_consensus.cc:359] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.752113   673 raft_consensus.cc:385] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.751595   675 consensus_queue.cc:260] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.733981   705 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.752393   673 raft_consensus.cc:740] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.754274   675 ts_tablet_manager.cc:1434] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:20.757793   558 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:20.755957   631 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:20.762485   675 tablet_bootstrap.cc:492] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:20.762816   447 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:20.763975   724 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.758430   674 tablet_bootstrap.cc:492] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:20.764495   724 raft_consensus.cc:697] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:20.765337   674 ts_tablet_manager.cc:1403] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.003s
I20260709 13:12:20.761684   673 consensus_queue.cc:260] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.765372   724 consensus_queue.cc:237] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } }
I20260709 13:12:20.766135   705 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.768400   674 raft_consensus.cc:359] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.769063   674 raft_consensus.cc:385] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.769325   674 raft_consensus.cc:740] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.769958   674 consensus_queue.cc:260] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.770725   675 tablet_bootstrap.cc:654] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.770278   379 catalog_manager.cc:5697] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:20.772262   674 ts_tablet_manager.cc:1434] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:20.773175   674 tablet_bootstrap.cc:492] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:20.773348   705 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.776046   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:20.776667   484 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.778594   673 ts_tablet_manager.cc:1434] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:12:20.756444   726 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:20.779527   673 tablet_bootstrap.cc:492] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:20.788178   674 tablet_bootstrap.cc:654] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.792268   705 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:20.793845   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:20.794513   559 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.794468   379 catalog_manager.cc:5697] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:20.796197   675 tablet_bootstrap.cc:492] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:20.796628   675 ts_tablet_manager.cc:1403] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.009s
I20260709 13:12:20.799256   675 raft_consensus.cc:359] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.799865   675 raft_consensus.cc:385] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.800124   675 raft_consensus.cc:740] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.800711   675 consensus_queue.cc:260] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.802625   675 ts_tablet_manager.cc:1434] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:20.803509   675 tablet_bootstrap.cc:492] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:20.804483   674 tablet_bootstrap.cc:492] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:20.804962   674 ts_tablet_manager.cc:1403] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.003s
I20260709 13:12:20.807648   674 raft_consensus.cc:359] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.808292   674 raft_consensus.cc:385] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.808555   674 raft_consensus.cc:740] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.809321   675 tablet_bootstrap.cc:654] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.813226   559 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:20.809332   674 consensus_queue.cc:260] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.814903   597 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:20.815734   705 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.816186   705 raft_consensus.cc:697] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:20.816390   484 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:20.816916   674 ts_tablet_manager.cc:1434] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:12:20.817628   705 consensus_queue.cc:237] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.827948   674 tablet_bootstrap.cc:492] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:20.829687   675 tablet_bootstrap.cc:492] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:20.830293   675 ts_tablet_manager.cc:1403] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.011s
I20260709 13:12:20.821828   673 tablet_bootstrap.cc:654] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.832923   675 raft_consensus.cc:359] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.833640   675 raft_consensus.cc:385] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.833904   675 raft_consensus.cc:740] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.834554   675 consensus_queue.cc:260] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.834986   674 tablet_bootstrap.cc:654] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.839951   675 ts_tablet_manager.cc:1434] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:12:20.840891   675 tablet_bootstrap.cc:492] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:20.843961   380 catalog_manager.cc:5697] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:20.846379   674 tablet_bootstrap.cc:492] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:20.846498   675 tablet_bootstrap.cc:654] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.847012   674 ts_tablet_manager.cc:1403] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 13:12:20.849850   674 raft_consensus.cc:359] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.850508   674 raft_consensus.cc:385] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.850768   674 raft_consensus.cc:740] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.851099   724 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.851557   724 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.851485   674 consensus_queue.cc:260] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.853562   724 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:20.853807   674 ts_tablet_manager.cc:1434] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:12:20.854701   674 tablet_bootstrap.cc:492] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:20.856117   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:20.856734   559 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:20.858952   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:20.860493   674 tablet_bootstrap.cc:654] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:20.864650   447 leader_election.cc:343] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.865592   448 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:20.867724   726 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:20.868110   726 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.868455   726 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.870496   673 tablet_bootstrap.cc:492] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:20.870935   673 ts_tablet_manager.cc:1403] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.005s
I20260709 13:12:20.871548   675 tablet_bootstrap.cc:492] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:20.871956   675 ts_tablet_manager.cc:1403] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.006s
I20260709 13:12:20.873703   673 raft_consensus.cc:359] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.874337   673 raft_consensus.cc:385] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.874374   675 raft_consensus.cc:359] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.874696   673 raft_consensus.cc:740] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.875074   675 raft_consensus.cc:385] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.875367   675 raft_consensus.cc:740] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.875561   673 consensus_queue.cc:260] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.876086   675 consensus_queue.cc:260] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.877923   675 ts_tablet_manager.cc:1434] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:20.879079   675 tablet_bootstrap.cc:492] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:20.884755   675 tablet_bootstrap.cc:654] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.885018   726 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.888610   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:20.889317   559 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.891484   673 ts_tablet_manager.cc:1434] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.003s
I20260709 13:12:20.897562   673 tablet_bootstrap.cc:492] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:20.899814   675 tablet_bootstrap.cc:492] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:20.900276   675 ts_tablet_manager.cc:1403] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 13:12:20.903075   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:20.904224   726 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:20.903028   675 raft_consensus.cc:359] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.904858   675 raft_consensus.cc:385] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:20.904887   447 leader_election.cc:343] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.905303   675 raft_consensus.cc:740] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.906111   674 tablet_bootstrap.cc:492] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:20.905975   675 consensus_queue.cc:260] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.906539   674 ts_tablet_manager.cc:1403] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.022s
I20260709 13:12:20.906590   673 tablet_bootstrap.cc:654] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.907881   675 ts_tablet_manager.cc:1434] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:12:20.903362   559 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:20.908885   675 tablet_bootstrap.cc:492] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:20.908833   448 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:20.909601   674 raft_consensus.cc:359] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.910184   674 raft_consensus.cc:385] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.910394   674 raft_consensus.cc:740] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.910856   726 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.911041   674 consensus_queue.cc:260] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.911638   726 raft_consensus.cc:697] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:20.912542   726 consensus_queue.cc:237] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.913314   674 ts_tablet_manager.cc:1434] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:20.914314   674 tablet_bootstrap.cc:492] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:20.914682   675 tablet_bootstrap.cc:654] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.919590   674 tablet_bootstrap.cc:654] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.924580   673 tablet_bootstrap.cc:492] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:20.925140   673 ts_tablet_manager.cc:1403] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.006s
I20260709 13:12:20.925913   674 tablet_bootstrap.cc:492] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:20.926398   674 ts_tablet_manager.cc:1403] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:12:20.927644   675 tablet_bootstrap.cc:492] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:20.927309   673 raft_consensus.cc:359] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.927961   673 raft_consensus.cc:385] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.928081   675 ts_tablet_manager.cc:1403] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:12:20.928236   673 raft_consensus.cc:740] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.929035   673 consensus_queue.cc:260] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.929306   674 raft_consensus.cc:359] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.930050   674 raft_consensus.cc:385] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.930375   674 raft_consensus.cc:740] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.930732   675 raft_consensus.cc:359] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.931393   675 raft_consensus.cc:385] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.931129   674 consensus_queue.cc:260] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.931682   675 raft_consensus.cc:740] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.933333   674 ts_tablet_manager.cc:1434] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:20.933122   380 catalog_manager.cc:5697] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:20.934517   674 tablet_bootstrap.cc:492] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:20.934235   675 consensus_queue.cc:260] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.936275   675 ts_tablet_manager.cc:1434] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:20.937077   675 tablet_bootstrap.cc:492] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:20.933357   673 ts_tablet_manager.cc:1434] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:12:20.939970   673 tablet_bootstrap.cc:492] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:20.941176   674 tablet_bootstrap.cc:654] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.945397   673 tablet_bootstrap.cc:654] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.950500   675 tablet_bootstrap.cc:654] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.952735   674 tablet_bootstrap.cc:492] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:20.953299   674 ts_tablet_manager.cc:1403] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:12:20.956604   674 raft_consensus.cc:359] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.957647   674 raft_consensus.cc:385] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.958050   674 raft_consensus.cc:740] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.959000   674 consensus_queue.cc:260] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.962210   674 ts_tablet_manager.cc:1434] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:20.963589   674 tablet_bootstrap.cc:492] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:20.971586   674 tablet_bootstrap.cc:654] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.984179   674 tablet_bootstrap.cc:492] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:20.984637   674 ts_tablet_manager.cc:1403] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:12:20.985646   673 tablet_bootstrap.cc:492] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:20.986085   673 ts_tablet_manager.cc:1403] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.046s	user 0.026s	sys 0.014s
I20260709 13:12:20.987036   675 tablet_bootstrap.cc:492] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:20.986927   674 raft_consensus.cc:359] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.987494   675 ts_tablet_manager.cc:1403] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.051s	user 0.025s	sys 0.016s
I20260709 13:12:20.987550   674 raft_consensus.cc:385] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.987965   674 raft_consensus.cc:740] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.988063   705 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.988480   705 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.988606   673 raft_consensus.cc:359] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.988768   674 consensus_queue.cc:260] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.989305   673 raft_consensus.cc:385] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.989632   673 raft_consensus.cc:740] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.990263   675 raft_consensus.cc:359] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.990383   673 consensus_queue.cc:260] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.990808   705 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:20.992329   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:20.994599   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:20.995428   484 raft_consensus.cc:2393] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:12:20.995613   675 raft_consensus.cc:385] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.995903   675 raft_consensus.cc:740] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.996644   675 consensus_queue.cc:260] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.997824   673 ts_tablet_manager.cc:1434] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:12:20.998546   726 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.999017   726 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:20.999832   674 ts_tablet_manager.cc:1434] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:12:21.000507   599 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:21.001044   674 tablet_bootstrap.cc:492] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:21.001863   705 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.002563   726 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:20.999770   675 ts_tablet_manager.cc:1434] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:12:21.002789   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:21.003805   675 tablet_bootstrap.cc:492] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
W20260709 13:12:21.004216   448 leader_election.cc:343] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.998673   673 tablet_bootstrap.cc:492] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:21.008237   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:21.009374   705 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:21.012064   447 leader_election.cc:343] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.012562   447 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:21.013751   726 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:21.019170   674 tablet_bootstrap.cc:654] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.022608   675 tablet_bootstrap.cc:654] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.029685   675 tablet_bootstrap.cc:492] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:21.030154   675 ts_tablet_manager.cc:1403] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.000s
I20260709 13:12:21.030215   674 tablet_bootstrap.cc:492] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:21.030810   674 ts_tablet_manager.cc:1403] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.012s
I20260709 13:12:21.031193   673 tablet_bootstrap.cc:654] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.032034   722 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.032464   722 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.033349   674 raft_consensus.cc:359] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.033753   559 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.033408   675 raft_consensus.cc:359] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.034065   674 raft_consensus.cc:385] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.034248   675 raft_consensus.cc:385] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.034404   674 raft_consensus.cc:740] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.034607   722 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:21.034628   675 raft_consensus.cc:740] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.035072   674 consensus_queue.cc:260] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.036312   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:21.037009   631 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:21.038394   447 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:21.039495   675 consensus_queue.cc:260] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.040019   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:21.040642   558 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:21.040742   679 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:21.043285   679 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.043673   679 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.045701   675 ts_tablet_manager.cc:1434] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:12:21.046728   675 tablet_bootstrap.cc:492] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:21.048602   722 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.049108   722 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.052333   679 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.053601   722 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:21.053433   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:21.053433   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:21.054319   558 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
W20260709 13:12:21.055693   447 leader_election.cc:343] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.056464   448 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:21.056573   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:21.057363   558 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.057492   722 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:21.057973   722 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.058471   722 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.065303   723 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.070533   675 tablet_bootstrap.cc:654] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.070873   723 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.073468   724 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.073639   723 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:21.062764   674 ts_tablet_manager.cc:1434] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 13:12:21.075968   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:21.076805   674 tablet_bootstrap.cc:492] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:21.076812   484 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:21.074836   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:21.078600   525 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:21.073992   724 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:21.079268   522 leader_election.cc:343] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.080142   679 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:21.067991   722 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.080734   724 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:21.082125   722 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:21.083429   673 tablet_bootstrap.cc:492] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:21.083928   673 ts_tablet_manager.cc:1403] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.085s	user 0.028s	sys 0.015s
I20260709 13:12:21.084142   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:21.084743   674 tablet_bootstrap.cc:654] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.084702   631 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.086704   673 raft_consensus.cc:359] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.087440   673 raft_consensus.cc:385] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.087766   673 raft_consensus.cc:740] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.089746   673 consensus_queue.cc:260] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.090786   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:21.087646   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:21.092533   673 ts_tablet_manager.cc:1434] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:21.093106   723 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:21.093605   723 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.094022   723 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.099984   673 tablet_bootstrap.cc:492] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
W20260709 13:12:21.100286   447 leader_election.cc:343] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:21.101202   447 leader_election.cc:343] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.105877   673 tablet_bootstrap.cc:654] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.089665   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:21.107175   557 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.113118   675 tablet_bootstrap.cc:492] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:21.113549   675 ts_tablet_manager.cc:1403] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.003s
I20260709 13:12:21.115425   675 raft_consensus.cc:359] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.116107   675 raft_consensus.cc:385] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.116374   675 raft_consensus.cc:740] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.117311   673 tablet_bootstrap.cc:492] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:21.117100   675 consensus_queue.cc:260] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.117825   673 ts_tablet_manager.cc:1403] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:12:21.121294   673 raft_consensus.cc:359] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.121978   673 raft_consensus.cc:385] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.122303   673 raft_consensus.cc:740] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.122959   673 consensus_queue.cc:260] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.128387   675 ts_tablet_manager.cc:1434] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:12:21.131771   675 tablet_bootstrap.cc:492] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:21.135720   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:21.136570   673 ts_tablet_manager.cc:1434] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
W20260709 13:12:21.137482   448 leader_election.cc:343] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.137926   448 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:21.139043   722 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:21.139796   631 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:21.140391   673 tablet_bootstrap.cc:492] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:21.141319   447 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:21.142349   722 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:21.142825   722 raft_consensus.cc:697] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:21.143734   722 consensus_queue.cc:237] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.146494   673 tablet_bootstrap.cc:654] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.147310   683 consensus_queue.cc:1048] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.150158   675 tablet_bootstrap.cc:654] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.070122   558 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:21.154493   557 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:21.157966   448 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:21.161407   722 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:21.165385   722 raft_consensus.cc:697] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:21.166114   674 tablet_bootstrap.cc:492] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:21.166674   674 ts_tablet_manager.cc:1403] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.090s	user 0.024s	sys 0.052s
I20260709 13:12:21.168670   379 catalog_manager.cc:5697] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.166261   722 consensus_queue.cc:237] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.170154   674 raft_consensus.cc:359] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.171895   674 raft_consensus.cc:385] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.172402   674 raft_consensus.cc:740] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.173605   674 consensus_queue.cc:260] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.174104   723 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.176295   674 ts_tablet_manager.cc:1434] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:12:21.184840   723 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:21.185870   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:21.185676   723 consensus_queue.cc:1048] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:21.186396   631 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.188287   674 tablet_bootstrap.cc:492] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:21.193162   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:21.193809   482 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.198945   675 tablet_bootstrap.cc:492] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:21.228719   675 ts_tablet_manager.cc:1403] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.097s	user 0.028s	sys 0.007s
I20260709 13:12:21.230939   675 raft_consensus.cc:359] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.232348   738 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.231642   675 raft_consensus.cc:385] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.235198   675 raft_consensus.cc:740] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.235828   675 consensus_queue.cc:260] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.236704   723 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.238692   631 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:21.244074   522 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:21.244923   773 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:21.245371   773 raft_consensus.cc:697] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:12:21.245461   429 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:21.246963   675 ts_tablet_manager.cc:1434] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:12:21.246682   773 consensus_queue.cc:237] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.247905   675 tablet_bootstrap.cc:492] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:21.242193   738 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.243604   482 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:21.254230   673 tablet_bootstrap.cc:492] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:21.256242   673 ts_tablet_manager.cc:1403] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.116s	user 0.009s	sys 0.016s
I20260709 13:12:21.254165   738 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.249193   722 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:12:21.256258   379 catalog_manager.cc:5697] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.277088   558 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.277446   674 tablet_bootstrap.cc:654] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.277583   673 raft_consensus.cc:359] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.257253   724 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.278716   673 raft_consensus.cc:385] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.279021   673 raft_consensus.cc:740] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.279583   738 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:21.280100   673 consensus_queue.cc:260] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.286522   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:21.398115   673 ts_tablet_manager.cc:1434] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.142s	user 0.018s	sys 0.018s
I20260709 13:12:21.399133   673 tablet_bootstrap.cc:492] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:21.396931   724 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.406042   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:21.406658   483 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:21.398835   722 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.399324   630 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:21.416682   705 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.413888   722 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.424815   679 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.435592   522 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:21.430089   723 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.426452   705 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.438768   683 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:21.437472   679 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.455591   683 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.444464   723 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.470069   780 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.471650   683 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.483539   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:21.486081   559 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:21.486675   724 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:21.488358   723 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:21.488680   448 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:12:21.476576   776 log.cc:927] Time spent T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:12:21.490191   724 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.492910   673 tablet_bootstrap.cc:654] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.503261   779 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.507408   779 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.510142   779 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:21.477031   780 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.528723   781 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:21.529229   781 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.529693   781 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.516122   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:21.537567   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:21.538988   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:21.511191   779 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260709 13:12:21.548194   778 log.cc:927] Time spent T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:12:21.536144   705 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:21.550175   559 raft_consensus.cc:2393] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:12:21.572427   722 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:21.575804   679 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:21.605983   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:21.643885   675 tablet_bootstrap.cc:654] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.647533   780 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:21.647605   787 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.549515   556 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:21.548822   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:21.583323   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:12:21.635562   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 98982.1us
I20260709 13:12:21.549901   633 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:21.652834   787 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.577229   783 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.077s
I20260709 13:12:21.656663   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:21.659121   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:21.662688   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:21.663318   483 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:21.663715   738 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:21.664240   738 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.664530   683 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.659126   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:21.676967   522 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:21.655887   630 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:21.678800   773 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:21.661441   482 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:21.685349   738 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:21.685662   773 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.686556   787 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:21.687809   557 raft_consensus.cc:2393] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:12:21.693225   674 tablet_bootstrap.cc:492] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:21.693632   674 ts_tablet_manager.cc:1403] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.516s	user 0.010s	sys 0.017s
I20260709 13:12:21.683821   556 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:21.691071   773 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.698812   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:21.700513   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:21.694499   599 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:21.704897   683 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:21.716284   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:21.708149   597 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:21.724603   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:12:21.724866   522 leader_election.cc:343] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.725296   631 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.729084   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:21.729966   482 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:21.735558   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:21.735598   783 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:21.737097   783 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.737440   783 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.737672   674 raft_consensus.cc:359] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.738384   674 raft_consensus.cc:385] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.738687   674 raft_consensus.cc:740] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.739498   674 consensus_queue.cc:260] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.742123   525 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:21.741945   781 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.743860   484 raft_consensus.cc:2393] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:12:21.745388   674 ts_tablet_manager.cc:1434] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 13:12:21.743597   381 catalog_manager.cc:5697] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.746170   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:21.747593   674 tablet_bootstrap.cc:492] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:21.748139   786 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:21.746791   483 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.748616   786 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.744143   631 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:21.756489   786 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.761490   785 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.762401   525 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:21.764119   673 tablet_bootstrap.cc:492] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:21.765332   673 ts_tablet_manager.cc:1403] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.366s	user 0.019s	sys 0.014s
I20260709 13:12:21.767668   723 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:21.768006   522 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:21.773365   787 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:21.773839   787 raft_consensus.cc:697] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:21.774631   787 consensus_queue.cc:237] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.762142   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:21.776567   673 raft_consensus.cc:359] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.777174   781 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:21.777323   673 raft_consensus.cc:385] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.777819   673 raft_consensus.cc:740] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.778064   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:21.779011   673 consensus_queue.cc:260] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.777220   632 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:21.783898   673 ts_tablet_manager.cc:1434] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:12:21.784987   673 tablet_bootstrap.cc:492] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:21.786410   783 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.768829   773 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.765735   448 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:21.799934   738 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.805241   724 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:21.806690   724 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.807118   724 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.815958   675 tablet_bootstrap.cc:492] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:21.816397   675 ts_tablet_manager.cc:1403] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.569s	user 0.011s	sys 0.009s
I20260709 13:12:21.816728   381 catalog_manager.cc:5697] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.818830   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:21.818503   786 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:21.804704   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 46316.4us
I20260709 13:12:21.823880   673 tablet_bootstrap.cc:654] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.824671   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:21.825428   786 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:21.827483   675 raft_consensus.cc:359] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.828035   675 raft_consensus.cc:385] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.828248   675 raft_consensus.cc:740] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.829568   675 consensus_queue.cc:260] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.825277   631 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.830986   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:21.831694   480 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.831794   483 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:21.835278   781 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:12:21.846244   631 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:21.847870   724 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.848913   522 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:21.827670   773 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:21.849192   484 raft_consensus.cc:2393] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 1: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:12:21.856457   786 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:21.857424   675 ts_tablet_manager.cc:1434] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.002s
I20260709 13:12:21.861261   724 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:21.861454   675 tablet_bootstrap.cc:492] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:21.864809   783 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:21.864923   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:21.865566   554 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.868254   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:21.863912   786 raft_consensus.cc:697] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:21.869843   674 tablet_bootstrap.cc:654] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.864678   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:21.871524   599 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:21.872293   631 raft_consensus.cc:2393] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 1: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:12:21.867669   448 leader_election.cc:343] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.876052   554 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:21.882619   738 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.883477   597 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:21.870716   630 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.881489   793 raft_consensus.cc:2764] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:12:21.885267   783 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:21.886549   783 raft_consensus.cc:697] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:12:21.888693   447 leader_election.cc:343] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:21.887472   783 consensus_queue.cc:237] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.889173   447 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:21.889922   781 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:21.871927   786 consensus_queue.cc:237] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.893056   480 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:21.895802   675 tablet_bootstrap.cc:654] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.895947   525 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:21.897042   787 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:21.897342   673 tablet_bootstrap.cc:492] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:21.897004   781 consensus_queue.cc:1048] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:21.897610   787 raft_consensus.cc:697] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:21.899648   673 ts_tablet_manager.cc:1403] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.115s	user 0.015s	sys 0.028s
I20260709 13:12:21.898820   787 consensus_queue.cc:237] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.900593   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:21.900664   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:21.901678   480 raft_consensus.cc:2393] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:12:21.901865   633 raft_consensus.cc:2393] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 1: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:12:21.902356   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:21.903617   554 raft_consensus.cc:2393] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 1: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:12:21.917630   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:21.935395   674 tablet_bootstrap.cc:492] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:21.935977   674 ts_tablet_manager.cc:1403] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.189s	user 0.023s	sys 0.017s
I20260709 13:12:21.937587   785 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:21.941879   673 raft_consensus.cc:359] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.942598   673 raft_consensus.cc:385] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.943833   673 raft_consensus.cc:740] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.945248   781 consensus_queue.cc:1048] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:21.945431   447 consensus_peers.cc:597] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 -> Peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Couldn't send request to peer 50f7c2247be24f3685d7fbca7b6c71e3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:21.947172   781 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:21.947129   379 catalog_manager.cc:5697] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:21.944576   673 consensus_queue.cc:260] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.949616   448 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:21.950568   674 raft_consensus.cc:359] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.952560   674 raft_consensus.cc:385] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.953306   674 raft_consensus.cc:740] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.953338   781 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:21.952817   448 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:21.954977   781 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:21.954752   674 consensus_queue.cc:260] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.948758   630 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:21.958624   674 ts_tablet_manager.cc:1434] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:12:21.959635   674 tablet_bootstrap.cc:492] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:21.959729   675 tablet_bootstrap.cc:492] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:21.960270   675 ts_tablet_manager.cc:1403] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.002s
I20260709 13:12:21.960794   781 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.953678   673 ts_tablet_manager.cc:1434] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.002s
I20260709 13:12:21.974967   673 tablet_bootstrap.cc:492] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:21.980010   675 raft_consensus.cc:359] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.980839   675 raft_consensus.cc:385] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:21.981137   675 raft_consensus.cc:740] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.982435   675 consensus_queue.cc:260] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:21.984759   675 ts_tablet_manager.cc:1434] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:21.985772   675 tablet_bootstrap.cc:492] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:21.997148   673 tablet_bootstrap.cc:654] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.998200   675 tablet_bootstrap.cc:654] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.966851   674 tablet_bootstrap.cc:654] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:21.972160   381 catalog_manager.cc:5697] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:22.001633   785 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.002139   785 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.006032   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:22.006218   785 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:22.006425   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:22.009013   599 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:22.010515   785 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:22.015275   675 tablet_bootstrap.cc:492] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:22.015769   675 ts_tablet_manager.cc:1403] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.007s
I20260709 13:12:22.024699   673 tablet_bootstrap.cc:492] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:22.025439   673 ts_tablet_manager.cc:1403] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.003s
I20260709 13:12:22.029632   673 raft_consensus.cc:359] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.030797   673 raft_consensus.cc:385] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.031252   673 raft_consensus.cc:740] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.032430   673 consensus_queue.cc:260] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.033701   381 catalog_manager.cc:5697] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:22.035276   675 raft_consensus.cc:359] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.035763   673 ts_tablet_manager.cc:1434] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:12:22.036602   675 raft_consensus.cc:385] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.036917   675 raft_consensus.cc:740] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.037408   673 tablet_bootstrap.cc:492] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:22.037585   675 consensus_queue.cc:260] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.040253   675 ts_tablet_manager.cc:1434] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:12:22.040989   675 tablet_bootstrap.cc:492] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:22.043663   674 tablet_bootstrap.cc:492] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:22.044103   674 ts_tablet_manager.cc:1403] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.025s
I20260709 13:12:22.046362   675 tablet_bootstrap.cc:654] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.046711   674 raft_consensus.cc:359] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.050452   673 tablet_bootstrap.cc:654] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.050724   674 raft_consensus.cc:385] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.051016   674 raft_consensus.cc:740] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.051728   674 consensus_queue.cc:260] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.053766   674 ts_tablet_manager.cc:1434] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 13:12:22.054800   674 tablet_bootstrap.cc:492] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:22.061812   674 tablet_bootstrap.cc:654] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.068606   726 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.069280   726 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.072095   787 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.072719   787 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.074222   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:22.075707   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:12:22.076057   447 leader_election.cc:343] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.076535   554 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:22.076851   726 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:22.079623   448 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:22.082482   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:12:22.084389   525 leader_election.cc:343] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.085779   787 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:22.086424   726 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:22.086618   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:22.087455   633 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:22.089488   522 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:22.091457   786 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:22.091807   786 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.092116   786 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:22.097947   726 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.098433   726 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:22.098915   786 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.101089   786 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:22.101926   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:12:22.103575   525 leader_election.cc:343] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.106830   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:22.107782   633 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:22.110891   675 tablet_bootstrap.cc:492] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:22.111354   675 ts_tablet_manager.cc:1403] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.070s	user 0.029s	sys 0.032s
I20260709 13:12:22.113844   675 raft_consensus.cc:359] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.114485   675 raft_consensus.cc:385] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.116623   675 raft_consensus.cc:740] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.117276   675 consensus_queue.cc:260] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.117847   633 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:22.118983   522 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:22.119252   675 ts_tablet_manager.cc:1434] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 13:12:22.119868   786 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:22.119729   726 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.120328   675 tablet_bootstrap.cc:492] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:22.120420   786 raft_consensus.cc:697] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:22.121199   786 consensus_queue.cc:237] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.121798   726 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:22.124063   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:22.124600   554 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:22.126374   675 tablet_bootstrap.cc:654] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.116335   673 tablet_bootstrap.cc:492] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:22.127671   673 ts_tablet_manager.cc:1403] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.006s
I20260709 13:12:22.129280   674 tablet_bootstrap.cc:492] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:22.129709   674 ts_tablet_manager.cc:1403] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.075s	user 0.028s	sys 0.024s
I20260709 13:12:22.130183   673 raft_consensus.cc:359] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.130718   673 raft_consensus.cc:385] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.130884   673 raft_consensus.cc:740] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.131450   673 consensus_queue.cc:260] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.131718   554 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:22.133414   448 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:22.134528   726 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:22.134982   726 raft_consensus.cc:697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:22.135972   726 consensus_queue.cc:237] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.136361   674 raft_consensus.cc:359] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.136979   674 raft_consensus.cc:385] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.137243   674 raft_consensus.cc:740] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.142517   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:22.143894   633 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:22.144130   673 ts_tablet_manager.cc:1434] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:12:22.145798   673 tablet_bootstrap.cc:492] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:22.139683   674 consensus_queue.cc:260] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.156697   674 ts_tablet_manager.cc:1434] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:12:22.157522   380 catalog_manager.cc:5697] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:22.158667   674 tablet_bootstrap.cc:492] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:22.162370   633 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:22.162392   378 catalog_manager.cc:5697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:22.165187   674 tablet_bootstrap.cc:654] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.173169   673 tablet_bootstrap.cc:654] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.173943   675 tablet_bootstrap.cc:492] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:22.174492   675 ts_tablet_manager.cc:1403] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.008s
I20260709 13:12:22.177420   675 raft_consensus.cc:359] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.178201   675 raft_consensus.cc:385] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.178480   675 raft_consensus.cc:740] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.180174   675 consensus_queue.cc:260] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.183969   675 ts_tablet_manager.cc:1434] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:22.185132   675 tablet_bootstrap.cc:492] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:22.188959   786 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:22.192734   675 tablet_bootstrap.cc:654] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.202548   674 tablet_bootstrap.cc:492] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:22.202648   675 tablet_bootstrap.cc:492] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:22.203152   675 ts_tablet_manager.cc:1403] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:12:22.203152   674 ts_tablet_manager.cc:1403] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.045s	user 0.026s	sys 0.013s
I20260709 13:12:22.206372   675 raft_consensus.cc:359] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.207084   675 raft_consensus.cc:385] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.207444   675 raft_consensus.cc:740] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.208297   675 consensus_queue.cc:260] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.209563   674 raft_consensus.cc:359] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.210204   674 raft_consensus.cc:385] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.210309   675 ts_tablet_manager.cc:1434] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:22.210500   674 raft_consensus.cc:740] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.212064   674 consensus_queue.cc:260] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.213110   675 tablet_bootstrap.cc:492] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:22.213323   786 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:22.226982   675 tablet_bootstrap.cc:654] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.229336   674 ts_tablet_manager.cc:1434] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.005s
I20260709 13:12:22.230268   674 tablet_bootstrap.cc:492] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:22.245903   781 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.248468   781 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.250526   781 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:22.251434   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:22.247884   674 tablet_bootstrap.cc:654] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.241034   673 tablet_bootstrap.cc:492] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:22.252501   673 ts_tablet_manager.cc:1403] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.026s
W20260709 13:12:22.253129   448 leader_election.cc:343] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.254649   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:22.255501   673 raft_consensus.cc:359] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:22.256620   447 leader_election.cc:343] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.256805   673 raft_consensus.cc:385] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.257184   673 raft_consensus.cc:740] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.257166   447 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:22.259423   673 consensus_queue.cc:260] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.260707   726 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:22.268172   673 ts_tablet_manager.cc:1434] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:12:22.269166   673 tablet_bootstrap.cc:492] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:22.272673   675 tablet_bootstrap.cc:492] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:22.273247   675 ts_tablet_manager.cc:1403] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.007s
I20260709 13:12:22.276173   675 raft_consensus.cc:359] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.279765   675 raft_consensus.cc:385] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.280092   675 raft_consensus.cc:740] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.280292   726 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.280850   726 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.280828   675 consensus_queue.cc:260] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.282972   726 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:22.283099   675 ts_tablet_manager.cc:1434] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:12:22.284468   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:12:22.285816   447 leader_election.cc:343] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.290555   673 tablet_bootstrap.cc:654] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:22.291116   429 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:22.287812   674 tablet_bootstrap.cc:492] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:22.293169   674 ts_tablet_manager.cc:1403] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.015s
I20260709 13:12:22.293102   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:22.294183   675 tablet_bootstrap.cc:492] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
W20260709 13:12:22.294900   448 leader_election.cc:343] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.295130   773 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:22.295399   448 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:22.295909   674 raft_consensus.cc:359] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.296543   674 raft_consensus.cc:385] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.296830   674 raft_consensus.cc:740] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.297610   789 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:22.297436   674 consensus_queue.cc:260] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.300222   675 tablet_bootstrap.cc:654] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.300280   781 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.300865   781 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.302771   781 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:22.304518   674 ts_tablet_manager.cc:1434] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:12:22.305374   674 tablet_bootstrap.cc:492] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:22.307617   773 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.308259   773 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.312649   673 tablet_bootstrap.cc:492] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:22.313182   673 ts_tablet_manager.cc:1403] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.000s
I20260709 13:12:22.313107   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:22.314131   482 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:22.315897   525 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:22.316375   673 raft_consensus.cc:359] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.317152   673 raft_consensus.cc:385] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.317703   673 raft_consensus.cc:740] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.317091   787 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:22.318607   787 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.318543   673 consensus_queue.cc:260] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.319172   787 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:22.321300   674 tablet_bootstrap.cc:654] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.325716   786 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.326422   786 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.326846   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:22.329612   773 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:22.331086   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:22.331403   786 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:22.331873   785 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.332527   785 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.331099   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:22.337774   632 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:22.331877   630 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:22.330441   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:22.340755   633 raft_consensus.cc:2393] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 1: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:12:22.340575   522 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:22.342329   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:22.343389   738 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:22.343961   738 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.344445   738 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:22.350792   785 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:22.343178   482 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:22.353310   786 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:22.354737   599 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:22.358711   779 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:22.359279   779 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.359743   779 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:22.364678   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:22.365845   738 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:22.367543   525 leader_election.cc:343] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.368876   673 ts_tablet_manager.cc:1434] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 13:12:22.369360   448 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:22.370255   673 tablet_bootstrap.cc:492] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:22.371099   726 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:22.380355   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:22.383191   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:22.384074   630 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:22.388991   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:22.391618   773 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.392354   773 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.401031   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:12:22.402513   522 leader_election.cc:343] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.403532   773 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:22.407090   630 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:22.408991   738 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:12:22.406826   525 leader_election.cc:343] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.430249   673 tablet_bootstrap.cc:654] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.439689   781 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.440447   781 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.446182   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:22.462236   559 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:22.465502   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:22.448922   789 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.467423   789 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.470114   789 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:22.448670   785 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:12:22.477010   785 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:22.479198   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:22.443197   781 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:12:22.482699   447 leader_election.cc:343] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:22.492439   447 leader_election.cc:343] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.495169   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:22.498055   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:22.490948   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:22.504657   482 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:22.421311   525 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:12:22.505805   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 99037.8us
I20260709 13:12:22.506691   738 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:22.518074   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 109372us
I20260709 13:12:22.525662   786 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:22.514415   781 raft_consensus.cc:2804] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:22.532502   781 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.533034   781 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:22.537714   525 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:22.547616   674 tablet_bootstrap.cc:492] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:22.550202   674 ts_tablet_manager.cc:1403] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.245s	user 0.075s	sys 0.131s
I20260709 13:12:22.553794   844 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.554387   844 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.554255   781 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.556531   781 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:22.557518   844 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:22.559113   844 raft_consensus.cc:2804] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:22.559860   844 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.560273   844 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:22.560436   675 tablet_bootstrap.cc:492] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:22.561054   675 ts_tablet_manager.cc:1403] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.267s	user 0.096s	sys 0.111s
I20260709 13:12:22.558269   674 raft_consensus.cc:359] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.562965   674 raft_consensus.cc:385] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.563325   674 raft_consensus.cc:740] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.563926   674 consensus_queue.cc:260] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.565744   674 ts_tablet_manager.cc:1434] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:12:22.566519   674 tablet_bootstrap.cc:492] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:22.569507   675 raft_consensus.cc:359] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.570192   675 raft_consensus.cc:385] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.570340   726 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:22.570465   675 raft_consensus.cc:740] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.578867   675 consensus_queue.cc:260] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.532493   787 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.578300   738 raft_consensus.cc:697] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:22.582775   675 ts_tablet_manager.cc:1434] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:12:22.577319   773 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:12:22.590642   554 raft_consensus.cc:2393] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
W20260709 13:12:22.597756   448 leader_election.cc:343] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.598214   448 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:22.599969   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:22.600873   726 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:22.580222   779 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.585243   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:22.594332   674 tablet_bootstrap.cc:654] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.595472   787 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:22.582114   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:22.606367   844 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.611829   554 raft_consensus.cc:2393] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 1: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:12:22.613865   844 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:22.615939   673 tablet_bootstrap.cc:492] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:22.616429   673 ts_tablet_manager.cc:1403] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.246s	user 0.017s	sys 0.012s
I20260709 13:12:22.608134   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:22.608536   738 consensus_queue.cc:237] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.620023   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:22.621878   484 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:22.622264   631 raft_consensus.cc:2393] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 1: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:12:22.624220   630 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:22.626772   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:22.627377   482 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:22.630383   839 log.cc:927] Time spent T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:12:22.631927   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:12:22.635571   522 leader_election.cc:343] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:22.635609   447 leader_election.cc:343] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.635598   779 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:22.637393   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:22.637605   781 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:22.638166   557 raft_consensus.cc:2393] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
W20260709 13:12:22.639020   522 leader_election.cc:343] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.644280   673 raft_consensus.cc:359] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.644996   673 raft_consensus.cc:385] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.645862   673 raft_consensus.cc:740] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.646485   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:22.646723   673 consensus_queue.cc:260] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.648568   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:22.649329   481 raft_consensus.cc:2393] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 1: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:12:22.646420   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:22.654014   781 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:22.654790   525 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:22.655930   845 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:22.656275   845 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.656577   845 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:22.650355   673 ts_tablet_manager.cc:1434] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.002s
I20260709 13:12:22.658949   673 tablet_bootstrap.cc:492] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:22.671339   726 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:22.671644   378 catalog_manager.cc:5697] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:22.676465   525 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:22.677445   773 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:22.679808   673 tablet_bootstrap.cc:654] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.682389   773 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.683108   773 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.684188   525 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:22.685199   848 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:22.686012   773 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:22.688814   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:12:22.700448   522 leader_election.cc:343] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.652712   785 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.707785   785 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.708215   845 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.710000   785 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:22.710873   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:22.712270   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:22.712983   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:22.711519   738 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:22.713603   484 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:22.713708   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:22.714247   481 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:22.714653   597 leader_election.cc:343] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.652344   675 tablet_bootstrap.cc:492] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:22.715442   599 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:22.716538   785 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:22.716908   785 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.717464   785 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:22.728005   525 leader_election.cc:343] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.702888   673 tablet_bootstrap.cc:492] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:22.728929   673 ts_tablet_manager.cc:1403] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.000s
I20260709 13:12:22.728513   525 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:22.730711   773 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:22.731573   845 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:22.731434   773 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:22.682711   482 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:22.732003   785 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.732898   599 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:22.734719   779 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:22.735366   779 raft_consensus.cc:697] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:22.736088   674 tablet_bootstrap.cc:492] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:22.736580   674 ts_tablet_manager.cc:1403] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.170s	user 0.013s	sys 0.007s
I20260709 13:12:22.736197   779 consensus_queue.cc:237] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.785219   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:22.833650   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:12:22.835096   597 leader_election.cc:343] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.837225   785 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:12:22.837422   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 104588us
I20260709 13:12:22.838006   673 raft_consensus.cc:359] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.838701   673 raft_consensus.cc:385] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.838982   673 raft_consensus.cc:740] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.843724   673 consensus_queue.cc:260] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.845527   673 ts_tablet_manager.cc:1434] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.116s	user 0.013s	sys 0.030s
I20260709 13:12:22.846426   673 tablet_bootstrap.cc:492] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
W20260709 13:12:22.853775   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 65303.5us
W20260709 13:12:22.852046   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 58768.5us
W20260709 13:12:22.858353   522 leader_election.cc:343] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.863960   481 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:22.864615   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:22.865252   525 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:22.865243   482 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:22.866565   674 raft_consensus.cc:359] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.867228   674 raft_consensus.cc:385] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.867540   674 raft_consensus.cc:740] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.868114   674 consensus_queue.cc:260] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.869704   674 ts_tablet_manager.cc:1434] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.133s	user 0.004s	sys 0.009s
I20260709 13:12:22.870383   674 tablet_bootstrap.cc:492] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:22.871191   726 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.871688   726 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.873943   726 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:22.875056   773 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:22.876956   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:22.877260   482 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:22.875756   773 raft_consensus.cc:697] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:22.877586   559 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:22.879850   448 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:22.880904   773 consensus_queue.cc:237] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.881606   726 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:22.882151   726 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.882617   726 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:22.883138   673 tablet_bootstrap.cc:654] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.885591   599 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:22.886448   785 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:22.887176   785 raft_consensus.cc:697] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:22.889688   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:22.888334   785 consensus_queue.cc:237] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:22.894068   447 leader_election.cc:343] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.894515   726 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.899964   674 tablet_bootstrap.cc:654] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.904707   726 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:22.905942   675 tablet_bootstrap.cc:654] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.912767   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:22.913497   557 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:22.910652   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:12:22.918465   447 leader_election.cc:343] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:22.944134   673 tablet_bootstrap.cc:492] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:22.944621   673 ts_tablet_manager.cc:1403] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.098s	user 0.019s	sys 0.001s
I20260709 13:12:22.947464   673 raft_consensus.cc:359] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.948130   673 raft_consensus.cc:385] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.948407   673 raft_consensus.cc:740] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.949059   673 consensus_queue.cc:260] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.948937   381 catalog_manager.cc:5697] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:22.953173   673 ts_tablet_manager.cc:1434] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:22.953928   673 tablet_bootstrap.cc:492] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:22.949554   557 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:22.957401   448 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:22.957945   675 tablet_bootstrap.cc:492] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:22.958398   675 ts_tablet_manager.cc:1403] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.306s	user 0.016s	sys 0.003s
I20260709 13:12:22.959266   789 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:22.959712   789 raft_consensus.cc:697] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:22.960500   789 consensus_queue.cc:237] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.971730   673 tablet_bootstrap.cc:654] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.974560   674 tablet_bootstrap.cc:492] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:22.975363   674 ts_tablet_manager.cc:1403] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.105s	user 0.018s	sys 0.004s
I20260709 13:12:22.977111   380 catalog_manager.cc:5697] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:22.978799   674 raft_consensus.cc:359] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.979127   380 catalog_manager.cc:5697] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:22.980216   674 raft_consensus.cc:385] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.980517   673 tablet_bootstrap.cc:492] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:22.980943   673 ts_tablet_manager.cc:1403] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.003s
I20260709 13:12:22.982779   378 catalog_manager.cc:5697] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:22.980527   674 raft_consensus.cc:740] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.986510   673 raft_consensus.cc:359] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.987215   673 raft_consensus.cc:385] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.987098   674 consensus_queue.cc:260] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.987545   673 raft_consensus.cc:740] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.981590   675 raft_consensus.cc:359] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.988332   675 raft_consensus.cc:385] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.988227   673 consensus_queue.cc:260] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.988644   675 raft_consensus.cc:740] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.990300   673 ts_tablet_manager.cc:1434] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:12:22.990808   674 ts_tablet_manager.cc:1434] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.004s
I20260709 13:12:22.991189   673 tablet_bootstrap.cc:492] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:22.991823   675 consensus_queue.cc:260] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:22.993280   674 tablet_bootstrap.cc:492] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:22.996933   675 ts_tablet_manager.cc:1434] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.001s
I20260709 13:12:22.999583   675 tablet_bootstrap.cc:492] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:23.005592   673 tablet_bootstrap.cc:654] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.005671   675 tablet_bootstrap.cc:654] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.007128   674 tablet_bootstrap.cc:654] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.010484   675 tablet_bootstrap.cc:492] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:23.010933   675 ts_tablet_manager.cc:1403] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:12:23.012183   674 tablet_bootstrap.cc:492] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:23.012646   674 ts_tablet_manager.cc:1403] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.001s
I20260709 13:12:23.013490   675 raft_consensus.cc:359] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.014744   675 raft_consensus.cc:385] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.015007   675 raft_consensus.cc:740] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.015808   674 raft_consensus.cc:359] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.015764   675 consensus_queue.cc:260] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.016474   674 raft_consensus.cc:385] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.016752   674 raft_consensus.cc:740] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.017441   674 consensus_queue.cc:260] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.018316   675 ts_tablet_manager.cc:1434] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:23.019481   674 ts_tablet_manager.cc:1434] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:23.019763   675 tablet_bootstrap.cc:492] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:23.021423   674 tablet_bootstrap.cc:492] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:23.026264   675 tablet_bootstrap.cc:654] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.030676   673 tablet_bootstrap.cc:492] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:23.031131   673 ts_tablet_manager.cc:1403] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.003s
I20260709 13:12:23.031634   674 tablet_bootstrap.cc:654] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.034399   673 raft_consensus.cc:359] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.035336   673 raft_consensus.cc:385] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.035686   673 raft_consensus.cc:740] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.036513   673 consensus_queue.cc:260] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.039213   673 ts_tablet_manager.cc:1434] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 13:12:23.040906   673 tablet_bootstrap.cc:492] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:23.042752   675 tablet_bootstrap.cc:492] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:23.043190   675 ts_tablet_manager.cc:1403] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 13:12:23.045614   847 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.045728   675 raft_consensus.cc:359] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.046975   673 tablet_bootstrap.cc:654] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.047053   848 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.047137   675 raft_consensus.cc:385] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.047688   675 raft_consensus.cc:740] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.047722   848 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.046129   847 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.048663   675 consensus_queue.cc:260] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.050134   848 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:23.050841   674 tablet_bootstrap.cc:492] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:23.051425   674 ts_tablet_manager.cc:1403] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.000s
I20260709 13:12:23.052093   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:23.052866   482 raft_consensus.cc:2393] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 1: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:12:23.052681   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:23.054189   522 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:23.054726   674 raft_consensus.cc:359] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.055605   674 raft_consensus.cc:385] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.055946   674 raft_consensus.cc:740] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.056035   773 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.056335   847 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:23.057361   674 consensus_queue.cc:260] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.057977   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:23.059959   675 ts_tablet_manager.cc:1434] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:12:23.061061   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:23.061451   482 raft_consensus.cc:2393] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:12:23.062064   557 raft_consensus.cc:2393] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:12:23.064090   599 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:23.065183   847 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.066002   675 tablet_bootstrap.cc:492] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:23.074152   773 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:23.074429   675 tablet_bootstrap.cc:654] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.081256   674 ts_tablet_manager.cc:1434] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 13:12:23.082427   785 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.082962   785 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.085037   785 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:23.082561   674 tablet_bootstrap.cc:492] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:23.085719   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:23.086516   482 raft_consensus.cc:2393] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:12:23.086512   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:23.088023   597 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:23.091061   848 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.091562   848 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.088670   785 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.093562   848 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:23.094094   674 tablet_bootstrap.cc:654] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.095094   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:23.095772   629 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:23.096956   522 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:23.097790   675 tablet_bootstrap.cc:492] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:23.098387   675 ts_tablet_manager.cc:1403] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.001s
I20260709 13:12:23.098582   848 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:23.098979   848 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.099328   848 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.099750   785 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:23.101812   675 raft_consensus.cc:359] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.102762   675 raft_consensus.cc:385] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.103116   675 raft_consensus.cc:740] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.103160   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:23.103932   482 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:23.104106   675 consensus_queue.cc:260] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.109205   675 ts_tablet_manager.cc:1434] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:12:23.110898   675 tablet_bootstrap.cc:492] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:23.125172   848 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.138163   481 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.140789   847 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:23.141753   773 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.141834   845 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:23.142313   773 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.144394   773 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:23.148671   848 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:23.148557   773 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:23.152143   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:23.152957   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:23.153513   632 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.154343   675 tablet_bootstrap.cc:654] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.155933   674 tablet_bootstrap.cc:492] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:23.156374   674 ts_tablet_manager.cc:1403] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.008s
I20260709 13:12:23.157462   673 tablet_bootstrap.cc:492] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:23.157909   673 ts_tablet_manager.cc:1403] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.117s	user 0.033s	sys 0.041s
I20260709 13:12:23.159837   722 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.160295   722 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.161461   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:23.162107   481 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.162343   722 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:23.163448   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:23.164822   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:23.165477   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:23.166615   482 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:23.159291   674 raft_consensus.cc:359] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.167742   674 raft_consensus.cc:385] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.167605   448 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:23.168059   674 raft_consensus.cc:740] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
W20260709 13:12:23.165920   522 leader_election.cc:343] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.169729   674 consensus_queue.cc:260] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.171690   525 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:23.173075   845 raft_consensus.cc:2804] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:23.173486   845 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.173849   845 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.174336   481 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:23.176002   673 raft_consensus.cc:359] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.176697   673 raft_consensus.cc:385] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.177654   673 raft_consensus.cc:740] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.179036   673 consensus_queue.cc:260] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.182119   673 ts_tablet_manager.cc:1434] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:12:23.182108   845 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.183588   525 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:23.184331   773 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:23.184923   632 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:23.185221   773 raft_consensus.cc:697] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:23.188726   847 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:23.189896   673 tablet_bootstrap.cc:492] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:23.191488   722 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:23.192363   674 ts_tablet_manager.cc:1434] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:12:23.193814   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:23.194376   484 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.198267   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:12:23.200228   522 leader_election.cc:343] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.186293   773 consensus_queue.cc:237] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.202824   845 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:23.203358   484 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:23.207216   525 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:23.208491   845 raft_consensus.cc:2804] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:23.209278   845 raft_consensus.cc:697] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:23.210312   673 tablet_bootstrap.cc:654] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.210391   845 consensus_queue.cc:237] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.212992   674 tablet_bootstrap.cc:492] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:23.229051   674 tablet_bootstrap.cc:654] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.229877   781 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.230537   781 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.232590   781 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:23.233042   847 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:23.233325   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:23.233999   675 tablet_bootstrap.cc:492] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
W20260709 13:12:23.234674   448 leader_election.cc:343] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.236799   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:23.237334   381 catalog_manager.cc:5697] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:23.238348   447 leader_election.cc:343] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.238621   845 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.238854   447 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:23.239171   845 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.240568   722 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:23.238489   673 tablet_bootstrap.cc:492] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:23.241746   845 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:23.242034   673 ts_tablet_manager.cc:1403] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.052s	user 0.006s	sys 0.005s
I20260709 13:12:23.242574   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:23.243152   482 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:23.234464   675 ts_tablet_manager.cc:1403] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.124s	user 0.004s	sys 0.010s
I20260709 13:12:23.244699   673 raft_consensus.cc:359] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.245482   673 raft_consensus.cc:385] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.245756   673 raft_consensus.cc:740] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.246392   675 raft_consensus.cc:359] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.247005   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:23.247211   675 raft_consensus.cc:385] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.247786   675 raft_consensus.cc:740] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.249056   525 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:23.249874   845 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:23.250233   845 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.248436   675 consensus_queue.cc:260] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.250746   845 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.252545   675 ts_tablet_manager.cc:1434] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:12:23.254079   675 tablet_bootstrap.cc:492] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:23.246474   673 consensus_queue.cc:260] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.258244   631 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:23.260258   675 tablet_bootstrap.cc:654] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.262027   673 ts_tablet_manager.cc:1434] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:12:23.263046   673 tablet_bootstrap.cc:492] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:23.265264   674 tablet_bootstrap.cc:492] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:23.266265   674 ts_tablet_manager.cc:1403] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.003s
I20260709 13:12:23.266822   738 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.267550   738 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.269044   674 raft_consensus.cc:359] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.269775   674 raft_consensus.cc:385] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.270102   674 raft_consensus.cc:740] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.270252   738 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:23.270695   674 consensus_queue.cc:260] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.272483   674 ts_tablet_manager.cc:1434] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:23.273285   674 tablet_bootstrap.cc:492] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:23.281031   674 tablet_bootstrap.cc:654] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.285862   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:23.289389   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:12:23.290686   522 leader_election.cc:343] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:23.298031   525 leader_election.cc:343] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.298771   525 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:23.300890   848 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:23.290997   773 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:23.302004   738 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:23.306053   674 tablet_bootstrap.cc:492] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:23.306530   674 ts_tablet_manager.cc:1403] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.033s	user 0.001s	sys 0.013s
I20260709 13:12:23.306823   673 tablet_bootstrap.cc:654] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.259048   845 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.325120   674 raft_consensus.cc:359] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.325917   674 raft_consensus.cc:385] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.326300   674 raft_consensus.cc:740] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.328732   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:23.329449   481 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.334584   722 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.341377   722 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.343861   722 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:23.346131   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:23.347014   557 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:23.348636   448 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:23.309477   381 catalog_manager.cc:5697] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:23.352191   785 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.352695   785 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.354492   847 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:23.356045   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:23.356948   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:23.358129   557 raft_consensus.cc:2393] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:12:23.359254   597 leader_election.cc:304] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:23.357465   785 leader_election.cc:290] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:23.360847   674 consensus_queue.cc:260] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.365507   726 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:23.365316   847 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.373257   726 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.373816   726 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.381388   845 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:23.382987   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:23.383610   632 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.350332   481 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:23.415340   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:23.422086   632 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
W20260709 13:12:23.427515   447 leader_election.cc:343] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.428005   674 ts_tablet_manager.cc:1434] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.121s	user 0.017s	sys 0.007s
I20260709 13:12:23.427892   722 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.428959   674 tablet_bootstrap.cc:492] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:23.428864   522 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:23.430264   847 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:23.430409   773 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:23.430204   722 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.430974   773 raft_consensus.cc:697] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:23.437810   726 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.439929   726 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:23.431838   773 consensus_queue.cc:237] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.442570   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:23.443735   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:23.444351   557 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:23.446245   447 leader_election.cc:343] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.446811   892 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.446902   785 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:23.447319   892 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.453547   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:23.454180   554 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:23.455528   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:23.456646   448 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:23.457370   722 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:12:23.457401   447 leader_election.cc:343] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.457968   789 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:23.462282   789 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.462653   789 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.468158   726 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:23.469615   557 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
W20260709 13:12:23.474776   429 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:23.476001   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:23.476709   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:23.478336   448 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:12:23.478360   447 leader_election.cc:343] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.480027   726 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:23.482586   726 raft_consensus.cc:697] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:23.483441   726 consensus_queue.cc:237] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.485677   673 tablet_bootstrap.cc:492] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:23.486105   673 ts_tablet_manager.cc:1403] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.223s	user 0.022s	sys 0.046s
I20260709 13:12:23.487051   675 tablet_bootstrap.cc:492] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:23.487622   675 ts_tablet_manager.cc:1403] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.234s	user 0.063s	sys 0.082s
W20260709 13:12:23.480667   448 leader_election.cc:343] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.472754   892 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:23.491153   673 raft_consensus.cc:359] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.495826   673 raft_consensus.cc:385] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.496168   673 raft_consensus.cc:740] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.496245   675 raft_consensus.cc:359] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.497140   675 raft_consensus.cc:385] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.497675   675 raft_consensus.cc:740] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.497104   673 consensus_queue.cc:260] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.498489   675 consensus_queue.cc:260] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.500687   448 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:23.501791   675 ts_tablet_manager.cc:1434] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:12:23.502622   675 tablet_bootstrap.cc:492] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:23.502687   673 ts_tablet_manager.cc:1434] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:12:23.503753   673 tablet_bootstrap.cc:492] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:23.508184   892 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:23.516673   789 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.520874   789 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:23.521435   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:23.522420   675 tablet_bootstrap.cc:654] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:23.522579   447 leader_election.cc:343] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.524576   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:23.525151   557 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.540082   674 tablet_bootstrap.cc:654] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.541046   557 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:23.542901   448 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:23.544181   892 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:23.544636   892 raft_consensus.cc:697] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:23.545440   892 consensus_queue.cc:237] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.546239   893 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:23.547479   673 tablet_bootstrap.cc:654] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.549787   380 catalog_manager.cc:5697] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:23.568634   675 tablet_bootstrap.cc:492] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:23.569098   675 ts_tablet_manager.cc:1403] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.008s
I20260709 13:12:23.574569   378 catalog_manager.cc:5697] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:23.575723   675 raft_consensus.cc:359] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.576604   675 raft_consensus.cc:385] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.576865   675 raft_consensus.cc:740] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.577759   675 consensus_queue.cc:260] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.581046   675 ts_tablet_manager.cc:1434] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:12:23.582149   675 tablet_bootstrap.cc:492] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:23.583300   673 tablet_bootstrap.cc:492] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:23.583743   673 ts_tablet_manager.cc:1403] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.004s
I20260709 13:12:23.586254   673 raft_consensus.cc:359] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.586889   673 raft_consensus.cc:385] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.587148   673 raft_consensus.cc:740] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.587916   675 tablet_bootstrap.cc:654] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.590576   673 consensus_queue.cc:260] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.593861   673 ts_tablet_manager.cc:1434] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:12:23.595001   673 tablet_bootstrap.cc:492] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:23.600597   779 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.601104   779 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.606313   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:23.606774   673 tablet_bootstrap.cc:654] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.606936   557 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:23.607484   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:23.608158   483 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:23.608223   597 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:23.609103   847 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:23.609434   847 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.609732   847 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.611945   845 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.612571   845 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.619036   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:23.619655   785 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.620318   785 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.624038   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:23.624856   483 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:12:23.625236   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:12:23.627084   525 leader_election.cc:343] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:23.628193   522 leader_election.cc:343] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.628721   522 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:23.603101   779 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:23.629549   381 catalog_manager.cc:5697] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:23.630726   773 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:23.639364   845 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:23.641624   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:23.643976   629 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.623029   785 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:23.643858   597 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:23.658001   847 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.658772   674 tablet_bootstrap.cc:492] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:23.659373   674 ts_tablet_manager.cc:1403] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.231s	user 0.042s	sys 0.044s
I20260709 13:12:23.660118   847 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:23.661291   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:23.661887   481 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.662263   674 raft_consensus.cc:359] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.662983   674 raft_consensus.cc:385] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.663309   674 raft_consensus.cc:740] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.663714   738 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:23.664096   674 consensus_queue.cc:260] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.665949   779 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:23.667037   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:23.667670   557 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.668606   674 ts_tablet_manager.cc:1434] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:12:23.669900   674 tablet_bootstrap.cc:492] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:23.673676   673 tablet_bootstrap.cc:492] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:23.674278   673 ts_tablet_manager.cc:1403] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.080s	user 0.023s	sys 0.025s
I20260709 13:12:23.676160   675 tablet_bootstrap.cc:492] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:23.676610   675 ts_tablet_manager.cc:1403] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.095s	user 0.018s	sys 0.003s
I20260709 13:12:23.676558   726 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.677100   726 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.677640   673 raft_consensus.cc:359] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.678540   673 raft_consensus.cc:385] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.678858   673 raft_consensus.cc:740] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.679111   726 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:23.679988   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:23.680274   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:23.680763   559 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
W20260709 13:12:23.681527   447 leader_election.cc:343] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.681687   673 consensus_queue.cc:260] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.682320   448 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:23.681293   481 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:23.684010   726 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:23.684369   726 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.684713   599 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:23.684933   726 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.685573   779 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:23.686043   779 raft_consensus.cc:697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:23.686233   557 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:23.686875   779 consensus_queue.cc:237] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.687693   675 raft_consensus.cc:359] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.688347   675 raft_consensus.cc:385] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.688601   675 raft_consensus.cc:740] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.689944   675 consensus_queue.cc:260] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.692188   675 ts_tablet_manager.cc:1434] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:12:23.692847   726 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.693266   675 tablet_bootstrap.cc:492] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:23.684347   673 ts_tablet_manager.cc:1434] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:12:23.695477   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:23.696058   559 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.696372   726 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:23.695703   673 tablet_bootstrap.cc:492] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:23.697228   674 tablet_bootstrap.cc:654] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.700152   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:12:23.701737   447 leader_election.cc:343] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.702833   673 tablet_bootstrap.cc:654] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.704818   675 tablet_bootstrap.cc:654] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.707193   559 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:23.713591   448 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:23.714641   726 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:23.715090   726 raft_consensus.cc:697] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:23.716027   726 consensus_queue.cc:237] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.717101   738 consensus_queue.cc:1048] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:23.723019   674 tablet_bootstrap.cc:492] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:23.723641   674 ts_tablet_manager.cc:1403] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.010s
I20260709 13:12:23.749655   674 raft_consensus.cc:359] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.750586   674 raft_consensus.cc:385] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.750926   674 raft_consensus.cc:740] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.759447   848 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:23.764243   674 consensus_queue.cc:260] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.767045   674 ts_tablet_manager.cc:1434] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:12:23.768230   674 tablet_bootstrap.cc:492] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:23.773963   674 tablet_bootstrap.cc:654] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.797204   673 tablet_bootstrap.cc:492] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:23.797830   673 ts_tablet_manager.cc:1403] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.102s	user 0.018s	sys 0.006s
I20260709 13:12:23.800710   848 consensus_queue.cc:1048] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:23.805218   381 catalog_manager.cc:5697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.809769   673 raft_consensus.cc:359] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.810706   673 raft_consensus.cc:385] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.811038   673 raft_consensus.cc:740] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.812213   673 consensus_queue.cc:260] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.816656   673 ts_tablet_manager.cc:1434] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:12:23.818724   673 tablet_bootstrap.cc:492] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:23.831622   675 tablet_bootstrap.cc:492] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:23.832218   675 ts_tablet_manager.cc:1403] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.139s	user 0.016s	sys 0.004s
I20260709 13:12:23.833024   673 tablet_bootstrap.cc:654] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.835505   675 raft_consensus.cc:359] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.836418   675 raft_consensus.cc:385] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.836762   675 raft_consensus.cc:740] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.837566   675 consensus_queue.cc:260] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.842664   675 ts_tablet_manager.cc:1434] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:12:23.891444   380 catalog_manager.cc:5697] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:23.895998   722 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.895998   847 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.917125   779 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.918155   779 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.897127   722 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.927129   847 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.929803   779 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:23.939177   673 tablet_bootstrap.cc:492] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:23.940269   673 ts_tablet_manager.cc:1403] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.123s	user 0.012s	sys 0.007s
I20260709 13:12:23.931658   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:23.942342   559 raft_consensus.cc:2393] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:12:23.946465   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:23.948421   673 raft_consensus.cc:359] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.949007   559 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:23.950047   675 tablet_bootstrap.cc:492] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:23.952764   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:23.949234   673 raft_consensus.cc:385] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.953709   482 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:23.953702   673 raft_consensus.cc:740] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.955610   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:23.955125   673 consensus_queue.cc:260] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:23.958751   599 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:23.960661   674 tablet_bootstrap.cc:492] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:23.986071   674 ts_tablet_manager.cc:1403] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.218s	user 0.047s	sys 0.033s
I20260709 13:12:23.963395   722 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:23.967087   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:23.996062   558 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:23.932456   847 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:23.993592   893 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:23.997936   785 raft_consensus.cc:2804] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:23.998526   785 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.999037   785 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.000972   448 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:24.002127   892 raft_consensus.cc:2804] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.002595   892 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.003027   892 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.002197   674 raft_consensus.cc:359] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.006769   674 raft_consensus.cc:385] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.007125   674 raft_consensus.cc:740] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.012182   674 consensus_queue.cc:260] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.023957   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:24.025244   893 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:24.026223   599 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:24.043462   848 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.044364   848 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.058554   847 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.064180   673 ts_tablet_manager.cc:1434] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.123s	user 0.009s	sys 0.000s
I20260709 13:12:24.080443   675 tablet_bootstrap.cc:654] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.080863   673 tablet_bootstrap.cc:492] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:24.085815   674 ts_tablet_manager.cc:1434] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.099s	user 0.010s	sys 0.005s
I20260709 13:12:24.087311   674 tablet_bootstrap.cc:492] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:24.094064   848 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:12:24.104056   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 77960.1us
I20260709 13:12:24.113384   917 consensus_queue.cc:1048] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:24.125345   674 tablet_bootstrap.cc:654] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.126794   847 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.131076   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:12:24.146469   522 leader_election.cc:343] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.153091   781 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:24.154460   447 consensus_peers.cc:597] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 -> Peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Couldn't send request to peer 50f7c2247be24f3685d7fbca7b6c71e3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:24.118831   892 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.157334   892 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:24.157632   779 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:24.160792   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:24.161481   557 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.169013   847 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.169693   847 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.175742   847 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:24.181339   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:24.183228   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:24.182592   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:24.184644   483 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
W20260709 13:12:24.187784   447 consensus_peers.cc:597] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 -> Peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Couldn't send request to peer 50f7c2247be24f3685d7fbca7b6c71e3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:24.189067   785 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.189370   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:24.190060   481 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
W20260709 13:12:24.190198   597 leader_election.cc:343] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.190929   525 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:24.192056   738 consensus_queue.cc:1048] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:24.192996   918 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.193457   918 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.193869   918 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.194453   599 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:24.200475   629 raft_consensus.cc:2393] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 1: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:12:24.196326   847 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.202574   847 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.205171   847 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.206755   675 tablet_bootstrap.cc:492] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:24.207132   675 ts_tablet_manager.cc:1403] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.293s	user 0.014s	sys 0.008s
I20260709 13:12:24.228298   789 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.228937   789 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.232317   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:24.232983   559 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:24.234298   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:24.235049   892 raft_consensus.cc:2804] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:24.235414   892 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.235782   892 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.236536   557 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:24.237924   448 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:24.231055   789 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:24.245373   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:24.246435   557 raft_consensus.cc:2393] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:12:24.248584   722 raft_consensus.cc:2804] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.249090   722 raft_consensus.cc:697] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:24.250046   722 consensus_queue.cc:237] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.254679   785 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:24.254390   789 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:24.259042   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:24.259785   629 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:24.260313   847 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.262213   847 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:24.264426   675 raft_consensus.cc:359] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.265874   675 raft_consensus.cc:385] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.266213   675 raft_consensus.cc:740] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.290445   673 tablet_bootstrap.cc:654] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.292176   892 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.294678   892 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:24.253039   918 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.309980   674 tablet_bootstrap.cc:492] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:24.332293   918 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:24.337435   674 ts_tablet_manager.cc:1403] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.250s	user 0.019s	sys 0.032s
I20260709 13:12:24.338578   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:12:24.339308   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 71150.2us
W20260709 13:12:24.340184   522 leader_election.cc:343] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.341367   675 consensus_queue.cc:260] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.344105   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:24.353547   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:24.354153   557 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.354672   785 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.346112   674 raft_consensus.cc:359] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.355361   674 raft_consensus.cc:385] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.355111   785 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.355669   674 raft_consensus.cc:740] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.356786   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:24.357304   785 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:12:24.358353   597 leader_election.cc:343] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.348520   675 ts_tablet_manager.cc:1434] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.141s	user 0.012s	sys 0.009s
I20260709 13:12:24.362461   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:24.363065   483 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.363641   675 tablet_bootstrap.cc:492] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:24.364383   785 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:24.368192   599 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:24.346997   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:24.369659   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:24.377938   673 tablet_bootstrap.cc:492] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:24.371366   631 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.378412   673 ts_tablet_manager.cc:1403] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.313s	user 0.008s	sys 0.004s
I20260709 13:12:24.356359   674 consensus_queue.cc:260] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.382984   674 ts_tablet_manager.cc:1434] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:12:24.371192   483 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:24.384006   674 tablet_bootstrap.cc:492] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
W20260709 13:12:24.373813   599 leader_election.cc:343] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.387458   557 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:12:24.388484   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:24.388832   675 tablet_bootstrap.cc:654] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.389182   722 raft_consensus.cc:2804] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:24.389686   722 raft_consensus.cc:697] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:24.374212   785 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.390554   722 consensus_queue.cc:237] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.374246   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:24.375686   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:24.392874   481 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.392958   554 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:24.393121   631 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:12:24.401437   525 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:24.403220   845 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.403074   673 raft_consensus.cc:359] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.403777   845 raft_consensus.cc:697] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:24.404637   845 consensus_queue.cc:237] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.408469   597 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:24.411181   920 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.411612   920 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.411954   920 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.412755   481 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:24.403800   673 raft_consensus.cc:385] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.418797   673 raft_consensus.cc:740] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.419271   599 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:24.419548   673 consensus_queue.cc:260] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.422148   785 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.422667   785 raft_consensus.cc:697] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:24.423506   785 consensus_queue.cc:237] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.424489   673 ts_tablet_manager.cc:1434] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.002s
I20260709 13:12:24.425751   673 tablet_bootstrap.cc:492] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:24.446686   380 catalog_manager.cc:5697] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:24.448448   920 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.451540   934 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.454296   675 tablet_bootstrap.cc:492] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:24.454766   675 ts_tablet_manager.cc:1403] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.091s	user 0.010s	sys 0.000s
I20260709 13:12:24.455361   674 tablet_bootstrap.cc:654] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.452132   934 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.456202   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:24.457093   920 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:12:24.459120   599 leader_election.cc:343] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.459935   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:24.460565   559 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.460610   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:24.466710   673 tablet_bootstrap.cc:654] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.467924   934 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:24.472847   559 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:24.476001   597 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:24.475848   381 catalog_manager.cc:5697] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.477648   785 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.478624   785 raft_consensus.cc:697] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:24.479421   785 consensus_queue.cc:237] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.480274   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:24.481452   675 raft_consensus.cc:359] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.481902   597 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:24.483099   920 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.478008   381 catalog_manager.cc:5697] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 2, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 2 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.482147   675 raft_consensus.cc:385] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.486805   675 raft_consensus.cc:740] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.488219   675 consensus_queue.cc:260] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.493721   673 tablet_bootstrap.cc:492] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:24.494207   673 ts_tablet_manager.cc:1403] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.001s
I20260709 13:12:24.500469   378 catalog_manager.cc:5697] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:24.501327   380 catalog_manager.cc:5697] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.503883   673 raft_consensus.cc:359] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.504562   673 raft_consensus.cc:385] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.504832   673 raft_consensus.cc:740] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.505493   673 consensus_queue.cc:260] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.508628   675 ts_tablet_manager.cc:1434] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 13:12:24.509680   675 tablet_bootstrap.cc:492] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:24.515676   673 ts_tablet_manager.cc:1434] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:12:24.516731   673 tablet_bootstrap.cc:492] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:24.519796   675 tablet_bootstrap.cc:654] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.522181   673 tablet_bootstrap.cc:654] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.525847   674 tablet_bootstrap.cc:492] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:24.526459   674 ts_tablet_manager.cc:1403] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.143s	user 0.014s	sys 0.006s
I20260709 13:12:24.529716   674 raft_consensus.cc:359] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.530491   674 raft_consensus.cc:385] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.530767   674 raft_consensus.cc:740] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.532371   675 tablet_bootstrap.cc:492] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:24.532826   675 ts_tablet_manager.cc:1403] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.000s
I20260709 13:12:24.532624   674 consensus_queue.cc:260] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.535138   674 ts_tablet_manager.cc:1434] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:12:24.535444   675 raft_consensus.cc:359] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.536131   675 raft_consensus.cc:385] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.536381   675 raft_consensus.cc:740] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.536958   675 consensus_queue.cc:260] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.538654   675 ts_tablet_manager.cc:1434] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:24.540156   674 tablet_bootstrap.cc:492] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:24.540932   845 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.541374   845 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.546816   675 tablet_bootstrap.cc:492] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:24.548640   845 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:24.549225   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:24.549893   484 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:24.551007   525 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:24.551620   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:24.552733   673 tablet_bootstrap.cc:492] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:24.552675   845 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.553340   845 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.553447   673 ts_tablet_manager.cc:1403] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.009s
I20260709 13:12:24.553714   845 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.557996   673 raft_consensus.cc:359] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:24.554224   522 leader_election.cc:343] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.558765   673 raft_consensus.cc:385] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.559259   673 raft_consensus.cc:740] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.560071   673 consensus_queue.cc:260] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.561074   845 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.562465   674 tablet_bootstrap.cc:654] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:24.553447   429 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:24.563776   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:24.564324   484 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.570762   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:24.571296   920 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:24.572213   522 leader_election.cc:343] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.572084   920 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.572762   845 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:24.574811   920 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:24.575486   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:24.575894   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:24.571393   484 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:24.578202   675 tablet_bootstrap.cc:654] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.578406   525 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:24.580744   673 ts_tablet_manager.cc:1434] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
W20260709 13:12:24.580917   597 leader_election.cc:343] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.583612   673 tablet_bootstrap.cc:492] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
W20260709 13:12:24.584085   599 leader_election.cc:343] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.584726   599 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:24.585717   920 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.590135   675 tablet_bootstrap.cc:492] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:24.590598   675 ts_tablet_manager.cc:1403] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.000s
I20260709 13:12:24.593601   675 raft_consensus.cc:359] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.595553   673 tablet_bootstrap.cc:654] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.594223   675 raft_consensus.cc:385] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.595472   845 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.596004   675 raft_consensus.cc:740] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.596993   674 tablet_bootstrap.cc:492] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:24.596702   675 consensus_queue.cc:260] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.597460   674 ts_tablet_manager.cc:1403] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.058s	user 0.022s	sys 0.011s
I20260709 13:12:24.597527   845 raft_consensus.cc:697] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:24.598899   675 ts_tablet_manager.cc:1434] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.004s
I20260709 13:12:24.599963   675 tablet_bootstrap.cc:492] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:24.598730   845 consensus_queue.cc:237] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.600061   674 raft_consensus.cc:359] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.600723   674 raft_consensus.cc:385] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.600910   674 raft_consensus.cc:740] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.601428   674 consensus_queue.cc:260] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.603515   674 ts_tablet_manager.cc:1434] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:12:24.604635   674 tablet_bootstrap.cc:492] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:24.607343   675 tablet_bootstrap.cc:654] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.608415   673 tablet_bootstrap.cc:492] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:24.608855   673 ts_tablet_manager.cc:1403] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.001s
I20260709 13:12:24.610227   674 tablet_bootstrap.cc:654] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.611310   673 raft_consensus.cc:359] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.611986   673 raft_consensus.cc:385] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.612258   673 raft_consensus.cc:740] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.612944   673 consensus_queue.cc:260] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.615806   673 ts_tablet_manager.cc:1434] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:24.617048   673 tablet_bootstrap.cc:492] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:24.618407   675 tablet_bootstrap.cc:492] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:24.618852   675 ts_tablet_manager.cc:1403] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:12:24.620435   892 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.620877   892 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.622870   892 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:24.624361   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:24.626307   673 tablet_bootstrap.cc:654] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.625515   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:24.627264   554 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
W20260709 13:12:24.629411   447 leader_election.cc:343] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.630187   448 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:24.631175   892 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.631543   892 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.631840   892 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.637615   674 tablet_bootstrap.cc:492] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:24.638101   674 ts_tablet_manager.cc:1403] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.021s
I20260709 13:12:24.629431   675 raft_consensus.cc:359] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.639946   675 raft_consensus.cc:385] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.640201   675 raft_consensus.cc:740] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.640722   674 raft_consensus.cc:359] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.640889   675 consensus_queue.cc:260] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.641379   674 raft_consensus.cc:385] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.641486   673 tablet_bootstrap.cc:492] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:24.641729   674 raft_consensus.cc:740] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.642022   673 ts_tablet_manager.cc:1403] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.002s
I20260709 13:12:24.642359   674 consensus_queue.cc:260] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.642973   675 ts_tablet_manager.cc:1434] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.000s
I20260709 13:12:24.639127   892 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.644565   673 raft_consensus.cc:359] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.644378   674 ts_tablet_manager.cc:1434] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:12:24.645205   892 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:24.645215   673 raft_consensus.cc:385] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.645787   673 raft_consensus.cc:740] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.646320   674 tablet_bootstrap.cc:492] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:24.646397   673 consensus_queue.cc:260] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.647017   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:24.648046   675 tablet_bootstrap.cc:492] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:24.648370   673 ts_tablet_manager.cc:1434] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:24.649873   673 tablet_bootstrap.cc:492] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:24.652169   918 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.652927   674 tablet_bootstrap.cc:654] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.652621   918 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.654951   918 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:24.665105   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:24.665721   554 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.655776   673 tablet_bootstrap.cc:654] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.656924   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:24.672647   554 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:24.661572   674 tablet_bootstrap.cc:492] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
W20260709 13:12:24.662192   447 leader_election.cc:343] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.673892   381 catalog_manager.cc:5697] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.674711   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:24.663847   675 tablet_bootstrap.cc:654] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.675618   484 raft_consensus.cc:2393] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 1: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:12:24.674118   448 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:24.678699   892 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.692510   892 raft_consensus.cc:697] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:24.693332   525 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:24.699605   738 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.693625   674 ts_tablet_manager.cc:1403] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.006s
I20260709 13:12:24.703620   789 consensus_queue.cc:1048] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:24.705588   674 raft_consensus.cc:359] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.706218   674 raft_consensus.cc:385] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.706473   674 raft_consensus.cc:740] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.693356   892 consensus_queue.cc:237] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.697108   673 tablet_bootstrap.cc:492] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:24.707127   673 ts_tablet_manager.cc:1403] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.004s
I20260709 13:12:24.707417   674 consensus_queue.cc:260] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.709486   674 ts_tablet_manager.cc:1434] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:24.709730   673 raft_consensus.cc:359] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.710379   674 tablet_bootstrap.cc:492] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:24.710394   673 raft_consensus.cc:385] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.715024   673 raft_consensus.cc:740] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.715670   673 consensus_queue.cc:260] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.716349   674 tablet_bootstrap.cc:654] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.717103   673 ts_tablet_manager.cc:1434] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:12:24.718163   673 tablet_bootstrap.cc:492] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:24.720731   631 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.722932   738 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.728567   673 tablet_bootstrap.cc:654] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.729130   674 tablet_bootstrap.cc:492] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:24.729745   674 ts_tablet_manager.cc:1403] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.005s
I20260709 13:12:24.731866   893 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.732304   674 raft_consensus.cc:359] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.732291   893 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.734279   893 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:24.733044   674 raft_consensus.cc:385] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.735630   674 raft_consensus.cc:740] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.736343   674 consensus_queue.cc:260] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.737794   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:24.738303   674 ts_tablet_manager.cc:1434] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 13:12:24.739283   674 tablet_bootstrap.cc:492] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:24.740199   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:24.742514   673 tablet_bootstrap.cc:492] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:24.742990   673 ts_tablet_manager.cc:1403] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
I20260709 13:12:24.743328   920 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.743808   920 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.744887   674 tablet_bootstrap.cc:654] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:24.745090   448 leader_election.cc:343] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.746459   920 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:24.746614   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:24.746838   726 consensus_queue.cc:1048] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:24.752547   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:24.753427   481 raft_consensus.cc:2393] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:12:24.755314   599 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:12:24.756168   447 leader_election.cc:343] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.756583   447 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:24.756747   785 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.757244   893 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.764127   934 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.764599   934 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.766530   934 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:24.768399   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:24.771457   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:24.772203   481 raft_consensus.cc:2393] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:12:24.778385   599 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:24.779775   934 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.790028   789 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.790527   789 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.792299   675 tablet_bootstrap.cc:492] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:24.792441   789 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:24.792765   675 ts_tablet_manager.cc:1403] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.145s	user 0.015s	sys 0.002s
I20260709 13:12:24.794198   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:24.794798   559 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:24.795202   675 raft_consensus.cc:359] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.795866   675 raft_consensus.cc:385] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.796109   675 raft_consensus.cc:740] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.796671   675 consensus_queue.cc:260] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.801136   785 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.805001   934 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.805249   448 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:24.748818   673 raft_consensus.cc:359] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.806457   673 raft_consensus.cc:385] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.806739   673 raft_consensus.cc:740] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.807410   673 consensus_queue.cc:260] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.807904   722 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.808449   722 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.808871   722 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.809644   673 ts_tablet_manager.cc:1434] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.000s
I20260709 13:12:24.809643   675 ts_tablet_manager.cc:1434] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.005s
I20260709 13:12:24.810690   673 tablet_bootstrap.cc:492] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:24.811024   675 tablet_bootstrap.cc:492] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:24.820111   674 tablet_bootstrap.cc:492] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:24.820569   674 ts_tablet_manager.cc:1403] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.082s	user 0.023s	sys 0.029s
I20260709 13:12:24.821468   673 tablet_bootstrap.cc:654] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.819689   380 catalog_manager.cc:5697] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.823122   674 raft_consensus.cc:359] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.823809   674 raft_consensus.cc:385] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.824118   674 raft_consensus.cc:740] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.822000   722 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.824769   674 consensus_queue.cc:260] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.826713   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:24.827984   674 ts_tablet_manager.cc:1434] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:24.828575   675 tablet_bootstrap.cc:654] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.828927   674 tablet_bootstrap.cc:492] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
W20260709 13:12:24.830572   447 leader_election.cc:343] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.839882   722 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:24.846817   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:24.847398   557 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.894219   845 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:24.897127   559 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:24.901345   892 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:24.903017   845 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:24.905153   557 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:24.906242   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:24.908215   785 consensus_queue.cc:1048] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:24.911540   629 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:24.929541   934 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.920579   674 tablet_bootstrap.cc:654] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.924868   673 tablet_bootstrap.cc:492] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:24.926479   779 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:24.929967   934 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.931406   673 ts_tablet_manager.cc:1403] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.121s	user 0.026s	sys 0.023s
W20260709 13:12:24.931931   447 leader_election.cc:343] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.933147   892 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:24.933954   673 raft_consensus.cc:359] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.934607   673 raft_consensus.cc:385] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.934873   673 raft_consensus.cc:740] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.936286   934 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:24.937786   675 tablet_bootstrap.cc:492] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:24.937973   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:24.939458   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:24.939422   673 consensus_queue.cc:260] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.940619   448 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:24.946188   722 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.946691   722 raft_consensus.cc:697] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:24.947537   722 consensus_queue.cc:237] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.948558   675 ts_tablet_manager.cc:1403] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.136s	user 0.011s	sys 0.015s
I20260709 13:12:24.954865   673 ts_tablet_manager.cc:1434] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:12:24.965742   599 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:24.968281   934 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.972519   674 tablet_bootstrap.cc:492] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:24.973014   674 ts_tablet_manager.cc:1403] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.144s	user 0.011s	sys 0.003s
I20260709 13:12:24.973940   673 tablet_bootstrap.cc:492] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:24.981222   675 raft_consensus.cc:359] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.981994   675 raft_consensus.cc:385] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.982241   675 raft_consensus.cc:740] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.983174   675 consensus_queue.cc:260] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.983741   674 raft_consensus.cc:359] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.984409   674 raft_consensus.cc:385] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.984674   674 raft_consensus.cc:740] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.985397   675 ts_tablet_manager.cc:1434] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:12:24.985268   674 consensus_queue.cc:260] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:24.986356   675 tablet_bootstrap.cc:492] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:24.987265   674 ts_tablet_manager.cc:1434] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 13:12:24.988227   674 tablet_bootstrap.cc:492] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:24.992478   380 catalog_manager.cc:5697] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.010793   722 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.994923   481 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:25.013023   675 tablet_bootstrap.cc:654] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:25.009433   779 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:12:25.002733   845 consensus_queue.cc:1048] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:12:25.018862   722 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.024036   934 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.025144   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:12:25.027613   448 leader_election.cc:343] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:25.033107   738 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.033708   738 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.036638   738 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:25.029243   934 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.037891   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:25.038350   722 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:25.043473   673 tablet_bootstrap.cc:654] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:25.043426   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:12:25.042029   522 leader_election.cc:343] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:25.044130   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:25.043757   779 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.043831   629 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:25.059221   785 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.059728   785 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.059266   934 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:25.062660   785 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:12:25.061414   525 leader_election.cc:343] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:25.063849   525 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:25.072790   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:25.073359   738 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:25.074787   674 tablet_bootstrap.cc:654] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:25.064601   632 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:25.081529   722 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.082036   722 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.084972   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:12:25.086223   448 leader_election.cc:343] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:25.087733   722 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:25.089138   447 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:25.089650   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:25.089895   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:25.090165   722 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:25.090245   484 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:25.090619   722 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.090970   722 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:25.091123   447 leader_election.cc:343] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:25.091696   447 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:25.092561   789 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:25.093585   599 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:25.094518   920 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:25.065075   779 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.094920   920 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.095536   920 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:25.103088   892 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.103910   674 tablet_bootstrap.cc:492] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:25.103638   892 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.104359   674 ts_tablet_manager.cc:1403] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.116s	user 0.010s	sys 0.004s
I20260709 13:12:25.106992   674 raft_consensus.cc:359] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.107637   674 raft_consensus.cc:385] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:25.107610   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:25.108178   674 raft_consensus.cc:740] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:25.109195   892 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:25.109261   674 consensus_queue.cc:260] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.111071   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:25.112819   447 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:25.113598   789 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:25.114401   972 consensus_queue.cc:1048] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:25.109936   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 53169us
I20260709 13:12:25.122440   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:25.099010   779 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:25.126395   559 raft_consensus.cc:2393] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:12:25.130445   674 ts_tablet_manager.cc:1434] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:12:25.190361   722 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.197418   726 consensus_queue.cc:1048] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.209928   597 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:25.194816   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:25.127305   920 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.139931   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:25.234391   674 tablet_bootstrap.cc:492] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:25.216250   934 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:25.234195   892 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.239704   892 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.241868   892 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:25.245759   673 tablet_bootstrap.cc:492] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:25.246429   673 ts_tablet_manager.cc:1403] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.279s	user 0.054s	sys 0.061s
I20260709 13:12:25.285964   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:25.286727   559 raft_consensus.cc:2393] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
W20260709 13:12:25.257622   970 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:12:25.293226   597 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:12:25.300247   597 leader_election.cc:343] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:25.296700   779 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:25.297709   893 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.314411   773 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.314924   773 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.321076   675 tablet_bootstrap.cc:492] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:25.321537   675 ts_tablet_manager.cc:1403] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.335s	user 0.047s	sys 0.024s
I20260709 13:12:25.322609   920 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:12:25.323185   971 log.cc:927] Time spent T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:12:25.318219   773 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:25.312913   893 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.326876   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:25.329082   481 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:25.333308   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:25.333804   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:12:25.338919   597 leader_election.cc:343] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:25.340073   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:25.340823   631 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:25.352061   675 raft_consensus.cc:359] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.352927   675 raft_consensus.cc:385] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:25.353221   675 raft_consensus.cc:740] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:25.356211   934 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:25.356357   673 raft_consensus.cc:359] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.357085   673 raft_consensus.cc:385] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:25.350304   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:25.335178   722 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:12:25.358989   447 leader_election.cc:343] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:25.357357   673 raft_consensus.cc:740] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:25.359887   673 consensus_queue.cc:260] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.361380   673 ts_tablet_manager.cc:1434] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.115s	user 0.007s	sys 0.002s
I20260709 13:12:25.364483   674 tablet_bootstrap.cc:654] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:25.354610   675 consensus_queue.cc:260] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.377822   631 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:25.381595   447 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:25.385912   675 ts_tablet_manager.cc:1434] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:12:25.349123   481 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:25.419202   675 tablet_bootstrap.cc:492] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
W20260709 13:12:25.421964   448 leader_election.cc:343] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:25.415059   892 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:25.423112   673 tablet_bootstrap.cc:492] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:25.422365   448 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:25.427672   726 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:25.429270   599 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:25.425298   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:25.427392   892 raft_consensus.cc:697] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:25.455380   976 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.455725   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:25.456115   976 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.437568   920 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:25.475855   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 47825.8us
I20260709 13:12:25.482553   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:25.485476   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:25.486903   893 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:12:25.533557   522 leader_election.cc:343] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:25.500324   892 consensus_queue.cc:237] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.531704   920 raft_consensus.cc:697] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:25.563690   779 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:25.596117   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:25.580034   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:25.631464   675 tablet_bootstrap.cc:654] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:25.633311   920 consensus_queue.cc:237] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.643859   674 tablet_bootstrap.cc:492] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:25.644403   674 ts_tablet_manager.cc:1403] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.432s	user 0.011s	sys 0.012s
W20260709 13:12:25.649958   448 leader_election.cc:343] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:25.647006   674 raft_consensus.cc:359] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.654134   674 raft_consensus.cc:385] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:25.654412   674 raft_consensus.cc:740] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:25.655620   738 consensus_queue.cc:1048] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:25.660585   448 leader_election.cc:343] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:25.661185   674 consensus_queue.cc:260] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:25.664651   525 leader_election.cc:343] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:25.665124   525 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:25.665813   845 raft_consensus.cc:2749] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:25.666133   674 ts_tablet_manager.cc:1434] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 13:12:25.667375   726 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.667163   674 tablet_bootstrap.cc:492] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:25.670994   673 tablet_bootstrap.cc:654] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:25.674166   448 leader_election.cc:343] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:25.681309   978 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:12:25.673489   726 consensus_queue.cc:1048] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.687467   976 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:12:25.715119   447 leader_election.cc:343] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:25.716740   447 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:25.724766   675 tablet_bootstrap.cc:492] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:25.725402   675 ts_tablet_manager.cc:1403] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.306s	user 0.025s	sys 0.028s
I20260709 13:12:25.750862   789 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:25.769955   673 tablet_bootstrap.cc:492] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:25.770987   673 ts_tablet_manager.cc:1403] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.354s	user 0.020s	sys 0.019s
I20260709 13:12:25.777781   675 raft_consensus.cc:359] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.778584   675 raft_consensus.cc:385] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:25.778890   675 raft_consensus.cc:740] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:25.779531   675 consensus_queue.cc:260] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.784168   972 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.786758   674 tablet_bootstrap.cc:654] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:25.793980   675 ts_tablet_manager.cc:1434] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:12:25.784657   972 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.815755   673 raft_consensus.cc:359] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.816613   673 raft_consensus.cc:385] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:25.816895   673 raft_consensus.cc:740] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:25.817706   673 consensus_queue.cc:260] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.825066   673 ts_tablet_manager.cc:1434] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:12:25.829767   972 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:25.830862   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:12:25.832499   597 leader_election.cc:343] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:25.833122   673 tablet_bootstrap.cc:492] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
W20260709 13:12:25.840549   429 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:25.858631   675 tablet_bootstrap.cc:492] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:25.862329   673 tablet_bootstrap.cc:654] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:25.863960   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 69367.7us
I20260709 13:12:25.870288   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:25.870976   484 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:25.873037   675 tablet_bootstrap.cc:654] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:25.876637   599 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:25.877717   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:25.882278   983 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.892787   379 catalog_manager.cc:5697] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.899521   990 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:25.899951   990 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.900305   990 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:25.901067   674 tablet_bootstrap.cc:492] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:25.901672   674 ts_tablet_manager.cc:1403] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.235s	user 0.017s	sys 0.004s
I20260709 13:12:25.914011   983 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:25.939327   447 leader_election.cc:343] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:25.937757   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:25.941039   479 raft_consensus.cc:2393] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 1: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:12:25.941730   673 tablet_bootstrap.cc:492] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:25.942225   673 ts_tablet_manager.cc:1403] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.013s
I20260709 13:12:25.942185   447 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:25.943617   893 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:25.937039   983 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:25.947583   673 raft_consensus.cc:359] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.948349   673 raft_consensus.cc:385] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:25.948664   673 raft_consensus.cc:740] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:25.951742   673 consensus_queue.cc:260] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.958612   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:25.950894   990 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.962219   522 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:25.962056   674 raft_consensus.cc:359] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.963567   674 raft_consensus.cc:385] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:25.963398   738 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:25.963884   674 raft_consensus.cc:740] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:25.964560   674 consensus_queue.cc:260] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.966090   845 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.966648   845 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:25.967628   674 ts_tablet_manager.cc:1434] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.066s	user 0.003s	sys 0.003s
I20260709 13:12:25.968763   674 tablet_bootstrap.cc:492] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:25.971509   845 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:25.974417   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:25.977651   673 ts_tablet_manager.cc:1434] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
W20260709 13:12:25.976962   522 leader_election.cc:343] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:25.979555   673 tablet_bootstrap.cc:492] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:25.983023   990 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:25.985437   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:25.985942   482 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:25.990736   482 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:25.991660   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:25.992041   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:25.992306   481 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
W20260709 13:12:25.993790   597 leader_election.cc:343] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.000900   675 tablet_bootstrap.cc:492] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:26.001461   675 ts_tablet_manager.cc:1403] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.143s	user 0.015s	sys 0.021s
I20260709 13:12:26.002697   525 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:26.003151   738 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:26.003204   599 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:26.003384   845 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:26.003858   845 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.004128   845 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.007539   990 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:26.008373   990 raft_consensus.cc:697] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:26.009264   990 consensus_queue.cc:237] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.009474   675 raft_consensus.cc:359] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.010272   673 tablet_bootstrap.cc:654] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.010499   675 raft_consensus.cc:385] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.011188   845 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.011894   675 raft_consensus.cc:740] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.013172   675 consensus_queue.cc:260] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.015285   674 tablet_bootstrap.cc:654] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.016306   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:26.017203   481 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.018078   675 ts_tablet_manager.cc:1434] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 13:12:26.019009   675 tablet_bootstrap.cc:492] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:26.025365   675 tablet_bootstrap.cc:654] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.045276   481 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:26.048656   845 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:26.050714   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:26.050751   380 catalog_manager.cc:5697] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:26.052806   522 leader_election.cc:343] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.054512   525 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:26.055927   738 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:26.056435   738 raft_consensus.cc:697] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:26.057513   990 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.057981   990 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.060962   990 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:26.061141   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:26.063315   481 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:26.057330   738 consensus_queue.cc:237] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.064345   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:26.065541   673 tablet_bootstrap.cc:492] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:26.065970   673 ts_tablet_manager.cc:1403] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.001s
I20260709 13:12:26.066778   599 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:26.069980   673 raft_consensus.cc:359] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:26.071156   597 leader_election.cc:343] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.071784   920 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:26.073339   920 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.073858   920 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.075897   977 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.076529   977 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.079262   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:26.080308   990 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:26.080619   977 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:12:26.081537   448 leader_election.cc:343] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.091342   673 raft_consensus.cc:385] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.091782   673 raft_consensus.cc:740] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.093218   380 catalog_manager.cc:5697] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:26.095325   673 consensus_queue.cc:260] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.108213   673 ts_tablet_manager.cc:1434] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260709 13:12:26.109135   990 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.109339   673 tablet_bootstrap.cc:492] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:26.112106   990 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.114871   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:26.115742   478 raft_consensus.cc:2393] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:12:26.118178   920 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.120368   920 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:26.120277   381 catalog_manager.cc:5697] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:26.121381   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:12:26.122749   597 leader_election.cc:343] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.123970   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:26.124706   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:26.126005   478 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:26.126107   447 leader_election.cc:343] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.126546   447 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:26.128998   722 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:26.129518   675 tablet_bootstrap.cc:492] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:26.129434   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:26.130023   675 ts_tablet_manager.cc:1403] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.111s	user 0.035s	sys 0.031s
I20260709 13:12:26.131026   597 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:26.131908   920 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.132861   990 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:26.138684   920 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:26.139076   478 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:26.132603   675 raft_consensus.cc:359] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.140147   675 raft_consensus.cc:385] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.140173   599 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:26.140653   675 raft_consensus.cc:740] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.141304   675 consensus_queue.cc:260] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.142030   674 tablet_bootstrap.cc:492] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:26.144253   674 ts_tablet_manager.cc:1403] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.176s	user 0.015s	sys 0.017s
I20260709 13:12:26.143015   920 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:26.147701   920 raft_consensus.cc:697] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:26.147998   674 raft_consensus.cc:359] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.148665   674 raft_consensus.cc:385] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.148816   920 consensus_queue.cc:237] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.143311   675 ts_tablet_manager.cc:1434] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
W20260709 13:12:26.157575   448 consensus_peers.cc:597] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:26.157699   675 tablet_bootstrap.cc:492] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:26.157718   674 raft_consensus.cc:740] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.160317   674 consensus_queue.cc:260] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.165812   674 ts_tablet_manager.cc:1434] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:12:26.167200   673 tablet_bootstrap.cc:654] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.169922   675 tablet_bootstrap.cc:654] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.171180   381 catalog_manager.cc:5697] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:26.167618   674 tablet_bootstrap.cc:492] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:26.177518   972 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:26.198195   674 tablet_bootstrap.cc:654] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.205233   673 tablet_bootstrap.cc:492] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:26.205842   673 ts_tablet_manager.cc:1403] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.097s	user 0.007s	sys 0.005s
I20260709 13:12:26.209967   673 raft_consensus.cc:359] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.205235   675 tablet_bootstrap.cc:492] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:26.212430   675 ts_tablet_manager.cc:1403] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.002s
I20260709 13:12:26.211323   673 raft_consensus.cc:385] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.212918   673 raft_consensus.cc:740] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.214035   674 tablet_bootstrap.cc:492] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:26.213857   673 consensus_queue.cc:260] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.215561   675 raft_consensus.cc:359] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.214514   674 ts_tablet_manager.cc:1403] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.003s
I20260709 13:12:26.216390   673 ts_tablet_manager.cc:1434] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:26.218735   673 tablet_bootstrap.cc:492] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:26.216400   675 raft_consensus.cc:385] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.219606   675 raft_consensus.cc:740] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.219471   674 raft_consensus.cc:359] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.220288   674 raft_consensus.cc:385] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.220634   674 raft_consensus.cc:740] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.221381   674 consensus_queue.cc:260] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.223646   674 ts_tablet_manager.cc:1434] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:26.221746   675 consensus_queue.cc:260] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.225666   675 ts_tablet_manager.cc:1434] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:12:26.226671   675 tablet_bootstrap.cc:492] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:26.228459   673 tablet_bootstrap.cc:654] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.232283   674 tablet_bootstrap.cc:492] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:26.232842   675 tablet_bootstrap.cc:654] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.236095   893 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:26.240554   674 tablet_bootstrap.cc:654] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.247630   675 tablet_bootstrap.cc:492] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:26.248318   675 ts_tablet_manager.cc:1403] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 13:12:26.251683   675 raft_consensus.cc:359] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.254694   675 raft_consensus.cc:385] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.255079   675 raft_consensus.cc:740] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.255811   675 consensus_queue.cc:260] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.258133   675 ts_tablet_manager.cc:1434] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:12:26.254122   673 tablet_bootstrap.cc:492] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:26.259367   673 ts_tablet_manager.cc:1403] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.003s
I20260709 13:12:26.261987   673 raft_consensus.cc:359] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.262686   673 raft_consensus.cc:385] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.262861   674 tablet_bootstrap.cc:492] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:26.263059   673 raft_consensus.cc:740] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.264050   675 tablet_bootstrap.cc:492] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:26.265038   673 consensus_queue.cc:260] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.268895   674 ts_tablet_manager.cc:1403] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.002s
I20260709 13:12:26.271917   675 tablet_bootstrap.cc:654] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.273435   673 ts_tablet_manager.cc:1434] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:12:26.274505   673 tablet_bootstrap.cc:492] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:26.275120   674 raft_consensus.cc:359] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.276679   674 raft_consensus.cc:385] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.277001   674 raft_consensus.cc:740] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.277751   674 consensus_queue.cc:260] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.280141   674 ts_tablet_manager.cc:1434] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:12:26.280661   673 tablet_bootstrap.cc:654] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.281863   674 tablet_bootstrap.cc:492] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:26.292529   673 tablet_bootstrap.cc:492] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:26.292989   673 ts_tablet_manager.cc:1403] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:12:26.296901   674 tablet_bootstrap.cc:654] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.298220   673 raft_consensus.cc:359] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.299014   673 raft_consensus.cc:385] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.299356   673 raft_consensus.cc:740] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.300632   675 tablet_bootstrap.cc:492] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:26.300169   673 consensus_queue.cc:260] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.301100   675 ts_tablet_manager.cc:1403] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.003s
I20260709 13:12:26.304304   675 raft_consensus.cc:359] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.305411   675 raft_consensus.cc:385] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.305862   675 raft_consensus.cc:740] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.306725   675 consensus_queue.cc:260] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.309221   673 ts_tablet_manager.cc:1434] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:12:26.309234   675 ts_tablet_manager.cc:1434] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 13:12:26.311349   983 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.312156   983 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.316388   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:26.317663   478 raft_consensus.cc:2393] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 1: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:12:26.311492   675 tablet_bootstrap.cc:492] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:26.320574   722 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.321393   722 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.325196   983 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:26.325450   675 tablet_bootstrap.cc:654] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.310479   673 tablet_bootstrap.cc:492] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:26.327121   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:26.327744   556 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:26.325834   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:26.330199   522 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:26.330430   674 tablet_bootstrap.cc:492] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:26.331032   674 ts_tablet_manager.cc:1403] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.012s
I20260709 13:12:26.331681   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:26.332837   726 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:26.333161   726 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.333451   726 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.334986   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:26.335633   625 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:26.338371   845 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.341614   674 raft_consensus.cc:359] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.342501   674 raft_consensus.cc:385] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.342836   674 raft_consensus.cc:740] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.343693   674 consensus_queue.cc:260] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.345629   978 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.326339   722 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:26.346112   978 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.348281   978 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:26.348889   845 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:26.350106   674 ts_tablet_manager.cc:1434] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:12:26.350693   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:26.353835   674 tablet_bootstrap.cc:492] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:26.356995   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:26.357755   726 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:26.358906   448 leader_election.cc:343] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.360018   673 tablet_bootstrap.cc:654] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.363006   726 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:26.364192   674 tablet_bootstrap.cc:654] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.365761   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:26.366647   554 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.369272   673 tablet_bootstrap.cc:492] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:26.369735   673 ts_tablet_manager.cc:1403] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.003s
I20260709 13:12:26.370298   674 tablet_bootstrap.cc:492] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:26.370776   674 ts_tablet_manager.cc:1403] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:12:26.372797   920 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.373253   920 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.373939   554 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:26.375381   920 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:26.372226   673 raft_consensus.cc:359] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.376144   673 raft_consensus.cc:385] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.376195   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:26.376488   673 raft_consensus.cc:740] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.376857   481 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
W20260709 13:12:26.377936   585 tablet.cc:2406] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:26.377579   673 consensus_queue.cc:260] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.377838   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:26.379379   983 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.378835   599 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:26.381556   978 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:26.381327   983 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.382521   673 ts_tablet_manager.cc:1434] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:12:26.382599   978 raft_consensus.cc:697] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:26.373275   674 raft_consensus.cc:359] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.383808   983 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:26.383538   978 consensus_queue.cc:237] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.383999   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:26.385857   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:26.386205   632 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.386771   673 tablet_bootstrap.cc:492] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
W20260709 13:12:26.387048   447 leader_election.cc:343] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.387478   447 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:26.388141   726 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:26.384414   920 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:26.388989   920 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.389142   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:26.389421   920 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.389756   554 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:26.400420   673 tablet_bootstrap.cc:654] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.409232   920 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.380695   675 tablet_bootstrap.cc:492] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:26.385246   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:26.411614   673 tablet_bootstrap.cc:492] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:26.423468   673 ts_tablet_manager.cc:1403] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.008s
I20260709 13:12:26.411652   972 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:26.423543   522 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:26.413933   632 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:26.424633   983 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:26.383562   674 raft_consensus.cc:385] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.422305   675 ts_tablet_manager.cc:1403] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.111s	user 0.022s	sys 0.012s
I20260709 13:12:26.426237   674 raft_consensus.cc:740] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.426927   674 consensus_queue.cc:260] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.427814   673 raft_consensus.cc:359] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.428063   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:26.428442   674 ts_tablet_manager.cc:1434] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 13:12:26.428670   554 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.428478   673 raft_consensus.cc:385] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.429512   673 raft_consensus.cc:740] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.429715   674 tablet_bootstrap.cc:492] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:26.429813   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:26.430370   481 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.436100   673 consensus_queue.cc:260] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.438393   675 raft_consensus.cc:359] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.439041   675 raft_consensus.cc:385] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.439198   673 ts_tablet_manager.cc:1434] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:12:26.439368   675 raft_consensus.cc:740] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.440338   673 tablet_bootstrap.cc:492] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:26.440865   379 catalog_manager.cc:5697] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:26.441751   674 tablet_bootstrap.cc:654] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.443524   675 consensus_queue.cc:260] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.445683   675 ts_tablet_manager.cc:1434] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:12:26.446617   673 tablet_bootstrap.cc:654] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.448503   481 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:26.451426   675 tablet_bootstrap.cc:492] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:26.453989   554 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:26.455585   597 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:26.462795   989 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:26.463711   989 raft_consensus.cc:697] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:26.463840   990 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.464592   990 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.464709   989 consensus_queue.cc:237] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.467027   990 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:26.467612   674 tablet_bootstrap.cc:492] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:26.463894   920 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:26.479908   675 tablet_bootstrap.cc:654] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.482308   674 ts_tablet_manager.cc:1403] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.008s
I20260709 13:12:26.483659   920 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.484181   920 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.485733   988 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:26.486166   920 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:26.485940   674 raft_consensus.cc:359] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.487414   674 raft_consensus.cc:385] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.488021   674 raft_consensus.cc:740] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.488740   674 consensus_queue.cc:260] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.489359   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:26.489972   556 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:26.491333   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:26.492874   990 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:26.493222   990 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.493557   990 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.493866   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:26.494485   478 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:26.500887   845 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.501446   845 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.502225   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:26.503930   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:26.505543   673 tablet_bootstrap.cc:492] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:26.509836   482 raft_consensus.cc:2393] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 1: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:12:26.510008   673 ts_tablet_manager.cc:1403] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.022s
I20260709 13:12:26.511205   481 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:26.512830   673 raft_consensus.cc:359] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.513517   673 raft_consensus.cc:385] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.513926   673 raft_consensus.cc:740] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.514735   599 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:26.514559   673 consensus_queue.cc:260] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.516235   988 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:26.516623   988 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.504195   845 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:26.516954   988 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.493558   674 ts_tablet_manager.cc:1434] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:12:26.517807   673 ts_tablet_manager.cc:1434] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:26.518201   674 tablet_bootstrap.cc:492] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:26.512362   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:26.507573   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:26.507436   990 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:26.527014   597 leader_election.cc:343] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.530768   990 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:26.531534   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:26.532089   481 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.535701   673 tablet_bootstrap.cc:492] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:26.542333   522 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:26.539664   674 tablet_bootstrap.cc:654] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.547544   738 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.551362   481 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:26.554591   738 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:26.554689   599 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:26.555977   972 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:26.556463   972 raft_consensus.cc:697] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:26.557252   972 consensus_queue.cc:237] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.559252   988 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.564487   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:26.565111   478 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.566882   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:26.568228   554 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.569794   990 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:26.574446   478 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:26.574692   738 consensus_queue.cc:1048] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:26.576588   599 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:26.581759   920 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:26.582381   920 raft_consensus.cc:697] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:26.583415   920 consensus_queue.cc:237] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.586104   673 tablet_bootstrap.cc:654] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.587728   845 consensus_queue.cc:1048] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:26.591747   993 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:26.595432   674 tablet_bootstrap.cc:492] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:26.595932   674 ts_tablet_manager.cc:1403] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.078s	user 0.008s	sys 0.006s
I20260709 13:12:26.598649   920 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.602747   379 catalog_manager.cc:5697] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:26.607021   675 tablet_bootstrap.cc:492] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:26.608024   673 tablet_bootstrap.cc:492] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:26.608846   673 ts_tablet_manager.cc:1403] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.073s	user 0.003s	sys 0.016s
I20260709 13:12:26.609144   993 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.609803   993 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.612072   555 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.598708   674 raft_consensus.cc:359] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.613822   674 raft_consensus.cc:385] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.614136   674 raft_consensus.cc:740] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.614279   993 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:26.611714   673 raft_consensus.cc:359] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.615758   673 raft_consensus.cc:385] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.616093   673 raft_consensus.cc:740] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.615950   674 consensus_queue.cc:260] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.616815   673 consensus_queue.cc:260] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.618229   675 ts_tablet_manager.cc:1403] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.167s	user 0.031s	sys 0.050s
I20260709 13:12:26.620460   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:26.621045   481 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:26.621101   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:12:26.622359   597 leader_election.cc:343] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.623207   599 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:26.626763   674 ts_tablet_manager.cc:1434] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:12:26.628091   674 tablet_bootstrap.cc:492] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:26.599217   920 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.591759   554 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:26.629237   993 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:26.630388   993 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.631615   673 ts_tablet_manager.cc:1434] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260709 13:12:26.632368   993 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.635387   673 tablet_bootstrap.cc:492] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:26.639019   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:26.639662   481 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:26.640786   599 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:26.641461   972 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:26.641839   972 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.642187   972 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.644171   675 raft_consensus.cc:359] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.645814   675 raft_consensus.cc:385] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.646096   675 raft_consensus.cc:740] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.646770   675 consensus_queue.cc:260] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.648856   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:12:26.650115   597 leader_election.cc:343] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.647682   988 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:26.656857   726 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.657371   726 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.662324   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:12:26.663650   447 leader_election.cc:343] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.664764   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:26.665411   556 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:26.666467   448 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:26.667430   726 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:26.667858   978 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:26.668270   978 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.668622   978 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.666673   993 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.667156   675 ts_tablet_manager.cc:1434] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:12:26.672318   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:26.672864   482 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.673594   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:26.674216   556 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:26.678821   972 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.669869   674 tablet_bootstrap.cc:654] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.683853   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:26.684422   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:26.670116   673 tablet_bootstrap.cc:654] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.684937   556 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.685062   478 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.685185   972 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:26.685705   675 tablet_bootstrap.cc:492] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:26.685972   972 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.691732   972 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.703169   380 catalog_manager.cc:5697] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:26.705376   380 catalog_manager.cc:5697] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:26.705502   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:26.693609   920 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:26.710656   478 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
W20260709 13:12:26.710904   597 leader_election.cc:343] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.698105   482 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:26.713357   599 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:26.715149   599 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:26.717947   990 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:26.721508   989 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:26.722151   989 raft_consensus.cc:697] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:26.727665   990 raft_consensus.cc:697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:26.723268   989 consensus_queue.cc:237] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.728663   990 consensus_queue.cc:237] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.734278   556 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:26.736907   978 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.706331   993 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:26.784193   972 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:26.785450   978 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:26.791473   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:26.792982   675 tablet_bootstrap.cc:654] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.795619   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:26.801000   554 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.807274   983 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.813968   983 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.816241   983 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:26.818636   674 tablet_bootstrap.cc:492] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:26.818544   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:26.818346   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:26.819190   674 ts_tablet_manager.cc:1403] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.191s	user 0.019s	sys 0.023s
I20260709 13:12:26.827209  1056 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:26.821187   599 leader_election.cc:343] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.818368   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:12:26.830447   597 leader_election.cc:343] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.830845   597 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:12:26.832639   522 leader_election.cc:343] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.828471   379 catalog_manager.cc:5697] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:26.834769   674 raft_consensus.cc:359] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.835052   379 catalog_manager.cc:5697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:26.835868   674 raft_consensus.cc:385] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.836330   674 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.836694   726 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.837121   726 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.837221   674 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.838567   726 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:26.827754  1056 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.840761  1056 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:26.841002   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:12:26.842543   448 leader_election.cc:343] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.843612   674 ts_tablet_manager.cc:1434] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:12:26.846158   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:26.847318   478 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:26.847929   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:26.849138   673 tablet_bootstrap.cc:492] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:26.849255   525 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:26.849571   673 ts_tablet_manager.cc:1403] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.216s	user 0.003s	sys 0.029s
I20260709 13:12:26.849983   983 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:26.850345   983 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:26.850433   597 leader_election.cc:343] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.850682   983 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.851501  1056 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:26.852135   673 raft_consensus.cc:359] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.852797   673 raft_consensus.cc:385] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.853073   673 raft_consensus.cc:740] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.853718   673 consensus_queue.cc:260] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.856735   554 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:26.858429   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:26.858987   481 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:26.861379   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:26.863854   599 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:12:26.854053   447 leader_election.cc:343] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.864434   983 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.865620   988 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:26.865866   447 leader_election.cc:343] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.866007   988 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.866335   988 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.867441   983 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:26.866281   447 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:26.870534   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:26.871014   481 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.870129   448 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:26.872843   722 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:26.873310   722 raft_consensus.cc:697] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:26.873852   722 consensus_queue.cc:237] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.878271   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:26.879416   673 ts_tablet_manager.cc:1434] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.002s
W20260709 13:12:26.880462   522 leader_election.cc:343] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.872615   978 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:26.883888   675 tablet_bootstrap.cc:492] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:26.884336   675 ts_tablet_manager.cc:1403] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.212s	user 0.019s	sys 0.025s
I20260709 13:12:26.888697   481 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:26.890837   525 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:26.891660   674 tablet_bootstrap.cc:492] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:26.893513   988 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.895764   983 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:26.896253   673 tablet_bootstrap.cc:492] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:26.900055   983 raft_consensus.cc:697] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:26.901657   983 consensus_queue.cc:237] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.903564   675 raft_consensus.cc:359] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:26.906646   429 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:26.930464   675 raft_consensus.cc:385] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:26.930806   675 raft_consensus.cc:740] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.931411   675 consensus_queue.cc:260] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:26.936286   675 ts_tablet_manager.cc:1434] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 13:12:26.938478   673 tablet_bootstrap.cc:654] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.940230   674 tablet_bootstrap.cc:654] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:26.942018   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:26.942651   478 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:26.944584   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:12:26.946177   597 leader_election.cc:343] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:26.947067   990 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:26.954159   675 tablet_bootstrap.cc:492] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:26.955097   478 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:26.963809   380 catalog_manager.cc:5697] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:26.966547   988 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:26.966890   599 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:26.981103  1056 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:26.992164  1056 raft_consensus.cc:697] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:26.996898   379 catalog_manager.cc:5697] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.001988   722 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.004555  1058 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:26.993673  1056 consensus_queue.cc:237] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:27.018797   597 consensus_peers.cc:597] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:27.021122   674 tablet_bootstrap.cc:492] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:27.021603   674 ts_tablet_manager.cc:1403] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.130s	user 0.013s	sys 0.001s
I20260709 13:12:27.022106   673 tablet_bootstrap.cc:492] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:27.034284   673 ts_tablet_manager.cc:1403] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.139s	user 0.012s	sys 0.004s
I20260709 13:12:27.024300   674 raft_consensus.cc:359] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.048678   674 raft_consensus.cc:385] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.049006   674 raft_consensus.cc:740] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.050038   674 consensus_queue.cc:260] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.025822   675 tablet_bootstrap.cc:654] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.051740   673 raft_consensus.cc:359] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.052397   673 raft_consensus.cc:385] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.054075   988 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.054499   674 ts_tablet_manager.cc:1434] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:12:27.057039   380 catalog_manager.cc:5697] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:27.058362   674 tablet_bootstrap.cc:492] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:27.057116   977 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.052665   673 raft_consensus.cc:740] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.063542   673 consensus_queue.cc:260] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.065234   988 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.068331   673 ts_tablet_manager.cc:1434] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:12:27.069352   673 tablet_bootstrap.cc:492] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:27.075300   674 tablet_bootstrap.cc:654] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.083765   673 tablet_bootstrap.cc:654] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.094184   675 tablet_bootstrap.cc:492] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:27.094638   675 ts_tablet_manager.cc:1403] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.141s	user 0.011s	sys 0.001s
I20260709 13:12:27.097610   845 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.097445   675 raft_consensus.cc:359] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.098110   675 raft_consensus.cc:385] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.098511   675 raft_consensus.cc:740] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.098076   845 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.099498   674 tablet_bootstrap.cc:492] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:27.099912   674 ts_tablet_manager.cc:1403] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.002s
I20260709 13:12:27.099948   675 consensus_queue.cc:260] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.101248   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:27.101809   632 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:27.102982   675 ts_tablet_manager.cc:1434] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:12:27.103201   522 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:27.103945   675 tablet_bootstrap.cc:492] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:27.103978   983 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.104496   983 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.104823   983 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.107890   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:27.108196   845 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:27.111050   675 tablet_bootstrap.cc:654] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.119577   983 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.130975  1058 consensus_queue.cc:1048] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.131546   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:27.122141   674 raft_consensus.cc:359] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.134646   674 raft_consensus.cc:385] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.137276   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:27.138226   632 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.146119   675 tablet_bootstrap.cc:492] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:27.146689   675 ts_tablet_manager.cc:1403] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.003s
I20260709 13:12:27.153432   675 raft_consensus.cc:359] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.154309   675 raft_consensus.cc:385] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.158941   675 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.159729   675 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.162601   632 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:27.163743   522 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:27.164728   845 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.165378   845 raft_consensus.cc:697] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:27.165584   726 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.166062   845 consensus_queue.cc:237] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.168166   675 ts_tablet_manager.cc:1434] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:12:27.166180   726 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.169167   675 tablet_bootstrap.cc:492] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:27.170455   726 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:27.174561   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:27.175359   554 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 0.
I20260709 13:12:27.175829   674 raft_consensus.cc:740] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.180075   673 tablet_bootstrap.cc:492] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:27.180698   673 ts_tablet_manager.cc:1403] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.112s	user 0.015s	sys 0.025s
I20260709 13:12:27.179627   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:27.182260   674 consensus_queue.cc:260] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.197247   478 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:27.179263   983 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:27.183307   673 raft_consensus.cc:359] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.198141   673 raft_consensus.cc:385] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.198509   673 raft_consensus.cc:740] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
W20260709 13:12:27.183063   447 leader_election.cc:343] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.199487   675 tablet_bootstrap.cc:654] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.199553   673 consensus_queue.cc:260] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.200716   448 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:27.212741   673 ts_tablet_manager.cc:1434] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.003s
I20260709 13:12:27.212929   722 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.213359   722 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.213737   722 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.214212   675 tablet_bootstrap.cc:492] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:27.214690   675 ts_tablet_manager.cc:1403] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.009s
I20260709 13:12:27.214908   673 tablet_bootstrap.cc:492] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:27.217669   675 raft_consensus.cc:359] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.219273   675 raft_consensus.cc:385] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.219583   675 raft_consensus.cc:740] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.220403   675 consensus_queue.cc:260] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.222563   675 ts_tablet_manager.cc:1434] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:27.223505   675 tablet_bootstrap.cc:492] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:27.223950   674 ts_tablet_manager.cc:1434] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.124s	user 0.005s	sys 0.001s
I20260709 13:12:27.225313   988 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.225822   988 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.228022   988 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:27.225649   674 tablet_bootstrap.cc:492] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:27.230522   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:27.232930   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:27.233721   481 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:27.235395   599 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:12:27.237260   597 leader_election.cc:343] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.238035   673 tablet_bootstrap.cc:654] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.239178   988 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:12:27.238113  1058 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.247552   722 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.248382  1058 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.248791  1058 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.250456   722 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:27.251509  1077 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.252012  1077 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.255107   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:27.255832  1056 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.256443  1077 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:27.256307  1056 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.257431   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:27.257997   556 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.258584  1056 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:27.258733   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:12:27.260264   522 leader_election.cc:343] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.246626   379 catalog_manager.cc:5697] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:27.262140   447 leader_election.cc:343] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.262519   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:27.264982   674 tablet_bootstrap.cc:654] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.266144   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:27.267429   481 raft_consensus.cc:2393] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:12:27.268652   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:27.268916  1058 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.269862   599 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:27.270918  1058 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:27.274438   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:12:27.275770   597 leader_election.cc:343] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.276194   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:27.276726   484 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.276928  1056 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.285351   484 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
W20260709 13:12:27.287557   525 leader_election.cc:343] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.295569   525 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:27.296325   845 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:27.302565   599 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:27.303788   920 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.304414   920 raft_consensus.cc:697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:27.305500   556 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:27.307814   448 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:27.308522   978 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.308954   978 raft_consensus.cc:697] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:27.305462   920 consensus_queue.cc:237] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.311558   978 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.313134   675 tablet_bootstrap.cc:654] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.318315   673 tablet_bootstrap.cc:492] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:27.318742   845 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.318810   673 ts_tablet_manager.cc:1403] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.105s	user 0.026s	sys 0.023s
I20260709 13:12:27.319270   845 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.325476   674 tablet_bootstrap.cc:492] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:27.326220   674 ts_tablet_manager.cc:1403] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.101s	user 0.006s	sys 0.008s
I20260709 13:12:27.326498   845 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:27.327557   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:27.329169  1056 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:27.329643  1058 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:27.329973   522 leader_election.cc:343] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:27.334079   597 consensus_peers.cc:597] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:27.335012   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:27.335338   673 raft_consensus.cc:359] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.335691   482 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 0.
I20260709 13:12:27.336012   673 raft_consensus.cc:385] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.336315   673 raft_consensus.cc:740] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.336980   673 consensus_queue.cc:260] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.337411   525 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:27.338346   845 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.338680   845 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.338984   845 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.339890   673 ts_tablet_manager.cc:1434] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:12:27.340889   673 tablet_bootstrap.cc:492] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:27.354620   673 tablet_bootstrap.cc:654] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.359843   920 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.361925   674 raft_consensus.cc:359] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.365355   674 raft_consensus.cc:385] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.365639   674 raft_consensus.cc:740] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.366685   845 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.367401   674 consensus_queue.cc:260] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.373340   845 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:27.373209   381 catalog_manager.cc:5697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:27.374475   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:27.375296   674 ts_tablet_manager.cc:1434] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.002s
I20260709 13:12:27.373364   379 catalog_manager.cc:5697] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.376353   674 tablet_bootstrap.cc:492] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
W20260709 13:12:27.376286   522 leader_election.cc:343] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.378158   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:27.378746   482 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.382505   675 tablet_bootstrap.cc:492] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:27.382977   675 ts_tablet_manager.cc:1403] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.160s	user 0.007s	sys 0.012s
I20260709 13:12:27.383091   674 tablet_bootstrap.cc:654] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.385475   675 raft_consensus.cc:359] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.386126   675 raft_consensus.cc:385] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.386374   675 raft_consensus.cc:740] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.387058   675 consensus_queue.cc:260] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.391595   675 ts_tablet_manager.cc:1434] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:12:27.392517   675 tablet_bootstrap.cc:492] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:27.407071   673 tablet_bootstrap.cc:492] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:27.407578   673 ts_tablet_manager.cc:1403] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.000s
I20260709 13:12:27.419389   675 tablet_bootstrap.cc:654] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.419622   673 raft_consensus.cc:359] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.420327   673 raft_consensus.cc:385] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.420606   673 raft_consensus.cc:740] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.421257   673 consensus_queue.cc:260] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.425829   482 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:27.431525   525 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:27.432619   983 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.433087   983 raft_consensus.cc:697] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:27.433859   983 consensus_queue.cc:237] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.450484   673 ts_tablet_manager.cc:1434] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.000s
I20260709 13:12:27.451576   673 tablet_bootstrap.cc:492] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:27.454526   624 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.466187   722 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.469776   673 tablet_bootstrap.cc:654] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.478075   674 tablet_bootstrap.cc:492] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:27.478546   674 ts_tablet_manager.cc:1403] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.102s	user 0.044s	sys 0.051s
I20260709 13:12:27.481009   674 raft_consensus.cc:359] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.483121   978 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:27.481640   674 raft_consensus.cc:385] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.484613   674 raft_consensus.cc:740] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.485316   674 consensus_queue.cc:260] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.487354   674 ts_tablet_manager.cc:1434] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:12:27.488297   674 tablet_bootstrap.cc:492] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Bootstrap starting.
I20260709 13:12:27.493877   674 tablet_bootstrap.cc:654] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.507007   674 tablet_bootstrap.cc:492] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: No bootstrap required, opened a new log
I20260709 13:12:27.507555   674 ts_tablet_manager.cc:1403] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.009s
I20260709 13:12:27.507820   675 tablet_bootstrap.cc:492] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:27.508335   675 ts_tablet_manager.cc:1403] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.116s	user 0.015s	sys 0.061s
I20260709 13:12:27.510206   920 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:27.510288   674 raft_consensus.cc:359] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.511098   674 raft_consensus.cc:385] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.511422   674 raft_consensus.cc:740] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Initialized, Role: FOLLOWER
W20260709 13:12:27.511566   597 consensus_peers.cc:597] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:27.512101   674 consensus_queue.cc:260] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.514443   674 ts_tablet_manager.cc:1434] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:12:27.517325   675 raft_consensus.cc:359] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.518286   675 raft_consensus.cc:385] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.518625   675 raft_consensus.cc:740] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.519519   675 consensus_queue.cc:260] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.523765   845 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.524305   845 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.526316   845 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:27.522261   675 ts_tablet_manager.cc:1434] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:12:27.527765   675 tablet_bootstrap.cc:492] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:27.530026   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:27.536154   675 tablet_bootstrap.cc:654] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.536278   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:27.538771   525 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:27.542447   980 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:27.540164  1077 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.555020   983 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:27.562345   977 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.562825   977 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.565187   977 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:27.577710   380 catalog_manager.cc:5697] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.584463   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:27.584460   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:12:27.594264   448 leader_election.cc:343] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:27.611336   447 leader_election.cc:343] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.622403   675 tablet_bootstrap.cc:492] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:27.622886   675 ts_tablet_manager.cc:1403] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.095s	user 0.032s	sys 0.039s
I20260709 13:12:27.629127   673 tablet_bootstrap.cc:492] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:27.629663   673 ts_tablet_manager.cc:1403] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.178s	user 0.036s	sys 0.074s
I20260709 13:12:27.632336   983 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.632491   447 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:27.632503   673 raft_consensus.cc:359] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.633452   673 raft_consensus.cc:385] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.633764   673 raft_consensus.cc:740] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.634461   673 consensus_queue.cc:260] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.637084   673 ts_tablet_manager.cc:1434] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:27.638456   673 tablet_bootstrap.cc:492] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:27.642048   978 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:27.652081   675 raft_consensus.cc:359] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.652920   675 raft_consensus.cc:385] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.653230   675 raft_consensus.cc:740] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.655148   675 consensus_queue.cc:260] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.663321   675 ts_tablet_manager.cc:1434] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.003s
I20260709 13:12:27.664888   675 tablet_bootstrap.cc:492] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:27.662971   673 tablet_bootstrap.cc:654] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.679886   675 tablet_bootstrap.cc:654] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.682047  1058 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.682593  1058 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.688006   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:27.688719   484 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:27.690027   599 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:27.690727   920 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.690987  1058 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:27.691079   920 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.691601   920 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.691672   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:12:27.693182   597 leader_election.cc:343] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.701112  1056 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.701607  1056 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.702813   920 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.705442   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:27.703636  1056 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:27.704237   478 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.706118   553 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:27.707648   920 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:27.709174   597 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:27.709658   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:12:27.711457   597 leader_election.cc:343] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.714800  1056 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.715201  1056 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.715571  1056 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.716547   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:27.716698   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:27.717202   482 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.717211   481 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:27.721776  1056 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.723445   482 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:27.729374   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:27.730283   556 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.733139   673 tablet_bootstrap.cc:492] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:27.733667   673 ts_tablet_manager.cc:1403] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.095s	user 0.020s	sys 0.000s
I20260709 13:12:27.736212   673 raft_consensus.cc:359] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.736624   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:27.737007   673 raft_consensus.cc:385] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.737323   482 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.737416   673 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.737779   599 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:27.738492  1058 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.738308   673 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.738955  1058 raft_consensus.cc:697] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:27.740032   673 ts_tablet_manager.cc:1434] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:27.739787  1058 consensus_queue.cc:237] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.743600   556 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:27.744969  1056 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:27.745329   597 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:27.746279  1056 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.747097  1056 raft_consensus.cc:697] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:27.748195  1056 consensus_queue.cc:237] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.750344   675 tablet_bootstrap.cc:492] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:27.751025  1101 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.751569  1101 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.752902   673 tablet_bootstrap.cc:492] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3: Bootstrap starting.
I20260709 13:12:27.754597  1101 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:27.755151   675 ts_tablet_manager.cc:1403] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.005s
I20260709 13:12:27.755915   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:27.757926   675 raft_consensus.cc:359] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.758666   675 raft_consensus.cc:385] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.759078   673 tablet_bootstrap.cc:654] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.759172   675 raft_consensus.cc:740] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.760255   675 consensus_queue.cc:260] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:27.763741   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 56613.1us
I20260709 13:12:27.768400   675 ts_tablet_manager.cc:1434] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:12:27.783152  1077 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:27.783278  1058 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.788079  1058 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.790300  1058 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:27.769574   675 tablet_bootstrap.cc:492] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:27.791209   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:27.794725  1077 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.795552  1077 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.796172   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:27.797235   553 raft_consensus.cc:2393] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:12:27.798252   675 tablet_bootstrap.cc:654] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.798210   597 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:27.799490  1058 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.805061   673 tablet_bootstrap.cc:492] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3: No bootstrap required, opened a new log
I20260709 13:12:27.805595   673 ts_tablet_manager.cc:1403] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.021s
I20260709 13:12:27.806668  1056 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.807265   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:27.807291   977 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:27.808717   380 catalog_manager.cc:5697] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:27.809913   673 raft_consensus.cc:359] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.810597   673 raft_consensus.cc:385] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.810930   673 raft_consensus.cc:740] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.810688   380 catalog_manager.cc:5697] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:27.813041   673 consensus_queue.cc:260] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.815528   673 ts_tablet_manager.cc:1434] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 13:12:27.818035  1077 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:27.819873  1058 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:27.833865   556 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.838814   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:27.859458  1058 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:27.879913   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:27.794801   482 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:27.887848   553 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.910118   556 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.933679   557 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.958420  1056 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.959149  1056 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:27.963943   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:27.965495   525 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:27.968163  1101 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:27.986949  1056 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:27.991807   525 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:27.995143   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:27.996248   484 raft_consensus.cc:2393] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 1: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:12:28.009308   726 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:28.010061   632 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:28.017424   599 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:28.022855   845 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:28.031873   675 tablet_bootstrap.cc:492] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:28.032457   675 ts_tablet_manager.cc:1403] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.263s	user 0.073s	sys 0.105s
I20260709 13:12:28.035295   675 raft_consensus.cc:359] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:28.036005   675 raft_consensus.cc:385] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:28.036296   675 raft_consensus.cc:740] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:28.036988   675 consensus_queue.cc:260] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:28.039258   675 ts_tablet_manager.cc:1434] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:12:28.040218   675 tablet_bootstrap.cc:492] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca: Bootstrap starting.
I20260709 13:12:28.046296   675 tablet_bootstrap.cc:654] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:28.054677   845 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:28.073923   675 tablet_bootstrap.cc:492] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca: No bootstrap required, opened a new log
I20260709 13:12:28.074508   675 ts_tablet_manager.cc:1403] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.012s
I20260709 13:12:28.079759  1054 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:28.080631   845 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:28.100250   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 122480us
I20260709 13:12:28.105795  1056 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.106460  1056 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:28.109004  1056 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:28.109867   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:28.110466   482 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:28.111953   599 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:28.114226   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:28.114746   675 raft_consensus.cc:359] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:28.115468   675 raft_consensus.cc:385] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:28.115721   675 raft_consensus.cc:740] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Initialized, Role: FOLLOWER
I20260709 13:12:28.115134   990 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:28.117061   990 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.117405   990 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:28.116287   675 consensus_queue.cc:260] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:28.119426   557 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 0.
I20260709 13:12:28.119721   675 ts_tablet_manager.cc:1434] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 13:12:28.157487   990 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:28.159538   990 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:28.161441   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:28.162067   553 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:28.164261   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:28.164942   484 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:28.176906   553 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:28.181725   484 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:28.178259   597 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:28.189186  1054 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:28.189824  1054 raft_consensus.cc:697] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:28.190620  1054 consensus_queue.cc:237] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:28.204011   557 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:28.221020  1114 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:28.222088   990 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:28.241109   429 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:28.241385   380 catalog_manager.cc:5697] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:28.250531  1054 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:28.252619  1114 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:28.594676   988 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:28.608204  1054 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:29.017208 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:29.053622  1127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:29.053805  1128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:29.054414 31814 server_base.cc:1061] running on GCE node
W20260709 13:12:29.053587  1130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:29.059473 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:29.059778 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:29.060010 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602749059989 us; error 0 us; skew 500 ppm
I20260709 13:12:29.060811 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:29.065280 31814 webserver.cc:533] Webserver started at http://127.31.17.132:33511/ using document root <none> and password file <none>
I20260709 13:12:29.065802 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:29.066023 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:29.066433 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:29.069471 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-3-root/instance:
uuid: "6e6df7e8ed204f1db5c371536b5b0683"
format_stamp: "Formatted at 2026-07-09 13:12:29 on dist-test-slave-zhw8"
I20260709 13:12:29.076485 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:12:29.088079  1136 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:29.089046 31814 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.010s	sys 0.001s
I20260709 13:12:29.089391 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-3-root
uuid: "6e6df7e8ed204f1db5c371536b5b0683"
format_stamp: "Formatted at 2026-07-09 13:12:29 on dist-test-slave-zhw8"
I20260709 13:12:29.089767 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:29.126403 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:29.127779 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:29.129040 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:29.131402 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:29.131593 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:29.131877 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:29.132130 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:29.214942  1199 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.132:39939 every 8 connection(s)
I20260709 13:12:29.215207 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.132:39939
I20260709 13:12:29.221386 31814 auto_leader_rebalancer-test.cc:384] add a tserver: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:29.237901  1200 heartbeater.cc:344] Connected to a master server at 127.31.17.190:46835
I20260709 13:12:29.238389  1200 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:29.239373  1200 heartbeater.cc:507] Master 127.31.17.190:46835 requested a full tablet report, sending...
I20260709 13:12:29.242460   378 ts_manager.cc:194] Registered new tserver with Master: 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:29.243919   378 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41332
I20260709 13:12:30.247040  1200 heartbeater.cc:499] Master 127.31.17.190:46835 was elected leader, sending a full tablet report...
I20260709 13:12:30.368510   553 consensus_queue.cc:237] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:30.377384   478 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:30.380733  1101 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:30.384690   626 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:30.394507  1207 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:30.410856  1101 raft_consensus.cc:2955] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:30.422725   478 raft_consensus.cc:2955] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:30.423889   632 raft_consensus.cc:2955] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:30.455629   378 catalog_manager.cc:5697] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
W20260709 13:12:30.466495   523 consensus_peers.cc:597] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2131bd04d2d4f3da62d75b100a2aecd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:30.476862   632 consensus_queue.cc:237] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:30.490594   553 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:30.497735   988 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:30.501278   478 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:12:30.502655   597 consensus_peers.cc:597] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b6c11587863a4a73ae8fca1c867e545d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:30.502696   988 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:12:30.510594   990 raft_consensus.cc:2955] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:30.512329   553 raft_consensus.cc:2955] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:30.514994   478 raft_consensus.cc:2955] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:30.523070   632 consensus_queue.cc:237] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:30.529910   380 catalog_manager.cc:5697] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:30.536469   482 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:30.537036   553 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:12:30.538990   597 consensus_peers.cc:597] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 578ce25d78a849989220d2a8dcb91233. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:30.539535   990 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:30.540524  1226 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:30.552771   988 raft_consensus.cc:2955] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:30.554157   482 raft_consensus.cc:2955] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:30.564919   553 raft_consensus.cc:2955] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:30.569262   379 catalog_manager.cc:5697] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:30.604301   482 consensus_queue.cc:237] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:30.611625   632 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:30.613055  1137 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:30.615640   553 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:30.616866  1210 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:30.625520  1137 raft_consensus.cc:2955] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:30.630342   632 raft_consensus.cc:2955] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:30.652402   379 catalog_manager.cc:5697] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
W20260709 13:12:30.693986   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 65740.2us
W20260709 13:12:30.693321   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 64293.4us
W20260709 13:12:30.695608   448 consensus_peers.cc:597] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99b1684e65e840ce8bcb13346b86d204. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:30.701126   557 raft_consensus.cc:2955] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:30.769068  1236 ts_tablet_manager.cc:933] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:30.777328  1236 tablet_copy_client.cc:323] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.130:41159
I20260709 13:12:30.800462   569 tablet_copy_service.cc:140] P 6ba2a9c02b534120bbf26e56a1e920ca: Received BeginTabletCopySession request for tablet d2131bd04d2d4f3da62d75b100a2aecd from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:43548)
I20260709 13:12:30.801113   569 tablet_copy_service.cc:161] P 6ba2a9c02b534120bbf26e56a1e920ca: Beginning new tablet copy session on tablet d2131bd04d2d4f3da62d75b100a2aecd from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:43548: session id = 6e6df7e8ed204f1db5c371536b5b0683-d2131bd04d2d4f3da62d75b100a2aecd
I20260709 13:12:30.809048   569 tablet_copy_source_session.cc:215] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:30.813302  1236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2131bd04d2d4f3da62d75b100a2aecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.827608  1236 tablet_copy_client.cc:806] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:30.828416  1236 tablet_copy_client.cc:670] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:30.833568  1236 tablet_copy_client.cc:538] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:30.839852  1236 tablet_bootstrap.cc:492] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:30.861488  1236 tablet_bootstrap.cc:492] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:30.862771  1236 tablet_bootstrap.cc:492] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:30.863549  1236 ts_tablet_manager.cc:1403] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.008s
I20260709 13:12:30.866858  1236 raft_consensus.cc:359] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:30.867916  1236 raft_consensus.cc:740] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:30.868661  1236 consensus_queue.cc:260] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:30.872622  1236 ts_tablet_manager.cc:1434] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:12:30.879063   569 tablet_copy_service.cc:342] P 6ba2a9c02b534120bbf26e56a1e920ca: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-d2131bd04d2d4f3da62d75b100a2aecd received from {username='slave'} at 127.0.0.1:43548
I20260709 13:12:30.879735   569 tablet_copy_service.cc:434] P 6ba2a9c02b534120bbf26e56a1e920ca: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-d2131bd04d2d4f3da62d75b100a2aecd on tablet d2131bd04d2d4f3da62d75b100a2aecd with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:31.012687  1236 ts_tablet_manager.cc:933] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:12:31.014318  1236 tablet_copy_client.cc:323] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.129:45711
I20260709 13:12:31.024884   494 tablet_copy_service.cc:140] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Received BeginTabletCopySession request for tablet 99b1684e65e840ce8bcb13346b86d204 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:41384)
I20260709 13:12:31.025501   494 tablet_copy_service.cc:161] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Beginning new tablet copy session on tablet 99b1684e65e840ce8bcb13346b86d204 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:41384: session id = 6e6df7e8ed204f1db5c371536b5b0683-99b1684e65e840ce8bcb13346b86d204
I20260709 13:12:31.032882   494 tablet_copy_source_session.cc:215] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:31.035944  1236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b1684e65e840ce8bcb13346b86d204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.047457  1236 tablet_copy_client.cc:806] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:31.048110  1236 tablet_copy_client.cc:670] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:31.053640  1236 tablet_copy_client.cc:538] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:31.061503  1236 tablet_bootstrap.cc:492] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:31.068360  1243 ts_tablet_manager.cc:933] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:31.070202  1243 tablet_copy_client.cc:323] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.131:36245
I20260709 13:12:31.074668  1245 ts_tablet_manager.cc:933] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:31.089810  1236 tablet_bootstrap.cc:492] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:31.091578  1236 tablet_bootstrap.cc:492] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:31.092849  1236 ts_tablet_manager.cc:1403] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.032s	user 0.022s	sys 0.008s
I20260709 13:12:31.096215  1245 tablet_copy_client.cc:323] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.131:36245
I20260709 13:12:31.096721  1236 raft_consensus.cc:359] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:31.097653  1236 raft_consensus.cc:740] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:31.098384  1236 consensus_queue.cc:260] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:31.100626  1236 ts_tablet_manager.cc:1434] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:31.102622   494 tablet_copy_service.cc:342] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-99b1684e65e840ce8bcb13346b86d204 received from {username='slave'} at 127.0.0.1:41384
I20260709 13:12:31.103056   494 tablet_copy_service.cc:434] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-99b1684e65e840ce8bcb13346b86d204 on tablet 99b1684e65e840ce8bcb13346b86d204 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:31.112957   642 tablet_copy_service.cc:140] P 50f7c2247be24f3685d7fbca7b6c71e3: Received BeginTabletCopySession request for tablet b6c11587863a4a73ae8fca1c867e545d from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:54754)
I20260709 13:12:31.113633   642 tablet_copy_service.cc:161] P 50f7c2247be24f3685d7fbca7b6c71e3: Beginning new tablet copy session on tablet b6c11587863a4a73ae8fca1c867e545d from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:54754: session id = 6e6df7e8ed204f1db5c371536b5b0683-b6c11587863a4a73ae8fca1c867e545d
I20260709 13:12:31.112957   643 tablet_copy_service.cc:140] P 50f7c2247be24f3685d7fbca7b6c71e3: Received BeginTabletCopySession request for tablet 578ce25d78a849989220d2a8dcb91233 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:54754)
I20260709 13:12:31.116881   643 tablet_copy_service.cc:161] P 50f7c2247be24f3685d7fbca7b6c71e3: Beginning new tablet copy session on tablet 578ce25d78a849989220d2a8dcb91233 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:54754: session id = 6e6df7e8ed204f1db5c371536b5b0683-578ce25d78a849989220d2a8dcb91233
I20260709 13:12:31.122083   642 tablet_copy_source_session.cc:215] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:31.126555  1245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c11587863a4a73ae8fca1c867e545d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.135214   643 tablet_copy_source_session.cc:215] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:31.143653  1243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 578ce25d78a849989220d2a8dcb91233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.159098  1243 tablet_copy_client.cc:806] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:31.159808  1243 tablet_copy_client.cc:670] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:31.163727  1243 tablet_copy_client.cc:538] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:31.168282  1245 tablet_copy_client.cc:806] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:31.168969  1245 tablet_copy_client.cc:670] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:31.172304  1243 tablet_bootstrap.cc:492] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:31.175504  1245 tablet_copy_client.cc:538] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:31.184711  1245 tablet_bootstrap.cc:492] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:31.217799  1175 raft_consensus.cc:1217] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:31.262094  1245 tablet_bootstrap.cc:492] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:31.263254  1245 tablet_bootstrap.cc:492] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:31.264001  1245 ts_tablet_manager.cc:1403] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.080s	user 0.032s	sys 0.035s
I20260709 13:12:31.265604  1243 tablet_bootstrap.cc:492] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:31.267315  1243 tablet_bootstrap.cc:492] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:31.267307  1245 raft_consensus.cc:359] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:31.268417  1243 ts_tablet_manager.cc:1403] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.010s
I20260709 13:12:31.268636  1245 raft_consensus.cc:740] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:31.269436  1245 consensus_queue.cc:260] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:31.271880  1243 raft_consensus.cc:359] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:31.273087  1243 raft_consensus.cc:740] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:31.273890  1243 consensus_queue.cc:260] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:31.274986  1245 ts_tablet_manager.cc:1434] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:12:31.277181   643 tablet_copy_service.cc:342] P 50f7c2247be24f3685d7fbca7b6c71e3: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-b6c11587863a4a73ae8fca1c867e545d received from {username='slave'} at 127.0.0.1:54754
I20260709 13:12:31.277640   643 tablet_copy_service.cc:434] P 50f7c2247be24f3685d7fbca7b6c71e3: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-b6c11587863a4a73ae8fca1c867e545d on tablet b6c11587863a4a73ae8fca1c867e545d with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:31.278127  1243 ts_tablet_manager.cc:1434] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:12:31.281750   643 tablet_copy_service.cc:342] P 50f7c2247be24f3685d7fbca7b6c71e3: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-578ce25d78a849989220d2a8dcb91233 received from {username='slave'} at 127.0.0.1:54754
I20260709 13:12:31.282207   643 tablet_copy_service.cc:434] P 50f7c2247be24f3685d7fbca7b6c71e3: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-578ce25d78a849989220d2a8dcb91233 on tablet 578ce25d78a849989220d2a8dcb91233 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:31.396093  1175 raft_consensus.cc:1217] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:31.452363  1175 raft_consensus.cc:1217] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:31.647838  1175 raft_consensus.cc:1217] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:31.768735  1249 raft_consensus.cc:1064] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:31.771302  1249 consensus_queue.cc:237] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:31.779225   624 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:31.781214  1101 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:31.783170  1175 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:31.787537   482 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:31.789861  1214 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:31.805003  1249 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:12:31.832918   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 48574.9us
I20260709 13:12:31.838039  1214 raft_consensus.cc:2955] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:31.844890  1210 raft_consensus.cc:1064] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:31.848204  1210 consensus_queue.cc:237] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:31.857153  1175 raft_consensus.cc:2955] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:31.857252   624 raft_consensus.cc:2955] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:31.869001   482 raft_consensus.cc:2955] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:31.879431   379 catalog_manager.cc:5697] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:31.898226   626 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:31.904354  1175 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:31.905301   553 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:31.907827  1234 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:31.910065  1252 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:31.913338  1234 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:31.942436  1234 raft_consensus.cc:2955] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:31.946465  1175 raft_consensus.cc:2955] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:31.947350   556 consensus_queue.cc:237] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:31.954571   556 raft_consensus.cc:2955] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:31.955566   481 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:31.958395  1174 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:31.961627  1249 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:31.968502  1101 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:31.972555  1254 raft_consensus.cc:2955] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:31.985328   378 catalog_manager.cc:5697] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:31.988746  1174 raft_consensus.cc:2955] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:31.995330   366 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d2131bd04d2d4f3da62d75b100a2aecd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:32.002403   381 catalog_manager.cc:5697] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:32.004324   625 raft_consensus.cc:2955] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.011359   482 raft_consensus.cc:2955] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.017300   617 tablet_service.cc:1558] Processing DeleteTablet for tablet d2131bd04d2d4f3da62d75b100a2aecd with delete_type TABLET_DATA_TOMBSTONED (TS 50f7c2247be24f3685d7fbca7b6c71e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54246
I20260709 13:12:32.033257  1267 tablet_replica.cc:333] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:12:32.031940  1241 raft_consensus.cc:1064] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:32.034411  1267 raft_consensus.cc:2243] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:32.034291   481 consensus_queue.cc:237] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:32.035147  1267 raft_consensus.cc:2272] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.037698  1241 consensus_queue.cc:237] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:32.038739  1267 ts_tablet_manager.cc:1916] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:32.048403   556 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:32.051717  1174 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:32.052026  1252 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:32.064705  1267 ts_tablet_manager.cc:1929] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:32.065378  1267 log.cc:1199] T d2131bd04d2d4f3da62d75b100a2aecd P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-2-root/wals/d2131bd04d2d4f3da62d75b100a2aecd
I20260709 13:12:32.067727   365 catalog_manager.cc:5028] TS 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): tablet d2131bd04d2d4f3da62d75b100a2aecd (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:32.068477  1235 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:32.071491  1226 raft_consensus.cc:1064] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:32.074196  1226 consensus_queue.cc:237] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:32.088738   557 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:32.089413  1174 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:32.089892   478 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:32.090341   988 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:32.083469  1234 raft_consensus.cc:2955] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.092839   988 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:32.101015   990 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:32.120571  1174 raft_consensus.cc:2955] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.145583   368 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 99b1684e65e840ce8bcb13346b86d204 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:32.157305   378 catalog_manager.cc:5697] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:12:32.177611   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 81770.6us
I20260709 13:12:32.181779  1175 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:32.192425   482 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:32.194048  1275 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:32.205102   555 raft_consensus.cc:2955] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.208338   617 tablet_service.cc:1558] Processing DeleteTablet for tablet 99b1684e65e840ce8bcb13346b86d204 with delete_type TABLET_DATA_TOMBSTONED (TS 50f7c2247be24f3685d7fbca7b6c71e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54246
I20260709 13:12:32.209873  1267 tablet_replica.cc:333] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:12:32.212082  1267 raft_consensus.cc:2243] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:32.216658  1267 raft_consensus.cc:2272] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.220633  1267 ts_tablet_manager.cc:1916] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:32.235033  1241 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:32.239897   553 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:32.242229  1175 raft_consensus.cc:2955] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.243027   556 raft_consensus.cc:2955] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.225582   988 raft_consensus.cc:2955] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.257654  1269 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:32.265125   378 catalog_manager.cc:5697] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.280136  1267 ts_tablet_manager.cc:1929] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:32.280915  1267 log.cc:1199] T 99b1684e65e840ce8bcb13346b86d204 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-2-root/wals/99b1684e65e840ce8bcb13346b86d204
I20260709 13:12:32.283473   365 catalog_manager.cc:5028] TS 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): tablet 99b1684e65e840ce8bcb13346b86d204 (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:32.317612  1241 raft_consensus.cc:2955] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.327895   482 raft_consensus.cc:2955] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.329113   555 raft_consensus.cc:2955] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.336498  1174 raft_consensus.cc:2955] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.348474   378 catalog_manager.cc:5697] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.371776   482 raft_consensus.cc:2955] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.381676   625 consensus_queue.cc:237] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:32.389382   626 consensus_queue.cc:237] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:32.395257  1174 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:32.402597   556 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:32.407498  1226 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:32.412914  1241 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:32.419745  1175 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:32.419034   988 raft_consensus.cc:2955] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.421437  1275 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:32.427258  1175 raft_consensus.cc:2955] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.431218   557 raft_consensus.cc:2955] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.442307   365 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b6c11587863a4a73ae8fca1c867e545d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:32.449599   478 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:32.449220  1226 raft_consensus.cc:2955] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.452234  1275 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:32.452497   380 catalog_manager.cc:5697] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.458029   478 raft_consensus.cc:2955] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.464349   467 tablet_service.cc:1558] Processing DeleteTablet for tablet b6c11587863a4a73ae8fca1c867e545d with delete_type TABLET_DATA_TOMBSTONED (TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38120
I20260709 13:12:32.461197  1175 raft_consensus.cc:2955] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.481256  1280 tablet_replica.cc:333] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:12:32.482301  1280 raft_consensus.cc:2243] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:32.482933  1280 raft_consensus.cc:2272] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.486300  1280 ts_tablet_manager.cc:1916] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:32.489802   365 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 578ce25d78a849989220d2a8dcb91233 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:32.498129   378 catalog_manager.cc:5697] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:32.510186   545 tablet_service.cc:1558] Processing DeleteTablet for tablet 578ce25d78a849989220d2a8dcb91233 with delete_type TABLET_DATA_TOMBSTONED (TS 6ba2a9c02b534120bbf26e56a1e920ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59108
I20260709 13:12:32.515928  1280 ts_tablet_manager.cc:1929] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:32.516644  1280 log.cc:1199] T b6c11587863a4a73ae8fca1c867e545d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-0-root/wals/b6c11587863a4a73ae8fca1c867e545d
I20260709 13:12:32.519227   368 catalog_manager.cc:5028] TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): tablet b6c11587863a4a73ae8fca1c867e545d (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:32.522666  1281 tablet_replica.cc:333] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:12:32.524144  1281 raft_consensus.cc:2243] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:32.524737  1281 raft_consensus.cc:2272] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.527832  1281 ts_tablet_manager.cc:1916] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:32.538756  1281 ts_tablet_manager.cc:1929] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:32.539103  1281 log.cc:1199] T 578ce25d78a849989220d2a8dcb91233 P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-1-root/wals/578ce25d78a849989220d2a8dcb91233
I20260709 13:12:32.541311   366 catalog_manager.cc:5028] TS 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): tablet 578ce25d78a849989220d2a8dcb91233 (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:33.582168   626 consensus_queue.cc:237] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:33.589309   556 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:12:33.589488   597 consensus_peers.cc:597] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12805530d9a3471aa3d5b4c086cc454a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.590556  1275 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:33.593562   478 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:33.594733  1275 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:33.598902   556 raft_consensus.cc:2955] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:33.597520  1269 raft_consensus.cc:2955] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:33.617066   380 catalog_manager.cc:5697] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:33.623416   626 consensus_queue.cc:237] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:33.624185   478 raft_consensus.cc:2955] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
W20260709 13:12:33.641880   597 consensus_peers.cc:597] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18dea61d0790411c88602b2cfc2fbcdb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.643743   481 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:33.648496   557 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:33.651252  1275 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:33.652580  1284 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:33.671797  1269 raft_consensus.cc:2955] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:33.674022   481 raft_consensus.cc:2955] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:33.674861   557 raft_consensus.cc:2955] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:33.692878   556 consensus_queue.cc:237] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:33.697413   381 catalog_manager.cc:5697] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:33.721740   523 consensus_peers.cc:597] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c192fb76f82248d78ddc2aac1d721cd9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.723929   624 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:33.724154   481 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:33.725889  1254 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:33.727954  1254 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:33.744077  1254 raft_consensus.cc:2955] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:33.752431   481 raft_consensus.cc:2955] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:33.757274   626 raft_consensus.cc:2955] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:33.758251   478 consensus_queue.cc:237] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:33.763996   381 catalog_manager.cc:5697] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:33.769445   624 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:33.774160  1274 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:33.778512   556 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:12:33.780972   448 consensus_peers.cc:597] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 304d1b96642140f19543be15d23a061c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.784174  1210 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:33.804157  1274 raft_consensus.cc:2955] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:33.805256   625 raft_consensus.cc:2955] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:33.824424   378 catalog_manager.cc:5697] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:33.848570   556 raft_consensus.cc:2955] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
W20260709 13:12:34.114676   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 82962.3us
W20260709 13:12:34.126885   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 48943.1us
W20260709 13:12:34.140530   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 78647.2us
I20260709 13:12:34.168058  1313 ts_tablet_manager.cc:933] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:34.197826  1313 tablet_copy_client.cc:323] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.131:36245
I20260709 13:12:34.200822   643 tablet_copy_service.cc:140] P 50f7c2247be24f3685d7fbca7b6c71e3: Received BeginTabletCopySession request for tablet 12805530d9a3471aa3d5b4c086cc454a from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:54754)
I20260709 13:12:34.201577   643 tablet_copy_service.cc:161] P 50f7c2247be24f3685d7fbca7b6c71e3: Beginning new tablet copy session on tablet 12805530d9a3471aa3d5b4c086cc454a from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:54754: session id = 6e6df7e8ed204f1db5c371536b5b0683-12805530d9a3471aa3d5b4c086cc454a
I20260709 13:12:34.218286   643 tablet_copy_source_session.cc:215] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:34.225382  1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12805530d9a3471aa3d5b4c086cc454a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.241353  1313 tablet_copy_client.cc:806] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:34.242115  1313 tablet_copy_client.cc:670] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:34.247715  1313 tablet_copy_client.cc:538] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:34.248046  1315 ts_tablet_manager.cc:933] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:34.250123  1315 tablet_copy_client.cc:323] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.130:41159
I20260709 13:12:34.252437   569 tablet_copy_service.cc:140] P 6ba2a9c02b534120bbf26e56a1e920ca: Received BeginTabletCopySession request for tablet c192fb76f82248d78ddc2aac1d721cd9 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:43548)
I20260709 13:12:34.253119   569 tablet_copy_service.cc:161] P 6ba2a9c02b534120bbf26e56a1e920ca: Beginning new tablet copy session on tablet c192fb76f82248d78ddc2aac1d721cd9 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:43548: session id = 6e6df7e8ed204f1db5c371536b5b0683-c192fb76f82248d78ddc2aac1d721cd9
I20260709 13:12:34.258807  1313 tablet_bootstrap.cc:492] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:34.262064   569 tablet_copy_source_session.cc:215] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:34.265930  1315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c192fb76f82248d78ddc2aac1d721cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.296789  1315 tablet_copy_client.cc:806] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:34.297832  1315 tablet_copy_client.cc:670] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:34.306946  1315 tablet_copy_client.cc:538] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:34.310474  1317 ts_tablet_manager.cc:933] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:34.317588  1315 tablet_bootstrap.cc:492] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:34.320616  1313 tablet_bootstrap.cc:492] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:34.321902  1313 tablet_bootstrap.cc:492] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:34.322729  1313 ts_tablet_manager.cc:1403] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.064s	user 0.023s	sys 0.021s
I20260709 13:12:34.326694  1313 raft_consensus.cc:359] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:34.328084  1313 raft_consensus.cc:740] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:34.329203  1313 consensus_queue.cc:260] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:34.357445  1317 tablet_copy_client.cc:323] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.131:36245
I20260709 13:12:34.358847  1321 ts_tablet_manager.cc:933] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:12:34.359470   643 tablet_copy_service.cc:140] P 50f7c2247be24f3685d7fbca7b6c71e3: Received BeginTabletCopySession request for tablet 18dea61d0790411c88602b2cfc2fbcdb from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:54754)
I20260709 13:12:34.360179   643 tablet_copy_service.cc:161] P 50f7c2247be24f3685d7fbca7b6c71e3: Beginning new tablet copy session on tablet 18dea61d0790411c88602b2cfc2fbcdb from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:54754: session id = 6e6df7e8ed204f1db5c371536b5b0683-18dea61d0790411c88602b2cfc2fbcdb
I20260709 13:12:34.369280   643 tablet_copy_source_session.cc:215] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:34.373241  1313 ts_tablet_manager.cc:1434] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.050s	user 0.028s	sys 0.014s
I20260709 13:12:34.381114  1317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18dea61d0790411c88602b2cfc2fbcdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.385771  1321 tablet_copy_client.cc:323] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.129:45711
I20260709 13:12:34.389127   494 tablet_copy_service.cc:140] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Received BeginTabletCopySession request for tablet 304d1b96642140f19543be15d23a061c from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:41384)
I20260709 13:12:34.389825   494 tablet_copy_service.cc:161] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Beginning new tablet copy session on tablet 304d1b96642140f19543be15d23a061c from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:41384: session id = 6e6df7e8ed204f1db5c371536b5b0683-304d1b96642140f19543be15d23a061c
I20260709 13:12:34.390926  1315 tablet_bootstrap.cc:492] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:34.391860  1315 tablet_bootstrap.cc:492] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:34.392518  1315 ts_tablet_manager.cc:1403] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.012s
I20260709 13:12:34.395542  1315 raft_consensus.cc:359] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:34.396373  1315 raft_consensus.cc:740] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:34.396997  1315 consensus_queue.cc:260] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:34.399977  1315 ts_tablet_manager.cc:1434] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:34.402478   569 tablet_copy_service.cc:342] P 6ba2a9c02b534120bbf26e56a1e920ca: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-c192fb76f82248d78ddc2aac1d721cd9 received from {username='slave'} at 127.0.0.1:43548
I20260709 13:12:34.402978   569 tablet_copy_service.cc:434] P 6ba2a9c02b534120bbf26e56a1e920ca: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-c192fb76f82248d78ddc2aac1d721cd9 on tablet c192fb76f82248d78ddc2aac1d721cd9 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:34.403672   494 tablet_copy_source_session.cc:215] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:34.407528  1321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304d1b96642140f19543be15d23a061c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.422077   643 tablet_copy_service.cc:342] P 50f7c2247be24f3685d7fbca7b6c71e3: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-12805530d9a3471aa3d5b4c086cc454a received from {username='slave'} at 127.0.0.1:54754
I20260709 13:12:34.422632   643 tablet_copy_service.cc:434] P 50f7c2247be24f3685d7fbca7b6c71e3: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-12805530d9a3471aa3d5b4c086cc454a on tablet 12805530d9a3471aa3d5b4c086cc454a with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:34.441814  1321 tablet_copy_client.cc:806] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:34.442250  1317 tablet_copy_client.cc:806] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:34.442741  1321 tablet_copy_client.cc:670] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:34.442834  1317 tablet_copy_client.cc:670] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:34.449647  1317 tablet_copy_client.cc:538] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:34.451516  1321 tablet_copy_client.cc:538] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:34.458918  1317 tablet_bootstrap.cc:492] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:34.461028  1321 tablet_bootstrap.cc:492] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:34.488684  1317 tablet_bootstrap.cc:492] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:34.489686  1317 tablet_bootstrap.cc:492] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:34.490600  1317 ts_tablet_manager.cc:1403] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.032s	user 0.022s	sys 0.008s
I20260709 13:12:34.493563  1317 raft_consensus.cc:359] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:34.494462  1317 raft_consensus.cc:740] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:34.495143  1317 consensus_queue.cc:260] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:34.497807  1317 ts_tablet_manager.cc:1434] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:12:34.499655   643 tablet_copy_service.cc:342] P 50f7c2247be24f3685d7fbca7b6c71e3: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-18dea61d0790411c88602b2cfc2fbcdb received from {username='slave'} at 127.0.0.1:54754
I20260709 13:12:34.500140   643 tablet_copy_service.cc:434] P 50f7c2247be24f3685d7fbca7b6c71e3: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-18dea61d0790411c88602b2cfc2fbcdb on tablet 18dea61d0790411c88602b2cfc2fbcdb with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:34.508176  1321 tablet_bootstrap.cc:492] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:34.509212  1321 tablet_bootstrap.cc:492] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:34.509948  1321 ts_tablet_manager.cc:1403] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.019s
I20260709 13:12:34.512946  1321 raft_consensus.cc:359] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:34.513852  1321 raft_consensus.cc:740] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:34.514531  1321 consensus_queue.cc:260] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:34.516914  1321 ts_tablet_manager.cc:1434] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:12:34.521062   494 tablet_copy_service.cc:342] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-304d1b96642140f19543be15d23a061c received from {username='slave'} at 127.0.0.1:41384
I20260709 13:12:34.521564   494 tablet_copy_service.cc:434] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-304d1b96642140f19543be15d23a061c on tablet 304d1b96642140f19543be15d23a061c with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:34.647112  1175 raft_consensus.cc:1217] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:34.701944  1175 raft_consensus.cc:1217] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:34.738910  1175 raft_consensus.cc:1217] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:34.871147  1175 raft_consensus.cc:1217] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:35.134727  1311 raft_consensus.cc:1064] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:35.137346  1311 consensus_queue.cc:237] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:35.144510  1175 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:35.144656   554 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:35.146261   481 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:35.146605  1310 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:35.147816  1309 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:35.149545  1310 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:35.181154  1308 raft_consensus.cc:1064] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:35.218677  1308 consensus_queue.cc:237] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:35.229269  1309 raft_consensus.cc:2955] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.256821   481 raft_consensus.cc:2955] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.259954   554 raft_consensus.cc:2955] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.264201  1175 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:35.266973  1307 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:35.276633   478 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:35.280346  1308 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:35.292002   378 catalog_manager.cc:5697] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.315933  1308 raft_consensus.cc:2955] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.334625   481 raft_consensus.cc:2955] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.337746  1328 raft_consensus.cc:1064] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:35.341368  1328 consensus_queue.cc:237] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:35.347103  1175 raft_consensus.cc:2955] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.352339   624 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:35.359426  1299 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:35.363622  1174 raft_consensus.cc:2955] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.393839   557 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:35.395565   478 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:35.395434  1342 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:35.398403  1335 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:12:35.402118  1312 raft_consensus.cc:1064] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:35.405175  1174 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:35.405799  1312 consensus_queue.cc:237] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:35.408957  1311 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:35.392005   626 raft_consensus.cc:2955] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.425601   632 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:35.427167  1326 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:35.427645  1175 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:35.432413  1304 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:35.440865   554 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:35.449796  1326 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:35.450673   624 consensus_queue.cc:237] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:35.467165  1310 raft_consensus.cc:2955] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.463892   380 catalog_manager.cc:5697] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.478569   556 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:35.478910  1174 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:35.476404   554 raft_consensus.cc:2955] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.489260  1328 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:35.490123  1342 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:35.498701  1175 raft_consensus.cc:2955] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.503958  1342 raft_consensus.cc:2955] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.516705   381 catalog_manager.cc:5697] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.518618   556 raft_consensus.cc:2955] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.522856   481 raft_consensus.cc:2955] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.526289   555 raft_consensus.cc:2955] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.528067   365 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 12805530d9a3471aa3d5b4c086cc454a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:35.532634  1175 raft_consensus.cc:2955] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.524529  1351 raft_consensus.cc:2955] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.537866   380 catalog_manager.cc:5697] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:35.563848   626 raft_consensus.cc:2955] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.575865   467 tablet_service.cc:1558] Processing DeleteTablet for tablet 12805530d9a3471aa3d5b4c086cc454a with delete_type TABLET_DATA_TOMBSTONED (TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38120
I20260709 13:12:35.596048  1356 tablet_replica.cc:333] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:12:35.597150  1356 raft_consensus.cc:2243] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.595220   378 catalog_manager.cc:5697] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.604717  1174 raft_consensus.cc:2955] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.597844  1356 raft_consensus.cc:2272] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.598408   626 consensus_queue.cc:237] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:35.613945  1356 ts_tablet_manager.cc:1916] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:35.614557   481 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:35.614033  1175 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:35.616029  1342 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:35.623214  1342 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:35.630165   481 consensus_queue.cc:237] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:35.632184  1309 raft_consensus.cc:2955] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.637990   624 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:35.640612  1351 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:35.637742   481 raft_consensus.cc:2955] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.654801   365 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 18dea61d0790411c88602b2cfc2fbcdb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:35.658562  1356 ts_tablet_manager.cc:1929] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:35.659116  1356 log.cc:1199] T 12805530d9a3471aa3d5b4c086cc454a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-0-root/wals/12805530d9a3471aa3d5b4c086cc454a
I20260709 13:12:35.663008  1173 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:35.664211  1351 raft_consensus.cc:2955] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.677683   379 catalog_manager.cc:5697] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.678418  1355 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:12:35.683779  1174 raft_consensus.cc:2955] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.693946   545 tablet_service.cc:1558] Processing DeleteTablet for tablet 18dea61d0790411c88602b2cfc2fbcdb with delete_type TABLET_DATA_TOMBSTONED (TS 6ba2a9c02b534120bbf26e56a1e920ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59108
I20260709 13:12:35.697410   379 catalog_manager.cc:5697] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.703744   368 catalog_manager.cc:5028] TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): tablet 12805530d9a3471aa3d5b4c086cc454a (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:35.704551   368 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 304d1b96642140f19543be15d23a061c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:35.704723   626 raft_consensus.cc:2955] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.708406  1357 tablet_replica.cc:333] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:12:35.714371  1175 raft_consensus.cc:2955] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.724417  1357 raft_consensus.cc:2243] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.727133   545 tablet_service.cc:1558] Processing DeleteTablet for tablet 304d1b96642140f19543be15d23a061c with delete_type TABLET_DATA_TOMBSTONED (TS 6ba2a9c02b534120bbf26e56a1e920ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59108
I20260709 13:12:35.728755  1357 raft_consensus.cc:2272] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.739494  1357 ts_tablet_manager.cc:1916] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:35.753202  1357 ts_tablet_manager.cc:1929] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:35.753609  1357 log.cc:1199] T 18dea61d0790411c88602b2cfc2fbcdb P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-1-root/wals/18dea61d0790411c88602b2cfc2fbcdb
I20260709 13:12:35.755491  1357 tablet_replica.cc:333] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:12:35.755535   366 catalog_manager.cc:5028] TS 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): tablet 18dea61d0790411c88602b2cfc2fbcdb (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:35.756516  1357 raft_consensus.cc:2243] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.757292  1357 raft_consensus.cc:2272] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.760278  1357 ts_tablet_manager.cc:1916] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:35.775005  1357 ts_tablet_manager.cc:1929] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:35.775521  1357 log.cc:1199] T 304d1b96642140f19543be15d23a061c P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-1-root/wals/304d1b96642140f19543be15d23a061c
I20260709 13:12:35.776859   366 catalog_manager.cc:5028] TS 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): tablet 304d1b96642140f19543be15d23a061c (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:35.954496   555 consensus_queue.cc:237] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:35.964921  1175 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:35.966519  1299 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:35.966919   626 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:35.968482  1339 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:35.976219  1339 raft_consensus.cc:2955] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.979972  1175 raft_consensus.cc:2955] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.986974   626 raft_consensus.cc:2955] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:35.997182   379 catalog_manager.cc:5697] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:36.000836   366 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c192fb76f82248d78ddc2aac1d721cd9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:36.013414   467 tablet_service.cc:1558] Processing DeleteTablet for tablet c192fb76f82248d78ddc2aac1d721cd9 with delete_type TABLET_DATA_TOMBSTONED (TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38120
I20260709 13:12:36.014340  1356 tablet_replica.cc:333] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:12:36.015393  1356 raft_consensus.cc:2243] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.016058  1356 raft_consensus.cc:2272] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.019812  1356 ts_tablet_manager.cc:1916] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:36.038429  1356 ts_tablet_manager.cc:1929] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:36.038867  1356 log.cc:1199] T c192fb76f82248d78ddc2aac1d721cd9 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-0-root/wals/c192fb76f82248d78ddc2aac1d721cd9
I20260709 13:12:36.041002   368 catalog_manager.cc:5028] TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): tablet c192fb76f82248d78ddc2aac1d721cd9 (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:37.091473   481 consensus_queue.cc:237] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
W20260709 13:12:37.098348   448 consensus_peers.cc:597] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 54372ad9508c44d2824f4810f03a5081. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.099216   632 raft_consensus.cc:1275] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:37.099947   555 raft_consensus.cc:1275] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:37.100695  1326 consensus_queue.cc:1048] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:37.101527  1351 consensus_queue.cc:1048] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:37.109289  1326 raft_consensus.cc:2955] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:37.111653   626 raft_consensus.cc:2955] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:37.112082   555 raft_consensus.cc:2955] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:37.127839   378 catalog_manager.cc:5697] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:37.134372   626 consensus_queue.cc:237] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:37.149168   555 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:12:37.150110   597 consensus_peers.cc:597] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d2f65eaa10d4428a49b5f1ed8b939f1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.151345  1328 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:37.154300   481 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:37.155524  1309 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:37.175544  1358 raft_consensus.cc:2955] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:37.186296   481 raft_consensus.cc:2955] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:37.191200   554 consensus_queue.cc:237] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:37.191588   555 raft_consensus.cc:2955] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:37.194690   378 catalog_manager.cc:5697] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.206528   632 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:37.207146   481 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:12:37.207792   523 consensus_peers.cc:597] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67e346d318734aba97a45543ff4ad474. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.208561  1344 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:37.209705  1339 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:37.217010  1344 raft_consensus.cc:2955] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:37.218430   632 raft_consensus.cc:2955] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:37.219429   481 raft_consensus.cc:2955] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:37.239107   378 catalog_manager.cc:5697] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:37.244175   632 consensus_queue.cc:237] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:37.251627   554 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:12:37.250968   597 consensus_peers.cc:597] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5153b5ac109e49b78fd24ec7f42e3c8e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.253403  1328 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:37.274899  1309 raft_consensus.cc:2955] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:37.279979   481 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:37.281529  1328 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:37.281760   554 raft_consensus.cc:2955] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:37.287071   481 raft_consensus.cc:2955] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:37.315858   379 catalog_manager.cc:5697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:37.597012  1377 ts_tablet_manager.cc:933] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:37.598995  1377 tablet_copy_client.cc:323] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.131:36245
I20260709 13:12:37.600898   643 tablet_copy_service.cc:140] P 50f7c2247be24f3685d7fbca7b6c71e3: Received BeginTabletCopySession request for tablet 4d2f65eaa10d4428a49b5f1ed8b939f1 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:54754)
I20260709 13:12:37.601364   643 tablet_copy_service.cc:161] P 50f7c2247be24f3685d7fbca7b6c71e3: Beginning new tablet copy session on tablet 4d2f65eaa10d4428a49b5f1ed8b939f1 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:54754: session id = 6e6df7e8ed204f1db5c371536b5b0683-4d2f65eaa10d4428a49b5f1ed8b939f1
I20260709 13:12:37.608816   643 tablet_copy_source_session.cc:215] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:37.612177  1377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2f65eaa10d4428a49b5f1ed8b939f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.625932  1377 tablet_copy_client.cc:806] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:37.626456  1377 tablet_copy_client.cc:670] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:37.630165  1377 tablet_copy_client.cc:538] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:37.636178  1377 tablet_bootstrap.cc:492] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:37.652556  1377 tablet_bootstrap.cc:492] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:37.653370  1377 tablet_bootstrap.cc:492] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:37.653940  1377 ts_tablet_manager.cc:1403] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:12:37.656643  1377 raft_consensus.cc:359] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:37.657284  1377 raft_consensus.cc:740] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:37.657793  1377 consensus_queue.cc:260] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:37.660517  1377 ts_tablet_manager.cc:1434] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:12:37.662079   643 tablet_copy_service.cc:342] P 50f7c2247be24f3685d7fbca7b6c71e3: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-4d2f65eaa10d4428a49b5f1ed8b939f1 received from {username='slave'} at 127.0.0.1:54754
I20260709 13:12:37.662524   643 tablet_copy_service.cc:434] P 50f7c2247be24f3685d7fbca7b6c71e3: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-4d2f65eaa10d4428a49b5f1ed8b939f1 on tablet 4d2f65eaa10d4428a49b5f1ed8b939f1 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:37.691526  1377 ts_tablet_manager.cc:933] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:12:37.693316  1377 tablet_copy_client.cc:323] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.129:45711
I20260709 13:12:37.695307   494 tablet_copy_service.cc:140] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Received BeginTabletCopySession request for tablet 54372ad9508c44d2824f4810f03a5081 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:41384)
I20260709 13:12:37.695803   494 tablet_copy_service.cc:161] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Beginning new tablet copy session on tablet 54372ad9508c44d2824f4810f03a5081 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:41384: session id = 6e6df7e8ed204f1db5c371536b5b0683-54372ad9508c44d2824f4810f03a5081
I20260709 13:12:37.707499   494 tablet_copy_source_session.cc:215] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:37.710345  1377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54372ad9508c44d2824f4810f03a5081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.727017  1377 tablet_copy_client.cc:806] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:37.727686  1377 tablet_copy_client.cc:670] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:37.731302  1377 tablet_copy_client.cc:538] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:37.740760  1377 tablet_bootstrap.cc:492] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:37.762401  1377 tablet_bootstrap.cc:492] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:37.763383  1377 tablet_bootstrap.cc:492] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:37.764094  1377 ts_tablet_manager.cc:1403] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.008s
I20260709 13:12:37.767298  1377 raft_consensus.cc:359] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:37.768285  1377 raft_consensus.cc:740] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:37.769022  1383 ts_tablet_manager.cc:933] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:37.768923  1377 consensus_queue.cc:260] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:37.771428  1377 ts_tablet_manager.cc:1434] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:12:37.782302   494 tablet_copy_service.cc:342] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-54372ad9508c44d2824f4810f03a5081 received from {username='slave'} at 127.0.0.1:41384
I20260709 13:12:37.782961   494 tablet_copy_service.cc:434] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-54372ad9508c44d2824f4810f03a5081 on tablet 54372ad9508c44d2824f4810f03a5081 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:37.859165  1377 ts_tablet_manager.cc:933] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:37.860670  1383 tablet_copy_client.cc:323] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.130:41159
I20260709 13:12:37.863227   569 tablet_copy_service.cc:140] P 6ba2a9c02b534120bbf26e56a1e920ca: Received BeginTabletCopySession request for tablet 67e346d318734aba97a45543ff4ad474 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:43548)
I20260709 13:12:37.863987   569 tablet_copy_service.cc:161] P 6ba2a9c02b534120bbf26e56a1e920ca: Beginning new tablet copy session on tablet 67e346d318734aba97a45543ff4ad474 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:43548: session id = 6e6df7e8ed204f1db5c371536b5b0683-67e346d318734aba97a45543ff4ad474
I20260709 13:12:37.871855   569 tablet_copy_source_session.cc:215] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:37.880844  1383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67e346d318734aba97a45543ff4ad474. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:37.885895   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 81426.6us
I20260709 13:12:37.889891  1377 tablet_copy_client.cc:323] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.131:36245
I20260709 13:12:37.891708   643 tablet_copy_service.cc:140] P 50f7c2247be24f3685d7fbca7b6c71e3: Received BeginTabletCopySession request for tablet 5153b5ac109e49b78fd24ec7f42e3c8e from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:54754)
I20260709 13:12:37.892239   643 tablet_copy_service.cc:161] P 50f7c2247be24f3685d7fbca7b6c71e3: Beginning new tablet copy session on tablet 5153b5ac109e49b78fd24ec7f42e3c8e from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:54754: session id = 6e6df7e8ed204f1db5c371536b5b0683-5153b5ac109e49b78fd24ec7f42e3c8e
I20260709 13:12:37.902168   643 tablet_copy_source_session.cc:215] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:37.905897  1377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5153b5ac109e49b78fd24ec7f42e3c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.912473  1383 tablet_copy_client.cc:806] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:37.913067  1383 tablet_copy_client.cc:670] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:37.916894  1383 tablet_copy_client.cc:538] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:37.921011  1377 tablet_copy_client.cc:806] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:37.921525  1377 tablet_copy_client.cc:670] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:37.925843  1377 tablet_copy_client.cc:538] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:37.927374  1383 tablet_bootstrap.cc:492] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:37.937412  1377 tablet_bootstrap.cc:492] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:37.956503  1383 tablet_bootstrap.cc:492] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:37.957654  1383 tablet_bootstrap.cc:492] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:37.969368  1383 ts_tablet_manager.cc:1403] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.020s
I20260709 13:12:37.972175  1383 raft_consensus.cc:359] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:37.972983  1383 raft_consensus.cc:740] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:37.973631  1383 consensus_queue.cc:260] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:37.977016  1383 ts_tablet_manager.cc:1434] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:37.980290  1377 tablet_bootstrap.cc:492] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:37.981138  1377 tablet_bootstrap.cc:492] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:37.982335   569 tablet_copy_service.cc:342] P 6ba2a9c02b534120bbf26e56a1e920ca: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-67e346d318734aba97a45543ff4ad474 received from {username='slave'} at 127.0.0.1:43548
I20260709 13:12:37.982812   569 tablet_copy_service.cc:434] P 6ba2a9c02b534120bbf26e56a1e920ca: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-67e346d318734aba97a45543ff4ad474 on tablet 67e346d318734aba97a45543ff4ad474 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:37.984696  1377 ts_tablet_manager.cc:1403] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.019s
I20260709 13:12:37.987221  1377 raft_consensus.cc:359] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:37.987823  1377 raft_consensus.cc:740] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:37.988351  1377 consensus_queue.cc:260] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:37.990165  1377 ts_tablet_manager.cc:1434] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:12:37.991653   643 tablet_copy_service.cc:342] P 50f7c2247be24f3685d7fbca7b6c71e3: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-5153b5ac109e49b78fd24ec7f42e3c8e received from {username='slave'} at 127.0.0.1:54754
I20260709 13:12:37.992048   643 tablet_copy_service.cc:434] P 50f7c2247be24f3685d7fbca7b6c71e3: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-5153b5ac109e49b78fd24ec7f42e3c8e on tablet 5153b5ac109e49b78fd24ec7f42e3c8e with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:38.219488  1175 raft_consensus.cc:1217] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:38.273483  1175 raft_consensus.cc:1217] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:38.300798  1175 raft_consensus.cc:1217] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:38.457842  1175 raft_consensus.cc:1217] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:38.720628  1387 raft_consensus.cc:1064] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:38.722723  1387 consensus_queue.cc:237] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:38.731282   555 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:38.731803   484 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:38.731282  1174 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:38.734392  1328 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:38.735170  1358 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:38.737027  1358 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:38.753762  1328 raft_consensus.cc:2955] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:38.757652   555 raft_consensus.cc:2955] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:38.759775  1174 raft_consensus.cc:2955] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:38.775722   484 raft_consensus.cc:2955] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:38.782363   378 catalog_manager.cc:5697] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:38.836287  1385 raft_consensus.cc:1064] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:38.838935  1385 consensus_queue.cc:237] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:38.849493  1328 raft_consensus.cc:1064] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:38.852097  1328 consensus_queue.cc:237] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:38.894186   624 consensus_queue.cc:237] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:38.897181   626 raft_consensus.cc:1275] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:38.902086  1386 consensus_queue.cc:1048] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:38.905637  1174 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:38.908011  1358 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:38.917390   555 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:38.918303  1339 raft_consensus.cc:1064] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:38.920265  1358 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:38.921540  1339 consensus_queue.cc:237] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:38.922453  1358 raft_consensus.cc:2955] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:38.928295   555 raft_consensus.cc:2955] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:38.938869  1174 raft_consensus.cc:2955] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:38.952442   624 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:38.954545  1175 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:38.954345  1404 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:38.963197  1404 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:38.967618   484 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:38.971498  1392 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:38.983016   557 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:38.984932  1173 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:38.987533  1387 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:38.987840   478 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:38.991900  1411 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:39.009586  1404 raft_consensus.cc:2955] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.013535   624 raft_consensus.cc:2955] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.013422   484 raft_consensus.cc:2955] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:12:39.043315   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 44679.8us
I20260709 13:12:39.056875  1411 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:39.066721  1175 raft_consensus.cc:2955] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.103171   380 catalog_manager.cc:5697] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.109061   365 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4d2f65eaa10d4428a49b5f1ed8b939f1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:39.114459  1358 raft_consensus.cc:2955] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.116611   478 raft_consensus.cc:2955] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:12:39.119580   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 234577us
I20260709 13:12:39.133292  1173 raft_consensus.cc:1275] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:39.133468   555 raft_consensus.cc:1275] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:39.159305  1175 raft_consensus.cc:2955] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.173506  1326 consensus_queue.cc:1048] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:39.173219   557 raft_consensus.cc:2955] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.179412   381 catalog_manager.cc:5697] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.194170   555 consensus_queue.cc:237] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:39.195454   467 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d2f65eaa10d4428a49b5f1ed8b939f1 with delete_type TABLET_DATA_TOMBSTONED (TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38120
I20260709 13:12:39.199548   381 catalog_manager.cc:5697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:39.216090  1405 consensus_queue.cc:1048] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:39.222108  1175 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:39.223766  1404 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:39.232009   632 consensus_queue.cc:237] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:39.233346   478 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:39.234575  1392 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:39.245841  1174 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:39.246577   478 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:39.247723  1411 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:39.252460  1404 raft_consensus.cc:2955] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.260941  1411 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:39.266294  1419 tablet_replica.cc:333] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:12:39.269390  1419 raft_consensus.cc:2243] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.270227  1419 raft_consensus.cc:2272] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.269620   483 raft_consensus.cc:2955] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.278471  1173 raft_consensus.cc:2955] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.281173  1405 raft_consensus.cc:2955] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.284736  1172 raft_consensus.cc:2955] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.311736  1358 raft_consensus.cc:2955] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.313270  1419 ts_tablet_manager.cc:1916] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:39.327834   378 catalog_manager.cc:5697] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.331786   365 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5153b5ac109e49b78fd24ec7f42e3c8e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:39.337874   624 raft_consensus.cc:2955] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.344255   381 catalog_manager.cc:5697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:39.355083   366 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 67e346d318734aba97a45543ff4ad474 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:39.361135   555 raft_consensus.cc:2955] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.369441   379 catalog_manager.cc:5697] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.360030  1172 raft_consensus.cc:2955] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.374284   545 tablet_service.cc:1558] Processing DeleteTablet for tablet 5153b5ac109e49b78fd24ec7f42e3c8e with delete_type TABLET_DATA_TOMBSTONED (TS 6ba2a9c02b534120bbf26e56a1e920ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59108
I20260709 13:12:39.375592   478 raft_consensus.cc:2955] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.398523  1419 ts_tablet_manager.cc:1929] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:39.399022  1419 log.cc:1199] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-0-root/wals/4d2f65eaa10d4428a49b5f1ed8b939f1
I20260709 13:12:39.400847   617 tablet_service.cc:1558] Processing DeleteTablet for tablet 67e346d318734aba97a45543ff4ad474 with delete_type TABLET_DATA_TOMBSTONED (TS 50f7c2247be24f3685d7fbca7b6c71e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54246
I20260709 13:12:39.400473   368 catalog_manager.cc:5028] TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): tablet 4d2f65eaa10d4428a49b5f1ed8b939f1 (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:39.420922   478 consensus_queue.cc:237] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:39.433243  1423 tablet_replica.cc:333] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:12:39.435333  1423 raft_consensus.cc:2243] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.436125  1423 raft_consensus.cc:2272] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.437448  1424 tablet_replica.cc:333] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:12:39.440213   555 raft_consensus.cc:1275] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:39.442167  1386 consensus_queue.cc:1048] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:39.442852  1172 raft_consensus.cc:1275] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:39.448673  1423 ts_tablet_manager.cc:1916] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:39.450443  1405 consensus_queue.cc:1048] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:39.456483  1406 raft_consensus.cc:2955] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.456670   555 raft_consensus.cc:2955] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.466909   368 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 54372ad9508c44d2824f4810f03a5081 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:39.468001  1173 raft_consensus.cc:2955] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.480562   380 catalog_manager.cc:5697] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:39.456176  1424 raft_consensus.cc:2243] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.485833  1424 raft_consensus.cc:2272] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.493237  1424 ts_tablet_manager.cc:1916] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:39.497705   617 tablet_service.cc:1558] Processing DeleteTablet for tablet 54372ad9508c44d2824f4810f03a5081 with delete_type TABLET_DATA_TOMBSTONED (TS 50f7c2247be24f3685d7fbca7b6c71e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54246
I20260709 13:12:39.512375  1424 ts_tablet_manager.cc:1929] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:39.512929  1424 log.cc:1199] T 67e346d318734aba97a45543ff4ad474 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-2-root/wals/67e346d318734aba97a45543ff4ad474
I20260709 13:12:39.514638   365 catalog_manager.cc:5028] TS 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): tablet 67e346d318734aba97a45543ff4ad474 (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:39.515005  1424 tablet_replica.cc:333] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:12:39.516007  1424 raft_consensus.cc:2243] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.516582  1423 ts_tablet_manager.cc:1929] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:39.516716  1424 raft_consensus.cc:2272] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.517007  1423 log.cc:1199] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-1-root/wals/5153b5ac109e49b78fd24ec7f42e3c8e
I20260709 13:12:39.518640   366 catalog_manager.cc:5028] TS 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): tablet 5153b5ac109e49b78fd24ec7f42e3c8e (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:39.519824  1424 ts_tablet_manager.cc:1916] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:39.533174  1424 ts_tablet_manager.cc:1929] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:39.533507  1424 log.cc:1199] T 54372ad9508c44d2824f4810f03a5081 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-2-root/wals/54372ad9508c44d2824f4810f03a5081
I20260709 13:12:39.534981   365 catalog_manager.cc:5028] TS 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): tablet 54372ad9508c44d2824f4810f03a5081 (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:40.568624   555 consensus_queue.cc:237] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:40.574802   483 raft_consensus.cc:1275] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:40.574987   632 raft_consensus.cc:1275] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:12:40.575371   523 consensus_peers.cc:597] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 093a5bf347e94e52af24456f0631abe3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:40.576094  1425 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:40.576874  1422 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:40.584914  1422 raft_consensus.cc:2955] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:40.590551   483 raft_consensus.cc:2955] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:40.604574   483 consensus_queue.cc:237] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:40.604471   378 catalog_manager.cc:5697] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:40.608024   632 raft_consensus.cc:2955] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:40.613875   624 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:40.615206  1405 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:40.616628   448 consensus_peers.cc:597] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f221a3b77aba453e80c06e1de30b76aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:40.617589   555 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:40.618991  1405 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:40.639320  1386 raft_consensus.cc:2955] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:40.647835   624 raft_consensus.cc:2955] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:40.650846   559 raft_consensus.cc:2955] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:40.673095   624 consensus_queue.cc:237] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:40.674278   380 catalog_manager.cc:5697] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:40.683867   555 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:40.685565   483 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:40.686812  1438 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:40.687831   597 consensus_peers.cc:597] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b7fddd60ae54606847dc6f4111a7e30. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:40.688392  1415 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:40.707517  1438 raft_consensus.cc:2955] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:40.709882   554 raft_consensus.cc:2955] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:40.711131   483 raft_consensus.cc:2955] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:40.724515   483 consensus_queue.cc:237] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:40.725649   381 catalog_manager.cc:5697] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:40.732791   624 raft_consensus.cc:1275] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:40.734127  1405 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:40.739562   448 consensus_peers.cc:597] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 372575938bbf471c935e1b39ba9e588f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:40.741403   554 raft_consensus.cc:1275] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:40.742892  1386 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:40.761547  1386 raft_consensus.cc:2955] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:40.763815   554 raft_consensus.cc:2955] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:40.779876   624 raft_consensus.cc:2955] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:40.781046   380 catalog_manager.cc:5697] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.089036  1445 ts_tablet_manager.cc:933] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:12:41.092257  1445 tablet_copy_client.cc:323] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.129:45711
I20260709 13:12:41.094125   494 tablet_copy_service.cc:140] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Received BeginTabletCopySession request for tablet f221a3b77aba453e80c06e1de30b76aa from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:41384)
I20260709 13:12:41.094663   494 tablet_copy_service.cc:161] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Beginning new tablet copy session on tablet f221a3b77aba453e80c06e1de30b76aa from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:41384: session id = 6e6df7e8ed204f1db5c371536b5b0683-f221a3b77aba453e80c06e1de30b76aa
I20260709 13:12:41.100332   494 tablet_copy_source_session.cc:215] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:41.103673  1445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f221a3b77aba453e80c06e1de30b76aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.118903  1445 tablet_copy_client.cc:806] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:41.119581  1445 tablet_copy_client.cc:670] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:41.125480  1445 tablet_copy_client.cc:538] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:41.136235  1445 tablet_bootstrap.cc:492] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:41.156158  1448 ts_tablet_manager.cc:933] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:41.158850  1445 tablet_bootstrap.cc:492] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:41.159943  1445 tablet_bootstrap.cc:492] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:41.160902  1445 ts_tablet_manager.cc:1403] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.025s	user 0.024s	sys 0.000s
I20260709 13:12:41.164222  1445 raft_consensus.cc:359] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:41.165258  1445 raft_consensus.cc:740] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:41.166014  1445 consensus_queue.cc:260] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:41.170423  1448 tablet_copy_client.cc:323] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.130:41159
I20260709 13:12:41.175088   569 tablet_copy_service.cc:140] P 6ba2a9c02b534120bbf26e56a1e920ca: Received BeginTabletCopySession request for tablet 093a5bf347e94e52af24456f0631abe3 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:43548)
I20260709 13:12:41.175721   569 tablet_copy_service.cc:161] P 6ba2a9c02b534120bbf26e56a1e920ca: Beginning new tablet copy session on tablet 093a5bf347e94e52af24456f0631abe3 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:43548: session id = 6e6df7e8ed204f1db5c371536b5b0683-093a5bf347e94e52af24456f0631abe3
I20260709 13:12:41.196136   569 tablet_copy_source_session.cc:215] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:41.198894  1445 ts_tablet_manager.cc:1434] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.005s
I20260709 13:12:41.202334  1448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 093a5bf347e94e52af24456f0631abe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.203455   494 tablet_copy_service.cc:342] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-f221a3b77aba453e80c06e1de30b76aa received from {username='slave'} at 127.0.0.1:41384
I20260709 13:12:41.203912   494 tablet_copy_service.cc:434] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-f221a3b77aba453e80c06e1de30b76aa on tablet f221a3b77aba453e80c06e1de30b76aa with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:41.221729  1445 ts_tablet_manager.cc:933] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:41.223790  1445 tablet_copy_client.cc:323] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.131:36245
I20260709 13:12:41.225602   643 tablet_copy_service.cc:140] P 50f7c2247be24f3685d7fbca7b6c71e3: Received BeginTabletCopySession request for tablet 9b7fddd60ae54606847dc6f4111a7e30 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:54754)
I20260709 13:12:41.226127   643 tablet_copy_service.cc:161] P 50f7c2247be24f3685d7fbca7b6c71e3: Beginning new tablet copy session on tablet 9b7fddd60ae54606847dc6f4111a7e30 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:54754: session id = 6e6df7e8ed204f1db5c371536b5b0683-9b7fddd60ae54606847dc6f4111a7e30
I20260709 13:12:41.226872  1448 tablet_copy_client.cc:806] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:41.227545  1448 tablet_copy_client.cc:670] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:41.232223  1448 tablet_copy_client.cc:538] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:41.234045   643 tablet_copy_source_session.cc:215] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:41.237142  1445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7fddd60ae54606847dc6f4111a7e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.238987  1448 tablet_bootstrap.cc:492] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:41.253108  1445 tablet_copy_client.cc:806] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:41.253665  1445 tablet_copy_client.cc:670] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:41.259025  1445 tablet_copy_client.cc:538] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:41.281638  1445 tablet_bootstrap.cc:492] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:41.302234  1448 tablet_bootstrap.cc:492] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:41.303563  1448 tablet_bootstrap.cc:492] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:41.305486  1448 ts_tablet_manager.cc:1403] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.067s	user 0.032s	sys 0.004s
I20260709 13:12:41.309271  1448 raft_consensus.cc:359] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:41.310240  1448 raft_consensus.cc:740] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:41.311004  1448 consensus_queue.cc:260] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:41.314014  1448 ts_tablet_manager.cc:1434] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:12:41.316274   569 tablet_copy_service.cc:342] P 6ba2a9c02b534120bbf26e56a1e920ca: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-093a5bf347e94e52af24456f0631abe3 received from {username='slave'} at 127.0.0.1:43548
I20260709 13:12:41.316708   569 tablet_copy_service.cc:434] P 6ba2a9c02b534120bbf26e56a1e920ca: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-093a5bf347e94e52af24456f0631abe3 on tablet 093a5bf347e94e52af24456f0631abe3 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:41.325816  1445 tablet_bootstrap.cc:492] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:41.326743  1445 tablet_bootstrap.cc:492] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:41.327426  1445 ts_tablet_manager.cc:1403] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.046s	user 0.026s	sys 0.004s
I20260709 13:12:41.330150  1445 raft_consensus.cc:359] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:41.330948  1445 raft_consensus.cc:740] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:41.331198  1448 ts_tablet_manager.cc:933] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:12:41.331575  1445 consensus_queue.cc:260] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:41.333968  1445 ts_tablet_manager.cc:1434] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:12:41.338697   643 tablet_copy_service.cc:342] P 50f7c2247be24f3685d7fbca7b6c71e3: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-9b7fddd60ae54606847dc6f4111a7e30 received from {username='slave'} at 127.0.0.1:54754
I20260709 13:12:41.339112   643 tablet_copy_service.cc:434] P 50f7c2247be24f3685d7fbca7b6c71e3: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-9b7fddd60ae54606847dc6f4111a7e30 on tablet 9b7fddd60ae54606847dc6f4111a7e30 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:41.347338  1448 tablet_copy_client.cc:323] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.129:45711
I20260709 13:12:41.348877   494 tablet_copy_service.cc:140] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Received BeginTabletCopySession request for tablet 372575938bbf471c935e1b39ba9e588f from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:41384)
I20260709 13:12:41.349339   494 tablet_copy_service.cc:161] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Beginning new tablet copy session on tablet 372575938bbf471c935e1b39ba9e588f from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:41384: session id = 6e6df7e8ed204f1db5c371536b5b0683-372575938bbf471c935e1b39ba9e588f
I20260709 13:12:41.356015   494 tablet_copy_source_session.cc:215] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:41.359505  1448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372575938bbf471c935e1b39ba9e588f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.372963  1448 tablet_copy_client.cc:806] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:41.373521  1448 tablet_copy_client.cc:670] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:41.376727  1448 tablet_copy_client.cc:538] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:41.400027  1448 tablet_bootstrap.cc:492] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:41.423759  1448 tablet_bootstrap.cc:492] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:41.424711  1448 tablet_bootstrap.cc:492] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:41.425585  1448 ts_tablet_manager.cc:1403] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.004s
I20260709 13:12:41.428920  1448 raft_consensus.cc:359] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:41.429759  1448 raft_consensus.cc:740] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:41.430382  1448 consensus_queue.cc:260] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:41.433806  1448 ts_tablet_manager.cc:1434] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:41.435906   494 tablet_copy_service.cc:342] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-372575938bbf471c935e1b39ba9e588f received from {username='slave'} at 127.0.0.1:41384
I20260709 13:12:41.436405   494 tablet_copy_service.cc:434] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-372575938bbf471c935e1b39ba9e588f on tablet 372575938bbf471c935e1b39ba9e588f with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:41.525743  1173 raft_consensus.cc:1217] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:41.541045  1173 raft_consensus.cc:1217] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:41.644308  1173 raft_consensus.cc:1217] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:41.792213  1173 raft_consensus.cc:1217] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:41.930622  1425 raft_consensus.cc:1064] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:41.933247  1425 consensus_queue.cc:237] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:41.943357   626 raft_consensus.cc:1275] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:41.944703   483 raft_consensus.cc:1275] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:41.944888  1422 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:41.946007  1429 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:41.947113  1173 raft_consensus.cc:1275] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:41.953823  1429 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:12:41.990644  1459 raft_consensus.cc:2955] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:41.994797  1173 raft_consensus.cc:2955] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:41.999933   483 raft_consensus.cc:2955] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.003024   626 raft_consensus.cc:2955] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.015832   381 catalog_manager.cc:5697] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:42.045611  1415 raft_consensus.cc:1064] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:42.049093  1415 consensus_queue.cc:237] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:42.056201   554 consensus_queue.cc:237] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:42.062163  1173 raft_consensus.cc:1275] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:42.063083   483 raft_consensus.cc:1275] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:42.064594  1173 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:42.066082  1467 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:42.066633  1459 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:42.070533  1422 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:42.075631   479 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:42.078167  1438 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:42.080245  1425 raft_consensus.cc:2955] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.078505   554 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:42.086249  1415 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:42.088338  1172 raft_consensus.cc:2955] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.113510   478 raft_consensus.cc:2955] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.118016   366 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 093a5bf347e94e52af24456f0631abe3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:42.121223  1415 raft_consensus.cc:2955] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.122979   554 raft_consensus.cc:2955] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.126287   380 catalog_manager.cc:5697] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:42.136055  1172 raft_consensus.cc:2955] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.143308  1456 raft_consensus.cc:1064] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:42.145687   617 tablet_service.cc:1558] Processing DeleteTablet for tablet 093a5bf347e94e52af24456f0631abe3 with delete_type TABLET_DATA_TOMBSTONED (TS 50f7c2247be24f3685d7fbca7b6c71e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54246
I20260709 13:12:42.146811   483 raft_consensus.cc:2955] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.149678  1456 consensus_queue.cc:237] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:42.181267  1472 tablet_replica.cc:333] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:12:42.182317  1472 raft_consensus.cc:2243] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.183038  1472 raft_consensus.cc:2272] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.186569   624 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:42.177907   380 catalog_manager.cc:5697] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:42.188377   554 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:42.188700  1172 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:42.190282  1405 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:42.192005  1472 ts_tablet_manager.cc:1916] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:42.192013  1405 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:42.193903  1393 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:42.225575  1472 ts_tablet_manager.cc:1929] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:42.226117  1472 log.cc:1199] T 093a5bf347e94e52af24456f0631abe3 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-2-root/wals/093a5bf347e94e52af24456f0631abe3
I20260709 13:12:42.230645  1173 raft_consensus.cc:2955] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.226766  1474 raft_consensus.cc:2955] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.235713   624 raft_consensus.cc:2955] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.243319   554 raft_consensus.cc:2955] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.245702   365 catalog_manager.cc:5028] TS 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): tablet 093a5bf347e94e52af24456f0631abe3 (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:42.249225   632 consensus_queue.cc:237] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:42.260085   555 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:42.262187  1415 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:42.263754  1173 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:42.273036   379 catalog_manager.cc:5697] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.275190  1457 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:42.281399  1393 raft_consensus.cc:1064] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:42.281576  1457 raft_consensus.cc:2955] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.284261  1393 consensus_queue.cc:237] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:42.284911   555 raft_consensus.cc:2955] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.302206   483 consensus_queue.cc:237] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:42.303917  1172 raft_consensus.cc:2955] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.309383  1173 raft_consensus.cc:1275] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:42.311012   555 raft_consensus.cc:1275] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:42.314332  1474 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:42.316354  1474 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:42.316642  1173 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:42.316643   632 raft_consensus.cc:1275] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:42.319482   365 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9b7fddd60ae54606847dc6f4111a7e30 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:42.320981  1405 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:42.326573  1474 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:42.322593   632 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:42.334071  1474 raft_consensus.cc:2955] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.336468  1174 raft_consensus.cc:2955] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.342934   379 catalog_manager.cc:5697] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:42.353447  1393 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:42.358477   624 raft_consensus.cc:2955] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.360633  1456 raft_consensus.cc:2955] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.366657   557 raft_consensus.cc:2955] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.383780  1172 raft_consensus.cc:2955] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.412220   381 catalog_manager.cc:5697] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:12:42.429136   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 60798.1us
I20260709 13:12:42.435329   378 catalog_manager.cc:5697] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.437999   624 raft_consensus.cc:2955] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.441387   368 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f221a3b77aba453e80c06e1de30b76aa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:42.444878   467 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b7fddd60ae54606847dc6f4111a7e30 with delete_type TABLET_DATA_TOMBSTONED (TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38120
I20260709 13:12:42.445866   545 tablet_service.cc:1558] Processing DeleteTablet for tablet f221a3b77aba453e80c06e1de30b76aa with delete_type TABLET_DATA_TOMBSTONED (TS 6ba2a9c02b534120bbf26e56a1e920ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59108
I20260709 13:12:42.463645  1486 tablet_replica.cc:333] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:12:42.464864  1486 raft_consensus.cc:2243] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.465677  1486 raft_consensus.cc:2272] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.467375  1485 tablet_replica.cc:333] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:12:42.468535  1485 raft_consensus.cc:2243] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.469306  1485 raft_consensus.cc:2272] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.472846  1485 ts_tablet_manager.cc:1916] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:42.473824   483 consensus_queue.cc:237] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:42.478444  1486 ts_tablet_manager.cc:1916] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:42.485463  1172 raft_consensus.cc:1275] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:42.487327  1484 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:42.489548   554 raft_consensus.cc:1275] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:42.497553  1485 ts_tablet_manager.cc:1929] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:42.498081  1485 log.cc:1199] T 9b7fddd60ae54606847dc6f4111a7e30 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-0-root/wals/9b7fddd60ae54606847dc6f4111a7e30
I20260709 13:12:42.501039   368 catalog_manager.cc:5028] TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): tablet 9b7fddd60ae54606847dc6f4111a7e30 (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:42.501178  1484 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:42.502805  1474 raft_consensus.cc:2955] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.508248  1486 ts_tablet_manager.cc:1929] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:42.508697  1486 log.cc:1199] T f221a3b77aba453e80c06e1de30b76aa P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-1-root/wals/f221a3b77aba453e80c06e1de30b76aa
I20260709 13:12:42.508052  1174 raft_consensus.cc:2955] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.517122   366 catalog_manager.cc:5028] TS 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): tablet f221a3b77aba453e80c06e1de30b76aa (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:42.517601   368 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 372575938bbf471c935e1b39ba9e588f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:42.520241   554 raft_consensus.cc:2955] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:42.529994   378 catalog_manager.cc:5697] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:42.542309   617 tablet_service.cc:1558] Processing DeleteTablet for tablet 372575938bbf471c935e1b39ba9e588f with delete_type TABLET_DATA_TOMBSTONED (TS 50f7c2247be24f3685d7fbca7b6c71e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54246
I20260709 13:12:42.543164  1472 tablet_replica.cc:333] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:12:42.543994  1472 raft_consensus.cc:2243] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.544595  1472 raft_consensus.cc:2272] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.547513  1472 ts_tablet_manager.cc:1916] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:42.559640  1472 ts_tablet_manager.cc:1929] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:42.560002  1472 log.cc:1199] T 372575938bbf471c935e1b39ba9e588f P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-2-root/wals/372575938bbf471c935e1b39ba9e588f
I20260709 13:12:42.561519   365 catalog_manager.cc:5028] TS 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): tablet 372575938bbf471c935e1b39ba9e588f (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:43.608863   624 consensus_queue.cc:237] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:43.614925   478 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:43.614970   557 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:12:43.615132   597 consensus_peers.cc:597] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01c3584d0546405ca79fa6b68e7468ec. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:43.616240  1438 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:43.616951  1489 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:43.623982  1438 raft_consensus.cc:2955] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:43.632537   557 raft_consensus.cc:2955] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:43.642230   478 raft_consensus.cc:2955] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:43.646562   483 consensus_queue.cc:237] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:43.652854   380 catalog_manager.cc:5697] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
W20260709 13:12:43.662915   448 consensus_peers.cc:597] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dbb5b767a04141fab4e7259cec37f6d7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:43.665627   624 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:43.666525   557 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:43.667500  1456 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:43.668684  1484 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:43.686753  1484 raft_consensus.cc:2955] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:43.700762   557 raft_consensus.cc:2955] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:43.701150   624 raft_consensus.cc:2955] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:43.716581   554 consensus_queue.cc:237] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:43.725987   378 catalog_manager.cc:5697] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:43.733431   624 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:43.735337   478 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:12:43.735862   523 consensus_peers.cc:597] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d74f5d3a02ed490499ba666721531edc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:43.736688  1493 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:43.737707  1425 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:43.748180  1425 raft_consensus.cc:2955] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:43.749678   624 raft_consensus.cc:2955] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:43.751147   478 raft_consensus.cc:2955] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:43.763900   626 consensus_queue.cc:237] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:43.768896   380 catalog_manager.cc:5697] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.773749   554 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:43.775323  1457 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:43.775974   478 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:12:43.777297   597 consensus_peers.cc:597] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef98285de93a4829880e7892e2b03e6a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:43.777783  1457 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:43.791468  1492 raft_consensus.cc:2955] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:43.794134   554 raft_consensus.cc:2955] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:43.796018   483 raft_consensus.cc:2955] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:43.825129   378 catalog_manager.cc:5697] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:44.112046  1511 ts_tablet_manager.cc:933] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:12:44.128123  1511 tablet_copy_client.cc:323] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.129:45711
I20260709 13:12:44.130829   494 tablet_copy_service.cc:140] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Received BeginTabletCopySession request for tablet dbb5b767a04141fab4e7259cec37f6d7 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:41384)
I20260709 13:12:44.131839   494 tablet_copy_service.cc:161] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Beginning new tablet copy session on tablet dbb5b767a04141fab4e7259cec37f6d7 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:41384: session id = 6e6df7e8ed204f1db5c371536b5b0683-dbb5b767a04141fab4e7259cec37f6d7
I20260709 13:12:44.149722   494 tablet_copy_source_session.cc:215] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:44.154127  1511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb5b767a04141fab4e7259cec37f6d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:44.170800  1511 tablet_copy_client.cc:806] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:44.171445  1511 tablet_copy_client.cc:670] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:44.175714  1511 tablet_copy_client.cc:538] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:44.185899  1511 tablet_bootstrap.cc:492] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:44.210405  1511 tablet_bootstrap.cc:492] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:44.211505  1511 tablet_bootstrap.cc:492] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:44.212263  1511 ts_tablet_manager.cc:1403] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.027s	user 0.027s	sys 0.000s
I20260709 13:12:44.216281  1511 raft_consensus.cc:359] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:44.217661  1511 raft_consensus.cc:740] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:44.218446  1511 consensus_queue.cc:260] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:44.224864  1514 ts_tablet_manager.cc:933] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:44.252426  1514 tablet_copy_client.cc:323] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.131:36245
I20260709 13:12:44.256402  1511 ts_tablet_manager.cc:1434] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.008s
I20260709 13:12:44.261643   494 tablet_copy_service.cc:342] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-dbb5b767a04141fab4e7259cec37f6d7 received from {username='slave'} at 127.0.0.1:41384
I20260709 13:12:44.262245   494 tablet_copy_service.cc:434] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-dbb5b767a04141fab4e7259cec37f6d7 on tablet dbb5b767a04141fab4e7259cec37f6d7 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:44.270179  1511 ts_tablet_manager.cc:933] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:44.277241   643 tablet_copy_service.cc:140] P 50f7c2247be24f3685d7fbca7b6c71e3: Received BeginTabletCopySession request for tablet 01c3584d0546405ca79fa6b68e7468ec from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:54754)
I20260709 13:12:44.277931   643 tablet_copy_service.cc:161] P 50f7c2247be24f3685d7fbca7b6c71e3: Beginning new tablet copy session on tablet 01c3584d0546405ca79fa6b68e7468ec from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:54754: session id = 6e6df7e8ed204f1db5c371536b5b0683-01c3584d0546405ca79fa6b68e7468ec
I20260709 13:12:44.278259  1511 tablet_copy_client.cc:323] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.131:36245
I20260709 13:12:44.280203   642 tablet_copy_service.cc:140] P 50f7c2247be24f3685d7fbca7b6c71e3: Received BeginTabletCopySession request for tablet ef98285de93a4829880e7892e2b03e6a from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:54754)
I20260709 13:12:44.280787   642 tablet_copy_service.cc:161] P 50f7c2247be24f3685d7fbca7b6c71e3: Beginning new tablet copy session on tablet ef98285de93a4829880e7892e2b03e6a from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:54754: session id = 6e6df7e8ed204f1db5c371536b5b0683-ef98285de93a4829880e7892e2b03e6a
I20260709 13:12:44.291180   642 tablet_copy_source_session.cc:215] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:44.293051  1517 ts_tablet_manager.cc:933] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:44.304296   643 tablet_copy_source_session.cc:215] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:44.304495  1511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef98285de93a4829880e7892e2b03e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:44.308597  1514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01c3584d0546405ca79fa6b68e7468ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:44.328871  1514 tablet_copy_client.cc:806] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:44.329432  1514 tablet_copy_client.cc:670] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:44.334443  1514 tablet_copy_client.cc:538] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:44.340687  1517 tablet_copy_client.cc:323] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.130:41159
I20260709 13:12:44.345635  1514 tablet_bootstrap.cc:492] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:44.347648  1511 tablet_copy_client.cc:806] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:44.348256  1511 tablet_copy_client.cc:670] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:44.353369   569 tablet_copy_service.cc:140] P 6ba2a9c02b534120bbf26e56a1e920ca: Received BeginTabletCopySession request for tablet d74f5d3a02ed490499ba666721531edc from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:43548)
I20260709 13:12:44.354029   569 tablet_copy_service.cc:161] P 6ba2a9c02b534120bbf26e56a1e920ca: Beginning new tablet copy session on tablet d74f5d3a02ed490499ba666721531edc from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:43548: session id = 6e6df7e8ed204f1db5c371536b5b0683-d74f5d3a02ed490499ba666721531edc
I20260709 13:12:44.356439  1511 tablet_copy_client.cc:538] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:44.365788  1511 tablet_bootstrap.cc:492] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:44.411056  1511 tablet_bootstrap.cc:492] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:44.411984  1511 tablet_bootstrap.cc:492] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:44.412611  1511 ts_tablet_manager.cc:1403] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.013s
I20260709 13:12:44.415548  1511 raft_consensus.cc:359] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:44.416384  1511 raft_consensus.cc:740] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:44.416988  1511 consensus_queue.cc:260] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:44.431465  1511 ts_tablet_manager.cc:1434] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.005s
I20260709 13:12:44.439998   642 tablet_copy_service.cc:342] P 50f7c2247be24f3685d7fbca7b6c71e3: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-ef98285de93a4829880e7892e2b03e6a received from {username='slave'} at 127.0.0.1:54754
I20260709 13:12:44.440601   642 tablet_copy_service.cc:434] P 50f7c2247be24f3685d7fbca7b6c71e3: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-ef98285de93a4829880e7892e2b03e6a on tablet ef98285de93a4829880e7892e2b03e6a with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:44.473462   569 tablet_copy_source_session.cc:215] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:44.478446  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d74f5d3a02ed490499ba666721531edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:44.490250  1514 tablet_bootstrap.cc:492] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:44.491356  1514 tablet_bootstrap.cc:492] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:44.492143  1514 ts_tablet_manager.cc:1403] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.147s	user 0.056s	sys 0.087s
I20260709 13:12:44.495532  1514 raft_consensus.cc:359] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:44.496362  1514 raft_consensus.cc:740] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:44.496995  1514 consensus_queue.cc:260] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:44.504040  1514 ts_tablet_manager.cc:1434] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:12:44.505616   642 tablet_copy_service.cc:342] P 50f7c2247be24f3685d7fbca7b6c71e3: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-01c3584d0546405ca79fa6b68e7468ec received from {username='slave'} at 127.0.0.1:54754
I20260709 13:12:44.506012   642 tablet_copy_service.cc:434] P 50f7c2247be24f3685d7fbca7b6c71e3: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-01c3584d0546405ca79fa6b68e7468ec on tablet 01c3584d0546405ca79fa6b68e7468ec with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:44.514037  1517 tablet_copy_client.cc:806] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:44.514668  1517 tablet_copy_client.cc:670] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:44.518414  1517 tablet_copy_client.cc:538] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:44.524895  1517 tablet_bootstrap.cc:492] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:44.545220  1517 tablet_bootstrap.cc:492] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:44.546172  1517 tablet_bootstrap.cc:492] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:44.546808  1517 ts_tablet_manager.cc:1403] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.010s
I20260709 13:12:44.549808  1517 raft_consensus.cc:359] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:44.550648  1517 raft_consensus.cc:740] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:44.551327  1517 consensus_queue.cc:260] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:44.554015  1517 ts_tablet_manager.cc:1434] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:12:44.555809   569 tablet_copy_service.cc:342] P 6ba2a9c02b534120bbf26e56a1e920ca: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-d74f5d3a02ed490499ba666721531edc received from {username='slave'} at 127.0.0.1:43548
I20260709 13:12:44.556224   569 tablet_copy_service.cc:434] P 6ba2a9c02b534120bbf26e56a1e920ca: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-d74f5d3a02ed490499ba666721531edc on tablet d74f5d3a02ed490499ba666721531edc with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:44.636013  1172 raft_consensus.cc:1217] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:44.760258  1172 raft_consensus.cc:1217] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:44.828562  1172 raft_consensus.cc:1217] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:44.905817  1172 raft_consensus.cc:1217] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:45.195372  1492 raft_consensus.cc:1064] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:45.197785  1492 consensus_queue.cc:237] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:45.205245   555 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:45.206044   478 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:45.206864  1172 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:45.208446  1489 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:12:45.210878  1457 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:45.212836  1492 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:45.219326  1474 raft_consensus.cc:1064] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:45.222182  1474 consensus_queue.cc:237] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:45.229784  1173 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:45.231287  1523 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:45.241604   557 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:45.243186   624 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:45.243835  1522 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:45.246302  1523 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:45.273239  1523 raft_consensus.cc:2955] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.274662  1492 raft_consensus.cc:2955] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.279935   554 raft_consensus.cc:2955] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.289897   478 raft_consensus.cc:2955] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.294934  1172 raft_consensus.cc:2955] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.296900  1508 raft_consensus.cc:1064] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:45.305737   377 catalog_manager.cc:5697] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:45.306905  1508 consensus_queue.cc:237] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:45.323352   555 raft_consensus.cc:2955] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.392724  1489 raft_consensus.cc:1064] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:45.392272   379 catalog_manager.cc:5697] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.381505  1173 raft_consensus.cc:2955] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.395156  1489 consensus_queue.cc:237] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:45.462239  1173 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:45.468284  1542 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:12:45.489625   626 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:45.504940  1429 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:45.508078   479 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:45.518850  1542 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:12:45.493579   624 raft_consensus.cc:2955] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.578961  1174 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:45.579164   483 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:45.581260   555 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:45.581322  1539 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:45.584067  1539 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:45.584952  1492 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:45.598155  1541 raft_consensus.cc:2955] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.600005   478 raft_consensus.cc:2955] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.610607   624 raft_consensus.cc:2955] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:12:45.611645   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 44941us
I20260709 13:12:45.629004  1172 raft_consensus.cc:2955] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.649624   380 catalog_manager.cc:5697] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:45.657294   624 consensus_queue.cc:237] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:45.659508  1492 raft_consensus.cc:2955] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.668855   554 raft_consensus.cc:2955] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.671663   555 consensus_queue.cc:237] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:45.681139   479 consensus_queue.cc:237] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:45.662483   478 raft_consensus.cc:2955] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.697077  1172 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:45.698841   625 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:45.700378  1523 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:45.704699  1172 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:45.708252  1539 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:45.712767  1173 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:45.715413  1541 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:45.715854   626 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:45.716063  1523 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:45.718371  1429 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:45.720196   379 catalog_manager.cc:5697] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.725303  1508 raft_consensus.cc:2955] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.726572   626 raft_consensus.cc:2955] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.733393  1173 raft_consensus.cc:2955] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.742460  1174 raft_consensus.cc:2955] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.744436  1547 raft_consensus.cc:2955] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.745149  1533 raft_consensus.cc:2955] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.747856   554 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:45.750238  1175 raft_consensus.cc:2955] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.759497  1539 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:45.771131   624 raft_consensus.cc:2955] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.772552   366 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d74f5d3a02ed490499ba666721531edc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:45.762297  1171 raft_consensus.cc:2955] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.767891   365 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 01c3584d0546405ca79fa6b68e7468ec with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:45.781695   378 catalog_manager.cc:5697] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:45.783617   368 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dbb5b767a04141fab4e7259cec37f6d7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:45.798467   467 tablet_service.cc:1558] Processing DeleteTablet for tablet d74f5d3a02ed490499ba666721531edc with delete_type TABLET_DATA_TOMBSTONED (TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38120
I20260709 13:12:45.790710   554 raft_consensus.cc:2955] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.796885   380 catalog_manager.cc:5697] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:45.802196   377 catalog_manager.cc:5697] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.803699   624 consensus_queue.cc:237] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:45.810252  1558 tablet_replica.cc:333] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:12:45.811610  1558 raft_consensus.cc:2243] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.812670  1558 raft_consensus.cc:2272] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.822686   483 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:45.823148  1174 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:45.824846  1539 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:45.829967   467 tablet_service.cc:1558] Processing DeleteTablet for tablet 01c3584d0546405ca79fa6b68e7468ec with delete_type TABLET_DATA_TOMBSTONED (TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38120
I20260709 13:12:45.825073   545 tablet_service.cc:1558] Processing DeleteTablet for tablet dbb5b767a04141fab4e7259cec37f6d7 with delete_type TABLET_DATA_TOMBSTONED (TS 6ba2a9c02b534120bbf26e56a1e920ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59108
I20260709 13:12:45.832687  1558 ts_tablet_manager.cc:1916] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:45.833107  1533 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:45.842011  1539 raft_consensus.cc:2955] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.845331   478 raft_consensus.cc:2955] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.863674  1559 tablet_replica.cc:333] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:12:45.865062  1559 raft_consensus.cc:2243] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.865785  1559 raft_consensus.cc:2272] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.872476   378 catalog_manager.cc:5697] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.872825  1171 raft_consensus.cc:2955] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:45.874384   365 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ef98285de93a4829880e7892e2b03e6a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:45.888347  1558 ts_tablet_manager.cc:1929] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:45.889112  1558 log.cc:1199] T d74f5d3a02ed490499ba666721531edc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-0-root/wals/d74f5d3a02ed490499ba666721531edc
I20260709 13:12:45.891057  1558 tablet_replica.cc:333] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:12:45.890900   368 catalog_manager.cc:5028] TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): tablet d74f5d3a02ed490499ba666721531edc (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:45.893378  1558 raft_consensus.cc:2243] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.894174  1558 raft_consensus.cc:2272] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.896495   545 tablet_service.cc:1558] Processing DeleteTablet for tablet ef98285de93a4829880e7892e2b03e6a with delete_type TABLET_DATA_TOMBSTONED (TS 6ba2a9c02b534120bbf26e56a1e920ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59108
I20260709 13:12:45.898643  1559 ts_tablet_manager.cc:1916] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:45.900722  1558 ts_tablet_manager.cc:1916] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:45.915200  1559 ts_tablet_manager.cc:1929] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:45.915701  1559 log.cc:1199] T dbb5b767a04141fab4e7259cec37f6d7 P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-1-root/wals/dbb5b767a04141fab4e7259cec37f6d7
I20260709 13:12:45.917069   366 catalog_manager.cc:5028] TS 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): tablet dbb5b767a04141fab4e7259cec37f6d7 (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:45.917173  1559 tablet_replica.cc:333] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:12:45.918043  1559 raft_consensus.cc:2243] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.918644  1559 raft_consensus.cc:2272] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.918752  1558 ts_tablet_manager.cc:1929] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:45.919099  1558 log.cc:1199] T 01c3584d0546405ca79fa6b68e7468ec P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-0-root/wals/01c3584d0546405ca79fa6b68e7468ec
I20260709 13:12:45.920529   368 catalog_manager.cc:5028] TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): tablet 01c3584d0546405ca79fa6b68e7468ec (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:45.921833  1559 ts_tablet_manager.cc:1916] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:45.931703  1559 ts_tablet_manager.cc:1929] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:45.932067  1559 log.cc:1199] T ef98285de93a4829880e7892e2b03e6a P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-1-root/wals/ef98285de93a4829880e7892e2b03e6a
I20260709 13:12:45.933382   366 catalog_manager.cc:5028] TS 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): tablet ef98285de93a4829880e7892e2b03e6a (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:46.971756   478 consensus_queue.cc:237] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:46.977087   626 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:46.977713   448 consensus_peers.cc:597] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3253e2dfadea481ea66147319ece61c5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:46.978700  1523 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:46.979319   555 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:46.980468  1523 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:46.986145  1560 raft_consensus.cc:2955] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:46.987815   626 raft_consensus.cc:2955] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:46.990108   555 raft_consensus.cc:2955] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:47.004927   555 consensus_queue.cc:237] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:47.005823   377 catalog_manager.cc:5697] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 2 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:47.030855   626 raft_consensus.cc:1275] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:47.032672  1508 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:47.036792   523 consensus_peers.cc:597] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12fb4cc9b97f4bab8a7fad87dcdba73c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:47.037977   483 raft_consensus.cc:1275] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:47.042266  1548 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:47.053653  1561 raft_consensus.cc:2955] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:47.056653   626 raft_consensus.cc:2955] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:47.069589   483 raft_consensus.cc:2955] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:47.076249   479 consensus_queue.cc:237] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:47.097328   377 catalog_manager.cc:5697] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:47.108302   626 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:47.108467   555 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:47.110365  1523 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:47.117079  1574 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:47.137167   448 consensus_peers.cc:597] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 70cfcc65b0e14d6cb141bc839a21b558. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:47.140436  1573 raft_consensus.cc:2955] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:47.148478   555 raft_consensus.cc:2955] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:47.155594   626 raft_consensus.cc:2955] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:47.164177   377 catalog_manager.cc:5697] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:47.171960   483 consensus_queue.cc:237] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:47.191951   626 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:47.192217   555 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:12:47.192205   448 consensus_peers.cc:597] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb12c292ec5d439b896dcc135d266150. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:47.193878  1576 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:47.195138  1522 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:47.203533  1576 raft_consensus.cc:2955] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:47.205250   555 raft_consensus.cc:2955] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:47.206944   626 raft_consensus.cc:2955] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:47.232082   380 catalog_manager.cc:5697] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:47.426764  1583 ts_tablet_manager.cc:933] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:47.428603  1583 tablet_copy_client.cc:323] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.130:41159
I20260709 13:12:47.430137   569 tablet_copy_service.cc:140] P 6ba2a9c02b534120bbf26e56a1e920ca: Received BeginTabletCopySession request for tablet 12fb4cc9b97f4bab8a7fad87dcdba73c from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:43548)
I20260709 13:12:47.430615   569 tablet_copy_service.cc:161] P 6ba2a9c02b534120bbf26e56a1e920ca: Beginning new tablet copy session on tablet 12fb4cc9b97f4bab8a7fad87dcdba73c from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:43548: session id = 6e6df7e8ed204f1db5c371536b5b0683-12fb4cc9b97f4bab8a7fad87dcdba73c
I20260709 13:12:47.436599   569 tablet_copy_source_session.cc:215] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:47.439647  1583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12fb4cc9b97f4bab8a7fad87dcdba73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.452395  1583 tablet_copy_client.cc:806] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:47.453078  1583 tablet_copy_client.cc:670] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:47.459555  1583 tablet_copy_client.cc:538] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:47.466203  1583 tablet_bootstrap.cc:492] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:47.486277  1583 tablet_bootstrap.cc:492] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:47.487061  1583 tablet_bootstrap.cc:492] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:47.487818  1583 ts_tablet_manager.cc:1403] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.008s
I20260709 13:12:47.490176  1583 raft_consensus.cc:359] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:47.490958  1583 raft_consensus.cc:740] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:47.491624  1583 consensus_queue.cc:260] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:47.499790  1583 ts_tablet_manager.cc:1434] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.002s
I20260709 13:12:47.502096   569 tablet_copy_service.cc:342] P 6ba2a9c02b534120bbf26e56a1e920ca: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-12fb4cc9b97f4bab8a7fad87dcdba73c received from {username='slave'} at 127.0.0.1:43548
I20260709 13:12:47.502496   569 tablet_copy_service.cc:434] P 6ba2a9c02b534120bbf26e56a1e920ca: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-12fb4cc9b97f4bab8a7fad87dcdba73c on tablet 12fb4cc9b97f4bab8a7fad87dcdba73c with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:47.508355  1583 ts_tablet_manager.cc:933] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:12:47.528122  1583 tablet_copy_client.cc:323] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.129:45711
I20260709 13:12:47.529704   494 tablet_copy_service.cc:140] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Received BeginTabletCopySession request for tablet 3253e2dfadea481ea66147319ece61c5 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:41384)
I20260709 13:12:47.530221   494 tablet_copy_service.cc:161] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Beginning new tablet copy session on tablet 3253e2dfadea481ea66147319ece61c5 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:41384: session id = 6e6df7e8ed204f1db5c371536b5b0683-3253e2dfadea481ea66147319ece61c5
I20260709 13:12:47.535745   494 tablet_copy_source_session.cc:215] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:47.538473  1583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3253e2dfadea481ea66147319ece61c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.552690  1583 tablet_copy_client.cc:806] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:47.553303  1583 tablet_copy_client.cc:670] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:47.557480  1583 tablet_copy_client.cc:538] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:47.566737  1583 tablet_bootstrap.cc:492] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:47.587817  1587 ts_tablet_manager.cc:933] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:12:47.590938  1587 tablet_copy_client.cc:323] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.129:45711
I20260709 13:12:47.593241   494 tablet_copy_service.cc:140] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Received BeginTabletCopySession request for tablet 70cfcc65b0e14d6cb141bc839a21b558 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:41384)
I20260709 13:12:47.593757   494 tablet_copy_service.cc:161] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Beginning new tablet copy session on tablet 70cfcc65b0e14d6cb141bc839a21b558 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:41384: session id = 6e6df7e8ed204f1db5c371536b5b0683-70cfcc65b0e14d6cb141bc839a21b558
I20260709 13:12:47.601845   494 tablet_copy_source_session.cc:215] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:47.602989  1583 tablet_bootstrap.cc:492] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:47.603811  1583 tablet_bootstrap.cc:492] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:47.604511  1583 ts_tablet_manager.cc:1403] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.016s
I20260709 13:12:47.605202  1587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70cfcc65b0e14d6cb141bc839a21b558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.607362  1583 raft_consensus.cc:359] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:47.608238  1583 raft_consensus.cc:740] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:47.608909  1583 consensus_queue.cc:260] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:47.610742  1583 ts_tablet_manager.cc:1434] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:47.615490   494 tablet_copy_service.cc:342] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-3253e2dfadea481ea66147319ece61c5 received from {username='slave'} at 127.0.0.1:41384
I20260709 13:12:47.616017   494 tablet_copy_service.cc:434] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-3253e2dfadea481ea66147319ece61c5 on tablet 3253e2dfadea481ea66147319ece61c5 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:47.624439  1587 tablet_copy_client.cc:806] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:47.625070  1587 tablet_copy_client.cc:670] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:47.628247  1587 tablet_copy_client.cc:538] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:47.634610  1587 tablet_bootstrap.cc:492] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:47.652385  1587 tablet_bootstrap.cc:492] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:47.653383  1587 tablet_bootstrap.cc:492] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:47.654024  1587 ts_tablet_manager.cc:1403] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.007s
I20260709 13:12:47.657128  1587 raft_consensus.cc:359] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:47.659035  1587 raft_consensus.cc:740] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:47.659783  1587 consensus_queue.cc:260] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:47.662195  1587 ts_tablet_manager.cc:1434] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:12:47.664350   494 tablet_copy_service.cc:342] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-70cfcc65b0e14d6cb141bc839a21b558 received from {username='slave'} at 127.0.0.1:41384
I20260709 13:12:47.664829   494 tablet_copy_service.cc:434] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-70cfcc65b0e14d6cb141bc839a21b558 on tablet 70cfcc65b0e14d6cb141bc839a21b558 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:47.679888  1587 ts_tablet_manager.cc:933] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:12:47.686769  1587 tablet_copy_client.cc:323] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.129:45711
I20260709 13:12:47.688318   494 tablet_copy_service.cc:140] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Received BeginTabletCopySession request for tablet cb12c292ec5d439b896dcc135d266150 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:41384)
I20260709 13:12:47.688820   494 tablet_copy_service.cc:161] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Beginning new tablet copy session on tablet cb12c292ec5d439b896dcc135d266150 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:41384: session id = 6e6df7e8ed204f1db5c371536b5b0683-cb12c292ec5d439b896dcc135d266150
I20260709 13:12:47.696223   494 tablet_copy_source_session.cc:215] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:47.698882  1587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb12c292ec5d439b896dcc135d266150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.715090  1587 tablet_copy_client.cc:806] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:47.715734  1587 tablet_copy_client.cc:670] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:47.719270  1587 tablet_copy_client.cc:538] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:47.728650  1587 tablet_bootstrap.cc:492] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:47.748732  1587 tablet_bootstrap.cc:492] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:47.749461  1587 tablet_bootstrap.cc:492] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:47.749994  1587 ts_tablet_manager.cc:1403] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:12:47.752658  1587 raft_consensus.cc:359] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:47.753568  1587 raft_consensus.cc:740] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:47.754267  1587 consensus_queue.cc:260] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:47.756165  1587 ts_tablet_manager.cc:1434] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:12:47.758309   494 tablet_copy_service.cc:342] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-cb12c292ec5d439b896dcc135d266150 received from {username='slave'} at 127.0.0.1:41384
I20260709 13:12:47.758806   494 tablet_copy_service.cc:434] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-cb12c292ec5d439b896dcc135d266150 on tablet cb12c292ec5d439b896dcc135d266150 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:47.920406  1175 raft_consensus.cc:1217] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:47.998277  1175 raft_consensus.cc:1217] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:12:48.025940  1175 raft_consensus.cc:1217] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:48.122908  1171 raft_consensus.cc:1217] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:48.421533  1522 raft_consensus.cc:1064] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:48.423823  1522 consensus_queue.cc:237] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:48.438324   626 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:48.439860  1522 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:48.440563   554 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:48.441871  1171 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEARNER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:48.442960  1522 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:48.443703  1574 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:48.459470  1522 raft_consensus.cc:2955] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.476359   626 raft_consensus.cc:2955] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.487098   380 catalog_manager.cc:5697] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:48.491513  1171 raft_consensus.cc:2955] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.496851  1596 raft_consensus.cc:1064] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:48.499449  1596 consensus_queue.cc:237] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:48.507129   554 raft_consensus.cc:2955] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.524996  1171 raft_consensus.cc:1275] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:48.527693  1602 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:48.539763   483 raft_consensus.cc:1275] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:48.542512   626 raft_consensus.cc:1275] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:48.543744  1522 raft_consensus.cc:1064] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:48.541759  1602 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:12:48.545989  1522 consensus_queue.cc:237] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:48.548416  1548 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:48.579984  1602 raft_consensus.cc:2955] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.585172   624 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:48.586680  1574 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:48.594421   483 raft_consensus.cc:2955] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.607895  1175 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:48.607745   626 raft_consensus.cc:2955] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.610191   554 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:48.613615  1522 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:48.613946  1175 raft_consensus.cc:2955] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.641422   378 catalog_manager.cc:5697] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.653039  1522 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:48.670672   555 consensus_queue.cc:237] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:48.701188  1175 raft_consensus.cc:1275] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:48.701982   483 consensus_queue.cc:237] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:48.703629   626 raft_consensus.cc:1275] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:48.708755  1175 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:12:48.710537  1576 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:48.715960  1602 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:48.720480  1603 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:48.727571  1614 raft_consensus.cc:2955] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.741611  1599 raft_consensus.cc:1064] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:48.745307  1599 consensus_queue.cc:237] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:48.757030   559 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:12:48.761984  1596 raft_consensus.cc:2955] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.777676  1174 raft_consensus.cc:2955] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.788268   626 raft_consensus.cc:2955] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.824267  1522 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:48.831200  1175 raft_consensus.cc:2955] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.849174   378 catalog_manager.cc:5697] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New cstate: current_term: 2 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.852100   557 raft_consensus.cc:2955] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.861478   368 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3253e2dfadea481ea66147319ece61c5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:48.860039  1522 raft_consensus.cc:2955] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.875847   617 tablet_service.cc:1558] Processing DeleteTablet for tablet 3253e2dfadea481ea66147319ece61c5 with delete_type TABLET_DATA_TOMBSTONED (TS 50f7c2247be24f3685d7fbca7b6c71e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54246
I20260709 13:12:48.880913  1171 raft_consensus.cc:2955] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.880939   366 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 12fb4cc9b97f4bab8a7fad87dcdba73c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:48.901193   378 catalog_manager.cc:5697] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.904219  1620 tablet_replica.cc:333] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:12:48.905047   624 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:48.906289  1599 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:48.908568   377 catalog_manager.cc:5697] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 3 to 4, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.923074   467 tablet_service.cc:1558] Processing DeleteTablet for tablet 12fb4cc9b97f4bab8a7fad87dcdba73c with delete_type TABLET_DATA_TOMBSTONED (TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38120
I20260709 13:12:48.926910  1624 tablet_replica.cc:333] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:12:48.927922  1624 raft_consensus.cc:2243] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:48.928700  1624 raft_consensus.cc:2272] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:48.934702  1171 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:48.939869   557 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:48.940012   556 raft_consensus.cc:2955] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:48.968251  1574 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:48.972754  1624 ts_tablet_manager.cc:1916] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:48.994617  1620 raft_consensus.cc:2243] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:48.995513  1620 raft_consensus.cc:2272] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:48.996148   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 64963.6us
I20260709 13:12:49.006208  1620 ts_tablet_manager.cc:1916] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:49.017216   626 raft_consensus.cc:2955] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:49.022084  1576 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:49.046229  1624 ts_tablet_manager.cc:1929] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:49.047734  1624 log.cc:1199] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-0-root/wals/12fb4cc9b97f4bab8a7fad87dcdba73c
I20260709 13:12:49.049834   368 catalog_manager.cc:5028] TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): tablet 12fb4cc9b97f4bab8a7fad87dcdba73c (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:49.061249  1620 ts_tablet_manager.cc:1929] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:12:49.061868  1620 log.cc:1199] T 3253e2dfadea481ea66147319ece61c5 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-2-root/wals/3253e2dfadea481ea66147319ece61c5
I20260709 13:12:49.061895  1614 raft_consensus.cc:2955] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:49.064282   365 catalog_manager.cc:5028] TS 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): tablet 3253e2dfadea481ea66147319ece61c5 (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:49.070113   483 consensus_queue.cc:237] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:49.077502   626 raft_consensus.cc:2955] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:49.080168  1171 raft_consensus.cc:2955] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:49.083051   554 raft_consensus.cc:2955] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:49.088383   631 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:49.092799  1627 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:49.104210  1576 raft_consensus.cc:2955] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:49.102401   377 catalog_manager.cc:5697] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:49.111613  1174 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:49.117368   631 raft_consensus.cc:2955] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:49.120818   368 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 70cfcc65b0e14d6cb141bc839a21b558 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:49.125155  1614 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:49.137606  1175 raft_consensus.cc:2955] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:49.137905   377 catalog_manager.cc:5697] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:49.159719   545 tablet_service.cc:1558] Processing DeleteTablet for tablet 70cfcc65b0e14d6cb141bc839a21b558 with delete_type TABLET_DATA_TOMBSTONED (TS 6ba2a9c02b534120bbf26e56a1e920ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59108
I20260709 13:12:49.160933   479 consensus_queue.cc:237] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:49.161793  1630 tablet_replica.cc:333] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:12:49.162889  1630 raft_consensus.cc:2243] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:49.163607  1630 raft_consensus.cc:2272] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.167171  1175 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:49.167953   556 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:49.169147  1630 ts_tablet_manager.cc:1916] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:49.169679  1614 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:49.171738  1576 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:49.176215  1614 raft_consensus.cc:2955] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:49.180315   556 raft_consensus.cc:2955] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:49.186457  1175 raft_consensus.cc:2955] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:49.189592   368 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cb12c292ec5d439b896dcc135d266150 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:49.201656   377 catalog_manager.cc:5697] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 3 to 4, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:49.211513  1630 ts_tablet_manager.cc:1929] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:49.212560  1630 log.cc:1199] T 70cfcc65b0e14d6cb141bc839a21b558 P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-1-root/wals/70cfcc65b0e14d6cb141bc839a21b558
I20260709 13:12:49.215612   617 tablet_service.cc:1558] Processing DeleteTablet for tablet cb12c292ec5d439b896dcc135d266150 with delete_type TABLET_DATA_TOMBSTONED (TS 50f7c2247be24f3685d7fbca7b6c71e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54246
I20260709 13:12:49.216928  1620 tablet_replica.cc:333] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:12:49.217975  1620 raft_consensus.cc:2243] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:49.218662  1620 raft_consensus.cc:2272] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.220023   366 catalog_manager.cc:5028] TS 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): tablet 70cfcc65b0e14d6cb141bc839a21b558 (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:49.225993 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:49.229478  1620 ts_tablet_manager.cc:1916] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:49.244171  1620 ts_tablet_manager.cc:1929] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:49.244590  1620 log.cc:1199] T cb12c292ec5d439b896dcc135d266150 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-2-root/wals/cb12c292ec5d439b896dcc135d266150
I20260709 13:12:49.246246   365 catalog_manager.cc:5028] TS 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): tablet cb12c292ec5d439b896dcc135d266150 (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:12:49.275205   631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:12:49.275849   631 raft_consensus.cc:606] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:49.287209   479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "304d1b96642140f19543be15d23a061c"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:52312
I20260709 13:12:49.287839   479 raft_consensus.cc:606] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Received request to transfer leadership to TS 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:49.290491   479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:52312
I20260709 13:12:49.290995   479 raft_consensus.cc:606] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:49.293222   479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:52312
I20260709 13:12:49.293668   479 raft_consensus.cc:606] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Received request to transfer leadership to TS 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:49.304575   556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82382f158074497a857b03f9f87f9e86"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:12:49.305044   556 raft_consensus.cc:606] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:49.307279   479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:52312
I20260709 13:12:49.307746   479 raft_consensus.cc:606] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Received request to transfer leadership to TS 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:49.309741   479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:52312
I20260709 13:12:49.310218   479 raft_consensus.cc:606] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Received request to transfer leadership to TS 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:49.311226 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:12:49.312840 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:49.330394  1626 raft_consensus.cc:993] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:12:49.330912  1626 raft_consensus.cc:1081] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:12:49.332365   479 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:12:49.332913   479 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:49.333237   479 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.338243   479 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:49.340219   479 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:49.341058   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:49.341593   554 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.342254   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:49.342793   631 raft_consensus.cc:3055] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:49.343082   631 raft_consensus.cc:740] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:49.343747   631 consensus_queue.cc:260] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:49.344882   631 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.347221   554 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:12:49.349776   448 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:49.351070  1627 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:49.351553  1627 raft_consensus.cc:697] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:49.352334  1627 consensus_queue.cc:237] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:49.352998   631 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:12:49.363080   377 catalog_manager.cc:5697] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 1 to 2, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 2 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.368633  1622 raft_consensus.cc:993] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:12:49.369186  1621 raft_consensus.cc:1081] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:12:49.370535   479 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82382f158074497a857b03f9f87f9e86"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38134
I20260709 13:12:49.370985   479 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:49.371387   479 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.376216   479 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:49.377853   479 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:49.378490   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:49.378902   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:49.379107   556 raft_consensus.cc:3055] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:49.379515   556 raft_consensus.cc:740] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:49.379464   631 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.380285   556 consensus_queue.cc:260] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:49.381410   556 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.386150   631 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:12:49.387959   447 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:49.389273  1627 raft_consensus.cc:993] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6e6df7e8ed204f1db5c371536b5b0683 to start an election
I20260709 13:12:49.389883  1576 raft_consensus.cc:1081] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Signalling peer 6e6df7e8ed204f1db5c371536b5b0683 to start an election
I20260709 13:12:49.390017  1627 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:49.390573  1627 raft_consensus.cc:697] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:49.391597  1627 consensus_queue.cc:237] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:49.392709   556 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:12:49.394349  1614 raft_consensus.cc:993] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6e6df7e8ed204f1db5c371536b5b0683 to start an election
I20260709 13:12:49.394479  1171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "304d1b96642140f19543be15d23a061c"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:36742
I20260709 13:12:49.394996  1522 raft_consensus.cc:1081] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Signalling peer 6e6df7e8ed204f1db5c371536b5b0683 to start an election
I20260709 13:12:49.395155  1171 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:49.395673  1171 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.397436  1175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:36742
I20260709 13:12:49.397871  1175 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:49.398152  1175 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.401652  1171 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:49.402930  1175 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:49.404659   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:49.404896  1171 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:49.404852   377 catalog_manager.cc:5697] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 1 to 2, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 2 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.405336   479 raft_consensus.cc:3055] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:49.405726   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:49.404593   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:49.406215   479 raft_consensus.cc:740] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:49.406361   483 raft_consensus.cc:3055] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:49.406448   631 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.406827   483 raft_consensus.cc:740] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:49.407264   479 consensus_queue.cc:260] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:49.407600   483 consensus_queue.cc:260] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:49.408349   479 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.408655   483 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.413488   631 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:12:49.414780   479 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:12:49.416020  1138 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:12:49.416985  1586 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:49.422369   483 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:12:49.423661  1141 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:12:49.429687   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:49.430231   554 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.439606   554 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:12:49.441804  1175 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:49.456173  1638 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:49.456743  1638 raft_consensus.cc:697] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:12:49.457600  1638 consensus_queue.cc:237] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:49.462407  1586 raft_consensus.cc:697] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:12:49.467595  1586 consensus_queue.cc:237] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:49.478152   377 catalog_manager.cc:5697] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 1 to 2, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 2 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:49.479362   377 catalog_manager.cc:5697] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 1 to 2, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 2 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:49.583792  1576 raft_consensus.cc:993] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:12:49.584314  1576 raft_consensus.cc:1081] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Signalling peer 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:12:49.585953   554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59114
I20260709 13:12:49.586374   554 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:49.586670   554 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.591452   554 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:49.593225   554 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:49.593833   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:49.594043   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:49.594410   483 raft_consensus.cc:3055] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:49.594625   624 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.594771   483 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:49.595512   483 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:49.596360   483 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.599360   624 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:12:49.600515   522 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:49.601250  1622 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:49.601529   483 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:12:49.601702  1622 raft_consensus.cc:697] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:49.602638  1622 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:49.612632   377 catalog_manager.cc:5697] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 1 to 2, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 2 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.728272  1576 raft_consensus.cc:993] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6e6df7e8ed204f1db5c371536b5b0683 to start an election
I20260709 13:12:49.728785  1627 raft_consensus.cc:1081] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Signalling peer 6e6df7e8ed204f1db5c371536b5b0683 to start an election
I20260709 13:12:49.730485  1171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:36742
I20260709 13:12:49.731019  1171 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:49.731381  1171 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.738682  1171 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:49.741067   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:49.741307   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:49.741624   483 raft_consensus.cc:3055] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:49.741883   631 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.742002   483 raft_consensus.cc:740] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:49.743399  1171 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:49.743675   483 consensus_queue.cc:260] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:49.744757   483 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.748289   631 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:12:49.749150   483 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:12:49.749254  1138 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:12:49.750046  1586 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:49.750517  1586 raft_consensus.cc:697] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:12:49.751297  1586 consensus_queue.cc:237] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:49.759100   377 catalog_manager.cc:5697] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 1 to 2, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 2 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:49.776983  1522 raft_consensus.cc:993] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6e6df7e8ed204f1db5c371536b5b0683 to start an election
I20260709 13:12:49.777475  1576 raft_consensus.cc:1081] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Signalling peer 6e6df7e8ed204f1db5c371536b5b0683 to start an election
I20260709 13:12:49.778997  1171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:36742
I20260709 13:12:49.779538  1171 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:49.779876  1171 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.784137  1171 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:49.785473  1171 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:49.786320   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:49.786402   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:49.787114   483 raft_consensus.cc:3055] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:49.787164   554 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.787585   483 raft_consensus.cc:740] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:49.788359   483 consensus_queue.cc:260] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:49.789274   483 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.793028   554 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:12:49.794117  1139 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:12:49.794925  1586 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:49.795415  1586 raft_consensus.cc:697] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:12:49.796269   483 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:12:49.796207  1586 consensus_queue.cc:237] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:49.802829   377 catalog_manager.cc:5697] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 1 to 2, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 2 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:49.845635   631 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:49.847019  1627 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:49.861289   554 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:49.875197  1627 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:49.887627   554 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:49.888932  1627 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:49.896262   631 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:49.897991  1586 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:49.915695   624 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:49.922549   556 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:49.924496   483 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:49.924276  1586 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:49.931522  1586 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:49.943372  1627 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:50.001995   483 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:50.004117  1650 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:50.032222   626 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:50.033895  1603 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:50.071127   479 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:50.076378  1622 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:50.157271   631 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:50.158565  1650 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:50.169497   479 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:50.175908  1586 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:50.184664   557 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:50.185952  1586 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:50.202471   483 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:50.203694  1650 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:50.296123   554 consensus_queue.cc:237] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:50.303257   631 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:50.303409   482 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:12:50.303555   523 consensus_peers.cc:597] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e472c1c82c9467a9a5563d6b06e3b53. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:50.304659  1622 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:50.305349  1621 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:50.313782 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:50.323079  1622 raft_consensus.cc:2955] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:50.326175   631 raft_consensus.cc:2955] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:50.327956   482 raft_consensus.cc:2955] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:50.343142   377 catalog_manager.cc:5697] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:50.345006   631 consensus_queue.cc:237] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
W20260709 13:12:50.352443   597 consensus_peers.cc:597] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ade492740624caba667436aa666025c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:50.356410   554 raft_consensus.cc:1275] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:50.357949   482 raft_consensus.cc:1275] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:50.357848  1625 consensus_queue.cc:1048] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:50.360944  1626 consensus_queue.cc:1048] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:50.388118  1626 raft_consensus.cc:2955] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:50.391994   482 raft_consensus.cc:2955] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:50.409404 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:50.408743   554 raft_consensus.cc:2955] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:50.422624   482 consensus_queue.cc:237] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:50.429092   626 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:50.428836   378 catalog_manager.cc:5697] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:50.433104   557 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:12:50.435101   448 consensus_peers.cc:597] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82382f158074497a857b03f9f87f9e86. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:50.439152  1522 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:50.445477  1627 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:50.448830  1522 raft_consensus.cc:2955] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:50.456629   554 raft_consensus.cc:2955] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:50.468248   482 consensus_queue.cc:237] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:50.472553   626 raft_consensus.cc:2955] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:50.486235   631 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:50.487353   482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:52312
I20260709 13:12:50.487986   482 raft_consensus.cc:606] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Received request to transfer leadership to TS 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:50.489310   377 catalog_manager.cc:5697] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index -1 to 3, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 2 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:50.490818  1576 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:50.494128   624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:12:50.494658   624 raft_consensus.cc:606] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:50.503880   554 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:12:50.506223   557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:12:50.506798   557 raft_consensus.cc:606] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:12:50.508759   448 consensus_peers.cc:597] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 227b93e1b31e4b058d5ec1fc69bd6849. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:50.512629   626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:12:50.513175   626 raft_consensus.cc:606] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:50.513716  1627 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:50.517514   624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:12:50.518038   624 raft_consensus.cc:606] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:50.538102  1621 raft_consensus.cc:993] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:12:50.538638  1621 raft_consensus.cc:1081] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:12:50.534565  1522 raft_consensus.cc:2955] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:50.544286   631 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:12:50.544826   631 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:50.545168   631 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:50.547555   626 raft_consensus.cc:2955] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:50.552772   631 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:50.568928   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:50.569489   482 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:50.569615   631 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:12:50.572932   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 52845.4us
I20260709 13:12:50.573136   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:50.579494   482 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:12:50.579538   483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:52312
I20260709 13:12:50.580241   483 raft_consensus.cc:606] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Received request to transfer leadership to TS 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:50.574640   554 raft_consensus.cc:3055] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:50.580677   554 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:50.581393   554 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:50.582389   554 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:50.582013   557 raft_consensus.cc:2955] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:50.584890 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:50.586411 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:50.585865   378 catalog_manager.cc:5697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:12:50.588423  1522 raft_consensus.cc:993] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6e6df7e8ed204f1db5c371536b5b0683 to start an election
I20260709 13:12:50.588867  1677 raft_consensus.cc:1081] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Signalling peer 6e6df7e8ed204f1db5c371536b5b0683 to start an election
I20260709 13:12:50.590492   554 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:12:50.592391   599 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:50.593443  1625 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:50.593732  1171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:36742
I20260709 13:12:50.593924  1625 raft_consensus.cc:697] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:50.594360  1171 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:50.594738  1171 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.594971  1625 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:50.619153  1171 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:50.621732   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:50.623071   483 raft_consensus.cc:3055] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:50.623337   483 raft_consensus.cc:740] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:50.624073   483 consensus_queue.cc:260] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:50.625097   483 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.627178   380 catalog_manager.cc:5697] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 2 to 3, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 3 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.631158   483 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:12:50.632239  1141 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:12:50.633021  1638 raft_consensus.cc:2804] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:50.633496  1638 raft_consensus.cc:697] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:12:50.634336  1638 consensus_queue.cc:237] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:50.639005  1171 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:50.640149   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:50.640700   557 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.649874   557 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:12:50.658504   380 catalog_manager.cc:5697] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 1 to 2, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 2 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.701155  1626 raft_consensus.cc:993] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:12:50.701645  1625 raft_consensus.cc:1081] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:12:50.703122   483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:12:50.703665   483 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:50.703997   483 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.711187  1679 ts_tablet_manager.cc:933] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:50.712057   483 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:50.712864  1679 tablet_copy_client.cc:323] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.130:41159
I20260709 13:12:50.714354   569 tablet_copy_service.cc:140] P 6ba2a9c02b534120bbf26e56a1e920ca: Received BeginTabletCopySession request for tablet 4e472c1c82c9467a9a5563d6b06e3b53 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:43548)
I20260709 13:12:50.714802   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:50.714797   569 tablet_copy_service.cc:161] P 6ba2a9c02b534120bbf26e56a1e920ca: Beginning new tablet copy session on tablet 4e472c1c82c9467a9a5563d6b06e3b53 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:43548: session id = 6e6df7e8ed204f1db5c371536b5b0683-4e472c1c82c9467a9a5563d6b06e3b53
I20260709 13:12:50.715088   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:50.715493   626 raft_consensus.cc:3055] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:50.715641   557 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.715832   626 raft_consensus.cc:740] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:50.716627   626 consensus_queue.cc:260] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:50.717590   626 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.722491   557 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:12:50.724116   569 tablet_copy_source_session.cc:215] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:50.724310   626 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:12:50.725178   483 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:50.725591   447 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:50.726358  1677 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:50.726823  1677 raft_consensus.cc:697] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:50.727634  1677 consensus_queue.cc:237] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:50.740348  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e472c1c82c9467a9a5563d6b06e3b53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:50.741569   380 catalog_manager.cc:5697] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 1 to 2, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 2 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:50.757305  1679 tablet_copy_client.cc:806] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:50.757885  1679 tablet_copy_client.cc:670] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:50.761713  1679 tablet_copy_client.cc:538] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:50.768653  1679 tablet_bootstrap.cc:492] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:50.785619  1679 tablet_bootstrap.cc:492] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:50.786463  1679 tablet_bootstrap.cc:492] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:50.787106  1679 ts_tablet_manager.cc:1403] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.002s
I20260709 13:12:50.790022  1679 raft_consensus.cc:359] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:50.790599  1625 raft_consensus.cc:993] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:12:50.790838  1679 raft_consensus.cc:740] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:50.791155  1626 raft_consensus.cc:1081] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:12:50.791652  1679 consensus_queue.cc:260] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:50.792716   483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:12:50.793241   483 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:50.793550   483 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.794055  1679 ts_tablet_manager.cc:1434] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:50.795994   569 tablet_copy_service.cc:342] P 6ba2a9c02b534120bbf26e56a1e920ca: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-4e472c1c82c9467a9a5563d6b06e3b53 received from {username='slave'} at 127.0.0.1:43548
I20260709 13:12:50.796427   569 tablet_copy_service.cc:434] P 6ba2a9c02b534120bbf26e56a1e920ca: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-4e472c1c82c9467a9a5563d6b06e3b53 on tablet 4e472c1c82c9467a9a5563d6b06e3b53 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:50.801806   483 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:50.805598   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:50.806192   557 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.811180   557 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:12:50.811843   483 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:50.812906   448 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:50.813450   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:50.813748  1677 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:50.813995   626 raft_consensus.cc:3055] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:50.814280  1677 raft_consensus.cc:697] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:50.814323   626 raft_consensus.cc:740] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:50.815192  1677 consensus_queue.cc:237] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:50.815193   626 consensus_queue.cc:260] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:50.820739   626 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.829265  1679 ts_tablet_manager.cc:933] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:50.827088   626 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:12:50.836436  1679 tablet_copy_client.cc:323] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.131:36245
I20260709 13:12:50.837942   642 tablet_copy_service.cc:140] P 50f7c2247be24f3685d7fbca7b6c71e3: Received BeginTabletCopySession request for tablet 9ade492740624caba667436aa666025c from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:54754)
I20260709 13:12:50.838461   642 tablet_copy_service.cc:161] P 50f7c2247be24f3685d7fbca7b6c71e3: Beginning new tablet copy session on tablet 9ade492740624caba667436aa666025c from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:54754: session id = 6e6df7e8ed204f1db5c371536b5b0683-9ade492740624caba667436aa666025c
I20260709 13:12:50.840658   380 catalog_manager.cc:5697] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 1 to 2, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 2 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:50.848850   642 tablet_copy_source_session.cc:215] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:50.851847  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ade492740624caba667436aa666025c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:50.862982  1522 raft_consensus.cc:993] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6e6df7e8ed204f1db5c371536b5b0683 to start an election
I20260709 13:12:50.863479  1522 raft_consensus.cc:1081] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Signalling peer 6e6df7e8ed204f1db5c371536b5b0683 to start an election
I20260709 13:12:50.865031  1171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:36742
I20260709 13:12:50.865532  1171 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:50.865844  1171 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.868336  1679 tablet_copy_client.cc:806] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:50.868903  1679 tablet_copy_client.cc:670] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:50.875962  1679 tablet_copy_client.cc:538] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:50.879565  1171 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:50.882545   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:50.883157   483 raft_consensus.cc:3055] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:50.883504   483 raft_consensus.cc:740] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:50.884332   483 consensus_queue.cc:260] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:50.885447   483 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.886127  1679 tablet_bootstrap.cc:492] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:50.891681  1171 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:50.892819   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:50.893374   626 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.899557   483 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:12:50.900671  1141 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:12:50.901496  1638 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:50.901990  1638 raft_consensus.cc:697] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:12:50.902835  1638 consensus_queue.cc:237] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:50.910302   626 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:12:50.915762  1685 ts_tablet_manager.cc:933] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:12:50.926019  1685 tablet_copy_client.cc:323] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.129:45711
I20260709 13:12:50.925499   380 catalog_manager.cc:5697] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 1 to 2, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 2 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.928483   494 tablet_copy_service.cc:140] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Received BeginTabletCopySession request for tablet 82382f158074497a857b03f9f87f9e86 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:41384)
I20260709 13:12:50.929159   494 tablet_copy_service.cc:161] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Beginning new tablet copy session on tablet 82382f158074497a857b03f9f87f9e86 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:41384: session id = 6e6df7e8ed204f1db5c371536b5b0683-82382f158074497a857b03f9f87f9e86
I20260709 13:12:50.936309  1625 raft_consensus.cc:993] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:12:50.936826  1625 raft_consensus.cc:1081] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:12:50.938982   494 tablet_copy_source_session.cc:215] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:50.940670   482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:12:50.941203   482 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:50.941548   482 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.949030  1679 tablet_bootstrap.cc:492] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:50.948915   482 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:50.950177  1679 tablet_bootstrap.cc:492] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:50.950982  1679 ts_tablet_manager.cc:1403] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.018s
I20260709 13:12:50.952574   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:50.953107   557 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.954782  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82382f158074497a857b03f9f87f9e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:50.954725  1679 raft_consensus.cc:359] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:50.955991  1679 raft_consensus.cc:740] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:50.957113  1679 consensus_queue.cc:260] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:50.975625   557 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:12:50.977077   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:50.977666   626 raft_consensus.cc:3055] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:50.978019   626 raft_consensus.cc:740] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:50.978307   448 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:50.978708   626 consensus_queue.cc:260] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:50.979878   626 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.980762  1677 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:50.982117  1679 ts_tablet_manager.cc:1434] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:12:50.984432  1677 raft_consensus.cc:697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:50.986027  1677 consensus_queue.cc:237] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:50.987754   482 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:50.991135   626 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:12:50.997694   642 tablet_copy_service.cc:342] P 50f7c2247be24f3685d7fbca7b6c71e3: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-9ade492740624caba667436aa666025c received from {username='slave'} at 127.0.0.1:54754
I20260709 13:12:50.998296   642 tablet_copy_service.cc:434] P 50f7c2247be24f3685d7fbca7b6c71e3: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-9ade492740624caba667436aa666025c on tablet 9ade492740624caba667436aa666025c with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:51.013557  1685 tablet_copy_client.cc:806] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:51.014274  1685 tablet_copy_client.cc:670] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:51.014578   380 catalog_manager.cc:5697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 1 to 2, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 2 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:51.018023  1685 tablet_copy_client.cc:538] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:51.029036  1685 tablet_bootstrap.cc:492] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:51.049912  1685 tablet_bootstrap.cc:492] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:51.050791  1685 tablet_bootstrap.cc:492] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:51.051493  1685 ts_tablet_manager.cc:1403] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.003s
I20260709 13:12:51.054385  1685 raft_consensus.cc:359] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:51.055202  1685 raft_consensus.cc:740] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:51.055835  1685 consensus_queue.cc:260] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:51.058229  1685 ts_tablet_manager.cc:1434] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:51.060052   494 tablet_copy_service.cc:342] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-82382f158074497a857b03f9f87f9e86 received from {username='slave'} at 127.0.0.1:41384
I20260709 13:12:51.060415   494 tablet_copy_service.cc:434] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-82382f158074497a857b03f9f87f9e86 on tablet 82382f158074497a857b03f9f87f9e86 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:51.073917   482 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:51.075699  1625 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:51.100059  1685 ts_tablet_manager.cc:933] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:12:51.110183  1685 tablet_copy_client.cc:323] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.129:45711
I20260709 13:12:51.111882   494 tablet_copy_service.cc:140] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Received BeginTabletCopySession request for tablet 227b93e1b31e4b058d5ec1fc69bd6849 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:41384)
I20260709 13:12:51.112411   494 tablet_copy_service.cc:161] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Beginning new tablet copy session on tablet 227b93e1b31e4b058d5ec1fc69bd6849 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:41384: session id = 6e6df7e8ed204f1db5c371536b5b0683-227b93e1b31e4b058d5ec1fc69bd6849
I20260709 13:12:51.114807   557 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:51.116812  1599 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:51.122825   557 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:51.124555  1626 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:51.136638   494 tablet_copy_source_session.cc:215] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:51.146148  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 227b93e1b31e4b058d5ec1fc69bd6849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:51.155854  1171 raft_consensus.cc:1217] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:51.169236   556 raft_consensus.cc:1275] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:51.171068  1638 consensus_queue.cc:1048] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:51.212999  1685 tablet_copy_client.cc:806] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:51.213606  1685 tablet_copy_client.cc:670] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:51.216647   626 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:51.247593  1522 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:51.256901  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 47093.9us
I20260709 13:12:51.259850  1685 tablet_copy_client.cc:538] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:51.261641   483 raft_consensus.cc:1275] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:51.269805  1685 tablet_bootstrap.cc:492] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:12:51.274489  1638 consensus_queue.cc:1048] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:51.295848  1174 raft_consensus.cc:1217] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:12:51.311466   555 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:51.312808  1677 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:51.314828  1685 tablet_bootstrap.cc:492] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:51.315881  1685 tablet_bootstrap.cc:492] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:12:51.316740  1685 ts_tablet_manager.cc:1403] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.047s	user 0.025s	sys 0.004s
I20260709 13:12:51.320053  1685 raft_consensus.cc:359] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:51.320976  1685 raft_consensus.cc:740] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:12:51.321684  1685 consensus_queue.cc:260] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:12:51.326985  1685 ts_tablet_manager.cc:1434] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:12:51.329066   494 tablet_copy_service.cc:342] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-227b93e1b31e4b058d5ec1fc69bd6849 received from {username='slave'} at 127.0.0.1:41384
I20260709 13:12:51.329629   494 tablet_copy_service.cc:434] P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-227b93e1b31e4b058d5ec1fc69bd6849 on tablet 227b93e1b31e4b058d5ec1fc69bd6849 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:51.353590   626 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:51.354259   624 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:51.355844  1576 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:51.355017  1701 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:12:51.373884   483 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:51.375398  1700 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:51.414338  1174 raft_consensus.cc:1217] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:51.430130   555 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:51.431843  1522 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:51.480715   626 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:51.484335  1711 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:51.587455 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:51.639941 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:51.700259   626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:12:51.700851   626 raft_consensus.cc:606] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:51.701964  1174 raft_consensus.cc:1217] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:12:51.710932   482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:52312
I20260709 13:12:51.711584   482 raft_consensus.cc:606] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Received request to transfer leadership to TS 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:51.714687   482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:52312
I20260709 13:12:51.721866   482 raft_consensus.cc:606] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Received request to transfer leadership to TS 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:51.724445   479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:52312
I20260709 13:12:51.724922   479 raft_consensus.cc:606] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:51.727423   554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:12:51.728010   554 raft_consensus.cc:606] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:51.731149   626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:12:51.731766   626 raft_consensus.cc:606] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:51.732906 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:51.734181 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:51.775408  1711 raft_consensus.cc:993] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:12:51.775918  1711 raft_consensus.cc:1081] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Signalling peer 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:12:51.776338  1548 raft_consensus.cc:1064] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:51.777402   554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59114
I20260709 13:12:51.777926   554 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:51.778254   554 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.778578  1548 consensus_queue.cc:237] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:51.786285   624 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:51.788470  1654 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:51.791721  1174 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:51.794486   482 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:51.797427  1654 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:12:51.807032  1621 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:51.812160   554 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:51.820652   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:51.830605   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:51.831318   626 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.832311   479 raft_consensus.cc:3055] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:51.832685   479 raft_consensus.cc:740] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:51.833408   479 consensus_queue.cc:260] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:51.834435   479 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.842828   479 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:12:51.832262   554 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:51.840688   626 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:12:51.847774   522 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:51.850536  1654 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:51.851493  1654 raft_consensus.cc:697] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:51.854174  1672 raft_consensus.cc:1064] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:51.853682  1654 consensus_queue.cc:237] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:51.856417  1715 raft_consensus.cc:993] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:12:51.856951  1715 raft_consensus.cc:1081] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:12:51.858649   631 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:12:51.859256   631 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:51.859670   631 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.870971  1715 raft_consensus.cc:2955] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:51.878311   631 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:51.883482   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:51.874625   479 raft_consensus.cc:2955] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:51.884056   554 raft_consensus.cc:3055] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:51.884384   554 raft_consensus.cc:740] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:51.885134   554 consensus_queue.cc:260] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:51.886214   554 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.897109   554 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:12:51.907555   631 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:51.907177   624 raft_consensus.cc:2955] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:51.908998  1672 consensus_queue.cc:237] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:51.911535  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:12:51.912096  1174 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.918002  1599 raft_consensus.cc:1064] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:51.922515  1599 consensus_queue.cc:237] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:51.928057   597 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:51.928943  1625 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:51.929476  1625 raft_consensus.cc:697] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:51.930384  1625 consensus_queue.cc:237] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:51.933346  1174 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
W20260709 13:12:51.961458   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 95282.6us
I20260709 13:12:51.973453   378 catalog_manager.cc:5697] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:51.980351  1171 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEARNER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:12:51.982880  1522 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:51.966236   379 catalog_manager.cc:5697] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 1 to 2, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 2 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.009657   482 raft_consensus.cc:1275] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:52.015019   556 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:12:52.019040  1171 raft_consensus.cc:1275] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:52.020498  1677 raft_consensus.cc:993] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6e6df7e8ed204f1db5c371536b5b0683 to start an election
I20260709 13:12:52.020982  1677 raft_consensus.cc:1081] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Signalling peer 6e6df7e8ed204f1db5c371536b5b0683 to start an election
I20260709 13:12:52.022091   556 raft_consensus.cc:1275] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:52.023844   626 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:12:52.024044  1576 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:52.028069  1171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:36742
I20260709 13:12:52.028800  1171 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:52.029207  1171 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.032028  1725 consensus_queue.cc:1048] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:52.034606  1711 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:52.047322  1726 consensus_queue.cc:1048] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:52.061708  1711 raft_consensus.cc:2955] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:52.060256  1171 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:52.067143   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:52.067817   482 raft_consensus.cc:3055] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:52.068130   482 raft_consensus.cc:740] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:52.068928   482 consensus_queue.cc:260] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:52.070001   482 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.075889   482 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:12:52.077034  1141 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:12:52.077826  1700 raft_consensus.cc:2804] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:52.078282  1700 raft_consensus.cc:697] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:12:52.079088  1700 consensus_queue.cc:237] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:52.084323  1171 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:52.084749  1725 consensus_queue.cc:1048] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:52.086120   554 raft_consensus.cc:2955] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:52.086813   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:52.090725   557 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.134424   557 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:12:52.158687  1175 raft_consensus.cc:2955] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:52.168105   380 catalog_manager.cc:5697] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 2 to 3, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 3 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:52.173472   377 catalog_manager.cc:5697] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 1 to 2, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 2 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.179843  1726 raft_consensus.cc:2955] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:52.182359  1174 raft_consensus.cc:2955] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:52.184506   556 raft_consensus.cc:2955] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:52.209048  1175 raft_consensus.cc:2955] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:52.213912  1731 raft_consensus.cc:993] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:12:52.214712  1731 raft_consensus.cc:1081] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:12:52.222795   484 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:12:52.223381   484 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:52.223737   484 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.243770  1625 raft_consensus.cc:993] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:12:52.244290  1625 raft_consensus.cc:1081] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:12:52.251899   484 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:52.256546   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:52.257100   626 raft_consensus.cc:3055] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:52.257398   626 raft_consensus.cc:740] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:52.270205   626 consensus_queue.cc:260] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:52.271629   626 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.280875   626 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:12:52.282765   447 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:52.282948   484 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:52.308220  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:12:52.309008  1175 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.310283  1744 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:52.325551  1175 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
W20260709 13:12:52.327747   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 45099us
I20260709 13:12:52.327934   484 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:12:52.337788   484 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:52.338296   484 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.357014   484 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:52.359963   478 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:52.361279   484 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:52.363528   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:52.364254   624 raft_consensus.cc:3055] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:52.364611   624 raft_consensus.cc:740] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:52.365598   624 consensus_queue.cc:260] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:52.367628   624 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:52.376266   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 57385us
I20260709 13:12:52.378708  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:12:52.379558  1174 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.382391   624 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:12:52.371342  1715 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:12:52.389647  1174 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:12:52.409636   448 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:12:52.413867  1742 raft_consensus.cc:1064] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:12:52.416138  1745 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:52.433314  1745 raft_consensus.cc:697] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:52.434223  1745 consensus_queue.cc:237] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:52.432281  1742 consensus_queue.cc:237] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:52.439481   478 raft_consensus.cc:2955] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:52.450489  1522 raft_consensus.cc:993] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6e6df7e8ed204f1db5c371536b5b0683 to start an election
I20260709 13:12:52.451092  1522 raft_consensus.cc:1081] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Signalling peer 6e6df7e8ed204f1db5c371536b5b0683 to start an election
W20260709 13:12:52.478924   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 46670.2us
I20260709 13:12:52.500394   555 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:52.519384   555 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:12:52.521193  1700 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:52.542896  1731 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:12:52.526571  1744 raft_consensus.cc:697] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:52.546262  1744 consensus_queue.cc:237] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:52.555877   624 raft_consensus.cc:2955] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:52.555220  1174 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:52.571198  1724 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 13:12:52.571938   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 133122us
I20260709 13:12:52.573841  1174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:36742
I20260709 13:12:52.574514  1174 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:52.574920  1174 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.592041   380 catalog_manager.cc:5697] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 3 to 4, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:52.596724   380 catalog_manager.cc:5697] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:52.612550  1174 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:52.623025   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:52.623664   478 raft_consensus.cc:3055] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:52.623868  1174 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:52.623960   478 raft_consensus.cc:740] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:12:52.628883   478 consensus_queue.cc:260] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:52.630105   478 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.640435   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:52.641218   554 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.644639  1174 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 LEARNER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:52.645359   624 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:52.646078  1745 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:52.649941  1758 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:52.669958   478 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:12:52.674674   554 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:12:52.675519  1141 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:12:52.694013   559 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:12:52.699882   626 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:12:52.700170   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 157287us
I20260709 13:12:52.760272 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:52.708549  1700 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:52.751724  1599 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:12:52.778882  1700 raft_consensus.cc:697] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:12:52.824656  1748 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
W20260709 13:12:52.835354  1757 log.cc:927] Time spent T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:12:52.844935  1762 log.cc:927] Time spent T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:12:52.893306   482 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:12:52.898391   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 121778us
I20260709 13:12:52.907878  1771 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:52.889659  1764 log.cc:927] Time spent T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:12:52.910193  1700 consensus_queue.cc:237] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:52.914944  1173 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:52.927306   482 consensus_queue.cc:237] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:52.934293  1576 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:53.098068   624 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:53.099994  1522 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:53.113086  1711 raft_consensus.cc:2955] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:53.134778   555 raft_consensus.cc:2955] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:53.143736   626 consensus_queue.cc:237] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:53.161192   377 catalog_manager.cc:5697] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 1 to 2, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 2 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.170300   377 catalog_manager.cc:5697] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 1 to 2, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 2 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.189280   557 consensus_queue.cc:237] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:53.199807  1175 raft_consensus.cc:1275] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:53.214354   559 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:53.216432  1522 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:53.220679   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 235532us
W20260709 13:12:53.220862  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 278624us
I20260709 13:12:53.258836   378 catalog_manager.cc:5697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:12:53.273456   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 81480us
W20260709 13:12:53.346731   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 149793us
I20260709 13:12:53.420457  1173 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:53.422699  1174 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:53.437860   479 raft_consensus.cc:1275] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:53.445099   624 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:53.447865  1576 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:53.448618  1522 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:53.461673  1171 raft_consensus.cc:2955] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:53.528617  1625 consensus_queue.cc:1048] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:12:54.848899  1749 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:54.851074  1749 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:54.855765  1749 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:54.856731  1749 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:54.857035  1800 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:12:54.858002  1749 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:54.861444  1749 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:54.858095  1800 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:54.864585  1800 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:54.880425  1802 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:54.881528  1802 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:54.884478  1802 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:54.880438  1800 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:54.885588  1800 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:54.886791  1802 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:54.887686  1802 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:54.888998  1800 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:54.891117  1802 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:54.904553  1803 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:54.905527  1803 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:54.908610  1803 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:54.913714   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1218) took 1757 ms. Trace:
I20260709 13:12:54.914209   631 rpcz_store.cc:276] 0709 13:12:53.155902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.156108 (+   206us) service_pool.cc:224] Handling call
0709 13:12:53.156434 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:53.156817 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:53.156844 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:53.157352 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:12:53.445709 (+288357us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:53.445746 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.449467 (+  3721us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:54.913152 (+1463685us) raft_consensus.cc:1685] finished
0709 13:12:54.913189 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.913508 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77263,"raft.queue_time_us":930,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":7280,"thread_start_us":287610,"threads_started":1,"wal-append.queue_time_us":447054,"wal-append.run_cpu_time_us":1635,"wal-append.run_wall_time_us":1001640}
I20260709 13:12:54.921200  1804 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:54.922739  1804 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:54.931787  1804 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:54.941473  1804 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:54.942255  1746 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:54.942721  1804 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:54.943008  1746 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:54.945300  1746 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:54.945832  1804 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:54.947080  1805 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:54.947360  1804 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:12:54.947940  1805 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:54.948166  1804 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:54.951328  1805 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:54.952018  1805 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:54.952463  1801 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:54.952929  1800 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.952637  1805 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:54.953208  1801 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:54.953657  1800 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:54.956359  1800 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:54.960618  1804 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:54.964255   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 79) took 1905 ms. Trace:
I20260709 13:12:54.964684   478 rpcz_store.cc:276] 0709 13:12:53.058493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.058650 (+   157us) service_pool.cc:224] Handling call
0709 13:12:53.058986 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:53.059463 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:53.059502 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:53.059964 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:12:53.443374 (+383410us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:53.443411 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.443468 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:54.963769 (+1520301us) raft_consensus.cc:1685] finished
0709 13:12:54.963821 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.964072 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":203,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"thread_start_us":383112,"threads_started":1,"wal-append.queue_time_us":501090,"wal-append.run_cpu_time_us":1953,"wal-append.run_wall_time_us":1001989}
I20260709 13:12:54.967868   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:54.968936   479 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:54.986809  1802 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:54.989450  1802 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:54.994768  1802 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:54.999325  1802 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:55.001693  1802 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:54.992270  1801 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:55.005028  1749 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:12:55.020535   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:55.021517   480 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:55.112012  1749 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:54.955129  1805 leader_election.cc:290] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:55.703636  1802 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:55.115180  1749 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:12:55.708132   448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.041s	sys 0.037s
W20260709 13:12:55.709736   448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.042s	sys 0.037s
I20260709 13:12:55.714913   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1212) took 2683 ms. Trace:
I20260709 13:12:55.715579   629 rpcz_store.cc:276] 0709 13:12:53.031707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.037132 (+  5425us) service_pool.cc:224] Handling call
0709 13:12:53.055191 (+ 18059us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:53.055567 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:53.055593 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:53.056614 (+  1021us) log.cc:844] Serialized 564 byte log entry
0709 13:12:53.465454 (+408840us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:53.474696 (+  9242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.483192 (+  8496us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:55.714283 (+2231091us) raft_consensus.cc:1685] finished
0709 13:12:55.714328 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:55.714677 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":387485,"threads_started":1,"wal-append.queue_time_us":458881,"wal-append.run_cpu_time_us":2085,"wal-append.run_wall_time_us":1082716}
W20260709 13:12:55.721711   482 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.381s	user 0.008s	sys 0.037s
W20260709 13:12:55.722275   482 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.382s	user 0.008s	sys 0.037s
I20260709 13:12:55.723749  1802 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:12:55.724591  1802 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:55.730746  1807 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:55.731577  1807 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:55.732371  1802 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:55.733086  1810 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:55.733760  1810 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:55.734141  1749 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:55.735057  1749 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:55.735545   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1109) took 2396 ms. Trace:
I20260709 13:12:55.736001  1810 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:55.735918   482 rpcz_store.cc:276] 0709 13:12:53.339467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.339589 (+   122us) service_pool.cc:224] Handling call
0709 13:12:53.340150 (+   561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:53.340419 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:55.722749 (+2382330us) log.cc:844] Serialized 14 byte log entry
0709 13:12:55.730458 (+  7709us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:55.730541 (+    83us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:55.730634 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:55.735296 (+  4662us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:55.735453 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":281682,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":62,"raft.queue_time_us":2622,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":208,"thread_start_us":2389118,"threads_started":2,"wal-append.queue_time_us":7730}
I20260709 13:12:55.737334  1749 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:12:55.738247   484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.024s	sys 0.025s
W20260709 13:12:55.738628   484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.024s	sys 0.025s
I20260709 13:12:55.738723  1807 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:55.743623   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:55.744930   484 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:12:55.744792   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:55.745901   480 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:12:55.744230  1732 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:55.747267   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:55.747579  1732 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:55.750069  1732 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:55.750321   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:55.751420  1805 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:12:55.753399   450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.031s	sys 0.007s
W20260709 13:12:55.753755   450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.031s	sys 0.007s
I20260709 13:12:55.753547  1732 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:55.754455  1732 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:55.756266  1802 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:55.756951  1802 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:55.758075  1732 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:55.761768   378 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46024 (request call id 247) took 2532 ms. Trace:
I20260709 13:12:55.759589  1802 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:54.927706 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:55.762436  1802 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:12:55.763074  1802 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:55.767819  1807 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:55.762200   378 rpcz_store.cc:276] 0709 13:12:53.229578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.229791 (+   213us) service_pool.cc:224] Handling call
0709 13:12:55.761511 (+2531720us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:53.321775 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:53.325398 (+  3623us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:53.325431 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:12:53.325446 (+    15us) tablet.cc:662] Decoding operations
0709 13:12:53.325763 (+   317us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:53.325808 (+    45us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:53.325836 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:53.326027 (+   191us) tablet.cc:701] Row locks acquired
0709 13:12:53.326041 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:12:53.326160 (+   119us) write_op.cc:270] Start()
0709 13:12:53.326254 (+    94us) write_op.cc:276] Timestamp: P: 1783602773326117 usec, L: 0
0709 13:12:53.326274 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:12:53.326873 (+   599us) log.cc:844] Serialized 599 byte log entry
0709 13:12:53.340414 (+ 13541us) op_driver.cc:464] REPLICATION: finished
0709 13:12:53.348610 (+  8196us) write_op.cc:301] APPLY: starting
0709 13:12:53.348732 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:53.348833 (+   101us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:53.348926 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:53.349137 (+   211us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:53.349285 (+   148us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:53.349331 (+    46us) write_op.cc:312] APPLY: finished
0709 13:12:53.349509 (+   178us) log.cc:844] Serialized 23 byte log entry
0709 13:12:53.349667 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:53.349756 (+    89us) write_op.cc:454] Released schema lock
0709 13:12:53.349792 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:53.350074 (+   282us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:53.350105 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":931644,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":329,"apply.run_cpu_time_us":1445,"apply.run_wall_time_us":1445,"num_ops":1,"prepare.queue_time_us":367,"prepare.run_cpu_time_us":2877,"prepare.run_wall_time_us":53941,"replication_time_us":14021}]]}
I20260709 13:12:55.768797  1807 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:55.762200  1749 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:55.770349  1749 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:55.771672  1807 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:55.772629  1802 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:55.780738  1811 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:55.793192  1811 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:55.766578  1805 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:55.814232  1548 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:55.815820  1548 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:55.818275  1548 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:12:55.799191   557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.597s	user 0.026s	sys 0.061s
W20260709 13:12:55.820142   557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.618s	user 0.028s	sys 0.061s
I20260709 13:12:55.778201  1749 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:55.824887  1172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 262) took 2357 ms. Trace:
I20260709 13:12:55.825330  1172 rpcz_store.cc:276] 0709 13:12:53.464827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.465242 (+   415us) service_pool.cc:224] Handling call
0709 13:12:53.465511 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:53.580747 (+115236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:53.580792 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:53.581384 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:12:53.628778 (+ 47394us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:53.628829 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.628933 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:55.822126 (+2193193us) raft_consensus.cc:1685] finished
0709 13:12:55.822167 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:55.822382 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8232,"raft.queue_time_us":42217,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":1184,"thread_start_us":121573,"threads_started":2,"wal-append.queue_time_us":40256,"wal-append.run_cpu_time_us":1743,"wal-append.run_wall_time_us":1004831}
I20260709 13:12:55.796367  1811 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:55.839605  1813 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:55.840305  1813 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:12:55.836002   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.830638   599 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:55.855769  1746 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:55.856613  1746 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:55.861343  1805 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:55.864991  1811 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:55.865062  1814 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:55.865394  1811 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:55.865954  1811 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.866098  1814 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:55.867568  1721 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:55.868463  1721 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:55.873883   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1267) took 2654 ms. Trace:
I20260709 13:12:55.874418  1805 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:55.875180  1805 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:55.879042  1805 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:55.879786  1657 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:55.881769  1803 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:55.876892  1811 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:55.861626  1815 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:55.898140  1175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 256) took 2518 ms. Trace:
I20260709 13:12:55.902861  1812 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:55.897590  1815 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:55.903635  1812 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:55.902931  1175 rpcz_store.cc:276] 0709 13:12:53.379331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.434401 (+ 55070us) service_pool.cc:224] Handling call
0709 13:12:53.434693 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:53.439796 (+  5103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:53.439830 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:53.440235 (+   405us) log.cc:844] Serialized 26 byte log entry
0709 13:12:53.632299 (+192064us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:53.632344 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.632531 (+   187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:55.897584 (+2265053us) raft_consensus.cc:1685] finished
0709 13:12:55.897627 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:55.897911 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4734,"raft.queue_time_us":5112,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":191502,"threads_started":1,"wal-append.queue_time_us":199394,"wal-append.run_cpu_time_us":1828,"wal-append.run_wall_time_us":1014044}
I20260709 13:12:55.874428   559 rpcz_store.cc:276] 0709 13:12:53.219292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.219410 (+   118us) service_pool.cc:224] Handling call
0709 13:12:53.219961 (+   551us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:53.220355 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:53.220379 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:53.243781 (+ 23402us) log.cc:844] Serialized 501 byte log entry
0709 13:12:53.528811 (+285030us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:53.528872 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.528955 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:55.873186 (+2344231us) raft_consensus.cc:1685] finished
0709 13:12:55.873231 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:55.873567 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":284019,"threads_started":1,"wal-append.queue_time_us":360841,"wal-append.run_cpu_time_us":1480,"wal-append.run_wall_time_us":1001484}
I20260709 13:12:55.889544  1805 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:12:55.944252   379 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48622 (request call id 247) took 2801 ms. Trace:
I20260709 13:12:55.944936   379 rpcz_store.cc:276] 0709 13:12:53.143069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.143268 (+   199us) service_pool.cc:224] Handling call
0709 13:12:55.943959 (+2800691us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6976,"reported_tablets":4,"spinlock_wait_cycles":38528}
I20260709 13:12:55.946574  1819 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:55.954494  1812 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:55.955036  1811 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:55.957047  1818 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:55.957732  1818 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:55.959857  1807 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:12:55.961413  1818 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:55.960940  1807 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:55.962064  1818 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:55.963434  1802 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:55.969379  1813 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:55.969520  1802 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:55.940196  1803 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:55.971853  1802 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:55.947611  1805 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:55.962744  1818 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:55.979668   597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.472s	user 0.004s	sys 0.040s
I20260709 13:12:55.971858  1803 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:12:55.981000   597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.529s	user 0.005s	sys 0.041s
I20260709 13:12:55.973704  1800 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:12:55.982159  1805 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:55.983134  1814 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:55.983507  1807 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:55.980131  1813 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:55.989144  1800 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:55.995260  1813 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:55.997901  1813 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:56.001324  1800 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:56.002112  1814 consensus_queue.cc:1048] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:56.012931  1815 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:56.003690  1805 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:56.014168  1805 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.016848  1805 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:55.896341  1721 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:56.003193  1821 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.014868  1657 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.006852  1813 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:56.029101  1813 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.031570  1813 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:56.032512  1815 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:12:56.041786  1814 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:12:56.046698   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 55819.5us
I20260709 13:12:56.047417  1831 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:12:56.046248   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 155112us
I20260709 13:12:56.031960  1824 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.042711  1814 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.048162  1831 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.065124  1831 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:56.065639  1831 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.033620  1817 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:56.020112  1802 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:12:55.993162  1819 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.059211  1813 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.085019  1828 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.095094  1732 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:56.085834  1828 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.091248  1818 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:56.093294  1826 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.091857  1831 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.090137  1815 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.091008  1823 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.089805  1824 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:56.122298   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 47553us
I20260709 13:12:56.111857  1803 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.125566   599 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:56.111838  1813 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.130429   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:56.091156  1821 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.213356  1833 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.198576  1823 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.214113  1833 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.216511  1833 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:56.216588  1823 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:56.217031  1833 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:56.217702  1833 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.092417  1817 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.138430  1832 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.222223  1817 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:56.221834  1832 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.222811  1817 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.223734  1817 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.225327  1832 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:56.226176  1832 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.226244  1817 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:56.126425  1732 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:56.235993   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 110506us
I20260709 13:12:56.138818  1826 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.245378  1826 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:56.246060  1826 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.229590  1837 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:56.234171  1814 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:56.246737  1826 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.237010  1657 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:56.212169  1803 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.227103  1832 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.263396  1841 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.241633  1817 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.252156   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1174) took 1288 ms. Trace:
I20260709 13:12:56.268854   599 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:56.269577  1821 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:56.267422  1841 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.266539  1836 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:56.275535  1836 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:56.275952  1836 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.275040   599 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:56.260013  1823 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.288594  1843 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.289495  1843 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.269955  1657 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.296252  1822 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.296550  1835 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.270277   476 rpcz_store.cc:276] 0709 13:12:54.964168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.089717 (+1125549us) service_pool.cc:224] Handling call
0709 13:12:56.252035 (+162318us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:56.301044  1829 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.277402  1834 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:12:56.311112  1825 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.293004  1827 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:12:56.317093  1845 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:56.317901  1845 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.320578  1845 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:56.322518  1832 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:56.323177  1832 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.299551  1815 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:56.323889  1832 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.312768  1821 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:56.298215  1817 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.302640  1841 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:56.340590  1840 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.340824  1842 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.343743  1843 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:56.327976  1833 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:56.308614  1823 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.301819  1829 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.278252  1837 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.326536  1657 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.329036  1732 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:56.354938  1841 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.331707  1815 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.331956  1826 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:56.353535  1814 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:56.376547  1838 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.376767  1848 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:56.377269  1838 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.377359  1848 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.380255  1803 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:56.311985  1825 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.358780  1824 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:56.363976  1845 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:56.313066  1835 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.349416  1834 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:12:56.384310   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 109323us
I20260709 13:12:56.404078  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:56.353701  1827 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.378813  1842 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.615129  1829 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:56.615173  1837 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:56.365031  1814 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:56.472762   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:56.364817  1839 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.626685   557 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:12:56.334106  1822 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.492889  1818 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.627746  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:56.441625  1810 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.448316  1807 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.366276  1821 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.524885  1800 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.633628  1171 raft_consensus.cc:1813] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Handling vote request from an unknown peer 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:56.384555  1826 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.448096   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:56.448680   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:56.623420  1802 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.490763  1815 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.629462  1814 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:56.641477   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:56.489495  1846 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:56.629383  1824 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.489300  1850 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.644649  1171 raft_consensus.cc:2410] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:12:56.558609  1841 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.384469   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:56.637253  1827 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:56.448509  1830 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:56.428743  1852 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.382843  1840 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.448428  1854 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.422057  1849 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.638341  1818 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.376572  1847 raft_consensus.cc:2955] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:56.638581  1845 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.774226   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:56.756518   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:56.832724   479 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.759791   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:56.759316  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:56.835290   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:56.721227   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:56.699747  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:56.836971  1174 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:56.643479  1851 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:56.645643   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:56.701025   476 raft_consensus.cc:1275] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:56.796777  1848 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:56.718518   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:56.694182  1846 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:12:56.718719  1829 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.795920  1657 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:56.779515   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:56.659741  1837 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.642021  1800 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.841316  1777 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.867640   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:56.657919  1810 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.839059  1825 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:56.780148   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:56.672421  1802 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.780702   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:56.865263  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:56.722244  1826 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.783839  1824 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.866866   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:55.905550  1746 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:56.867067   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:56.870929   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:56.700584  1807 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.896064   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:56.659854  1839 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.773080   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:56.856539  1838 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:56.858477  1846 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:56.913813  1839 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:56.914451   558 raft_consensus.cc:1813] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Handling vote request from an unknown peer 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:56.915375   558 raft_consensus.cc:2410] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:12:56.853425  1842 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:12:56.757184  1850 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.870713   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:56.901312  1174 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:56.906459   478 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:12:56.869339  1853 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:56.870908  1817 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:56.905259   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:56.871392  1859 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:56.921473   554 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:56.916078   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:56.931857   626 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:56.939199   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:56.942303   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:56.857450  1852 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.916155   555 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:56.903731  1825 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.944312   557 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:56.896636  1829 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:56.943028  1822 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:56.943951   632 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:12:56.843353  1854 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.906106   633 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:56.904066   628 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:56.931134   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:56.905117  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:56.870962  1851 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.923614  1837 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:56.956215  1835 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:57.026834   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:12:57.002239   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.949489   477 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:56.858639  1830 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:57.032117   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:56.870024  1849 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:57.034806  1864 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:12:57.025295  1821 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:56.953847   475 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:57.035568   550 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:12:57.035575   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.036135   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.036186   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.051028   555 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:12:57.036856   479 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
W20260709 13:12:56.923693  1196 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7060 after lost signal to thread 31817
I20260709 13:12:57.016191  1834 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:57.035254   629 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
W20260709 13:12:57.040988   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 135385us
I20260709 13:12:57.041376   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.044677  1174 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:57.047538   631 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:57.018613   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.027871  1810 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:57.054311   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.033707  1815 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:56.952860  1777 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:57.043787  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:56.956774  1853 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:57.054443   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:57.235729  1840 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:57.050319  1841 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:57.237639   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.115891   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.065881   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:56.944944  1859 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:57.131069  1850 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:57.046684  1170 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:57.294085  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.294230  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.294936  1859 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:57.295284  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.116487   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.127486   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:12:57.229189  1860 log.cc:927] Time spent T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:12:57.297081   478 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:57.297360   626 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:57.302088   599 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:56.985082  1825 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:57.109135  1818 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:57.053345   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.306325   484 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 1.
I20260709 13:12:57.122525  1807 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:12:57.298734  1814 consensus_meta.cc:287] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.000s
I20260709 13:12:57.275985  1845 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:57.066119  1839 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:12:57.047317  1800 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:57.122761   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.130595   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.130434  1862 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:57.131775  1822 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:57.106789  1864 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:12:57.313215  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 139822us
I20260709 13:12:57.313478  1853 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:57.313871  1854 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:57.295986   629 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:57.307056  1657 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:57.314188  1831 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:57.314610   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:12:57.317593  1836 consensus_meta.cc:287] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.023s	user 0.010s	sys 0.003s
I20260709 13:12:57.086207  1832 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:57.298413  1824 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:57.318950   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.295416  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.337535   632 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:57.319500   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.337891   599 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:57.320559   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.335939   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.339583   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.303260   476 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:57.322525  1777 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:57.322731  1829 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:57.329607   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.302597  1167 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:12:57.330718  1839 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:57.352152  1811 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.352315  1813 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:57.352603  1811 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:57.318434  1830 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:57.353278   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.339185  1836 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:57.321267  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.340193   597 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:57.340184   481 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:57.342170  1849 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:57.354067   632 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 1.
I20260709 13:12:57.356665  1174 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:57.359130   597 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:12:57.359930   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:12:57.344787   599 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:12:57.325973  1196 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7740 after lost signal to thread 415
I20260709 13:12:57.340502   626 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:57.348827  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.349402  1851 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:57.335063  1657 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:12:57.375519  1657 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:57.375950   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.376538   484 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:57.338238   478 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:57.353009  1811 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.355182  1839 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:57.355438   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.372505  1812 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.382725  1812 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:57.382972   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.377360  1746 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:57.383781  1746 raft_consensus.cc:697] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:57.384279   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.384889   476 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:57.384713  1746 consensus_queue.cc:237] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:57.385142   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.312402  1814 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:57.386245   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.357026  1852 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:57.357262   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.357255   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.358876  1846 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:57.361116  1830 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.361531  1829 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.361917   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.344954  1822 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:57.371904   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.373204  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.373628  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.380861   624 raft_consensus.cc:2393] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:12:57.385797   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.387581   481 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:12:57.496189   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1195) took 1136 ms. Trace:
I20260709 13:12:57.393445   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.489218   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.598462   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.392382   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.372200  1864 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:57.395123   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.383112  1812 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.504101   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1187) took 1163 ms. Trace:
I20260709 13:12:57.484311   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.392846   633 raft_consensus.cc:2393] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:12:57.656523   555 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
W20260709 13:12:57.464897  1847 consensus_meta.cc:287] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.512s	user 0.006s	sys 0.002s
I20260709 13:12:57.491739  1172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 355) took 1242 ms. Trace:
W20260709 13:12:57.462956  1867 log.cc:927] Time spent T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:12:57.457070   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1190) took 1109 ms. Trace:
I20260709 13:12:57.485832   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.642407   554 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
W20260709 13:12:57.565351   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 58037.4us
I20260709 13:12:57.658867  1172 rpcz_store.cc:276] 0709 13:12:56.253075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.258792 (+  5717us) service_pool.cc:224] Handling call
0709 13:12:56.276847 (+ 18055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:56.290956 (+ 14109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:56.290987 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:56.291027 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:56.291071 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.491525 (+1200454us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b54003f9654. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:12:57.491565 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.491664 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31916800}
I20260709 13:12:57.496965  1171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 357) took 1196 ms. Trace:
W20260709 13:12:57.584542  1196 debug-util.cc:398] Leaking SignalData structure 0x7b08003166c0 after lost signal to thread 508
I20260709 13:12:57.626581   599 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:57.662902   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.659459   553 rpcz_store.cc:276] 0709 13:12:56.341760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.345747 (+  3987us) service_pool.cc:224] Handling call
0709 13:12:56.346075 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:56.862523 (+516448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:56.862556 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:56.862603 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:56.862643 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.451058 (+588415us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b54000488d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:12:57.451113 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.451323 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1172705152}
I20260709 13:12:57.663544   599 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:57.650430   483 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 1.
I20260709 13:12:57.529271  1826 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:57.649960   482 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:57.519061  1837 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:57.509203  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.507154   447 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:57.482070  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.667716   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:57.484408  1138 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:12:57.668340   599 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:57.643262  1829 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:57.669466   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.392393   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.608327   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.670071   479 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 1.
I20260709 13:12:57.642081   559 rpcz_store.cc:276] 0709 13:12:56.360908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.363282 (+  2374us) service_pool.cc:224] Handling call
0709 13:12:56.489641 (+126359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:56.855922 (+366281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:56.855942 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:56.858936 (+  2994us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:56.858979 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.495926 (+636947us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b5400152cd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:12:57.495983 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.496121 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":823284608}
I20260709 13:12:57.608477  1836 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:57.565389  1657 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:57.670190   597 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:57.671391   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.671687  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.392935  1819 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:57.662168   625 raft_consensus.cc:1240] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:57.528798   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.481082  1814 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:57.629357  1141 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:57.593294   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1197) took 1150 ms. Trace:
I20260709 13:12:57.537616  1823 leader_election.cc:290] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:57.534257   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.597167   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.640821   632 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:12:57.681990   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.673187  1829 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.682752   630 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 1.
I20260709 13:12:57.661434  1171 rpcz_store.cc:276] 0709 13:12:56.303438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.326464 (+ 23026us) service_pool.cc:224] Handling call
0709 13:12:57.496723 (+1170259us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b54007201d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:12:57.496868 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76767488}
I20260709 13:12:57.679121   558 rpcz_store.cc:276] 0709 13:12:56.442563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.448129 (+  5566us) service_pool.cc:224] Handling call
0709 13:12:57.593048 (+1144919us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b5400387554. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:12:57.593204 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622381440}
I20260709 13:12:57.679455  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.692162  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.692721  1171 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:57.692814   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.692905  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.693531  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.694072  1171 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:57.694375   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.694945   626 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 1.
I20260709 13:12:57.696100   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.605839   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.701162  1829 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:57.481274  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.510327   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1192) took 1167 ms. Trace:
I20260709 13:12:57.396873  1828 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:57.668290   483 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:57.566109  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.603080  1802 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:57.640676  1830 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:57.656591   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.498813  1749 raft_consensus.cc:2955] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:12:57.489238   448 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.17.130:41159 timed out after 1.515s (SENT) [suppressed 3 similar messages]
I20260709 13:12:57.503464  1825 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:57.536741   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.484428  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.670113   599 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:57.604418   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.654898   556 rpcz_store.cc:276] 0709 13:12:56.340692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.341258 (+   566us) service_pool.cc:224] Handling call
0709 13:12:56.341750 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.108763 (+767013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:57.108808 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:57.108868 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:57.108966 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.503723 (+394757us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b5400346f54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:12:57.503774 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.503919 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1667297664}
W20260709 13:12:57.672592  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 188450us
W20260709 13:12:57.672784   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 165838us
I20260709 13:12:57.673988  1851 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:57.669530  1848 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.674654  1166 raft_consensus.cc:2410] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:12:57.674018   597 leader_election.cc:304] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:57.714318   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.716876   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.674808   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.538578   380 catalog_manager.cc:5697] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 1 to 2, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 2 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:57.673192   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:57.611785  1838 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:12:57.483093  1811 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:57.680531  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 53354.9us
I20260709 13:12:57.682857   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.664883  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.682773   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.483167   477 raft_consensus.cc:2955] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:57.669638  1803 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.685743  1816 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.688151  1657 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:57.677057  1826 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.689585   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:12:57.714636  1196 debug-util.cc:398] Leaking SignalData structure 0x7b08003774a0 after lost signal to thread 583
I20260709 13:12:57.701687   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.700748  1171 raft_consensus.cc:2955] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:12:57.381129  1862 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:57.716070   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.675814  1746 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.707645   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.812173   447 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:12:57.812481   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 138540us
I20260709 13:12:57.812853   478 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 1.
I20260709 13:12:57.813138   481 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:57.813513   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 143453us
I20260709 13:12:57.813846   479 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 1.
I20260709 13:12:57.816128   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.839655   599 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:57.715772   629 raft_consensus.cc:2393] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:12:57.702159   552 rpcz_store.cc:276] 0709 13:12:56.342458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.342601 (+   143us) service_pool.cc:224] Handling call
0709 13:12:56.342957 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:56.638191 (+295234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:56.640428 (+  2237us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:56.657383 (+ 16955us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:56.660309 (+  2926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.509884 (+849575us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b5400388454. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:12:57.509936 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.510108 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637422976}
I20260709 13:12:57.816306  1141 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:12:57.847385  1141 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:57.817334  1803 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:57.677299  1800 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:57.820925  1816 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:57.822782   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.840911   447 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:57.847038   522 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:57.816634  1851 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:57.714253  1822 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:57.774583  1830 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.715205  1846 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:57.810516  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.845616   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.818233  1837 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.818364  1814 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.718443   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.839740   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.853986   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.904003   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.851310  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:57.904003   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.840380   628 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:57.821142  1826 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:57.824692   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:57.859707   447 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:57.824039  1820 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:57.813562  1848 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:57.853778  1803 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.864277   599 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:57.859046  1851 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:57.858178  1138 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:12:57.904227   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.845645  1810 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.854599  1816 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.907608   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.905844   626 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:12:57.910002   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.924075   559 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 1.
I20260709 13:12:57.841192   597 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:57.841427  1746 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:57.934491   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.935554   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.914217   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.853648  1857 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.853792  1813 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:57.914752   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 55098.7us
I20260709 13:12:57.954932   447 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:57.818059  1828 consensus_queue.cc:1059] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:12:57.863727  1823 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:57.899997  1802 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.912171   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.853737  1800 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:12:57.922158   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.962909  1836 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.922919  1810 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:57.907608  1814 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:57.945628  1805 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.944388   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.949107   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 58) took 1094 ms. Trace:
I20260709 13:12:57.912366  1826 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.950677   625 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:58.000488   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1085) took 1055 ms. Trace:
I20260709 13:12:57.942855  1746 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.923030  1820 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:57.906343  1837 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:12:57.927924  1196 debug-util.cc:398] Leaking SignalData structure 0x7b08002f71e0 after lost signal to thread 657
I20260709 13:12:57.920742  1848 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.961452  1823 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:57.961934   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.962425  1828 raft_consensus.cc:2804] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.923398  1859 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.961125  1139 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:57.957427   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.936704   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.976974  1814 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.966164  1836 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:58.021466  1836 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.964380   557 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:58.023806   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.024933   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.966759   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:58.025729   631 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:12:57.966631   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.967774   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.944010  1857 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:57.974005   481 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:12:57.974676   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.947052   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:57.954612  1813 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:57.963630   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1241) took 1166 ms. Trace:
I20260709 13:12:57.963936  1802 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:57.965721  1800 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:57.973661  1810 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.000847   625 rpcz_store.cc:276] 0709 13:12:56.945259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.950259 (+1005000us) service_pool.cc:224] Handling call
0709 13:12:57.950527 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.000244 (+ 49717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.000433 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:58.008657   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:57.966300  1838 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:58.018241   551 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 1.
W20260709 13:12:58.014812   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 525570us
I20260709 13:12:58.019420   624 raft_consensus.cc:2393] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:12:57.964241   553 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:58.050595  1813 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:57.943423   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 102335us
I20260709 13:12:58.001828   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.028077   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.006258  1837 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.035506   559 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:12:58.009260   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.016973  1823 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:58.046788   483 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
W20260709 13:12:58.048491  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 201166us
W20260709 13:12:58.096765   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 232536us
I20260709 13:12:58.019860  1859 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:58.018380  1828 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:58.018489  1811 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:58.018599  1829 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:58.064791   522 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:58.043560  1857 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.998927  1805 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:58.064002   556 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:12:58.086845   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:12:58.020207  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 104706us
I20260709 13:12:58.001856   633 rpcz_store.cc:276] 0709 13:12:56.854325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.948233 (+1093908us) service_pool.cc:224] Handling call
0709 13:12:57.948551 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.948763 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:57.948799 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:57.948839 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:57.948872 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.948927 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.949032 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:58.082808  1196 debug-util.cc:398] Leaking SignalData structure 0x7b080037b360 after lost signal to thread 1199
I20260709 13:12:58.092326   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.058923  1802 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.112375   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:58.094655   625 raft_consensus.cc:1240] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:58.113642   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.114416   553 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:58.097398   599 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:12:58.100455   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 195839us
I20260709 13:12:58.061170   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1247) took 1078 ms. Trace:
I20260709 13:12:58.116118   630 rpcz_store.cc:276] 0709 13:12:56.983035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.968132 (+985097us) service_pool.cc:224] Handling call
0709 13:12:58.000265 (+ 32133us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.015563 (+ 15298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.017210 (+  1647us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:58.028355 (+ 11145us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:58.038052 (+  9697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.048843 (+ 10791us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.059268 (+ 10425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:58.090237   597 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:58.120734   597 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:58.122397  1816 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:58.100174  1859 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.100431  1828 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.109930   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:12:58.126119   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 171267us
W20260709 13:12:58.127676  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 269570us
I20260709 13:12:58.128345   559 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:58.123147  1811 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:58.100329  1838 raft_consensus.cc:3055] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:58.124456   597 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:58.125362   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1086) took 1071 ms. Trace:
I20260709 13:12:58.124468   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.113127   624 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:58.100343  1847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:54246 (request call id 76) took 4960 ms. Trace:
I20260709 13:12:58.107841   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.166857  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:58.178680  1174 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:58.131992   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.104988  1805 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.132179   447 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:58.132869   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.149415  1138 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:12:58.149413   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 52098.3us
I20260709 13:12:58.101720   558 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 1.
I20260709 13:12:58.102653  1876 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:58.101903   550 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:12:58.050119   629 rpcz_store.cc:276] 0709 13:12:56.797732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.361673 (+563941us) service_pool.cc:224] Handling call
0709 13:12:57.945206 (+583533us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x7b5400052dd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:12:57.957326 (+ 12120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110450944}
W20260709 13:12:58.173800   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 49406.7us
W20260709 13:12:58.108592  1196 debug-util.cc:398] Leaking SignalData structure 0x7b080037b380 after lost signal to thread 1200
I20260709 13:12:58.176888   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.161705   448 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:12:58.096558  1812 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:58.192926   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:58.191017   555 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
W20260709 13:12:58.169314   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 104613us
I20260709 13:12:58.150283   625 rpcz_store.cc:276] 0709 13:12:57.053531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.063966 (+1010435us) service_pool.cc:224] Handling call
0709 13:12:58.094431 (+ 30465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.125057 (+ 30626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.125291 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:58.214368  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:58.220441   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.220577  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:58.223150   597 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:12:58.199615  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 102528us
I20260709 13:12:58.167546  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:58.224803  1175 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:58.150506  1657 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:58.164459  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:58.169853  1139 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:58.166101  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:58.180461   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:58.252092   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.165307  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:58.150010  1838 raft_consensus.cc:740] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:12:58.248337   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.263119  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:58.150913  1811 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:58.260439  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:58.192512  1862 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:58.160172  1893 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.177268  1878 raft_consensus.cc:2804] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.212934  1846 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.264231  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:12:58.167379  1837 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:58.248512  1872 log.cc:927] Time spent T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:12:58.213073   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:12:58.271018  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 121696us
I20260709 13:12:58.295691   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:58.278862  1811 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:58.277873  1823 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:58.213514  1895 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.282644   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:12:58.271533  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 101830us
I20260709 13:12:58.309305  1139 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:58.242785  1657 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:58.172461  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:12:58.290045   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 157914us
I20260709 13:12:58.288086  1846 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:58.251557  1822 consensus_queue.cc:1059] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:12:58.300421  1138 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:12:58.344194  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 43829.1us
I20260709 13:12:58.283728  1803 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:58.280728  1820 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:58.310822   632 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:58.174468  1847 rpcz_store.cc:276] 0709 13:12:53.139918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.140090 (+   172us) service_pool.cc:224] Handling call
0709 13:12:53.166498 (+ 26408us) log.cc:844] Serialized 501 byte log entry
0709 13:12:53.254888 (+ 88390us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b18003326e0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b652a6c0a 00007f4b6e9e6219 00007f4b6532ea40 00007f4b653294e4 00007f4b65329455 00007f4b68372b0b 00007f4b683f7b63 00007f4b6841f752 00007f4b684179fa
0709 13:12:58.100156 (+4845268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100621,"raft.queue_time_us":96243,"raft.run_cpu_time_us":1426,"raft.run_wall_time_us":86111,"spinlock_wait_cycles":9783552}
I20260709 13:12:58.291762   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.315333  1139 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:58.313158   447 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:58.298579   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.352473   556 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:12:58.313426  1657 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:58.270403   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 56528.5us
I20260709 13:12:58.285104  1878 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:58.286023  1893 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:58.350044   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.284551  1819 consensus_queue.cc:1059] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:12:58.305711   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:58.353533   447 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:58.346014   557 raft_consensus.cc:2393] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:12:58.306816   633 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:58.320564  1855 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:58.320428  1816 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:58.413111   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.457125   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.347903  1846 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:58.407281  1884 log.cc:927] Time spent T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:12:58.365561   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:12:58.456457  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 231651us
I20260709 13:12:58.453138   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.350795  1883 raft_consensus.cc:2804] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.351649  1820 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:12:58.522334   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 155429us
W20260709 13:12:58.629182   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 246527us
I20260709 13:12:58.629954   523 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:58.411419  1878 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.551129  1855 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:58.321739  1897 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.480767   555 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:58.551728  1876 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:58.552197   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:58.457056  1898 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:58.553864  1819 consensus_queue.cc:1243] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:12:58.556475  1812 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:58.379721  1838 consensus_queue.cc:260] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:58.600741   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.562451   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.564955   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:58.568058   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.653620   551 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:12:58.570075   632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1237) took 1789 ms. Trace:
I20260709 13:12:58.612291   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:12:58.611982  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 296724us
I20260709 13:12:58.655689  1139 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:58.566720   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1218) took 1241 ms. Trace:
I20260709 13:12:58.629343  1820 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:58.413769  1893 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.601821  1173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 281) took 1066 ms. Trace:
I20260709 13:12:58.625665   553 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
W20260709 13:12:58.525372  1877 log.cc:927] Time spent T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
W20260709 13:12:58.607204  1885 log.cc:927] Time spent T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.319s	user 0.000s	sys 0.000s
I20260709 13:12:58.525117  1847 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:58.607767  1886 log.cc:927] Time spent T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.266s	user 0.000s	sys 0.000s
I20260709 13:12:58.632719   523 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:58.632267   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.622176  1900 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:58.688172   554 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:12:58.349562  1894 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.604426  1887 raft_consensus.cc:3055] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:58.637637  1862 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
W20260709 13:12:58.640501  1800 consensus_meta.cc:287] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.556s	user 0.007s	sys 0.012s
I20260709 13:12:58.698280  1819 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:58.640413  1822 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:58.608419   558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:12:58.605767   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:58.560437  1803 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:58.645103   599 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:58.653072  1823 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:58.602494   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.638114  1855 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:58.656471   557 rpcz_store.cc:276] 0709 13:12:57.325074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.024705 (+699631us) service_pool.cc:224] Handling call
0709 13:12:58.566529 (+541824us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54001c9b54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:12:58.566660 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":730560768}
W20260709 13:12:58.705442   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 60421.7us
I20260709 13:12:58.706524   599 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:12:58.674595   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 512906us
I20260709 13:12:58.668298   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1273) took 1615 ms. Trace:
I20260709 13:12:58.637960  1897 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:58.629645  1883 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:58.671087   550 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:12:58.691061  1894 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:58.679442  1173 rpcz_store.cc:276] 0709 13:12:57.535693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.713149 (+177456us) service_pool.cc:224] Handling call
0709 13:12:57.820088 (+106939us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.822617 (+  2529us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:57.945373 (+122756us) log.cc:844] Serialized 14 byte log entry
0709 13:12:58.413991 (+468618us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:58.453179 (+ 39188us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:58.453236 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.454067 (+   831us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.601610 (+147543us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54005a64d0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:12:58.601753 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9692,"prepare.queue_time_us":145182,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":176937,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":32306,"spinlock_wait_cycles":245180672,"thread_start_us":477960,"threads_started":3,"wal-append.queue_time_us":297070}
I20260709 13:12:58.692085   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 52) took 1470 ms. Trace:
I20260709 13:12:58.718596   553 rpcz_store.cc:276] 0709 13:12:57.222212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.681742 (+1459530us) service_pool.cc:224] Handling call
0709 13:12:58.681998 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.691688 (+  9690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.691716 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:58.691778 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:58.691821 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.691899 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.692021 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:58.651314  1141 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:12:58.680495  1820 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:58.658291   552 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:12:58.700642  1904 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:58.703058  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 47506.5us
I20260709 13:12:58.740557  1139 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:58.741729  1139 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:12:58.742596  1139 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:58.683099   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:12:58.703483   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 70832.7us
W20260709 13:12:58.698848  1851 consensus_meta.cc:287] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.727s	user 0.010s	sys 0.011s
I20260709 13:12:58.654824   632 rpcz_store.cc:276] 0709 13:12:56.781090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.947575 (+1166485us) service_pool.cc:224] Handling call
0709 13:12:57.947855 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.351603 (+403748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.569829 (+218226us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54002bbbd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:12:58.570012 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":834341760}
I20260709 13:12:58.709292   599 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:58.707803   555 rpcz_store.cc:276] 0709 13:12:57.056608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.642803 (+1586195us) service_pool.cc:224] Handling call
0709 13:12:58.652033 (+  9230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.667961 (+ 15928us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.667989 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:58.668033 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:58.668058 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.668115 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.668220 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:58.749642   599 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:58.708173  1897 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.712062   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:58.716607   557 raft_consensus.cc:1275] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:58.756870   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:12:58.719871  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 68663.8us
I20260709 13:12:58.720429   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1224) took 1215 ms. Trace:
I20260709 13:12:58.691696  1887 raft_consensus.cc:740] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:12:58.726446   477 consensus_meta.cc:287] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.903s	user 0.017s	sys 0.013s
I20260709 13:12:58.737603   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1283) took 1129 ms. Trace:
W20260709 13:12:58.735467   597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.008s	sys 0.014s
I20260709 13:12:58.700474  1800 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:58.684796  1816 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:58.744050  1139 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:58.715857  1883 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.715536   558 raft_consensus.cc:606] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Received request to transfer leadership to TS 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:58.751729   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1221) took 1238 ms. Trace:
I20260709 13:12:58.775070   559 rpcz_store.cc:276] 0709 13:12:57.504110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.718500 (+1214390us) service_pool.cc:224] Handling call
0709 13:12:58.718781 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.742322 (+ 23541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.742349 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:58.742393 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:58.742425 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.742485 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.742590 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:58.718238  1829 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.716281  1837 leader_election.cc:290] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:58.723853  1894 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.737769   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:58.740329  1901 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:58.788697   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 81323.8us
I20260709 13:12:58.759352   553 rpcz_store.cc:276] 0709 13:12:57.504805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.719704 (+1214899us) service_pool.cc:224] Handling call
0709 13:12:58.719954 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.720102 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.720126 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:58.720164 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:58.720197 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.720249 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.720361 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:58.762498   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 409011us
I20260709 13:12:58.717023  1903 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:58.742424  1904 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:12:58.768033   597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.008s	sys 0.014s
I20260709 13:12:58.762755   630 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:58.701949  1900 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:58.774330  1816 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:58.773285   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 51) took 1662 ms. Trace:
I20260709 13:12:58.734162  1878 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:58.754968  1876 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:58.758546  1836 consensus_meta.cc:287] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.736s	user 0.019s	sys 0.011s
I20260709 13:12:58.761304   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:58.778774   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.907806   555 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
W20260709 13:12:58.760046  1889 log.cc:927] Time spent T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.407s	user 0.001s	sys 0.001s
I20260709 13:12:58.781663   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1226) took 1276 ms. Trace:
I20260709 13:12:58.748553  1851 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:58.772447   633 raft_consensus.cc:2393] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:12:58.778877   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:58.760589  1803 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:58.759207  1141 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:12:58.916467  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 157327us
W20260709 13:12:58.780557  1830 consensus_meta.cc:287] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.843s	user 0.017s	sys 0.007s
I20260709 13:12:58.917575  1830 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:58.919945  1830 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:12:58.860253   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 637134us
I20260709 13:12:58.922405   597 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:58.923825   626 raft_consensus.cc:2393] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:12:58.768612   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:58.775113   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1274) took 1664 ms. Trace:
I20260709 13:12:58.885732   447 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:12:58.748492  1891 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:58.924765   551 rpcz_store.cc:276] 0709 13:12:57.109625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.654300 (+1544675us) service_pool.cc:224] Handling call
0709 13:12:58.692771 (+ 38471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.739849 (+ 47078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.742653 (+  2804us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:58.750734 (+  8081us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:58.753786 (+  3052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.761023 (+  7237us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.773878 (+ 12855us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:58.926314  1891 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.926784  1891 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:58.926512  1830 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:58.927162   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1281) took 1333 ms. Trace:
I20260709 13:12:58.901257   556 rpcz_store.cc:276] 0709 13:12:57.111256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.667951 (+1556695us) service_pool.cc:224] Handling call
0709 13:12:58.681641 (+ 13690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.687671 (+  6030us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:58.738929 (+ 51258us) log.cc:844] Serialized 14 byte log entry
0709 13:12:58.772971 (+ 34042us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:58.773021 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:58.773062 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.773130 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.773231 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51228,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":78,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5347,"spinlock_wait_cycles":109312,"thread_start_us":81100,"threads_started":2}
W20260709 13:12:58.927886   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 68872us
I20260709 13:12:58.929411   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1284) took 1334 ms. Trace:
I20260709 13:12:58.929893   556 rpcz_store.cc:276] 0709 13:12:57.595041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.928270 (+1333229us) service_pool.cc:224] Handling call
0709 13:12:58.928710 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.928951 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.928991 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:58.929075 (+    84us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:58.929121 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.929198 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.929338 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:58.850296  1901 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:58.904994  1816 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:58.861914  1903 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:12:58.915020  1895 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:58.766280   550 rpcz_store.cc:276] 0709 13:12:57.594766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.562109 (+967343us) service_pool.cc:224] Handling call
0709 13:12:58.724163 (+162054us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:58.780174  1829 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:58.927340  1891 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.908793   559 rpcz_store.cc:276] 0709 13:12:57.505250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.776301 (+1271051us) service_pool.cc:224] Handling call
0709 13:12:58.776579 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.781313 (+  4734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.781352 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:58.781402 (+    50us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:58.781430 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.781500 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.781607 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:58.909559   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 64) took 1402 ms. Trace:
I20260709 13:12:58.885023  1904 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.932972   555 raft_consensus.cc:1240] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:58.910378  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 166375us
W20260709 13:12:58.914443  1813 consensus_meta.cc:287] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.812s	user 0.013s	sys 0.016s
W20260709 13:12:58.913992  1802 consensus_meta.cc:287] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.741s	user 0.015s	sys 0.012s
I20260709 13:12:58.958653   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1276) took 1393 ms. Trace:
I20260709 13:12:58.958985   555 rpcz_store.cc:276] 0709 13:12:57.565767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.908521 (+1342754us) service_pool.cc:224] Handling call
0709 13:12:58.932735 (+ 24214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.958424 (+ 25689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.958604 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:58.909334  1876 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:12:58.941429   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 90695.3us
W20260709 13:12:58.952291  1746 consensus_meta.cc:287] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.932s	user 0.015s	sys 0.041s
I20260709 13:12:58.954579   553 rpcz_store.cc:276] 0709 13:12:57.506924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.850846 (+1343922us) service_pool.cc:224] Handling call
0709 13:12:58.851128 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.901536 (+ 50408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.901564 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:58.909263 (+  7699us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:58.909305 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.909382 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.909506 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:58.936944  1901 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.981431   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1296) took 1017 ms. Trace:
I20260709 13:12:58.983191   523 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:12:58.984320   523 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:12:58.981945   559 rpcz_store.cc:276] 0709 13:12:57.966194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.958767 (+992573us) service_pool.cc:224] Handling call
0709 13:12:58.959040 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.981103 (+ 22063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.981128 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:58.981169 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:58.981195 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.981249 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.981374 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:58.985846   523 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:58.986660  1823 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.987006  1823 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:58.938928  1903 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:58.912349  1836 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:58.944137  1895 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.988889   523 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:58.991190   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:58.993424   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:58.953919  1829 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.030460   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1250) took 1979 ms. Trace:
I20260709 13:12:58.943825  1803 raft_consensus.cc:697] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:59.037817   631 rpcz_store.cc:276] 0709 13:12:57.052914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.026579 (+973665us) service_pool.cc:224] Handling call
0709 13:12:58.026907 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:58.027196 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.027252 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:58.043479 (+ 16227us) log.cc:844] Serialized 26 byte log entry
0709 13:12:58.230089 (+186610us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:58.230124 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.230188 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:59.030245 (+800057us) raft_consensus.cc:1685] finished
0709 13:12:59.030267 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.030392 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17239,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":8727,"thread_start_us":138040,"threads_started":1,"wal-append.queue_time_us":201739}
W20260709 13:12:59.028380   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 106043us
I20260709 13:12:58.982249   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:59.042081   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1299) took 1020 ms. Trace:
I20260709 13:12:58.987210   559 raft_consensus.cc:2955] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:12:59.043987   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 110286us
I20260709 13:12:58.990495  1823 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.924723  1883 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:58.996843  1819 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:59.052907   597 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:59.052867   555 rpcz_store.cc:276] 0709 13:12:58.021720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.983703 (+961983us) service_pool.cc:224] Handling call
0709 13:12:58.983956 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.026654 (+ 42698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:59.026683 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:59.039195 (+ 12512us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:59.039274 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.039359 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.042008 (+  2649us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:58.962512  1876 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.042855  1906 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:58.997179  1822 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:59.041052  1862 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:58.981578  1802 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.026407  1902 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.029264   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1199) took 2046 ms. Trace:
I20260709 13:12:58.981364  1813 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:59.052037   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:12:59.052644  1814 consensus_meta.cc:287] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.003s	user 0.006s	sys 0.004s
I20260709 13:12:59.075667   597 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:58.993872  1746 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:58.927888   551 rpcz_store.cc:276] 0709 13:12:57.594116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.926066 (+1331950us) service_pool.cc:224] Handling call
0709 13:12:58.926458 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.926707 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.926756 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:58.926833 (+    77us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:58.926883 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.926976 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.927101 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:59.118435   447 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:59.072768  1837 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:59.070282  1819 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:12:59.074226  1892 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:59.124024   631 raft_consensus.cc:2955] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:12:59.130805   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 55190.3us
I20260709 13:12:59.063550  1920 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:59.131861  1172 raft_consensus.cc:2393] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:12:59.046155  1894 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:59.132344   597 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:59.118495  1800 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:59.072594  1905 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:59.120752  1906 raft_consensus.cc:697] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:12:59.136237   597 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:12:59.137611   447 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:59.128715   480 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.140836   597 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:12:59.129819  1837 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:59.133102  1819 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.041433  1887 consensus_queue.cc:260] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:59.146199   447 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:12:59.135098   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1297) took 1116 ms. Trace:
I20260709 13:12:59.129411  1814 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.148516  1837 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.149350  1812 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:59.138387  1920 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:59.148914  1851 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:12:59.159086  1805 consensus_meta.cc:287] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.915s	user 0.009s	sys 0.011s
I20260709 13:12:59.147488  1905 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:12:59.158854   630 raft_consensus.cc:1240] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:59.171638  1880 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:59.171861  1909 log.cc:927] Time spent T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:12:59.174811   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:59.163100  1920 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.149912  1915 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:59.182699  1913 consensus_queue.cc:1059] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:12:59.150398  1803 consensus_queue.cc:237] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.172683  1836 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:59.172571  1905 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.186892  1906 consensus_queue.cc:237] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.182372  1900 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:59.241146  1802 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:59.122892   477 rpcz_store.cc:276] 0709 13:12:56.983034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.482219 (+499185us) service_pool.cc:224] Handling call
0709 13:12:57.482665 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.482992 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:58.773363 (+1290371us) log.cc:844] Serialized 14 byte log entry
0709 13:12:59.024231 (+250868us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:59.028889 (+  4658us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:59.028956 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.029032 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.029192 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120484,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":22140,"thread_start_us":201108,"threads_started":2,"wal-append.queue_time_us":217139}
I20260709 13:12:59.169741  1805 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.181181  1880 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:59.265552   629 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
W20260709 13:12:59.274276  1912 log.cc:927] Time spent T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:12:59.151387   550 rpcz_store.cc:276] 0709 13:12:58.015342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.961598 (+946256us) service_pool.cc:224] Handling call
0709 13:12:58.995836 (+ 34238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.070733 (+ 74897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:59.073075 (+  2342us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:59.075500 (+  2425us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:59.116869 (+ 41369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.120979 (+  4110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.129564 (+  8585us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:59.185580  1878 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:59.226065   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1089) took 1890 ms. Trace:
I20260709 13:12:59.182425  1917 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:59.293319   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:59.265765   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:59.297169   632 raft_consensus.cc:1240] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:59.226302  1915 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:59.282711  1880 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.301541   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1213) took 1973 ms. Trace:
I20260709 13:12:59.308262  1813 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:59.308346  1915 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.310889   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:59.289513   630 rpcz_store.cc:276] 0709 13:12:57.303352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.126849 (+1823497us) service_pool.cc:224] Handling call
0709 13:12:59.149905 (+ 23056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.176242 (+ 26337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.190079 (+ 13837us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:59.294559   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1093) took 1964 ms. Trace:
I20260709 13:12:59.307440   554 rpcz_store.cc:276] 0709 13:12:57.323682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.691557 (+1367875us) service_pool.cc:224] Handling call
0709 13:12:58.736349 (+ 44792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.749089 (+ 12740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.749119 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:58.749164 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:58.749195 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.749248 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.296460 (+547212us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b5400105750. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:12:59.296601 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63004544}
I20260709 13:12:59.291966  1746 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:59.289659  1918 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:59.361874   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:59.366168   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:12:59.369416  1820 consensus_meta.cc:287] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.630s	user 0.005s	sys 0.004s
W20260709 13:12:59.350381   626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54754 (request call id 69) took 1833 ms (client timeout 2044 ms). Trace:
W20260709 13:12:59.385011   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.387933  1901 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:59.389235  1166 raft_consensus.cc:1240] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:59.391462  1901 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:12:59.379464   626 rpcz_store.cc:269] 0709 13:12:57.478656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.923805 (+445149us) service_pool.cc:224] Handling call
0709 13:12:59.311467 (+1387662us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b54001bb554. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:12:59.311593 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2080284416}
I20260709 13:12:59.354163   629 rpcz_store.cc:276] 0709 13:12:57.323704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.264950 (+1941246us) service_pool.cc:224] Handling call
0709 13:12:59.265327 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.287780 (+ 22453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.288000 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:59.308982   477 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:12:59.408262   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 53) took 2024 ms. Trace:
I20260709 13:12:59.408888   557 rpcz_store.cc:276] 0709 13:12:57.383551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.706144 (+1322593us) service_pool.cc:224] Handling call
0709 13:12:58.716315 (+ 10171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.755514 (+ 39199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.407993 (+652479us) spinlock_profiling.cc:243] Waited 9.82 ms on lock 0x7b5400346a50. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:12:59.408180 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22593920}
I20260709 13:12:59.410475   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:59.416504  1917 raft_consensus.cc:2749] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:59.419368  1847 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:59.419845  1847 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.422652  1894 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:59.423848  1825 raft_consensus.cc:3055] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:59.424216  1825 raft_consensus.cc:740] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:12:59.425141  1825 consensus_queue.cc:260] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.426425  1825 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.426368   475 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:12:59.415354  1905 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.428803   482 raft_consensus.cc:1240] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:59.429874  1905 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:59.432367   522 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:12:59.441437   522 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:12:59.436172   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 291990us
I20260709 13:12:59.377131  1814 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:12:59.430560  1826 consensus_meta.cc:287] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 1.413s	user 0.009s	sys 0.011s
I20260709 13:12:59.392356   551 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.397716  1883 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:59.455561   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 70) took 1771 ms. Trace:
W20260709 13:12:59.459718  1810 consensus_meta.cc:287] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 1.371s	user 0.011s	sys 0.021s
I20260709 13:12:59.444765  1862 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:59.454447  1822 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:59.464980   556 rpcz_store.cc:276] 0709 13:12:57.684181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.442433 (+1758252us) service_pool.cc:224] Handling call
0709 13:12:59.445400 (+  2967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.455126 (+  9726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:59.455165 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:59.455224 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:59.455283 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.455360 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.455500 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:59.471792   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:59.448212   522 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:12:59.459848  1811 consensus_meta.cc:287] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.143s	user 0.011s	sys 0.014s
I20260709 13:12:59.395076  1820 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:12:59.497524  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 377880us
I20260709 13:12:59.484375   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:59.475525  1805 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:12:59.465714  1749 consensus_meta.cc:287] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 1.530s	user 0.013s	sys 0.021s
I20260709 13:12:59.506698  1169 raft_consensus.cc:1240] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:59.509959  1847 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.473943  1862 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:59.513739  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:12:59.495954  1900 raft_consensus.cc:3055] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:12:59.522301   597 connection.cc:256] RPC call timeout handler was delayed by -1.874356429000045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
I20260709 13:12:59.465368  1826 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:59.532501   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:12:59.536098   597 connection.cc:256] RPC call timeout handler was delayed by -1.3033453619998454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17210000000000003s for a response
W20260709 13:12:59.536623   597 connection.cc:256] RPC call timeout handler was delayed by -1.2614985479999632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
I20260709 13:12:59.537338   597 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:12:59.539330   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.524667  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:12:59.475649  1810 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.540978  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:12:59.543583  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:12:59.503647   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:12:59.524569   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:59.546258  1138 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:12:59.532565  1822 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:59.530555  1862 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:59.535409  1859 consensus_meta.cc:287] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 1.346s	user 0.009s	sys 0.006s
I20260709 13:12:59.515681   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:12:59.540206  1828 consensus_meta.cc:287] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 1.350s	user 0.029s	sys 0.030s
I20260709 13:12:59.503314  1811 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.538426   629 raft_consensus.cc:1240] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:59.496366  1895 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.534477  1900 raft_consensus.cc:740] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:12:59.562074   448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.018s	sys 0.042s
I20260709 13:12:59.542277   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:12:59.583205   448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.018s	sys 0.042s
W20260709 13:12:59.547221  1857 consensus_meta.cc:287] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.435s	user 0.015s	sys 0.018s
W20260709 13:12:59.583601   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 554025us
I20260709 13:12:59.584033  1857 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.556823  1911 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:59.557816  1822 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:59.608538   626 raft_consensus.cc:1240] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:59.608399   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:59.566738  1167 raft_consensus.cc:1240] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:59.611565   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:59.614192   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:59.615634   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:59.591245   558 raft_consensus.cc:1240] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:59.620934  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:12:59.622901  1175 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.599977   628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1107) took 1522 ms. Trace:
I20260709 13:12:59.566191  1898 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:12:59.565685  1859 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.609414  1822 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.664284   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:59.675639   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:59.624125   365 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9ade492740624caba667436aa666025c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:59.566227  1828 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:59.680307   555 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:59.681485  1811 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:59.617559   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 65) took 2130 ms. Trace:
I20260709 13:12:59.689736   481 raft_consensus.cc:2393] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:12:59.665360   628 rpcz_store.cc:276] 0709 13:12:58.083214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.681386 (+598172us) service_pool.cc:224] Handling call
0709 13:12:59.495435 (+814049us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b5800167198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4eee 0000000000375939 00007f4b6d3681e0 00007f4b6d4310c4 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:12:59.593335 (+ 97900us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6660480}
I20260709 13:12:59.692478   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:59.666769  1898 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:59.694434   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:59.671407   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:59.672401  1895 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:59.700858   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:59.702208   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:59.709975   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:12:59.692636   365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 151245us
I20260709 13:12:59.721298  1915 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:59.722505  1897 consensus_meta.cc:287] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.952s	user 0.010s	sys 0.015s
I20260709 13:12:59.722951  1826 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:12:59.733440  1657 consensus_meta.cc:287] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.276s	user 0.015s	sys 0.006s
I20260709 13:12:59.733839  1657 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:59.711619  1846 consensus_meta.cc:287] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.079s	user 0.008s	sys 0.004s
W20260709 13:12:59.734652  1812 consensus_meta.cc:287] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.572s	user 0.004s	sys 0.006s
I20260709 13:12:59.738863  1657 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:59.757089   624 raft_consensus.cc:2393] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:12:59.717559  1904 consensus_meta.cc:287] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.720s	user 0.004s	sys 0.016s
I20260709 13:12:59.685880   629 rpcz_store.cc:276] 0709 13:12:57.477654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.440093 (+1962439us) service_pool.cc:224] Handling call
0709 13:12:59.503985 (+ 63892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.563708 (+ 59723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.605342 (+ 41634us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:59.722918  1897 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.760389   478 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:59.763788   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:59.765407   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:59.689260  1900 consensus_queue.cc:260] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.729708  1847 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:59.775529  1749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:38120 (request call id 76) took 6850 ms. Trace:
W20260709 13:12:59.762282  1837 consensus_meta.cc:287] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.599s	user 0.004s	sys 0.006s
I20260709 13:12:59.763844   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:59.714956  1820 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:12:59.753968  1848 consensus_meta.cc:287] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.726s	user 0.028s	sys 0.013s
I20260709 13:12:59.713994   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:59.782337   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:59.762640  1810 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:59.785944   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:59.786616   479 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.787742   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:12:59.773881  1812 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:59.794085  1167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 220) took 2744 ms. Trace:
W20260709 13:12:59.795791  1920 consensus_meta.cc:287] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.552s	user 0.005s	sys 0.005s
I20260709 13:12:59.797413   551 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
W20260709 13:12:59.798025  1823 consensus_meta.cc:287] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.681s	user 0.019s	sys 0.010s
I20260709 13:12:59.784183  1837 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.767398  1846 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.821602   627 raft_consensus.cc:1240] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:59.822295   625 raft_consensus.cc:2393] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:12:59.822839  1837 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:12:59.799356  1816 consensus_meta.cc:287] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.846s	user 0.009s	sys 0.001s
I20260709 13:12:59.775955  1749 rpcz_store.cc:276] 0709 13:12:52.925249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.925417 (+   168us) service_pool.cc:224] Handling call
0709 13:12:52.929982 (+  4565us) log.cc:844] Serialized 501 byte log entry
0709 13:12:53.056941 (+126959us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b2c000014c8. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b66d12a11 00007f4b66d21a0a 00007f4b66d21693 00007f4b66d21631 00007f4b68455b52 00007f4b68455cf5 00007f4b68392691 00007f4b68372eaa 00007f4b68379d53 00007f4b68379cd9 00007f4b68379c69
0709 13:12:59.775415 (+6718474us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11127,"raft.queue_time_us":5041,"raft.run_cpu_time_us":5019,"raft.run_wall_time_us":216280,"spinlock_wait_cycles":5494144,"thread_start_us":213426,"threads_started":1}
I20260709 13:12:59.783746  1826 consensus_queue.cc:1059] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:12:59.808836   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.803661  1857 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:59.820856   477 raft_consensus.cc:2393] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:12:59.761477  1897 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:59.811419   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:12:59.811650  1929 log.cc:927] Time spent T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:12:59.814229   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:12:59.820538  1175 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
W20260709 13:12:59.836156   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 234677us
W20260709 13:12:59.828320  1903 consensus_meta.cc:287] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.797s	user 0.016s	sys 0.000s
I20260709 13:12:59.785596  1848 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.813495  1900 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.819808   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:12:59.811129  1920 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.767131  1904 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:12:59.841658   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.841820  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:12:59.845245   597 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:12:59.840133  1893 consensus_meta.cc:287] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 1.149s	user 0.006s	sys 0.007s
I20260709 13:12:59.851344  1175 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 2: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:12:59.853554  1857 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:59.850577  1846 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:59.854133  1838 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:59.841243  1859 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:59.854607  1904 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:12:59.825809  1823 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:59.828227  1816 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:59.860812   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:59.861586   483 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:12:59.863063   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:59.866816  1816 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:59.809162  1167 rpcz_store.cc:276] 0709 13:12:57.049275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.693854 (+644579us) service_pool.cc:224] Handling call
0709 13:12:57.694144 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.622066 (+1927922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.793854 (+171788us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b54004583d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:12:59.794030 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4277283584}
I20260709 13:12:59.861186   476 raft_consensus.cc:1240] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:59.872743   630 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:59.873453   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1257) took 2360 ms. Trace:
I20260709 13:12:59.873773   630 rpcz_store.cc:276] 0709 13:12:57.513294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.872183 (+2358889us) service_pool.cc:224] Handling call
0709 13:12:59.872554 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.873170 (+   616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.873363 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:59.874549   629 raft_consensus.cc:1240] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:59.884833   479 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:12:59.847206  1903 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:59.855808  1893 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:12:59.878667   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1255) took 2366 ms. Trace:
I20260709 13:12:59.893124   629 rpcz_store.cc:276] 0709 13:12:57.512747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.775007 (+2262260us) service_pool.cc:224] Handling call
0709 13:12:59.874223 (+ 99216us) spinlock_profiling.cc:243] Waited 9.98 ms on lock 0x7b5800167198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4eee 0000000000375939 00007f4b6d3681e0 00007f4b6d4310c4 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:12:59.874371 (+   148us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.874936 (+   565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.878584 (+  3648us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22953728}
I20260709 13:12:59.894590   629 raft_consensus.cc:1240] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:59.866992  1657 consensus_queue.cc:1059] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:12:59.901577   484 raft_consensus.cc:2393] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
W20260709 13:12:59.902148  1139 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.017s	sys 0.024s
W20260709 13:12:59.902469  1139 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.017s	sys 0.024s
I20260709 13:12:59.903106   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1253) took 2665 ms. Trace:
I20260709 13:12:59.895195   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1106) took 1824 ms. Trace:
W20260709 13:12:59.904664  1876 consensus_meta.cc:287] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.823s	user 0.015s	sys 0.003s
I20260709 13:12:59.912834  1895 consensus_queue.cc:1059] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:12:59.920593  1825 consensus_queue.cc:1059] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:12:59.939078  1171 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
W20260709 13:12:59.923559  1891 consensus_meta.cc:287] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.960s	user 0.006s	sys 0.024s
I20260709 13:12:59.903731   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1310) took 1879 ms. Trace:
I20260709 13:12:59.940595  1657 raft_consensus.cc:3055] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:12:59.896697  1819 consensus_meta.cc:287] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.744s	user 0.011s	sys 0.000s
W20260709 13:12:59.932456   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 324879us
I20260709 13:12:59.898171  1830 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:59.906004   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:12:59.892220  1828 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:12:59.951050   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 50041.2us
I20260709 13:12:59.892318   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:00.035812   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1251) took 2912 ms. Trace:
W20260709 13:12:59.900226  1902 consensus_meta.cc:287] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.766s	user 0.008s	sys 0.003s
W20260709 13:12:59.954332  1172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 269) took 2608 ms (client timeout 2136 ms). Trace:
I20260709 13:12:59.953226   631 rpcz_store.cc:276] 0709 13:12:57.237655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.051115 (+1813460us) service_pool.cc:224] Handling call
0709 13:12:59.072870 (+ 21755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.088259 (+ 15389us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:12:59.473150 (+384891us) log.cc:844] Serialized 14 byte log entry
0709 13:12:59.896532 (+423382us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:59.896584 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:59.896623 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.902876 (+  6253us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.903034 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38608,"raft.queue_time_us":2066,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5808,"thread_start_us":353254,"threads_started":1,"wal-append.queue_time_us":433839}
W20260709 13:13:00.046993  1172 rpcz_store.cc:269] 0709 13:12:57.330886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.681244 (+350358us) service_pool.cc:224] Handling call
0709 13:12:57.851108 (+169864us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:12:59.938633 (+2087525us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400600254. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:12:59.938790 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2936760320}
W20260709 13:12:59.954905   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 506744us
I20260709 13:12:59.958084   559 rpcz_store.cc:276] 0709 13:12:58.024716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.986651 (+961935us) service_pool.cc:224] Handling call
0709 13:12:58.986893 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.987098 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:59.496323 (+509225us) log.cc:844] Serialized 14 byte log entry
0709 13:12:59.890571 (+394248us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:59.891750 (+  1179us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:59.891807 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.891884 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.903659 (+ 11775us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5775,"thread_start_us":351230,"threads_started":1,"wal-append.queue_time_us":418116}
I20260709 13:12:59.912617  1816 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 13:12:59.955080  1829 consensus_meta.cc:287] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.901s	user 0.009s	sys 0.011s
I20260709 13:13:00.053274   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:12:59.950418  1920 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:00.012818   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1097) took 2688 ms. Trace:
I20260709 13:12:59.979897   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:00.019623   632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1087) took 2908 ms. Trace:
I20260709 13:13:00.058049   632 rpcz_store.cc:276] 0709 13:12:57.110875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.934594 (+1823719us) service_pool.cc:224] Handling call
0709 13:12:58.938283 (+  3689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.298509 (+360226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.976157 (+677648us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54001ad6d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:00.019501 (+ 43344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":824800640}
I20260709 13:13:00.020578   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1224) took 1242 ms. Trace:
I20260709 13:12:59.956530  1848 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:12:59.980206  1823 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:12:59.974365  1887 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.035123  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:12:59.962913  1891 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:12:59.954974   629 rpcz_store.cc:276] 0709 13:12:58.070380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.894090 (+1823710us) service_pool.cc:224] Handling call
0709 13:12:59.894412 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.894941 (+   529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.895145 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:59.959920  1657 raft_consensus.cc:740] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:00.021476  1933 log.cc:927] Time spent T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.071s	user 0.000s	sys 0.004s
I20260709 13:13:00.054587   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:00.056607   626 rpcz_store.cc:276] 0709 13:12:57.324762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.397964 (+2073202us) service_pool.cc:224] Handling call
0709 13:12:59.456384 (+ 58420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.611400 (+155016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.975888 (+364488us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54001ae5d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:00.012751 (+ 36863us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349476224}
I20260709 13:13:00.062649   631 raft_consensus.cc:1240] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:00.075773   479 raft_consensus.cc:1813] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Handling vote request from an unknown peer 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:00.076689   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1108) took 1992 ms. Trace:
I20260709 13:13:00.077194   479 raft_consensus.cc:2410] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:13:00.013502  1819 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:00.077193   631 rpcz_store.cc:276] 0709 13:12:58.083913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.047583 (+1963670us) service_pool.cc:224] Handling call
0709 13:13:00.062423 (+ 14840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:00.076371 (+ 13948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.076625 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:00.037290   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:00.036463   627 rpcz_store.cc:276] 0709 13:12:57.127641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.939970 (+1812329us) service_pool.cc:224] Handling call
0709 13:12:59.294022 (+354052us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b5800167198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4eee 0000000000375939 00007f4b6d3681e0 00007f4b6d4310c4 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:12:59.307986 (+ 13964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.822022 (+514036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.035535 (+213513us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54001e3f54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:00.035747 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1181678848}
I20260709 13:13:00.046226  1141 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:00.109432  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 63288us
I20260709 13:12:59.958571  1876 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:00.050626  1826 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:00.115443   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:00.070755   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1252) took 2833 ms. Trace:
I20260709 13:13:00.063964   448 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:00.059319   484 rpcz_store.cc:276] 0709 13:12:58.771442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.771629 (+   187us) service_pool.cc:224] Handling call
0709 13:12:59.976761 (+1205132us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b54002dda54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:00.013688 (+ 36927us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2269082880}
I20260709 13:13:00.060063  1805 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:00.055200  1902 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:00.075038  1167 raft_consensus.cc:1240] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: [1.4-1.4]
I20260709 13:13:00.069064  1893 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:00.069710  1903 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:00.062269  1895 raft_consensus.cc:3055] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:00.092023   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:00.057881  1829 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:00.147224   478 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:13:00.137470   632 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:00.143711   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:00.145668  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:00.115477  1828 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:13:00.119387  1855 consensus_meta.cc:287] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 1.397s	user 0.013s	sys 0.002s
I20260709 13:13:00.092025  1823 consensus_queue.cc:1059] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:13:00.119071  1168 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:00.138842  1822 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:00.169591   625 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1110) took 2085 ms (client timeout 1830 ms). Trace:
W20260709 13:13:00.171680  1935 log.cc:927] Time spent T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:13:00.174451   627 raft_consensus.cc:1240] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:00.174746   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:00.274928   525 leader_election.cc:336] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.526s (SENT)
I20260709 13:13:00.196800  1171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 234) took 2027 ms. Trace:
I20260709 13:13:00.452023   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:00.452726   559 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.452308  1171 rpcz_store.cc:276] 0709 13:12:58.169479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.270064 (+100585us) service_pool.cc:224] Handling call
0709 13:12:59.938888 (+1668824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.957453 (+ 18565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.196547 (+239094us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400600250. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:00.196727 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3795973376}
I20260709 13:13:00.268496   553 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
W20260709 13:13:00.346560   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 296847us
I20260709 13:13:00.177368  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:00.181006   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:00.195871   481 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1221) took 1437 ms (client timeout 1593 ms). Trace:
I20260709 13:13:00.181155   597 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:13:00.183586  1880 consensus_meta.cc:287] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.808s	user 0.015s	sys 0.000s
I20260709 13:13:00.439291   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:00.152586   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:00.417868   447 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:41384 dropped due to backpressure: service queue is full with 50 items
I20260709 13:13:00.171617   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:00.281483   625 rpcz_store.cc:269] 0709 13:12:58.091439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.278697 (+187258us) service_pool.cc:224] Handling call
0709 13:13:00.169396 (+1890699us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54000be5d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:00.169522 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3500128512}
I20260709 13:13:00.164790  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:00.172588   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:00.144889   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 81072.1us
I20260709 13:13:00.501681   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1232) took 1030 ms. Trace:
I20260709 13:13:00.509140   448 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:00.172609  1819 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:00.179301   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:00.496958   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:00.166980  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:00.148866   632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1117) took 2029 ms. Trace:
I20260709 13:13:00.510532   479 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:00.192112  1915 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:00.147500  1920 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:00.169127   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1285) took 2573 ms. Trace:
I20260709 13:13:00.149224  1895 raft_consensus.cc:740] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:00.449519  1891 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:00.172134  1936 log.cc:927] Time spent T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:13:00.191998  1862 consensus_meta.cc:287] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.000s
I20260709 13:13:00.486543   484 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:00.486706   626 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:00.455123   478 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:00.452154   525 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:00.179443  1657 consensus_queue.cc:260] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:00.166567   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:00.487769  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:00.487515  1825 consensus_queue.cc:1059] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:00.191371   475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1219) took 1435 ms (client timeout 1616 ms). Trace:
W20260709 13:13:00.172252  1941 log.cc:927] Time spent T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:13:00.502017  1173 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:00.172641   628 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:00.461992   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 280903us
I20260709 13:13:00.149415  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:13:00.182117   480 consensus_meta.cc:287] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 1.032s	user 0.011s	sys 0.003s
I20260709 13:13:00.537564   476 raft_consensus.cc:2393] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:00.547439   480 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:13:00.547665   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1234) took 1095 ms. Trace:
W20260709 13:13:00.547988   480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 109) took 1585 ms (client timeout 2007 ms). Trace:
I20260709 13:13:00.537739   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:00.548525  1919 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:00.548408   480 rpcz_store.cc:269] 0709 13:12:58.962847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.983408 (+ 20561us) service_pool.cc:224] Handling call
0709 13:13:00.547928 (+1564520us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:00.510834   632 rpcz_store.cc:276] 0709 13:12:58.119744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.078291 (+1958547us) service_pool.cc:224] Handling call
0709 13:13:00.137294 (+ 59003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:00.148620 (+ 11326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.148810 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:00.548141   476 rpcz_store.cc:276] 0709 13:12:59.452156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.166292 (+714136us) service_pool.cc:224] Handling call
0709 13:13:00.547604 (+381312us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:00.551424  1171 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:00.200001  1820 raft_consensus.cc:3055] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:00.511852   448 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:00.460338   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 104351us
I20260709 13:13:00.175401  1898 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:00.539177   475 rpcz_store.cc:269] 0709 13:12:58.755983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.761189 (+  5206us) service_pool.cc:224] Handling call
0709 13:12:59.293160 (+531971us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:00.191128 (+897968us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b540022e054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:00.191300 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308158720}
I20260709 13:13:00.512850   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:00.516849   558 rpcz_store.cc:276] 0709 13:12:57.595307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.936645 (+1341338us) service_pool.cc:224] Handling call
0709 13:12:58.938296 (+  1651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.624937 (+686641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.168883 (+543946us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b54001513d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:00.169067 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1486783360}
I20260709 13:13:00.509259   553 rpcz_store.cc:276] 0709 13:12:59.471159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.471580 (+   421us) service_pool.cc:224] Handling call
0709 13:13:00.501446 (+1029866us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b5400387054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:00.501609 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1765194112}
I20260709 13:13:00.557605   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:00.557696   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:00.557917  1938 raft_consensus.cc:3055] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:00.558279  1898 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:00.558552  1938 raft_consensus.cc:740] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:00.558730   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:00.559335   553 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:00.560746  1825 raft_consensus.cc:3055] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:00.561285  1825 raft_consensus.cc:740] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:00.561578  1173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 235) took 1206 ms. Trace:
I20260709 13:13:00.561990  1173 rpcz_store.cc:276] 0709 13:12:59.355635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.356955 (+  1320us) service_pool.cc:224] Handling call
0709 13:12:59.357271 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:00.541239 (+1183968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.561351 (+ 20112us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400652f54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:00.561525 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2632093440}
I20260709 13:13:00.563680   380 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41332 (request call id 153) took 7288 ms. Trace:
I20260709 13:13:00.564939  1895 consensus_queue.cc:260] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:00.520095  1943 consensus_queue.cc:1059] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:13:00.542547  1169 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:00.515348  1900 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:00.516323   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:00.488279   631 raft_consensus.cc:1240] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:00.517704   624 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1104) took 2447 ms (client timeout 2111 ms). Trace:
I20260709 13:13:00.582031  1900 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:00.582418   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1121) took 1961 ms. Trace:
I20260709 13:13:00.520771   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:00.174503  1876 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:00.583014   631 rpcz_store.cc:276] 0709 13:12:58.620988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.438762 (+1817774us) service_pool.cc:224] Handling call
0709 13:13:00.487120 (+ 48358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:00.582199 (+ 95079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.582370 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:00.583346   554 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.461268   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:00.584167   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:00.457050   449 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:38132 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1231)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1236)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1138)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 118)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1140)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1161)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1170)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1163)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1174)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1167)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1227)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1228)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1229)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1235)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1127)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1130)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1143)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1155)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 116)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 117)
I20260709 13:13:00.585223   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:00.582450  1900 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.536377   556 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:00.588253   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:00.588936   556 raft_consensus.cc:2393] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 2: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:00.589604   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:00.338191  1166 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:00.590508  1911 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.590934  1911 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:00.489950  1942 log.cc:927] Time spent T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.347s	user 0.011s	sys 0.008s
I20260709 13:13:00.586720   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:00.520263   630 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:00.515511  1819 consensus_queue.cc:1059] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:13:00.489846  1944 consensus_queue.cc:1059] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:13:00.527685  1823 consensus_queue.cc:1059] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:13:00.540395  1805 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:00.595947  1805 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:00.595206  1944 raft_consensus.cc:3055] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:00.516923  1920 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:00.596385  1944 raft_consensus.cc:740] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:00.596545  1920 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.597693   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1263) took 3082 ms. Trace:
I20260709 13:13:00.598075   630 rpcz_store.cc:276] 0709 13:12:57.514964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.874537 (+2359573us) service_pool.cc:224] Handling call
0709 13:13:00.518395 (+643858us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:00.593386 (+ 74991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.597496 (+  4110us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b54001aefd0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:00.597638 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1478190976}
W20260709 13:13:00.544835   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 269954us
I20260709 13:13:00.543366  1175 raft_consensus.cc:1240] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:00.444361  1855 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:00.551708   597 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:00.602860  1948 raft_consensus.cc:3055] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:00.525966   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1118) took 2290 ms. Trace:
I20260709 13:13:00.549341   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:00.600219   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.603613   550 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:00.603832  1166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 379) took 1088 ms. Trace:
I20260709 13:13:00.604213  1166 rpcz_store.cc:276] 0709 13:12:59.516034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.524382 (+  8348us) service_pool.cc:224] Handling call
0709 13:13:00.603664 (+1079282us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b540067cd54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:00.603778 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1641482496}
W20260709 13:13:00.604787   525 leader_election.cc:336] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.504s (SENT)
W20260709 13:13:00.605120   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 101121us
I20260709 13:13:00.605232   525 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:00.599366   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:00.605990   630 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:00.606276   525 leader_election.cc:336] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.592s (SENT)
I20260709 13:13:00.603391   627 rpcz_store.cc:276] 0709 13:12:58.223586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.146261 (+1922675us) service_pool.cc:224] Handling call
0709 13:13:00.174239 (+ 27978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:00.445242 (+271003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.514310 (+ 69068us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:00.541072   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:00.556792   557 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:00.608671  1951 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:00.135637  1826 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:00.619408  1826 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:00.619086  1920 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:00.619078   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:00.622803   476 raft_consensus.cc:2393] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:00.623328   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1236) took 1064 ms. Trace:
I20260709 13:13:00.622660  1172 raft_consensus.cc:2955] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:00.623677   476 rpcz_store.cc:276] 0709 13:12:59.561424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.618767 (+1057343us) service_pool.cc:224] Handling call
0709 13:13:00.623264 (+  4497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:00.624853   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:00.564008   380 rpcz_store.cc:276] 0709 13:12:53.275002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.333824 (+ 58822us) service_pool.cc:224] Handling call
0709 13:13:00.563610 (+7229786us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:58.389619 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:58.640796 (+251177us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:58.640859 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:12:58.640897 (+    38us) tablet.cc:662] Decoding operations
0709 13:12:58.689660 (+ 48763us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:58.704436 (+ 14776us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:58.709457 (+  5021us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:58.783904 (+ 74447us) tablet.cc:701] Row locks acquired
0709 13:12:58.898204 (+114300us) write_op.cc:260] PREPARE: finished
0709 13:12:58.932306 (+ 34102us) write_op.cc:270] Start()
0709 13:12:58.956567 (+ 24261us) write_op.cc:276] Timestamp: P: 1783602778911147 usec, L: 0
0709 13:12:58.982029 (+ 25462us) op_driver.cc:348] REPLICATION: starting
0709 13:12:59.134802 (+152773us) log.cc:844] Serialized 536 byte log entry
0709 13:13:00.083352 (+948550us) op_driver.cc:464] REPLICATION: finished
0709 13:13:00.161273 (+ 77921us) write_op.cc:301] APPLY: starting
0709 13:13:00.161377 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:00.161507 (+   130us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:00.164718 (+  3211us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:00.165056 (+   338us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:00.165291 (+   235us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:13:00.165353 (+    62us) write_op.cc:312] APPLY: finished
0709 13:13:00.165628 (+   275us) log.cc:844] Serialized 23 byte log entry
0709 13:13:00.175933 (+ 10305us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:00.176050 (+   117us) write_op.cc:454] Released schema lock
0709 13:13:00.176128 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:00.431489 (+255361us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:00.431548 (+    59us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10615,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":77609,"apply.run_cpu_time_us":7076,"apply.run_wall_time_us":270167,"num_ops":1,"prepare.queue_time_us":341467,"prepare.run_cpu_time_us":66198,"prepare.run_wall_time_us":1035436,"raft.queue_time_us":283822,"raft.run_cpu_time_us":8466,"raft.run_wall_time_us":331383,"replication_time_us":1073413,"thread_start_us":770406,"threads_started":4,"wal-append.queue_time_us":475392}]]}
I20260709 13:13:00.571641   379 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46024 (request call id 248) took 1811 ms. Trace:
I20260709 13:13:00.616559  1951 consensus_queue.cc:1059] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:00.960554   379 rpcz_store.cc:276] 0709 13:12:58.782046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.883428 (+101382us) service_pool.cc:224] Handling call
0709 13:13:00.571562 (+1688134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":383416,"reported_tablets":3}
I20260709 13:13:00.961198  1951 raft_consensus.cc:3055] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:00.961607  1951 raft_consensus.cc:740] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:13:00.566939   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 55164.7us
I20260709 13:13:00.965942   448 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:00.966745  1919 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:00.967164  1919 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:00.586172   449 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:38132 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1231)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1236)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1138)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 118)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1140)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1161)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1170)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1163)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1174)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1239)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1227)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1228)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1229)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1235)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1127)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1130)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1143)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1155)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 116)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 117)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1240)
I20260709 13:13:00.613222   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:00.971529   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1131) took 1213 ms. Trace:
I20260709 13:13:00.971907   480 rpcz_store.cc:276] 0709 13:12:59.758490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.612964 (+854474us) service_pool.cc:224] Handling call
0709 13:13:00.971465 (+358501us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:00.972841   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:00.973634   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1140) took 1175 ms. Trace:
I20260709 13:13:00.962560  1951 consensus_queue.cc:260] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:00.974037   480 rpcz_store.cc:276] 0709 13:12:59.798171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.972574 (+1174403us) service_pool.cc:224] Handling call
0709 13:13:00.973553 (+   979us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:00.455572   481 rpcz_store.cc:269] 0709 13:12:58.758876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.759400 (+   524us) service_pool.cc:224] Handling call
0709 13:13:00.195596 (+1436196us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b54002dd054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:00.195793 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1759061760}
I20260709 13:13:00.655467   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:00.649767   476 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:00.673647   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:00.660066   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 170068us
W20260709 13:13:00.607088   525 leader_election.cc:336] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.619s (SENT)
I20260709 13:13:01.014648  1819 consensus_queue.cc:1059] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:01.015074   525 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:00.586433   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:00.536690   559 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:00.575048   553 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:01.020190   559 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:00.610845   554 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:01.023520  1819 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:01.024863   554 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:01.024549  1819 consensus_queue.cc:1059] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:01.025456  1955 raft_consensus.cc:3055] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.025833  1955 raft_consensus.cc:740] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:01.026029   554 raft_consensus.cc:3055] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.026394   554 raft_consensus.cc:740] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:01.027216   559 raft_consensus.cc:3055] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:01.027984   559 raft_consensus.cc:740] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:00.592749   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:01.029142   559 consensus_queue.cc:260] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.029984   555 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.030284   559 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:00.649289   557 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
W20260709 13:13:00.610302   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 58694us
I20260709 13:13:00.577442   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1120) took 1956 ms. Trace:
I20260709 13:13:01.038442   626 rpcz_store.cc:276] 0709 13:12:58.620722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.182950 (+1562228us) service_pool.cc:224] Handling call
0709 13:13:00.183362 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:00.528450 (+345088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.577255 (+ 48805us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b54001612d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:00.577400 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":656451968}
I20260709 13:13:01.026654  1955 consensus_queue.cc:260] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:00.607395   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:01.043257   627 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.564415   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:01.048561   555 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:01.048884   629 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:01.027115   554 consensus_queue.cc:260] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.049708   554 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.572816   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:00.118927   633 rpcz_store.cc:276] 0709 13:12:57.237228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.960855 (+1723627us) service_pool.cc:224] Handling call
0709 13:12:59.041900 (+ 81045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.072813 (+ 30913us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:59.585501 (+512688us) log.cc:844] Serialized 14 byte log entry
0709 13:12:59.965745 (+380244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:00.019822 (+ 54077us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:00.052192 (+ 32370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.055392 (+  3200us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:00.068536 (+ 13144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1784,"prepare.queue_time_us":463181,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":6971,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":25665,"thread_start_us":749286,"threads_started":2,"wal-append.queue_time_us":463359}
I20260709 13:13:01.066452   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:01.066661   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:00.582240   624 rpcz_store.cc:269] 0709 13:12:58.069840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.643985 (+574145us) service_pool.cc:224] Handling call
0709 13:12:58.963853 (+319868us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5800167198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:12:59.310754 (+346901us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b5800167198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4e9c 00007f4b652f4a5b 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:00.517458 (+1206704us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54001aefd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:00.517641 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1046929408}
I20260709 13:13:00.514606   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:00.579634   628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1254) took 3067 ms. Trace:
I20260709 13:13:01.081272   628 rpcz_store.cc:276] 0709 13:12:57.512436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.722307 (+2209871us) service_pool.cc:224] Handling call
0709 13:13:00.172445 (+450138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:00.542265 (+369820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.579439 (+ 37174us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54000be5d0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:00.579579 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034398592}
I20260709 13:13:01.082712   628 raft_consensus.cc:1240] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:00.667531   630 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:01.084794  1956 raft_consensus.cc:3055] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:00.602981  1174 raft_consensus.cc:1240] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:00.572870  1657 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.660754  1805 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:00.566460  1820 raft_consensus.cc:740] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:01.097251  1820 consensus_queue.cc:260] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:00.579507  1822 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:00.562369  1825 consensus_queue.cc:260] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.102330  1825 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.575114  1829 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:00.519454  1828 raft_consensus.cc:697] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:01.111085  1828 consensus_queue.cc:237] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:00.489509  1846 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:01.114630  1829 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:01.115033  1846 raft_consensus.cc:697] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:01.115201  1829 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:01.116255  1846 consensus_queue.cc:237] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:01.117934  1829 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:00.650290  1855 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:01.120343  1855 consensus_queue.cc:1059] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:00.533198  1862 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.124279  1862 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:00.488551  1880 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:00.573290  1887 raft_consensus.cc:3055] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.128376  1887 raft_consensus.cc:740] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:01.129477  1887 consensus_queue.cc:260] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:00.567812  1895 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.661418  1900 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:01.135673   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.137579  1900 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:00.567761  1908 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:01.139097  1908 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:01.139631  1908 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.143651   482 raft_consensus.cc:2393] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:01.146343   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1139) took 1348 ms. Trace:
I20260709 13:13:00.595516  1911 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:00.612084  1915 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.149801   558 raft_consensus.cc:2393] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 2: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:00.600404  1938 consensus_queue.cc:260] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:00.580974  1943 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:00.597302  1944 consensus_queue.cc:260] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.154778   632 raft_consensus.cc:2393] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:01.155550  1944 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.617270  1948 raft_consensus.cc:740] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:01.157696  1880 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:01.157699  1948 consensus_queue.cc:260] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:00.509485   447 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:41384 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1140)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1161)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1170)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1163)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1174)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 120)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1227)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1228)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1229)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1235)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1127)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1130)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1143)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1155)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 116)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 117)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1240)
W20260709 13:13:00.948272   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:01.162022   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.967648  1919 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.974964  1951 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.975270   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:00.976186   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:00.977681  1838 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:01.163805   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1136) took 1366 ms. Trace:
I20260709 13:13:01.164206   479 rpcz_store.cc:276] 0709 13:12:59.797093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.974971 (+1177878us) service_pool.cc:224] Handling call
0709 13:13:01.163742 (+188771us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.164109  1838 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:01.166329  1838 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:00.978405   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.167279   478 raft_consensus.cc:2410] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:13:00.987478   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.170217   556 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.978175   449 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:38132 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1161)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1170)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1163)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1174)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1248)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 120)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1245)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1246)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 121)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1247)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1243)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1227)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1228)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1229)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1235)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1127)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1130)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1143)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1155)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 116)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 117)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1240)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1242)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1244)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1249)
I20260709 13:13:01.004734   380 catalog_manager.cc:5697] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index 4 to 5, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New cstate: current_term: 2 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:01.006518   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.006850   477 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:13:01.009176   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1138) took 1211 ms. Trace:
I20260709 13:13:01.173691   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1145) took 1353 ms. Trace:
I20260709 13:13:01.173636   476 rpcz_store.cc:276] 0709 13:12:59.797573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.624594 (+827021us) service_pool.cc:224] Handling call
0709 13:13:01.009115 (+384521us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.174139   477 rpcz_store.cc:276] 0709 13:12:59.820026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.650037 (+830011us) service_pool.cc:224] Handling call
0709 13:13:01.173634 (+523597us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.009362   483 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:01.010700   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.012162   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:01.014047  1949 consensus_queue.cc:1059] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.657135   550 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:01.015471  1954 consensus_queue.cc:1059] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:01.037070   597 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:01.036918  1848 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:01.041412  1955 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.042414  1826 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:01.062125   559 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:13:01.175134   483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1231) took 1759 ms (client timeout 2242 ms). Trace:
I20260709 13:13:01.177531  1887 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:01.180395   483 rpcz_store.cc:269] 0709 13:12:59.415932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.673365 (+1257433us) service_pool.cc:224] Handling call
0709 13:13:01.175082 (+501717us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.180855   484 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:01.181282   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 118) took 1164 ms. Trace:
I20260709 13:13:01.181706  1954 raft_consensus.cc:3055] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.181602   484 rpcz_store.cc:276] 0709 13:13:00.016928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.011921 (+994993us) service_pool.cc:224] Handling call
0709 13:13:01.181224 (+169303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.182257  1954 raft_consensus.cc:740] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:01.146750   482 rpcz_store.cc:276] 0709 13:12:59.797846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.586478 (+788632us) service_pool.cc:224] Handling call
0709 13:13:01.146072 (+559594us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54000d70d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:01.146264 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1265264000}
W20260709 13:13:01.183965   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 146961us
I20260709 13:13:01.063701   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:01.185226   626 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:01.185461   597 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:01.077631   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 470521us
I20260709 13:13:01.080437   629 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:01.186254  1814 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.186555   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:01.186307  1826 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:01.186969   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1123) took 2560 ms. Trace:
I20260709 13:13:01.187393   629 rpcz_store.cc:276] 0709 13:12:58.626835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.079894 (+2453059us) service_pool.cc:224] Handling call
0709 13:13:01.080244 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.186697 (+106453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.186914 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.187701  1949 raft_consensus.cc:3055] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.080655   625 raft_consensus.cc:2393] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:01.163755   480 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:01.189052   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1151) took 1334 ms. Trace:
I20260709 13:13:01.189149  1915 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.189404   480 rpcz_store.cc:276] 0709 13:12:59.856785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.974820 (+1118035us) service_pool.cc:224] Handling call
0709 13:13:01.188994 (+214174us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:00.671976  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 216986us
I20260709 13:13:00.576185  1168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 236) took 1220 ms. Trace:
I20260709 13:13:00.967075   448 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:01.199851   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 232834us
I20260709 13:13:00.623867  1920 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:01.196516  1919 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.201700  1920 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:01.202062  1920 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:01.202497  1920 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:01.183148  1954 consensus_queue.cc:260] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.077009   633 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:01.203317  1954 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.203778   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1122) took 2577 ms. Trace:
I20260709 13:13:01.158892  1948 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.204191   633 rpcz_store.cc:276] 0709 13:12:58.626502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.072812 (+2446310us) service_pool.cc:224] Handling call
0709 13:13:01.074341 (+  1529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.203473 (+129132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.203724 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.160696   447 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:38134 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1161)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1170)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1163)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1174)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1248)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 120)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1245)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1246)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 121)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1247)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1243)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1227)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1228)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1229)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1235)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1127)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1130)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1143)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1155)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 116)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 117)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1240)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1242)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1244)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1249)
I20260709 13:13:01.188591  1826 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:01.081808   624 raft_consensus.cc:1240] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:01.219833   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 76) took 1442 ms. Trace:
I20260709 13:13:01.220155   624 rpcz_store.cc:276] 0709 13:12:59.777205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.081361 (+1304156us) service_pool.cc:224] Handling call
0709 13:13:01.081644 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.219596 (+137952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.219781 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.223294   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.223918   481 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:01.219347   447 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:38134 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1163)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1174)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1248)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 120)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1252)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1245)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1246)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 121)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1247)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1243)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1180)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1253)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1227)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1228)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1229)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1235)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1127)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1130)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1143)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1155)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 116)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 117)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1240)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1242)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1244)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1249)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1251)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1254)
I20260709 13:13:01.226967   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.227962   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.228463   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.228626   477 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:01.229142   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1133) took 1433 ms. Trace:
I20260709 13:13:01.229491   477 rpcz_store.cc:276] 0709 13:12:59.796188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.215478 (+1419290us) service_pool.cc:224] Handling call
0709 13:13:01.227824 (+ 12346us) spinlock_profiling.cc:243] Waited 8.87 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:01.229086 (+  1262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20395264}
I20260709 13:13:01.229913   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.230433   483 raft_consensus.cc:1813] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Handling vote request from an unknown peer 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:01.230566   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.231001   483 raft_consensus.cc:2410] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:13:01.231787   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.232414   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:01.232816   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.233073   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1163) took 1090 ms. Trace:
I20260709 13:13:01.233393   484 rpcz_store.cc:276] 0709 13:13:00.142429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.232182 (+1089753us) service_pool.cc:224] Handling call
0709 13:13:01.233023 (+   841us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.234097   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.234900   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1153) took 1367 ms. Trace:
I20260709 13:13:01.235260   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.235895   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.236272   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:01.236634   476 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:01.236949   629 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:01.237090   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1146) took 1406 ms. Trace:
I20260709 13:13:01.237519   476 rpcz_store.cc:276] 0709 13:12:59.831091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.216410 (+1385319us) service_pool.cc:224] Handling call
0709 13:13:01.235764 (+ 19354us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:01.237033 (+  1269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43083648}
I20260709 13:13:01.192602  1956 raft_consensus.cc:740] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:01.239085   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:01.239148  1956 consensus_queue.cc:260] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.240303   629 raft_consensus.cc:2393] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:01.229142   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1164) took 1086 ms. Trace:
I20260709 13:13:01.220176   450 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:41384 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1248)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 120)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1252)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1245)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1246)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 121)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1247)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1243)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1180)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1253)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1227)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1228)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1229)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1235)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1127)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1130)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1143)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1155)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 116)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 117)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1240)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1242)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1244)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1249)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1251)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1254)
I20260709 13:13:01.241328   478 rpcz_store.cc:276] 0709 13:13:00.142876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.228211 (+1085335us) service_pool.cc:224] Handling call
0709 13:13:01.229085 (+   874us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.242331   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.242444   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:01.243466   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:01.244634   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.244760   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:01.245288   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1162) took 1104 ms. Trace:
I20260709 13:13:01.245513   629 raft_consensus.cc:2393] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:01.245692   482 rpcz_store.cc:276] 0709 13:13:00.140750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.220627 (+1079877us) service_pool.cc:224] Handling call
0709 13:13:01.244509 (+ 23882us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:01.245241 (+   732us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45557504}
I20260709 13:13:01.246680   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.247223   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:01.248064   629 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:01.248668   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:01.249070   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.235842   481 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:13:01.250567   629 raft_consensus.cc:1240] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:01.251931   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:01.252600   629 raft_consensus.cc:1240] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:01.197474  1168 rpcz_store.cc:276] 0709 13:12:59.355939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.356284 (+   345us) service_pool.cc:224] Handling call
0709 13:12:59.356676 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:00.456181 (+1099505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.575940 (+119759us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b54005f0ad4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:00.576129 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1718191488}
I20260709 13:13:01.200768  1829 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:01.254985  1829 raft_consensus.cc:697] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:01.221609   449 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:38132 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 120)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1252)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1245)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1246)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 121)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1247)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 125)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1243)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 127)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1180)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1253)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1227)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1228)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1229)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1235)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1127)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1130)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1143)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1155)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 116)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 117)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1240)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1242)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1244)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1249)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1251)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1254)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 128)
I20260709 13:13:01.255935  1829 consensus_queue.cc:237] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:01.208086   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.214799  1938 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.210625   597 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:01.263186   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 61343.5us
I20260709 13:13:01.263880   597 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:01.188249  1949 raft_consensus.cc:740] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:01.209513  1141 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:01.234226   633 raft_consensus.cc:1240] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:01.178865  1805 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:01.254372   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:01.274471   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 252029us
I20260709 13:13:01.274761   626 raft_consensus.cc:2393] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:01.233361   483 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:01.259765   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1161) took 1185 ms. Trace:
W20260709 13:13:01.269060   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.247324   482 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:01.271541  1848 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.196471  1908 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.231150   477 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:13:01.253036   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:01.286484   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:01.272805  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 63372.3us
W20260709 13:13:01.286959   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.287318  1141 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:01.277650  1139 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:01.278105   479 rpcz_store.cc:276] 0709 13:13:00.074494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.207815 (+1133321us) service_pool.cc:224] Handling call
0709 13:13:01.259710 (+ 51895us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.279949   556 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:01.277989   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:01.280575   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:01.289403   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:01.289783   522 connection.cc:256] RPC call timeout handler was delayed by -1.475426311000092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21110000000000004s for a response
I20260709 13:13:01.234259   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.281963   597 leader_election.cc:304] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:01.291127   484 raft_consensus.cc:2393] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:01.283010   554 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:01.292552   626 raft_consensus.cc:2393] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:01.292912   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.293661   483 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:01.203333  1919 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:01.291607   597 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:01.295894   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:01.273438  1915 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.280534  1826 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:01.328135   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:01.322180   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:01.329846   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:01.330786   482 raft_consensus.cc:2393] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:01.327318   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:01.331949   484 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.303761   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:01.332892   478 raft_consensus.cc:2376] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3. Re-sending same reply.
I20260709 13:13:01.340802   632 raft_consensus.cc:2393] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:01.341512   479 raft_consensus.cc:2393] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:01.273438  1895 consensus_queue.cc:1059] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:13:01.344175   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:01.344252   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:01.295644  1814 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:01.295887  1911 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:01.301729  1805 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:13:01.350395   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 149962us
I20260709 13:13:01.300513   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1165) took 1152 ms. Trace:
W20260709 13:13:01.355433   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 169243us
I20260709 13:13:01.357350   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:01.285873  1880 consensus_queue.cc:1059] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:13:01.235268   480 rpcz_store.cc:276] 0709 13:12:59.867957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.221466 (+1353509us) service_pool.cc:224] Handling call
0709 13:13:01.233952 (+ 12486us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:01.234842 (+   890us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27290368}
I20260709 13:13:01.361930   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:01.364696   553 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.367511   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.362607   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:01.362560   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:01.368153   483 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:13:01.368275   554 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:01.340598   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:01.369920   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.369675   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:01.370442   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:01.370802   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.370694   478 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:01.306969  1825 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:13:01.371228   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.373101   624 raft_consensus.cc:1240] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:01.353263   476 raft_consensus.cc:2393] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:01.376483   554 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:01.387524   553 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
W20260709 13:13:01.391113   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 60675.6us
I20260709 13:13:01.283627  1949 consensus_queue.cc:260] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.377532   475 raft_consensus.cc:2393] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:01.393064   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:01.405840   478 raft_consensus.cc:2393] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:01.362511  1828 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.406656   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:01.393327   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:01.407778   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:01.393684  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 308420us
I20260709 13:13:01.410679   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:01.359488   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:01.341355  1657 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:13:01.397476   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:01.363330  1951 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.419487  1951 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.412014  1826 raft_consensus.cc:697] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:01.421968   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:01.421468  1826 consensus_queue.cc:237] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:01.422647   476 raft_consensus.cc:1240] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:01.423344   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1122) took 2254 ms. Trace:
I20260709 13:13:01.423897  1949 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.402266   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:01.396029  1966 consensus_queue.cc:1059] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:01.401727  1956 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.413352   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:01.426234   481 raft_consensus.cc:2393] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:01.413769   368 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 82382f158074497a857b03f9f87f9e86 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:01.414271   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:01.361987  1805 raft_consensus.cc:697] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:01.412052  1138 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:01.432092   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:01.409211   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.433266   478 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:01.434077   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:01.434617   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 132879us
I20260709 13:13:01.359644   477 rpcz_store.cc:276] 0709 13:13:00.143171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.230303 (+1087132us) service_pool.cc:224] Handling call
0709 13:13:01.295772 (+ 65469us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.438107  1805 consensus_queue.cc:237] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.439743  1920 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.442116   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.442783   482 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 1.
I20260709 13:13:01.444818   556 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
W20260709 13:13:01.444764   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 146822us
W20260709 13:13:01.417109   525 leader_election.cc:336] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:38134 dropped due to backpressure: service queue is full with 50 items
I20260709 13:13:01.366884  1814 raft_consensus.cc:697] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:01.367337  1911 raft_consensus.cc:697] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:01.419788  1820 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:01.419057   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:01.394919  1141 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:01.423118   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:01.446645   525 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:01.470387   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:01.472366  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 77522.1us
I20260709 13:13:01.453701   597 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:01.473644  1141 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:01.421537  1951 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:01.474423   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:01.474680  1141 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:01.464823   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 110414us
I20260709 13:13:01.424686  1823 raft_consensus.cc:3055] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.481391   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1227) took 2066 ms. Trace:
I20260709 13:13:01.481799   483 rpcz_store.cc:276] 0709 13:12:59.414619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.480702 (+2066083us) service_pool.cc:224] Handling call
0709 13:13:01.480954 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.481104 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:01.481129 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:01.481169 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:01.481198 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.481246 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:01.481339 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.483644   478 raft_consensus.cc:1240] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:01.403101  1825 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.436713  1828 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:13:01.487304   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 71467.2us
I20260709 13:13:01.478586   630 raft_consensus.cc:2393] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:01.496598   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1123) took 2315 ms. Trace:
I20260709 13:13:01.498525   522 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:01.511268   478 rpcz_store.cc:276] 0709 13:12:59.169159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.443734 (+2274575us) service_pool.cc:224] Handling call
0709 13:13:01.479962 (+ 36228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.484277 (+  4315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.484518 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.488530   525 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:01.514077   525 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:01.515792  1819 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:01.516541  1819 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:01.516866  1819 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:01.517215  1819 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:01.423736   476 rpcz_store.cc:276] 0709 13:12:59.168873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.422087 (+2253214us) service_pool.cc:224] Handling call
0709 13:13:01.422407 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.423080 (+   673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.423287 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.411291  1964 consensus_queue.cc:1059] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 13:13:01.524729   481 raft_consensus.cc:1240] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:01.525390   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1228) took 2110 ms. Trace:
I20260709 13:13:01.525727   481 rpcz_store.cc:276] 0709 13:12:59.414936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.483451 (+2068515us) service_pool.cc:224] Handling call
0709 13:13:01.524541 (+ 41090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.525161 (+   620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.525339 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.526264   522 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:01.480384  1823 raft_consensus.cc:740] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:13:01.532444   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.497581  1657 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:01.483902  1838 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:01.497475  1951 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:01.485392   627 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:13:01.496879  1966 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.541155   483 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:01.544304   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:01.547438   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 275550us
I20260709 13:13:01.548328   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1235) took 2095 ms. Trace:
I20260709 13:13:01.548818   483 rpcz_store.cc:276] 0709 13:12:59.452427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.520732 (+2068305us) service_pool.cc:224] Handling call
0709 13:13:01.540973 (+ 20241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.547968 (+  6995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.548234 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:01.550154   525 leader_election.cc:336] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.890s (SENT)
I20260709 13:13:01.550799   556 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:13:01.483732  1943 consensus_queue.cc:1059] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:13:01.536267  1895 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:13:01.551532   525 leader_election.cc:336] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.901s (SENT)
I20260709 13:13:01.563453   525 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:01.530462  1920 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:01.565451   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:01.565622  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 91009.7us
I20260709 13:13:01.524658  1958 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:01.569051   481 raft_consensus.cc:1240] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:01.537495  1957 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.571911   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1126) took 1980 ms. Trace:
I20260709 13:13:01.572307   481 rpcz_store.cc:276] 0709 13:12:59.591872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.541071 (+1949199us) service_pool.cc:224] Handling call
0709 13:13:01.568879 (+ 27808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.571679 (+  2800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.571858 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.542790  1972 raft_consensus.cc:3055] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:01.568500  1976 consensus_queue.cc:1059] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
W20260709 13:13:01.578459  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 145798us
I20260709 13:13:01.562938   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54754 (request call id 83) took 1109 ms. Trace:
I20260709 13:13:01.579592   627 rpcz_store.cc:276] 0709 13:13:00.453708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.607095 (+153387us) service_pool.cc:224] Handling call
0709 13:13:01.552893 (+945798us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:01.580250  1963 log.cc:927] Time spent T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:13:01.575970  1895 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.583701   481 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:01.583962  1848 raft_consensus.cc:3055] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.584338  1848 raft_consensus.cc:740] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:01.585189  1848 consensus_queue.cc:260] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:01.586229  1848 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.564100  1657 raft_consensus.cc:697] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:01.563060  1966 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:01.589982  1657 consensus_queue.cc:237] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.591271  1966 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:01.591989   478 raft_consensus.cc:1240] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:01.563344  1967 raft_consensus.cc:2804] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:01.607432  1967 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:01.607856  1967 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.608681   482 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:01.609349   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1143) took 1810 ms. Trace:
I20260709 13:13:01.609635   482 rpcz_store.cc:276] 0709 13:12:59.798991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.594383 (+1795392us) service_pool.cc:224] Handling call
0709 13:13:01.608520 (+ 14137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.609124 (+   604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.609296 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.610453   551 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:01.610925   482 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:01.549945  1838 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.611435  1838 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:01.611685   555 raft_consensus.cc:2410] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:13:01.612107  1900 raft_consensus.cc:3055] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:01.612485  1900 raft_consensus.cc:740] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:01.613022   479 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:01.613279  1900 consensus_queue.cc:260] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.614127   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1229) took 2198 ms. Trace:
W20260709 13:13:01.614351   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.614451  1900 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:01.594538   483 raft_consensus.cc:1240] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:01.611694   475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1135) took 1814 ms (client timeout 2107 ms). Trace:
I20260709 13:13:01.615228   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1132) took 1832 ms. Trace:
I20260709 13:13:01.615692   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1147) took 1782 ms. Trace:
I20260709 13:13:01.616966   482 rpcz_store.cc:276] 0709 13:12:59.833058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.610345 (+1777287us) service_pool.cc:224] Handling call
0709 13:13:01.610637 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.615413 (+  4776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.615641 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.584357   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1130) took 1868 ms. Trace:
W20260709 13:13:01.595273   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 86942.2us
I20260709 13:13:01.618597   481 rpcz_store.cc:276] 0709 13:12:59.716036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.573116 (+1857080us) service_pool.cc:224] Handling call
0709 13:13:01.583548 (+ 10432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.584122 (+   574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.584305 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.615600   483 rpcz_store.cc:276] 0709 13:12:59.783254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.591050 (+1807796us) service_pool.cc:224] Handling call
0709 13:13:01.594371 (+  3321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.615025 (+ 20654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.615181 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:01.616354  1968 log.cc:927] Time spent T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:13:01.614485   479 rpcz_store.cc:276] 0709 13:12:59.415320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.484871 (+2069551us) service_pool.cc:224] Handling call
0709 13:13:01.612863 (+127992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.613426 (+   563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.613941 (+   515us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400370fd0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:01.614065 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293702400}
I20260709 13:13:01.626420  1138 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:01.604905   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 112) took 2188 ms. Trace:
I20260709 13:13:01.627101   478 rpcz_store.cc:276] 0709 13:12:59.416732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.512110 (+2095378us) service_pool.cc:224] Handling call
0709 13:13:01.530569 (+ 18459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.592360 (+ 61791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.593661 (+  1301us) spinlock_profiling.cc:243] Waited 55.4 ms on lock 0x7b540022e054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:01.604849 (+ 11188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127362304}
I20260709 13:13:01.626121   481 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:01.628760   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1155) took 1737 ms. Trace:
I20260709 13:13:01.629093   481 rpcz_store.cc:276] 0709 13:12:59.891208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.619385 (+1728177us) service_pool.cc:224] Handling call
0709 13:13:01.625946 (+  6561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.628493 (+  2547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.628705 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.572109   477 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:01.540390  1955 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:01.569840  1908 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:01.615079   475 rpcz_store.cc:269] 0709 13:12:59.796831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.010402 (+1213571us) service_pool.cc:224] Handling call
0709 13:13:01.611484 (+601082us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400370fd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:01.611639 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352011136}
I20260709 13:13:01.637506   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:01.639225   475 raft_consensus.cc:1240] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:01.583743  1880 raft_consensus.cc:3055] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.640627  1880 raft_consensus.cc:740] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:01.641189   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1240) took 1055 ms. Trace:
I20260709 13:13:01.641698   481 rpcz_store.cc:276] 0709 13:13:00.585512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.629766 (+1044254us) service_pool.cc:224] Handling call
0709 13:13:01.640774 (+ 11008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.640916 (+   142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:01.640938 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:01.640974 (+    36us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:01.641001 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.641047 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:01.641140 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.634606   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 117) took 1618 ms. Trace:
I20260709 13:13:01.642670   479 rpcz_store.cc:276] 0709 13:13:00.016661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.633867 (+1617206us) service_pool.cc:224] Handling call
0709 13:13:01.634127 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.634274 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:01.634299 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:01.634340 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:01.634368 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.634432 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:01.634550 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.644547   479 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:01.570750  1911 consensus_queue.cc:237] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:01.577494  1972 raft_consensus.cc:740] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:01.549892   599 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:01.615733  1825 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:01.641142  1855 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.602790   484 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
W20260709 13:13:01.604333   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 127928us
W20260709 13:13:01.655004   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.576258  1814 consensus_queue.cc:237] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.663951   482 raft_consensus.cc:1240] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:01.682687   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 116) took 1666 ms. Trace:
I20260709 13:13:01.651600   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1237) took 2089 ms. Trace:
I20260709 13:13:01.683285   482 rpcz_store.cc:276] 0709 13:13:00.016332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.632088 (+1615756us) service_pool.cc:224] Handling call
0709 13:13:01.663792 (+ 31704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.682418 (+ 18626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.682631 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.683487   476 rpcz_store.cc:276] 0709 13:12:59.561786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.535278 (+1973492us) service_pool.cc:224] Handling call
0709 13:13:01.570333 (+ 35055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.599796 (+ 29463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:01.616831 (+ 17035us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:01.632047 (+ 15216us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:01.635909 (+  3862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.651407 (+ 15498us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:01.651542 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.667057   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1125) took 2376 ms. Trace:
I20260709 13:13:01.685196   477 rpcz_store.cc:276] 0709 13:12:59.290435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.474928 (+2184493us) service_pool.cc:224] Handling call
0709 13:13:01.551642 (+ 76714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.641724 (+ 90082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.665329 (+ 23605us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.616181  1823 consensus_queue.cc:260] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:01.660790   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 115) took 1644 ms. Trace:
I20260709 13:13:01.689270   483 rpcz_store.cc:276] 0709 13:13:00.016086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.633687 (+1617601us) service_pool.cc:224] Handling call
0709 13:13:01.660266 (+ 26579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.660433 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:01.660458 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:01.660498 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:01.660536 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.660607 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:01.660731 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:01.663779   448 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:01.691154   448 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:01.669824   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 119997us
I20260709 13:13:01.693946   599 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:01.671093  1141 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:01.698628   448 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:01.673427   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 281566us
W20260709 13:13:01.658805  1944 consensus_meta.cc:287] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
I20260709 13:13:01.665671  1862 raft_consensus.cc:3055] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.708209   448 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:01.709815   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.662127   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1246) took 1144 ms. Trace:
I20260709 13:13:01.679263  1846 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.696822   480 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:01.716449   525 leader_election.cc:336] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 2.013s (SENT)
I20260709 13:13:01.717059   525 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:01.676633  1975 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.713142  1978 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.651861  1880 consensus_queue.cc:260] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:01.700963  1919 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:01.727949  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 200317us
I20260709 13:13:01.701311  1855 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:01.705919  1862 raft_consensus.cc:740] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:01.707425  1920 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:01.655138  1974 consensus_queue.cc:1059] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:13:01.729728   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:01.734261   557 raft_consensus.cc:2376] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3. Re-sending same reply.
I20260709 13:13:01.651151  1967 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:01.695724  1828 raft_consensus.cc:697] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:01.701028  1915 consensus_queue.cc:1059] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:13:01.719547  1944 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:01.655543  1955 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:01.738873   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:01.739142  1982 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.739799  1915 raft_consensus.cc:3055] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.740700  1819 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:01.740783  1828 consensus_queue.cc:237] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:01.741709  1880 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.744391   627 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:01.712502  1976 consensus_queue.cc:1059] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:13:01.731967  1805 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:13:01.763572   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:01.768471   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 60337.5us
I20260709 13:13:01.737725  1908 consensus_queue.cc:1059] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
W20260709 13:13:01.834044   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.769649  1915 raft_consensus.cc:740] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:01.768719   525 leader_election.cc:336] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.667s (SENT)
I20260709 13:13:01.835116   448 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:01.835554   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 66876.2us
I20260709 13:13:01.734127  1823 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.776623   552 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
W20260709 13:13:01.783445   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 92021.2us
I20260709 13:13:01.795444  1139 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:01.853593   448 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:01.725032  1846 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:01.714843   551 rpcz_store.cc:276] 0709 13:13:00.517784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.518429 (+   645us) service_pool.cc:224] Handling call
0709 13:13:01.661969 (+1143540us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b5400387a54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:01.662075 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1560793472}
W20260709 13:13:01.838711   525 leader_election.cc:336] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.744s (SENT)
I20260709 13:13:01.856691   525 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:01.853741   597 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:13:01.797793   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 103890us
W20260709 13:13:01.858372   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.858537   599 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:01.796761  1855 raft_consensus.cc:697] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
W20260709 13:13:01.830036   505 debug-util.cc:398] Leaking SignalData structure 0x7b0800105480 after lost signal to thread 31814
I20260709 13:13:01.859587  1975 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:01.746343  1983 consensus_queue.cc:1059] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 13:13:01.860918  1908 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.769769  1920 consensus_queue.cc:1059] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:13:01.723686  1972 consensus_queue.cc:260] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:01.864274   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 154980us
I20260709 13:13:01.866636   448 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:01.869719   599 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:01.863889   505 debug-util.cc:398] Leaking SignalData structure 0x7b08000df520 after lost signal to thread 31817
I20260709 13:13:01.889902  1967 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:01.890781  1955 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:01.799032  1862 consensus_queue.cc:260] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.895766  1862 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.896561  1846 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:01.902802  1997 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:13:01.904300   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:01.904805   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.906185  1915 consensus_queue.cc:260] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:01.907591  1915 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.912261  1986 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.913635  1992 raft_consensus.cc:3055] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.914105  1992 raft_consensus.cc:740] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:01.915032  1992 consensus_queue.cc:260] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:01.915650   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 57383.3us
I20260709 13:13:01.916361   597 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:01.916656  1992 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.917600   597 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:01.918246  1829 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:01.918785  1829 raft_consensus.cc:697] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:01.918936  1848 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.919128   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:01.920049  1982 raft_consensus.cc:2749] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.914950  1975 raft_consensus.cc:697] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:01.920804   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:01.921893  1975 consensus_queue.cc:237] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:01.922394   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 52754.2us
I20260709 13:13:01.922518  1855 consensus_queue.cc:237] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:01.923442  1987 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.923686   599 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:01.924844  1986 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.862133  1944 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:01.928755   525 leader_election.cc:336] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.830s (SENT)
I20260709 13:13:01.937347   525 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:01.919741  1829 consensus_queue.cc:237] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.932026  1920 raft_consensus.cc:3055] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:13:01.932765   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 66204.4us
W20260709 13:13:01.933404   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 44903.8us
I20260709 13:13:01.867175  1995 raft_consensus.cc:3055] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.933650   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:01.932577  1976 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.935287   597 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:13:01.946661  1938 consensus_meta.cc:287] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.673s	user 0.008s	sys 0.000s
I20260709 13:13:01.947854  1972 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:01.950176   525 leader_election.cc:336] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.848s (SENT)
I20260709 13:13:01.975435   525 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:01.976882   525 leader_election.cc:336] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.857s (SENT)
I20260709 13:13:01.977423   525 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:01.954612   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.933712  1966 raft_consensus.cc:3055] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:13:01.983057  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 187709us
I20260709 13:13:01.983887  1139 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:01.869107  1805 raft_consensus.cc:697] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:01.960002  1955 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.937932  1987 consensus_queue.cc:1059] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:13:01.956845  1920 raft_consensus.cc:740] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:01.985111  1825 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.961118  1846 consensus_queue.cc:1059] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:13:01.968492  1986 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:01.961529  1823 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.955793  1657 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:13:01.963124  1838 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:01.973018   597 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:01.980975   525 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:01.961649   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1257) took 1387 ms. Trace:
I20260709 13:13:01.983346  1956 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:01.983228  1966 raft_consensus.cc:740] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:01.995008   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:02.014981   554 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:02.016202   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:01.997007   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:02.018234   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:02.018997   553 raft_consensus.cc:2393] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:01.997103   558 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:13:01.987377  1848 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:13:01.994710  1986 raft_consensus.cc:697] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:02.021188  1920 consensus_queue.cc:260] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:02.021454  1986 consensus_queue.cc:237] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.996737   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:02.022594  1920 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:01.994419  1846 raft_consensus.cc:3055] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.022958  1805 consensus_queue.cc:237] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:02.023572  1846 raft_consensus.cc:740] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:02.024482  1846 consensus_queue.cc:260] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:01.961648  1995 raft_consensus.cc:740] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:02.002300  1911 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:02.026489   554 raft_consensus.cc:2393] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:02.006915   483 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:01.993718   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:02.007412   525 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:01.995869   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:02.007926   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.025923  1846 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.995299  1823 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:02.030443   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:02.030592   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:02.031138   475 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:13:02.031493   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:02.032209  1823 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:02.032500   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:02.005534  1820 consensus_meta.cc:287] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.519s	user 0.004s	sys 0.004s
I20260709 13:13:02.005700   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:02.033550   627 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:01.995561   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:02.004964   552 rpcz_store.cc:276] 0709 13:13:00.568616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.586170 (+ 17554us) service_pool.cc:224] Handling call
0709 13:13:01.948306 (+1362136us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b5400200dd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:01.955689 (+  7383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1590410624}
I20260709 13:13:02.037750   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:02.006757  1956 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.996429   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:02.005903  1966 consensus_queue.cc:260] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.040735  1966 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.996170   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:02.003633   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1127) took 2385 ms. Trace:
I20260709 13:13:02.003649  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:02.004776  1971 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:02.047180  1971 raft_consensus.cc:697] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:02.011142  1819 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:02.004585   597 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:02.048151  1971 consensus_queue.cc:237] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.011339  1979 consensus_queue.cc:1059] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:13:02.011487  1964 raft_consensus.cc:3055] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:01.996129  1978 consensus_queue.cc:1059] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:13:01.990841  1987 raft_consensus.cc:3055] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:02.045554   480 rpcz_store.cc:276] 0709 13:12:59.618555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.567163 (+1948608us) service_pool.cc:224] Handling call
0709 13:13:01.676139 (+108976us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.724858 (+ 48719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.003430 (+278572us) spinlock_profiling.cc:243] Waited 95.5 ms on lock 0x7b54002b25d0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:02.003571 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219629952}
I20260709 13:13:02.049566  1657 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:02.008457  1141 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:01.986905  1139 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:02.056336   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:02.059643   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:02.071681   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 64339.7us
I20260709 13:13:02.072492   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:02.072665   525 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:02.073174   556 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:02.074510   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:02.049515   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 45013.4us
I20260709 13:13:02.072005   553 raft_consensus.cc:2393] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:02.075523   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:02.075896   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:02.076282   554 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:02.076905   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:02.074342   525 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:02.084321   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:02.085969   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:02.086717   554 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:02.086972   553 raft_consensus.cc:2393] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 2: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:02.092970   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:02.093827   554 raft_consensus.cc:1813] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Handling vote request from an unknown peer 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:02.013954   505 debug-util.cc:398] Leaking SignalData structure 0x7b08000bb700 after lost signal to thread 415
I20260709 13:13:02.094527   554 raft_consensus.cc:2393] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:02.059109   555 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:02.004508  1838 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:02.095781   525 leader_election.cc:304] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:02.053259  1964 raft_consensus.cc:740] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:02.063424   557 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:02.090101   597 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:02.101825   557 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:02.097141   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 145262us
I20260709 13:13:02.064992  1938 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:02.111933   557 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:02.091966  1819 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:02.105765  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 97430us
I20260709 13:13:02.064682  1987 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:02.098714   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:02.116312  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:02.116667   555 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:02.096807  1822 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:02.117403  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 130564us
W20260709 13:13:02.119334   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.120666  1171 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:02.130769  1139 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:02.131436  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:02.122627   556 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:02.128301   525 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:02.096155  1657 raft_consensus.cc:697] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:02.129559   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:02.136078   448 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:02.129884  1174 raft_consensus.cc:1240] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.133477   525 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:02.137173   448 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:02.136265   597 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:02.101399  1956 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.138833  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:02.139688  1173 raft_consensus.cc:2393] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:02.107842  1829 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:02.143707   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:02.116863  1911 raft_consensus.cc:697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:02.118321  1820 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.117344  1819 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:02.151819  1139 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:02.153302  1139 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:02.130522  1944 raft_consensus.cc:2764] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:13:02.130388  1822 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:02.183811  1657 consensus_queue.cc:237] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.184828  1822 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:02.158085   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.135565  1955 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:02.189911   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:02.190522   558 raft_consensus.cc:1813] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Handling vote request from an unknown peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:02.191174   558 raft_consensus.cc:2410] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:13:02.191274   475 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:02.154193  1958 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.175938  1974 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:02.148200  1966 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.193305  1966 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.194397  1972 raft_consensus.cc:3055] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.144294  1999 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.148478  1971 consensus_queue.cc:1059] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:13:02.194921  1972 raft_consensus.cc:740] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:02.117178  1938 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:02.150023   505 debug-util.cc:398] Leaking SignalData structure 0x7b08003ce7e0 after lost signal to thread 508
W20260709 13:13:02.199545   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:02.200807   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 63694.7us
I20260709 13:13:02.216542  1141 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:02.209923  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 56674.2us
I20260709 13:13:02.143078   551 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:02.145002  1997 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:02.147457  1823 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.119899  1975 consensus_queue.cc:1059] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
W20260709 13:13:02.216845   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:02.231431   505 debug-util.cc:398] Leaking SignalData structure 0x7b08003ce900 after lost signal to thread 509
I20260709 13:13:02.154579   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:02.215073  1974 raft_consensus.cc:697] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:02.232956   448 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:02.285109   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 52273.6us
I20260709 13:13:02.236263   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:02.232306  1828 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:13:02.237763  1967 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:02.241534   483 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:02.147701  1915 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:13:02.290699  1974 consensus_queue.cc:237] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:02.293507   552 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:02.294134   550 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:02.246932  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:02.248683  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:02.250468  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:02.213341  1826 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:13:02.255949   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 122509us
I20260709 13:13:02.317245   525 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:02.316151   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 169606us
I20260709 13:13:02.157303  1819 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.221256   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:02.286630   553 raft_consensus.cc:2376] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2. Re-sending same reply.
I20260709 13:13:02.145470  1995 consensus_queue.cc:260] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.248561  1911 consensus_queue.cc:237] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:02.294215  1972 consensus_queue.cc:260] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.243031  1167 raft_consensus.cc:1240] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:01.920812  1949 consensus_queue.cc:1175] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:02.276696  1997 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:02.329463  1997 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:02.301860  2008 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:02.302553  1978 consensus_queue.cc:1059] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:02.331105  1978 raft_consensus.cc:3055] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:02.331558  1978 raft_consensus.cc:740] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:02.332590  1978 consensus_queue.cc:260] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:02.334131  1978 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:02.302786  1971 raft_consensus.cc:3055] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:02.335407  1971 raft_consensus.cc:740] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:02.336521  1971 consensus_queue.cc:260] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:02.338135  1971 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:02.303969  1938 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:02.306037   448 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:02.339650  1988 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:02.339988  1988 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.340299  1988 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:02.341745   448 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:02.342720  1991 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:02.342777   483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:52312
I20260709 13:13:02.343405   483 raft_consensus.cc:606] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Received request to transfer leadership to TS 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:02.343725   483 raft_consensus.cc:614] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:02.278772  1958 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:02.344929  1958 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:02.347461   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.348343  1988 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:02.350386  1988 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:02.315980  1171 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:02.319684   447 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:02.320269   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:02.353240  1966 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.353869  1966 consensus_queue.cc:1059] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:02.354862  1966 consensus_queue.cc:1059] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:02.347050  1958 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:02.355765  1966 consensus_queue.cc:1059] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:02.356436  1966 consensus_queue.cc:1243] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:13:02.356853  1966 raft_consensus.cc:3055] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.357156  1966 raft_consensus.cc:740] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:02.358362  2008 raft_consensus.cc:3055] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.358731  2008 raft_consensus.cc:740] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:02.359052   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:02.359519  2008 consensus_queue.cc:260] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.360280   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:02.360713  1991 raft_consensus.cc:3055] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.361078  1991 raft_consensus.cc:740] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:02.362601  1966 consensus_queue.cc:260] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.363828  1966 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:02.367718  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 52009.2us
W20260709 13:13:02.369997   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 218415us
I20260709 13:13:02.211973  1987 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.317715  1967 raft_consensus.cc:697] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
W20260709 13:13:02.369892   505 debug-util.cc:398] Leaking SignalData structure 0x7b08003eef00 after lost signal to thread 583
I20260709 13:13:02.369803  1988 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:02.321548  1944 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.403065   597 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:02.369556  1823 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.318152  1822 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:02.410190   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.309056  1996 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:13:02.382900  1958 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:13:02.425957   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 65737.7us
I20260709 13:13:02.432615   448 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:02.411115   627 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:02.425997  1988 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.421507  1987 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:02.414158  1944 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:02.439036  2002 raft_consensus.cc:2764] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:13:02.424552  1978 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:02.440116   505 debug-util.cc:398] Leaking SignalData structure 0x7b080025cc80 after lost signal to thread 657
I20260709 13:13:02.466801   448 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:02.474406   525 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:02.463171  1944 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.482995   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:02.484987   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:02.483644   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 80695.6us
I20260709 13:13:02.486424   597 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:02.487521   597 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:02.488615   597 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:02.489151  2010 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.489521  1956 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.489918  2010 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.490510  2010 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:02.422998  1991 consensus_queue.cc:260] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:02.492283  1991 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.471657  1975 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:02.495453  1975 raft_consensus.cc:697] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:02.495836   505 debug-util.cc:398] Leaking SignalData structure 0x7b08000b5fe0 after lost signal to thread 1199
W20260709 13:13:02.496193   505 debug-util.cc:398] Leaking SignalData structure 0x7b08002f3440 after lost signal to thread 1200
I20260709 13:13:02.496338  1975 consensus_queue.cc:237] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.497490  1805 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:02.420778  1967 consensus_queue.cc:237] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:02.501931  1171 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:02.497522   555 raft_consensus.cc:1275] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.505045   478 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:02.505466   448 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:02.483142   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.481748  1823 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.463173  1988 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.510869   525 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:02.502115  1166 raft_consensus.cc:1240] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:02.518026   525 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:02.520470   597 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:02.521080   555 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:02.522624   550 raft_consensus.cc:1240] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:02.528971   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.530396   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:02.531884   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:02.533874   632 raft_consensus.cc:2393] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:02.528081  1938 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:02.534960  2019 log.cc:927] Time spent T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:13:02.533582   559 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:02.536595   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:02.512163  1956 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.518271  1814 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.539110   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:02.539320   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:02.539677  1938 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:02.544806  1938 raft_consensus.cc:697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:02.545787  1938 consensus_queue.cc:237] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.518541  1978 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.542872  1814 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.525198  2024 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:02.552464   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:02.552903   628 raft_consensus.cc:1240] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.550835   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:02.559886   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:02.555632   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:02.556139   626 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:02.548401  1956 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:02.563525  1980 raft_consensus.cc:3055] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:02.563880  1980 raft_consensus.cc:740] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:02.564659   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:02.565021  1822 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:02.564743  1980 consensus_queue.cc:260] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:02.565447   556 raft_consensus.cc:2393] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 2: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:02.565670  1822 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.566028  1980 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:02.566150  1822 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.567478   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:02.568171   554 raft_consensus.cc:2393] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 2: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:02.568521  1966 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:02.554637  1964 consensus_queue.cc:260] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.559453  2021 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:02.563093  1139 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:02.584287   631 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
W20260709 13:13:02.613786   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 43510.7us
I20260709 13:13:02.623672  1956 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:02.624444  1986 consensus_queue.cc:1048] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.625972  1986 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:02.612855  1819 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.630764  2010 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:02.631343   557 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.631402  1657 consensus_queue.cc:1059] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:02.632311   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:02.640192  2011 raft_consensus.cc:3055] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.640400  2009 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.643908  2011 raft_consensus.cc:740] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:02.644279  1175 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:02.644361  2009 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:02.648514   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:02.649492   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.650346   447 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:02.647354   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:02.653576   628 raft_consensus.cc:1240] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:02.654341   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:02.655018   477 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:02.640328  1819 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:02.656414  1174 raft_consensus.cc:1813] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Handling vote request from an unknown peer 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:02.656976  1174 raft_consensus.cc:2393] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:02.636929  1826 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:02.667167  1170 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:02.656654  1964 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:02.576298  2002 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:13:02.644766  2011 consensus_queue.cc:260] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:02.682507   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.686995   447 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:02.721194   550 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:02.672152  1826 raft_consensus.cc:697] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:02.656618  2021 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:13:02.721333  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:02.751993  1880 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:13:02.723912  2009 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:02.770687  1814 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:02.761821   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:02.763378   482 raft_consensus.cc:1240] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.765879   481 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:02.758781  1944 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.779274   482 raft_consensus.cc:1240] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.751971   477 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:02.737744  2011 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.735347  1822 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:02.780377   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:02.785184   479 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.783059   477 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.783257   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:02.790477   630 raft_consensus.cc:2393] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:02.787278  1996 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:13:02.788582   478 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:02.796645   478 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.797724  1978 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.786012  1826 consensus_queue.cc:237] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:02.807202  2021 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.813174  2021 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.823567  1915 raft_consensus.cc:3055] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.824057  1915 raft_consensus.cc:740] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:02.825155   477 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:02.826771  1166 raft_consensus.cc:1240] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.824934  1915 consensus_queue.cc:260] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.831640   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:02.833133  1908 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.833884  1908 consensus_queue.cc:1059] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:02.836206   478 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:02.838114  1996 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:02.838884  1982 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:02.839594  1982 raft_consensus.cc:697] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:02.843483  2008 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.845207  2021 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:02.846128   633 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:02.846676  1978 raft_consensus.cc:3055] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:02.847050  1978 raft_consensus.cc:740] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:02.847874   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:02.848722   629 raft_consensus.cc:2393] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:02.843492  1982 consensus_queue.cc:237] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.826967   477 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.862507   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:02.863368   624 raft_consensus.cc:2393] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:02.873092  1944 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:02.848073  1978 consensus_queue.cc:260] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:02.874593   523 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:02.877724   523 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:02.882639  1862 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:02.883051  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:02.884178   550 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:02.885529  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:02.888211  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:02.888541   552 raft_consensus.cc:1240] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:02.888880  1988 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:02.888958  1170 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:02.889878   558 raft_consensus.cc:1240] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:02.890676  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:02.879905  1955 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.894940  1955 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:02.895618   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:02.896351   627 raft_consensus.cc:2393] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:02.897509  1955 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:02.926504  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:02.943117   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:02.945434   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.951121   476 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:02.961895  1995 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.969828   558 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:02.970142  1915 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.971143   558 raft_consensus.cc:1240] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:02.972565   558 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:13:02.967381   523 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:02.974771   552 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:02.975782  1862 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.976542  1978 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.978211   380 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46024 (request call id 249) took 1979 ms. Trace:
I20260709 13:13:02.980700   379 catalog_manager.cc:5697] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index 3 to 4, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New cstate: current_term: 1 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:02.978401   523 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:02.985741  1862 raft_consensus.cc:2804] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:02.986234  1862 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.986671  1862 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:02.986871  1972 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.978657   380 rpcz_store.cc:276] 0709 13:13:00.998342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.999539 (+  1197us) service_pool.cc:224] Handling call
0709 13:13:02.978154 (+1978615us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:01.406294 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:01.406856 (+   562us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:01.406889 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:13:01.406910 (+    21us) tablet.cc:662] Decoding operations
0709 13:13:01.407228 (+   318us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:01.407327 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:01.407363 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:13:01.407540 (+   177us) tablet.cc:701] Row locks acquired
0709 13:13:01.407557 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:13:01.407679 (+   122us) write_op.cc:270] Start()
0709 13:13:01.407784 (+   105us) write_op.cc:276] Timestamp: P: 1783602781407639 usec, L: 0
0709 13:13:01.407810 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:13:01.408373 (+   563us) log.cc:844] Serialized 536 byte log entry
0709 13:13:01.971359 (+562986us) op_driver.cc:464] REPLICATION: finished
0709 13:13:02.499945 (+528586us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b180025d200. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6532c3f3 00007f4b6532e7c1 00007f4b6532e779 00007f4b6532e709 00007f4b6532e6d1 00007f4b6532d9cd 000000000038f354 000000000038f199 00007f4b6530f83a
0709 13:13:02.500088 (+   143us) write_op.cc:301] APPLY: starting
0709 13:13:02.500160 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:02.500255 (+    95us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:02.500278 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:02.500514 (+   236us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:02.500664 (+   150us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:13:02.500713 (+    49us) write_op.cc:312] APPLY: finished
0709 13:13:02.500884 (+   171us) log.cc:844] Serialized 23 byte log entry
0709 13:13:02.501062 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:02.501141 (+    79us) write_op.cc:454] Released schema lock
0709 13:13:02.501178 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:02.501500 (+   322us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:02.501525 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":8448,"child_traces":[["op",{"apply.queue_time_us":133149,"apply.run_cpu_time_us":1380,"apply.run_wall_time_us":1381,"num_ops":1,"prepare.queue_time_us":233048,"prepare.run_cpu_time_us":3151,"prepare.run_wall_time_us":3338,"raft.queue_time_us":253145,"raft.run_cpu_time_us":10974,"raft.run_wall_time_us":171487,"replication_time_us":529615,"spinlock_wait_cycles":11400576,"thread_start_us":447052,"threads_started":4,"wal-append.queue_time_us":1493}]]}
I20260709 13:13:02.994493  1989 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:13:02.986439   550 raft_consensus.cc:1240] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:02.988667  2001 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
W20260709 13:13:03.001152   483 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.027s	sys 0.031s
W20260709 13:13:03.001617   483 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.027s	sys 0.031s
I20260709 13:13:03.007467   523 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:03.018020   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:03.018864   631 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:03.018697   625 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:03.022435   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:03.023089   624 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:03.024344   630 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:03.022445   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:02.993553  1855 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:13:02.993871  1996 consensus_queue.cc:1059] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 13:13:03.031565   475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.024s	sys 0.043s
I20260709 13:13:03.027077  1955 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:03.098469   484 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
W20260709 13:13:03.097532   475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.024s	sys 0.044s
I20260709 13:13:03.072677   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:03.060504  2001 consensus_queue.cc:1059] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:13:03.119663   625 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:03.141650   522 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:03.211315   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 69722.5us
I20260709 13:13:03.144909   631 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:13:03.195484  1915 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:03.129154  1967 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.021s	sys 0.011s
I20260709 13:13:03.150722   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:03.148954  2020 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:03.156097   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 467598us
I20260709 13:13:03.161550   629 raft_consensus.cc:1240] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:03.145774  1996 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:13:03.147217  1828 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:13:03.185436  1855 raft_consensus.cc:3055] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:03.301285  1855 raft_consensus.cc:740] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:03.302268  1855 consensus_queue.cc:260] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:03.186921   448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.014s	sys 0.016s
W20260709 13:13:03.303416   448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.014s	sys 0.016s
W20260709 13:13:03.304073   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 798672us
I20260709 13:13:03.304910   448 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:03.205039  2011 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.306126  2011 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:03.308681  2011 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:03.239895   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:03.309722   624 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
W20260709 13:13:03.242980   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:03.310806   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:03.311194   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:03.311712   447 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 1.535s (SENT) [suppressed 65 similar messages]
I20260709 13:13:03.243597   525 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:03.313107   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 69611.4us
I20260709 13:13:03.313936   525 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:03.238391  1949 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:03.210114   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:03.241963  1967 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.021s	sys 0.011s
I20260709 13:13:03.317390   448 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:03.292060   477 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:13:03.291399   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:03.320327  1955 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:03.316367  1949 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.321887  1972 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.321471   448 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:03.241804  1915 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:03.338160  1915 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:03.338995   630 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:13:03.343480   484 raft_consensus.cc:3055] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:03.344077   484 raft_consensus.cc:740] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:03.335117  1862 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:03.345185   484 consensus_queue.cc:260] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:03.346542   484 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.348225  1862 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:03.349382  1855 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.369323  1967 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:03.370397  1820 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.371031  1820 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:03.373843  1820 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:03.378192  1999 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:03.325796   448 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:03.323562  1949 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.380283  1972 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:03.380872  1972 raft_consensus.cc:697] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:03.381888  1972 consensus_queue.cc:237] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:03.326671  2029 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:03.383605  2029 raft_consensus.cc:697] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:13:03.384182   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 58474us
I20260709 13:13:03.384649  2029 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:03.388165   448 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:03.391912  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:03.392714  1908 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:03.393239  1908 raft_consensus.cc:697] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:03.393332   476 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:03.394126  1908 consensus_queue.cc:237] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:03.392535  1166 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.396996   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:03.398578   448 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:03.399040   477 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:03.400255   448 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:03.400972  1988 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:03.401172  1141 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:03.401643  1988 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:03.402153  1988 raft_consensus.cc:697] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:03.402976  1988 consensus_queue.cc:237] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:03.405014  1820 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:03.405586  1820 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.406556   448 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:03.406124  1820 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:03.390838  1862 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:03.408430  1657 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.001s	sys 0.029s
I20260709 13:13:03.402904  1999 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:13:03.434230   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:03.434842   630 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:03.436787   599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.000s	sys 0.048s
W20260709 13:13:03.437119   599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.000s	sys 0.048s
W20260709 13:13:03.438023   559 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.008s	sys 0.048s
W20260709 13:13:03.438313   559 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.008s	sys 0.048s
I20260709 13:13:03.408159  1166 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:03.406780   480 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:03.296293  2020 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:03.425832  1982 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:03.437638  1657 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.001s	sys 0.029s
W20260709 13:13:03.431051  1986 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.011s	sys 0.043s
I20260709 13:13:03.458166   624 raft_consensus.cc:1240] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:03.460393   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 53928.8us
I20260709 13:13:03.461329   448 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:03.429520  1862 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:03.449681   556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.018s	sys 0.029s
W20260709 13:13:03.466501   556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.019s	sys 0.030s
W20260709 13:13:03.467243   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.461772   523 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:03.457131  1986 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.011s	sys 0.043s
I20260709 13:13:03.471738   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:03.486444   553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.001s	sys 0.024s
I20260709 13:13:03.462479  2024 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:03.454804  1982 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:03.468973   633 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
W20260709 13:13:03.488245   481 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.011s	sys 0.047s
I20260709 13:13:03.472177  1944 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:03.486809   553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.001s	sys 0.024s
W20260709 13:13:03.494971   481 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.011s	sys 0.047s
I20260709 13:13:03.505077   484 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:03.479808   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1183) took 1370 ms. Trace:
I20260709 13:13:03.487618   629 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:03.490324  1987 consensus_queue.cc:1059] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:13:03.496335  1915 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:13:03.511371  1855 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 13:13:03.491067  1938 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.010s	sys 0.018s
W20260709 13:13:03.516606   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.461607  2030 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:13:03.512365   480 rpcz_store.cc:276] 0709 13:13:02.109329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.112604 (+  3275us) service_pool.cc:224] Handling call
0709 13:13:03.473483 (+1360879us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54000d66d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:03.477361 (+  3878us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2058463616}
I20260709 13:13:03.493139  2024 raft_consensus.cc:697] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:03.499274   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:03.514921   551 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.126s	user 0.022s	sys 0.045s
I20260709 13:13:03.512532   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:03.514581  2031 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:13:03.525236  1938 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.011s	sys 0.018s
W20260709 13:13:03.550741   479 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.029s	sys 0.041s
W20260709 13:13:03.539288   551 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.150s	user 0.022s	sys 0.045s
I20260709 13:13:03.555802  2020 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:03.551090   479 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.029s	sys 0.041s
I20260709 13:13:03.558763  2020 raft_consensus.cc:3055] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.559249  2020 raft_consensus.cc:740] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:03.560222  2020 consensus_queue.cc:260] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:03.561681  2020 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:03.588078   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:03.588579   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:03.588946   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.615727  1174 raft_consensus.cc:1240] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:03.605298   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:03.549696   476 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
W20260709 13:13:03.563467  1975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.016s	user 0.015s	sys 0.015s
I20260709 13:13:03.615195  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:03.578999  2031 raft_consensus.cc:697] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:03.551602  1949 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:03.643034   478 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.012s	sys 0.024s
W20260709 13:13:03.650771   478 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.012s	sys 0.024s
I20260709 13:13:03.614169  1938 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.631716   484 raft_consensus.cc:3055] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:13:03.652400   482 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.015s	sys 0.021s
W20260709 13:13:03.623616  1975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.076s	user 0.015s	sys 0.015s
W20260709 13:13:03.628890   555 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.017s	sys 0.012s
W20260709 13:13:03.807065   555 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.139s	user 0.017s	sys 0.012s
I20260709 13:13:03.714180  1862 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:03.643344  2010 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.021s	sys 0.015s
I20260709 13:13:03.710729  1938 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:03.832675   379 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.011s	sys 0.017s
W20260709 13:13:03.834895   379 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.012s	sys 0.017s
I20260709 13:13:03.757889   476 raft_consensus.cc:1275] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:03.731429   628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:03.756597  1949 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:03.650509  1166 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:03.639943  2035 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:03.752351  2051 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:13:03.751343  2033 log.cc:927] Time spent T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:13:03.756789  2031 consensus_queue.cc:237] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:03.640272  2024 consensus_queue.cc:237] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:03.625380  1944 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:03.714053  2045 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:03.652872  1826 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.006s	sys 0.030s
W20260709 13:13:03.805518   482 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.015s	sys 0.021s
I20260709 13:13:03.805500   484 raft_consensus.cc:740] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:03.701618  1982 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:03.807678  1978 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:03.819546  2010 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.023s	sys 0.027s
W20260709 13:13:03.808580   552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.000s	sys 0.026s
W20260709 13:13:03.855221   557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.020s	sys 0.033s
I20260709 13:13:03.754359  1820 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:03.834235   480 raft_consensus.cc:1240] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:03.817417   630 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
W20260709 13:13:03.900956   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:03.891676   483 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.029s	sys 0.008s
W20260709 13:13:04.008275   483 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.029s	sys 0.008s
W20260709 13:13:03.917012   554 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.245s	user 0.018s	sys 0.057s
W20260709 13:13:04.009737   554 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.338s	user 0.018s	sys 0.057s
W20260709 13:13:03.920101   597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.202s	user 0.025s	sys 0.016s
I20260709 13:13:03.890888   628 raft_consensus.cc:606] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:13:03.935441   557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.020s	sys 0.033s
I20260709 13:13:03.937819   484 consensus_queue.cc:260] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:03.920894  1944 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:03.922921  1826 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.083s	user 0.008s	sys 0.033s
W20260709 13:13:03.937666   552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.000s	sys 0.027s
I20260709 13:13:03.936934  1978 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:03.991487   559 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.014s	sys 0.050s
I20260709 13:13:03.891796  2035 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:03.913975  2042 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.878206  1862 raft_consensus.cc:2804] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:13:04.010697   597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.292s	user 0.025s	sys 0.016s
W20260709 13:13:04.027096   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 1.3087e+06us
W20260709 13:13:04.011065   525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.001s	sys 0.021s
W20260709 13:13:04.029109   525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.001s	sys 0.021s
W20260709 13:13:04.011828  1138 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.025s	sys 0.040s
I20260709 13:13:03.991458  1975 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.017084   484 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:04.031811  1138 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.025s	sys 0.040s
W20260709 13:13:04.032269  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 816530us
W20260709 13:13:03.989321   626 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.003s	sys 0.039s
W20260709 13:13:04.035336   626 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.003s	sys 0.041s
W20260709 13:13:04.021960   559 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.015s	sys 0.051s
I20260709 13:13:04.013094   628 raft_consensus.cc:614] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:04.008903  2011 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.932950  2045 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:04.157001  2045 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:04.013451   550 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.018s	sys 0.034s
I20260709 13:13:04.009196  1976 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:04.042269   484 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:04.194450  1138 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:04.163723   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1276) took 1393 ms. Trace:
I20260709 13:13:04.152323   480 raft_consensus.cc:1275] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.154568  1820 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:04.200126   550 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.078s	user 0.018s	sys 0.035s
W20260709 13:13:04.201375  2052 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:13:04.223323  1820 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.223533   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 147) took 1383 ms. Trace:
I20260709 13:13:04.223881  1820 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:04.224743   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 146) took 1430 ms. Trace:
I20260709 13:13:04.225136   481 rpcz_store.cc:276] 0709 13:13:02.794013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.840521 (+ 46508us) service_pool.cc:224] Handling call
0709 13:13:02.840917 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:02.841265 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:02.841304 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:02.849075 (+  7771us) log.cc:844] Serialized 26 byte log entry
0709 13:13:03.499296 (+650221us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:03.499335 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.499399 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:04.224456 (+725057us) raft_consensus.cc:1685] finished
0709 13:13:04.224477 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.224683 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17000,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":70,"thread_start_us":641886,"threads_started":1,"wal-append.queue_time_us":1059676}
I20260709 13:13:04.226408  1820 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:13:04.204313  2011 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:04.199664   476 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:04.209793  2035 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:04.210811  2047 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.193543  1855 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:04.216729  1138 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:04.216256   479 rpcz_store.cc:276] 0709 13:13:02.769841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.812865 (+ 43024us) service_pool.cc:224] Handling call
0709 13:13:02.866023 (+ 53158us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:02.866273 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:02.866307 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:02.866788 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:13:03.558291 (+691503us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:03.558347 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.558437 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:04.163423 (+604986us) raft_consensus.cc:1685] finished
0709 13:13:04.163453 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.163647 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":691102,"threads_started":1,"wal-append.queue_time_us":1145979}
W20260709 13:13:04.219831   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.213068   628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:04.226903  1820 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:13:04.045241  1822 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:04.224125   478 rpcz_store.cc:276] 0709 13:13:02.840229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.853568 (+ 13339us) service_pool.cc:224] Handling call
0709 13:13:02.864636 (+ 11068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:02.865005 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:02.865033 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:02.865463 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:13:03.803748 (+938285us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:03.803806 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.803908 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:04.223280 (+419372us) raft_consensus.cc:1685] finished
0709 13:13:04.223307 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.223466 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":2302,"thread_start_us":785371,"threads_started":1,"wal-append.queue_time_us":1172804}
I20260709 13:13:04.213522  1999 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.242081  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:04.242298   628 raft_consensus.cc:606] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:04.038758  2042 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:04.045939  1975 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:04.236377  2034 log.cc:927] Time spent T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:13:04.195550  1862 raft_consensus.cc:697] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:04.194824  1828 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:13:04.246872  2046 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
W20260709 13:13:04.243991  1955 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.015s	sys 0.013s
I20260709 13:13:04.251405  1938 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:04.268235   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 107) took 1025 ms. Trace:
I20260709 13:13:04.259406  1915 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:04.266618   558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.118s	user 0.032s	sys 0.063s
I20260709 13:13:04.276057   559 rpcz_store.cc:276] 0709 13:13:03.243160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.439578 (+196418us) service_pool.cc:224] Handling call
0709 13:13:03.439860 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:04.036219 (+596359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.036262 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:04.036318 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:04.036361 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.268014 (+231653us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b54001caf54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:04.268060 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.268183 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93455744,"thread_start_us":555277,"threads_started":1}
I20260709 13:13:04.244848  1855 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:04.234220  1976 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:04.268875  1140 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.003s	sys 0.021s
I20260709 13:13:04.252657  1999 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:04.288028   559 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:13:04.288848  2036 log.cc:927] Time spent T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.081s	user 0.000s	sys 0.003s
I20260709 13:13:04.244499  2047 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:04.251092  1822 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:04.291561   447 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.013s	sys 0.015s
I20260709 13:13:04.261004  1828 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:04.286795  1880 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:04.291363  1986 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.014s	sys 0.010s
W20260709 13:13:04.306032   447 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.013s	sys 0.015s
W20260709 13:13:04.309980   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 998207us
W20260709 13:13:04.310478   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.285933  1826 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:04.290202   558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.137s	user 0.032s	sys 0.064s
I20260709 13:13:04.306906   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1283) took 1787 ms. Trace:
W20260709 13:13:04.272168  1955 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.015s	sys 0.014s
W20260709 13:13:04.283222  2029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.007s	sys 0.016s
I20260709 13:13:04.318037  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:04.291765  1140 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.003s	sys 0.022s
I20260709 13:13:04.311805   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:04.322989   478 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.307091  1820 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:04.306389  1938 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:04.290529  1915 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:04.314344   553 rpcz_store.cc:276] 0709 13:13:02.519877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.521807 (+  1930us) service_pool.cc:224] Handling call
0709 13:13:02.522094 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:02.530093 (+  7999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:02.530128 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:02.540168 (+ 10040us) log.cc:844] Serialized 26 byte log entry
0709 13:13:03.497066 (+956898us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:03.497104 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.497167 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:04.298214 (+801047us) raft_consensus.cc:1685] finished
0709 13:13:04.298240 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.306846 (+  8606us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1941,"raft.queue_time_us":9489,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":2397,"thread_start_us":956533,"threads_started":1,"wal-append.queue_time_us":1377174}
I20260709 13:13:04.327950   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:04.318058  2029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.008s	sys 0.016s
W20260709 13:13:04.309713  1986 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.015s	sys 0.010s
I20260709 13:13:04.312069  2035 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.333184   479 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:04.313694  1826 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:04.318125  1955 raft_consensus.cc:697] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:13:04.325687  1972 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.938s	user 0.017s	sys 0.077s
W20260709 13:13:04.333343   477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.011s	sys 0.015s
W20260709 13:13:04.333175   475 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.012s	sys 0.014s
I20260709 13:13:04.293649  1862 consensus_queue.cc:237] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:04.363283   522 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.021s	sys 0.060s
W20260709 13:13:04.375872   522 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.021s	sys 0.060s
I20260709 13:13:04.314030  1880 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:04.326488  1820 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:13:04.359579  1988 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.009s	sys 0.022s
I20260709 13:13:04.375758   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:04.383769   479 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:04.357219  1826 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.329218  1978 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:04.376551   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 896444us
I20260709 13:13:04.360805  2042 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:04.378049   523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.011s	sys 0.022s
W20260709 13:13:04.360991  1972 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.017s	sys 0.077s
W20260709 13:13:04.365557   477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.011s	sys 0.015s
I20260709 13:13:04.371670   478 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:04.406186   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:04.406872   478 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:04.372980   475 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.012s	sys 0.014s
I20260709 13:13:04.408675   522 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:04.372645  2029 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:13:04.375864   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:04.420445   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:04.420902   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.374426  1986 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:04.395793   523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.012s	sys 0.022s
I20260709 13:13:04.381845  2011 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:04.378288  2045 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.423413   478 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
W20260709 13:13:04.391019  1988 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.010s	sys 0.022s
I20260709 13:13:04.425061   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:04.440857   479 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:04.425274   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 963481us
W20260709 13:13:04.367287  2001 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.110s	user 0.012s	sys 0.026s
I20260709 13:13:04.383061  1820 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.337508  1938 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:04.359794  2035 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:04.426715  1975 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:04.433708   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:04.444469   599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.014s	sys 0.030s
W20260709 13:13:04.424381  2020 consensus_meta.cc:287] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.862s	user 0.010s	sys 0.005s
W20260709 13:13:04.428005  1908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.030s	user 0.017s	sys 0.071s
W20260709 13:13:04.430792  1657 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.958s	user 0.025s	sys 0.057s
W20260709 13:13:04.471530   599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.014s	sys 0.030s
W20260709 13:13:04.449119  2001 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.202s	user 0.012s	sys 0.026s
W20260709 13:13:04.497241   555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.021s	sys 0.014s
W20260709 13:13:04.500317   555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.022s	sys 0.014s
I20260709 13:13:04.446902  1855 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:04.452592   551 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.020s	sys 0.039s
I20260709 13:13:04.445866  1995 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:04.507776   448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.005s	sys 0.026s
W20260709 13:13:04.476145  1908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.018s	sys 0.071s
W20260709 13:13:04.509182   448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.005s	sys 0.026s
W20260709 13:13:04.497746  1657 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.025s	sys 0.057s
W20260709 13:13:04.518136   449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.019s	sys 0.012s
W20260709 13:13:04.519439   449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.019s	sys 0.012s
I20260709 13:13:04.494769  2062 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.521028  2062 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:04.497936   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 1.02705e+06us
I20260709 13:13:04.433066  1986 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:04.432606  2029 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:04.523095   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:04.532145   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.530047   599 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:04.533155   524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.007s	sys 0.023s
W20260709 13:13:04.507475   551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.020s	sys 0.040s
I20260709 13:13:04.444341  2045 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:04.534386   524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.007s	sys 0.024s
W20260709 13:13:04.532799   482 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.006s	sys 0.025s
W20260709 13:13:04.543118   482 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.006s	sys 0.025s
I20260709 13:13:04.530910   479 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
W20260709 13:13:04.540810   450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.009s	sys 0.013s
I20260709 13:13:04.511439  1967 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:04.551599   525 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.004s	sys 0.012s
W20260709 13:13:04.551940   525 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.004s	sys 0.012s
W20260709 13:13:04.552194   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 521171us
W20260709 13:13:04.547827   450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.010s	sys 0.013s
I20260709 13:13:04.534413  1999 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:04.547823  1828 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:04.617702  2057 log.cc:927] Time spent T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 13:13:04.620537  1657 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.621012  1915 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:04.622653  2055 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:13:04.567060  1967 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:04.728509  2042 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.537206  2001 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:04.536604  1988 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:13:04.689491   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:04.793728   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.731431  2010 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:04.533375  2077 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:04.692175   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 162160us
W20260709 13:13:04.709815   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.546389  1982 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:04.531697  1978 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:04.533851  2063 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:04.567147  1908 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:04.726924  2020 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.741714   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1290) took 2105 ms. Trace:
W20260709 13:13:04.713806  2024 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.013s	sys 0.013s
W20260709 13:13:04.753136  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 348333us
I20260709 13:13:04.692806  2040 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.449631  1955 consensus_queue.cc:237] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:04.783704  2058 log.cc:927] Time spent T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.239s	user 0.002s	sys 0.005s
I20260709 13:13:04.784066  1972 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.785271   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 141) took 2305 ms. Trace:
I20260709 13:13:04.764648  1657 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:04.787735   617 tablet_service.cc:1558] Processing DeleteTablet for tablet 82382f158074497a857b03f9f87f9e86 with delete_type TABLET_DATA_TOMBSTONED (TS 50f7c2247be24f3685d7fbca7b6c71e3 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54246
I20260709 13:13:04.787835  1976 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:04.778386  1915 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:04.758932  2054 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
I20260709 13:13:04.754417  2009 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:04.750867  1880 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:04.819654  2047 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:04.737061  2068 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:04.883106  2040 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:04.786639  1938 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:04.885641  2024 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.014s	sys 0.013s
W20260709 13:13:04.899634  2044 log.cc:927] Time spent T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.372s	user 0.000s	sys 0.002s
I20260709 13:13:04.836468  1978 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:04.878420  2097 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.861163  2072 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.853686  1908 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:04.809026  2042 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:04.815184  1988 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.077232  1980 raft_consensus.cc:3055] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:04.814646  2010 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:04.814838  2001 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:04.913786  2079 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.906775  2062 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:04.914475  2029 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.154929  2102 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:04.855947  2092 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 13:13:04.989949  2071 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.992201  2011 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:04.993999  2082 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:04.833720  2077 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.169348  2082 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.170994  2077 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:04.995422  2059 log.cc:927] Time spent T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:13:04.996104  2099 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:04.998142  2043 log.cc:927] Time spent T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.992s	user 0.003s	sys 0.000s
W20260709 13:13:04.998682  2075 log.cc:927] Time spent T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:13:05.172538  2099 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:04.920661  2095 consensus_queue.cc:1059] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 13:13:05.154800  2079 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.138803  2072 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.178857  2095 raft_consensus.cc:3055] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:04.836272  2063 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:04.920861  2035 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:05.103289  2066 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:13:05.036005  2047 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.114550  2061 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.020746  2068 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:13:05.109704  2070 log.cc:927] Time spent T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.504s	user 0.001s	sys 0.000s
I20260709 13:13:05.187733  2068 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:05.187362  2061 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:05.064778  2080 log.cc:927] Time spent T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:13:05.076858  2078 log.cc:927] Time spent T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.346s	user 0.001s	sys 0.000s
I20260709 13:13:05.021123  2045 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.132983  2097 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.104808  2040 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:05.156778  2060 log.cc:927] Time spent T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.712s	user 0.002s	sys 0.004s
I20260709 13:13:05.158470  2042 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.171504  2071 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.174849  2099 leader_election.cc:290] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.163604  2102 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.181972  2079 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.182366  2063 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.152477  2104 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.179247  2095 raft_consensus.cc:740] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:05.183344  2113 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:05.185667  2082 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.184206  2114 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:05.186221  2047 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.193544  2098 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.189435  2062 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:05.212667  2062 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.213657  2072 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.214107  2047 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.214589  2061 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.204882  2071 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:05.204973  2097 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.205722  2104 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.212706  2095 consensus_queue.cc:260] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.214672  2062 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.217893  2095 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:05.218598  2104 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.205904  2113 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.214829  2114 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.221002  2113 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.225760  2102 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.222301  2098 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:04.892946   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.370249  2062 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.371343  2062 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.372200  2061 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:05.268280   448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.010s	sys 0.012s
I20260709 13:13:05.269833   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 159) took 1753 ms. Trace:
I20260709 13:13:05.270417   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 160) took 1749 ms. Trace:
I20260709 13:13:04.894898   483 rpcz_store.cc:276] 0709 13:13:02.479985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.480176 (+   191us) service_pool.cc:224] Handling call
0709 13:13:02.480490 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:03.002084 (+521594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.002130 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:03.020715 (+ 18585us) log.cc:844] Serialized 26 byte log entry
0709 13:13:04.008996 (+988281us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:04.009054 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.009299 (+   245us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:04.785035 (+775736us) raft_consensus.cc:1685] finished
0709 13:13:04.785057 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.785213 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":71087,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":1416773,"threads_started":2,"wal-append.queue_time_us":1211343}
I20260709 13:13:05.373095  2061 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:04.869220   481 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.011s	sys 0.050s
I20260709 13:13:05.276000   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 157) took 1875 ms. Trace:
I20260709 13:13:05.269834   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 139) took 2958 ms. Trace:
I20260709 13:13:04.851397   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 93) took 2599 ms. Trace:
W20260709 13:13:05.378034   481 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.012s	sys 0.051s
I20260709 13:13:05.278420   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1287) took 2642 ms. Trace:
I20260709 13:13:05.353178  2102 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:05.278537   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:04.877358   555 rpcz_store.cc:276] 0709 13:13:02.636682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.645541 (+  8859us) service_pool.cc:224] Handling call
0709 13:13:02.654265 (+  8724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:02.654447 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:03.807501 (+1153054us) log.cc:844] Serialized 14 byte log entry
0709 13:13:04.741311 (+933810us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:04.741367 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:04.741420 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.741504 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.741637 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29883,"prepare.queue_time_us":1337506,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":1305,"thread_start_us":2046999,"threads_started":3}
I20260709 13:13:05.352716  2072 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.279785   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 106) took 2215 ms. Trace:
I20260709 13:13:05.280083   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 105) took 2251 ms. Trace:
I20260709 13:13:04.855454   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 104) took 1854 ms. Trace:
I20260709 13:13:05.280380   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1286) took 2644 ms. Trace:
I20260709 13:13:05.279785   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 100) took 2314 ms. Trace:
W20260709 13:13:04.862416   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 91012.1us
W20260709 13:13:04.830554   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.290033   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 100) took 2122 ms. Trace:
W20260709 13:13:05.289791   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 462329us
I20260709 13:13:05.291353   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 102) took 1254 ms. Trace:
I20260709 13:13:05.291199   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:05.296166   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1284) took 1854 ms. Trace:
W20260709 13:13:04.990736  1166 consensus_meta.cc:287] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 1.099s	user 0.008s	sys 0.004s
I20260709 13:13:05.073856  1657 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:05.002472  1822 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.542335  1822 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.516955   476 rpcz_store.cc:276] 0709 13:13:03.441645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.933711 (+492066us) service_pool.cc:224] Handling call
0709 13:13:04.002972 (+ 69261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:04.231327 (+228355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.295427 (+1064100us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54002de454. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:05.295926 (+   499us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433812224}
I20260709 13:13:05.378616   475 rpcz_store.cc:276] 0709 13:13:02.310969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.313890 (+  2921us) service_pool.cc:224] Handling call
0709 13:13:02.380082 (+ 66192us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:03.238581 (+858499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.243298 (+  4717us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:03.388123 (+144825us) log.cc:844] Serialized 26 byte log entry
0709 13:13:04.431837 (+1043714us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:04.433222 (+  1385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.444660 (+ 11438us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.269104 (+824444us) raft_consensus.cc:1685] finished
0709 13:13:05.269152 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.269515 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2496,"raft.queue_time_us":70938,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":21916,"thread_start_us":1765721,"threads_started":2,"wal-append.queue_time_us":1448459}
I20260709 13:13:05.098273  1855 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:13:05.373673   484 rpcz_store.cc:276] 0709 13:13:03.516371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.215480 (+699109us) service_pool.cc:224] Handling call
0709 13:13:04.215845 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:04.216103 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.216139 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:04.219548 (+  3409us) log.cc:844] Serialized 26 byte log entry
0709 13:13:04.538075 (+318527us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:04.544518 (+  6443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.544600 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.269023 (+724423us) raft_consensus.cc:1685] finished
0709 13:13:05.269101 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.269526 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":317844,"threads_started":1,"wal-append.queue_time_us":770774}
I20260709 13:13:05.478155   558 rpcz_store.cc:276] 0709 13:13:03.064484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.065962 (+  1478us) service_pool.cc:224] Handling call
0709 13:13:03.114755 (+ 48793us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:03.115206 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.115374 (+   168us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:03.148676 (+ 33302us) log.cc:844] Serialized 26 byte log entry
0709 13:13:04.322654 (+1173978us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:04.327544 (+  4890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.339056 (+ 11512us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.279133 (+940077us) raft_consensus.cc:1685] finished
0709 13:13:05.279185 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.279549 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":187,"raft.queue_time_us":229,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":13472,"thread_start_us":1165181,"threads_started":1,"wal-append.queue_time_us":1397494}
I20260709 13:13:05.544981   552 rpcz_store.cc:276] 0709 13:13:02.997114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.997766 (+   652us) service_pool.cc:224] Handling call
0709 13:13:02.999581 (+  1815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:03.023595 (+ 24014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.023646 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:03.024231 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 13:13:04.037580 (+1013349us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:04.037652 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.037766 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:04.808796 (+771030us) raft_consensus.cc:1685] finished
0709 13:13:04.808815 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.851495 (+ 42680us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"thread_start_us":996959,"threads_started":1,"wal-append.queue_time_us":1287870}
I20260709 13:13:04.952490  1862 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:04.988130  1915 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.543068  1822 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.476450   477 rpcz_store.cc:276] 0709 13:13:03.400550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.404811 (+  4261us) service_pool.cc:224] Handling call
0709 13:13:03.405223 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:03.405641 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.405688 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:03.406222 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:13:04.427904 (+1021682us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:04.432904 (+  5000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.446226 (+ 13322us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.275399 (+829173us) raft_consensus.cc:1685] finished
0709 13:13:05.275454 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.275780 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1964,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":2143,"thread_start_us":959071,"threads_started":1,"wal-append.queue_time_us":1639777}
I20260709 13:13:05.543056  2102 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.561553  1822 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.561715  1915 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.562157  1822 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:04.990208  1949 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.905987  1972 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:05.570859   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.571451  1166 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:05.572435  1166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 291) took 1987 ms. Trace:
I20260709 13:13:05.572902  1174 raft_consensus.cc:1240] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:13:05.573761  1972 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.574473  1972 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.918869  1976 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:05.576152  1976 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:04.918226  1986 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:05.515398   633 rpcz_store.cc:276] 0709 13:13:04.036610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.160827 (+124217us) service_pool.cc:224] Handling call
0709 13:13:04.237574 (+ 76747us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:04.698348 (+460774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.726534 (+ 28186us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:04.853106 (+126572us) log.cc:844] Serialized 26 byte log entry
0709 13:13:04.964270 (+111164us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:04.964329 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.964423 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.290748 (+326325us) raft_consensus.cc:1685] finished
0709 13:13:05.290793 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.291131 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3004,"raft.queue_time_us":176270,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":10097,"thread_start_us":467245,"threads_started":2,"wal-append.queue_time_us":334827}
I20260709 13:13:05.578892  1986 consensus_queue.cc:1059] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:05.580067   559 raft_consensus.cc:1240] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:05.580420  1986 raft_consensus.cc:3055] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:05.575073  1174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 404) took 1335 ms. Trace:
I20260709 13:13:05.580862  1986 raft_consensus.cc:740] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:04.829350  1982 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.581269  1174 rpcz_store.cc:276] 0709 13:13:04.239920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.240077 (+   157us) service_pool.cc:224] Handling call
0709 13:13:05.572316 (+1332239us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:05.573422 (+  1106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.574778 (+  1356us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540069e950. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:05.574975 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3055931776}
I20260709 13:13:04.893764  2020 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.155550  2029 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.314960  1170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 405) took 1074 ms. Trace:
I20260709 13:13:05.143882  1980 raft_consensus.cc:740] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:05.317665  1978 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.318753  1988 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:05.322580  1826 consensus_meta.cc:287] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.910s	user 0.005s	sys 0.006s
I20260709 13:13:05.234355  2114 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.329564  1168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 407) took 1082 ms. Trace:
W20260709 13:13:05.307802  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 420216us
I20260709 13:13:05.333082  2063 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:05.351946  2079 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.656005  1986 consensus_queue.cc:260] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.656669  2079 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.658573  1986 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:05.351931  1908 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.355657  2107 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:05.660758  2107 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.363219  2099 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:05.363376  2110 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.366992   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1269) took 2597 ms. Trace:
I20260709 13:13:05.605618  1822 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.223739  2068 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.666548  1982 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.663406   482 rpcz_store.cc:276] 0709 13:13:02.768282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.782548 (+ 14266us) service_pool.cc:224] Handling call
0709 13:13:02.782857 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:03.923428 (+1140571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.923475 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:03.924011 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:13:04.543655 (+619644us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:04.543783 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.544017 (+   234us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.355128 (+811111us) raft_consensus.cc:1685] finished
0709 13:13:05.355165 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.365817 (+ 10652us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":63317,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":1759381,"threads_started":2,"wal-append.queue_time_us":1300636}
I20260709 13:13:05.668131  2068 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.369616  2001 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.354926  2104 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.669824  2104 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.654839  1168 rpcz_store.cc:276] 0709 13:13:04.240948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.245769 (+  4821us) service_pool.cc:224] Handling call
0709 13:13:04.272012 (+ 26243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:04.331214 (+ 59202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.334656 (+  3442us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:04.355420 (+ 20764us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:04.360221 (+  4801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.323054 (+962833us) spinlock_profiling.cc:243] Waited 51.3 ms on lock 0x7b54005ed154. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:05.323166 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.323511 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117881216}
W20260709 13:13:05.459537   450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.022s	sys 0.026s
W20260709 13:13:05.672664   450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.026s	sys 0.026s
I20260709 13:13:05.673028  2104 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.673919  1908 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:05.379313   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 161) took 1496 ms. Trace:
I20260709 13:13:05.674665  1908 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.675639   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:05.429061  2077 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.675450   481 rpcz_store.cc:276] 0709 13:13:03.883322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.226645 (+343323us) service_pool.cc:224] Handling call
0709 13:13:04.226952 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:04.227228 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.228933 (+  1705us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:04.229454 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:13:05.378774 (+1149320us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:05.378866 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.378993 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.379073 (+    80us) raft_consensus.cc:1685] finished
0709 13:13:05.379089 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.379259 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14711,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":4966,"thread_start_us":1148742,"threads_started":1,"wal-append.queue_time_us":997046}
I20260709 13:13:05.676954  2077 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.426932  2125 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:05.380777   448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.011s	sys 0.012s
I20260709 13:13:05.475044  2035 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.496393  2083 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.508237  1967 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.508952   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:05.509291  2061 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:05.460355  2062 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:05.429397  1820 consensus_meta.cc:287] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.951s	user 0.012s	sys 0.004s
I20260709 13:13:05.474680  2031 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:05.686499   617 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.036s	sys 0.022s
W20260709 13:13:05.533155   525 connection.cc:256] RPC call timeout handler was delayed by -1.1849699869999313s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
I20260709 13:13:05.460094  2082 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:05.546259   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:05.146070  1938 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.526024  2101 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.475907   557 rpcz_store.cc:276] 0709 13:13:02.964898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.966388 (+  1490us) service_pool.cc:224] Handling call
0709 13:13:02.966712 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:02.967114 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:02.967151 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:02.983594 (+ 16443us) log.cc:844] Serialized 26 byte log entry
0709 13:13:04.013288 (+1029694us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:04.013327 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.013407 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.279156 (+1265749us) raft_consensus.cc:1685] finished
0709 13:13:05.279196 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.279555 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":608,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":7317,"thread_start_us":1029342,"threads_started":1,"wal-append.queue_time_us":1368847}
I20260709 13:13:05.511484   626 rpcz_store.cc:276] 0709 13:13:03.167688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.167809 (+   121us) service_pool.cc:224] Handling call
0709 13:13:03.168226 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:03.168524 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.168561 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:03.170283 (+  1722us) log.cc:844] Serialized 26 byte log entry
0709 13:13:04.035758 (+865475us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:04.035812 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.035903 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.154900 (+1118997us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:05.287481 (+132581us) raft_consensus.cc:1685] finished
0709 13:13:05.287524 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.289773 (+  2249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5126400,"thread_start_us":848426,"threads_started":1,"wal-append.queue_time_us":1258248}
I20260709 13:13:05.474642  2106 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.562621  2102 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.563004   630 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:05.374806   480 rpcz_store.cc:276] 0709 13:13:03.521215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.220748 (+699533us) service_pool.cc:224] Handling call
0709 13:13:04.221215 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:04.221757 (+   542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.221811 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:04.222488 (+   677us) log.cc:844] Serialized 26 byte log entry
0709 13:13:04.565693 (+343205us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:04.577289 (+ 11596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.600060 (+ 22771us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.269818 (+669758us) raft_consensus.cc:1685] finished
0709 13:13:05.269852 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.270192 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9097,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":6278,"thread_start_us":326064,"threads_started":1,"wal-append.queue_time_us":773830}
W20260709 13:13:05.077320  1944 consensus_meta.cc:287] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 1.053s	user 0.009s	sys 0.004s
I20260709 13:13:05.379549   556 rpcz_store.cc:276] 0709 13:13:02.635727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.636890 (+  1163us) service_pool.cc:224] Handling call
0709 13:13:02.637300 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:02.637688 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:02.637728 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:02.646449 (+  8721us) log.cc:844] Serialized 26 byte log entry
0709 13:13:03.466877 (+820428us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:03.466915 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.466996 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:04.883903 (+1416907us) spinlock_profiling.cc:243] Waited 8.13 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:05.277679 (+393776us) raft_consensus.cc:1685] finished
0709 13:13:05.277724 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.278176 (+   452us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4711,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":11357,"spinlock_wait_cycles":18695040,"thread_start_us":795783,"threads_started":1,"wal-append.queue_time_us":1229678}
I20260709 13:13:05.563805  2072 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.500183   550 rpcz_store.cc:276] 0709 13:13:03.028455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.031402 (+  2947us) service_pool.cc:224] Handling call
0709 13:13:03.074070 (+ 42668us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:03.103955 (+ 29885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.104003 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:03.114739 (+ 10736us) log.cc:844] Serialized 26 byte log entry
0709 13:13:04.223358 (+1108619us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:04.223412 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.223493 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.279533 (+1056040us) raft_consensus.cc:1685] finished
0709 13:13:05.279577 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.279861 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9596,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":15919,"thread_start_us":1108126,"threads_started":1,"wal-append.queue_time_us":1334610}
I20260709 13:13:05.567207  1657 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:05.567806  2088 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:13:05.568323   522 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.002s	sys 0.011s
I20260709 13:13:05.378458   551 rpcz_store.cc:276] 0709 13:13:02.251564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.284689 (+ 33125us) service_pool.cc:224] Handling call
0709 13:13:02.319158 (+ 34469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:02.372783 (+ 53625us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:03.623220 (+1250437us) log.cc:844] Serialized 14 byte log entry
0709 13:13:04.808832 (+1185612us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:04.814237 (+  5405us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:04.834758 (+ 20521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.851078 (+ 16320us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.851317 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1450865,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":7165,"raft.queue_time_us":450179,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":2284013,"threads_started":3,"wal-append.queue_time_us":1274155}
I20260709 13:13:05.576017  1949 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.569875   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:04.996543  1995 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:05.078274  2009 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:13:05.571967   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.476549   554 rpcz_store.cc:276] 0709 13:13:02.635405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.638281 (+  2876us) service_pool.cc:224] Handling call
0709 13:13:02.638650 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:02.642740 (+  4090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:02.642784 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:02.647982 (+  5198us) log.cc:844] Serialized 26 byte log entry
0709 13:13:04.010230 (+1362248us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:04.010284 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.010370 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.279828 (+1269458us) raft_consensus.cc:1685] finished
0709 13:13:05.279863 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.280138 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4827,"raft.queue_time_us":3775,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":14036,"thread_start_us":1337905,"threads_started":1,"wal-append.queue_time_us":1779100}
I20260709 13:13:05.602061  1976 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.551672  1862 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.602247   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:05.646799  1880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.016s	sys 0.057s
I20260709 13:13:05.581533  1972 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.606396   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:05.572913  1166 rpcz_store.cc:276] 0709 13:13:03.585428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.585561 (+   133us) service_pool.cc:224] Handling call
0709 13:13:05.572281 (+1986720us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:05.651571  1826 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.655613  2063 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.667536  2099 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.669603  1980 consensus_queue.cc:260] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:05.369696  2086 log.cc:927] Time spent T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:13:05.380738  2010 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:05.683036  2127 tablet_replica.cc:333] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:13:05.683614  1908 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.683681  2035 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:05.687111   525 connection.cc:256] RPC call timeout handler was delayed by -1.1444943869998951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20030000000000003s for a response
I20260709 13:13:05.653468  1915 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:13:05.686203  2083 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.653477  2098 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.793581   559 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:05.770699   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:05.664819  2079 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:05.688512   617 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.036s	sys 0.022s
I20260709 13:13:05.682123  1982 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:05.805539   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.819870  1822 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.821063   628 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:05.722297  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:05.823586  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:05.823993  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:05.824846  2035 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.825284  2029 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.825881   525 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:05.804713   522 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.005s	sys 0.012s
I20260709 13:13:05.692121   599 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:05.728969  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:05.832547  1967 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.832625  1995 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.833503  1967 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.728353  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:05.692932  1988 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:05.692559  2077 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.760661  2107 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.826282  2101 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:05.827688  1880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.016s	sys 0.061s
I20260709 13:13:05.691005  1978 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.727144  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:05.842036   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 150062us
I20260709 13:13:05.824855  1166 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:05.686417  1820 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.850618  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:05.851899  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:05.852241  1820 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.852509  1172 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:05.703192  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:05.848001   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.701462  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:05.680270  2125 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.857291  1978 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.849607   481 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
W20260709 13:13:05.844894   629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.029s	sys 0.068s
I20260709 13:13:05.856585  2009 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:05.760126  2106 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.857041  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:05.857185  1938 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.687922  2031 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.858315  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:05.854775  1822 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:05.859896   552 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:05.875373   477 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:05.875665   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:05.876442   480 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 1.
I20260709 13:13:05.880787   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:05.881551   476 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:05.881944   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:05.855327  1980 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:05.882460  1908 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:05.882586   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:05.883533   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.884346   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54754 (request call id 101) took 1850 ms. Trace:
I20260709 13:13:05.884580  1976 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:05.884794   630 rpcz_store.cc:276] 0709 13:13:04.033721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.037312 (+  3591us) service_pool.cc:224] Handling call
0709 13:13:05.290621 (+1253309us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b5800167198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:05.884108 (+593487us) spinlock_profiling.cc:243] Waited 46 ms on lock 0x7b54000bead4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:05.884239 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144645376}
I20260709 13:13:05.885339  1976 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.886365  2085 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.856611  1175 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:05.863349   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:05.864019  2099 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.864377  2063 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.864634  1826 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.865866  2072 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.866549  1880 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.648321  1170 rpcz_store.cc:276] 0709 13:13:04.240345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.242777 (+  2432us) service_pool.cc:224] Handling call
0709 13:13:04.243304 (+   527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:04.243797 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.243847 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:04.248537 (+  4690us) log.cc:844] Serialized 26 byte log entry
0709 13:13:04.531577 (+283040us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:04.536633 (+  5056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.545822 (+  9189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.314156 (+768334us) raft_consensus.cc:1685] finished
0709 13:13:05.314220 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.314628 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":257946,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":27969,"thread_start_us":258752,"threads_started":1,"wal-append.queue_time_us":924234}
I20260709 13:13:05.859925  1944 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.860801   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:05.867386  2088 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.853574  2010 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:05.695986  2082 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.874747   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:05.883436   557 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
W20260709 13:13:05.861485   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.882648   484 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 1.
I20260709 13:13:05.691274  2110 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.884449  1972 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.886998  2085 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.892555  2035 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:13:05.894801   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 69166.2us
I20260709 13:13:05.888804  1167 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:05.884443  1908 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.899477  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:05.902618  2115 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.902920  1995 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.889168  1822 raft_consensus.cc:697] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:05.903363  1976 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.868494  1988 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:05.909174  2083 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.897614   558 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:05.910257   551 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:05.910444   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:05.911088  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.911382  1880 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.913735  1938 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.896009   550 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:05.915599  1944 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.916162  1173 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
W20260709 13:13:05.916606  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.916455  2125 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:05.907837   554 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 1.
I20260709 13:13:05.869995  1982 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:05.870769   629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.030s	sys 0.068s
I20260709 13:13:05.936060  2035 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:05.936275  2095 consensus_queue.cc:1059] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:05.937634  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:05.943257  2114 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:05.944370  2131 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:13:05.945267  1171 raft_consensus.cc:2393] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:05.945138   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:05.945904   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:05.911144  2088 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:06.281894   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:06.276866   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:05.991966   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:06.286850   481 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
W20260709 13:13:06.166903   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 64094.4us
I20260709 13:13:05.946087   597 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:05.902463  1168 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
W20260709 13:13:06.331224   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.285772   556 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
W20260709 13:13:06.257608  1175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 408) took 2016 ms (client timeout 2113 ms). Trace:
I20260709 13:13:05.950436   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:06.048523  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:05.917883  2010 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:13:06.332585   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 390009us
I20260709 13:13:06.333285   557 raft_consensus.cc:2393] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:06.342800   559 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:06.344549   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1360) took 1047 ms. Trace:
I20260709 13:13:06.340427  1174 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:06.344959   559 rpcz_store.cc:276] 0709 13:13:05.297101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.841601 (+544500us) service_pool.cc:224] Handling call
0709 13:13:06.281676 (+440075us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b5800116198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:06.344484 (+ 62808us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9316224}
W20260709 13:13:06.333509  1175 rpcz_store.cc:269] 0709 13:13:04.241287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.241396 (+   109us) service_pool.cc:224] Handling call
0709 13:13:06.219183 (+1977787us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b540067d9d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:06.257486 (+ 38303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3529682688}
I20260709 13:13:05.920881  2031 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:05.947923   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:06.353145   555 raft_consensus.cc:2393] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:06.377754   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1306) took 1082 ms. Trace:
I20260709 13:13:06.352813  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:06.276541   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:06.378232   555 rpcz_store.cc:276] 0709 13:13:05.295630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.508320 (+212690us) service_pool.cc:224] Handling call
0709 13:13:06.282974 (+774654us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b5400387da8. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e1f6924 00007f4b6d3df227 00007f4b6d3deab8 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6
0709 13:13:06.377669 (+ 94695us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12415360}
I20260709 13:13:05.947822  1908 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:06.328835   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1303) took 1034 ms. Trace:
I20260709 13:13:05.949595  2085 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:06.282091  1995 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:06.387786   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:05.952617  1978 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:06.024932  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:05.995837  2106 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:06.279495  1862 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:06.280751  2101 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:06.276232  2082 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:06.028569  2029 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:06.278993   628 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:06.217984   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.389653  1171 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:06.394044   484 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:13:06.439531   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:05.922369  1169 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:06.398097   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:05.946051  2020 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:06.339923   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1361) took 1032 ms. Trace:
I20260709 13:13:06.333698   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1358) took 1044 ms. Trace:
I20260709 13:13:06.077175  2072 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:06.133698  2113 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:06.149715  1949 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:06.395097   525 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:06.345898  2010 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:06.399781   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:06.403378   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:06.332835  2083 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:06.430671  1975 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:06.395794   630 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:06.393568   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:05.950095  2011 consensus_queue.cc:1048] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.454s
I20260709 13:13:06.435160   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:06.435395   448 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:06.436997  2035 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:06.437229   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.405546  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:06.444413   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 103) took 2407 ms. Trace:
I20260709 13:13:06.429349  1967 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:06.444864   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:05.947973   477 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:06.346233  2009 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:06.445439   554 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:13:06.447340   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:06.428447  2114 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:06.439157   475 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.010s	sys 0.050s
I20260709 13:13:06.450326   552 rpcz_store.cc:276] 0709 13:13:05.297498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.547032 (+249534us) service_pool.cc:224] Handling call
0709 13:13:06.282661 (+735629us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x7b54001f27d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:06.289856 (+  7195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132601088}
I20260709 13:13:06.456144   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.457816   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:06.455348   555 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:06.454998   556 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:06.459199   626 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
W20260709 13:13:06.467641   475 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.011s	sys 0.050s
I20260709 13:13:06.441740  1995 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:06.481305  1982 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:06.481706   476 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:06.463411   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:06.406945  2115 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:06.462229   478 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:06.453747  2110 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:06.467864   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1294) took 1186 ms. Trace:
W20260709 13:13:06.456617   598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.028s	sys 0.039s
I20260709 13:13:06.393858   551 rpcz_store.cc:276] 0709 13:13:05.294263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.835170 (+540907us) service_pool.cc:224] Handling call
0709 13:13:06.289555 (+454385us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:06.477505   484 raft_consensus.cc:2393] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:06.479463   553 raft_consensus.cc:2393] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:06.483963   481 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:06.484397   557 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
W20260709 13:13:06.485941   598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.029s	sys 0.039s
I20260709 13:13:06.485705   559 rpcz_store.cc:276] 0709 13:13:05.281225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.431115 (+1149890us) service_pool.cc:224] Handling call
0709 13:13:06.467807 (+ 36692us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:06.482996   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:06.477777  1949 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:06.494002   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:06.503140   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:06.451087   550 rpcz_store.cc:276] 0709 13:13:05.286682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.831358 (+544676us) service_pool.cc:224] Handling call
0709 13:13:06.331443 (+500085us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1918848}
I20260709 13:13:06.499557   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.499815   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:06.462845  1822 consensus_queue.cc:237] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:06.509078   484 raft_consensus.cc:1813] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Handling vote request from an unknown peer 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:06.509275   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:06.509785   484 raft_consensus.cc:2410] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:13:06.509991   559 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:06.510563   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1302) took 1216 ms. Trace:
I20260709 13:13:06.510601   484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:52312
I20260709 13:13:06.511615   484 raft_consensus.cc:606] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:06.500319   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:06.508363   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:06.473066  2035 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:06.513685   556 raft_consensus.cc:2393] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:06.503408  1166 raft_consensus.cc:2393] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 4: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:06.494349   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:06.461077  2139 consensus_queue.cc:1059] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 13:13:06.500381   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 167450us
I20260709 13:13:06.463012  2083 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:06.517593   484 raft_consensus.cc:614] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:06.504163   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:06.518429   481 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:06.476939   633 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:06.510980   559 rpcz_store.cc:276] 0709 13:13:05.293829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.508977 (+1215148us) service_pool.cc:224] Handling call
0709 13:13:06.510489 (+  1512us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:06.499861   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.515206   554 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:06.505123   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.501032  1988 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:06.520205   478 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:13:06.471956  2072 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:06.505112  1949 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.508136   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:06.513754  2035 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:06.536755   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:06.549897   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.537569   625 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:06.526171  2135 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:06.541131   630 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:06.542692   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1295) took 1260 ms. Trace:
I20260709 13:13:06.543062   525 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:06.543756  2009 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:06.492651  2113 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:06.544045  2137 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:13:06.553618   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:06.546604  1949 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:06.565932  1995 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:06.569847  2020 raft_consensus.cc:3055] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:06.519305   476 raft_consensus.cc:2376] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2. Re-sending same reply.
I20260709 13:13:06.570255  2020 raft_consensus.cc:740] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:06.564044   556 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:06.571983   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:06.572570   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.573313   632 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:06.573472   556 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:06.572063  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:06.574111   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1354) took 1298 ms. Trace:
I20260709 13:13:06.574352  1172 raft_consensus.cc:2393] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:06.574438   556 rpcz_store.cc:276] 0709 13:13:05.275754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.572953 (+1297199us) service_pool.cc:224] Handling call
0709 13:13:06.573276 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:06.573863 (+   587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.574044 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:06.575328   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:06.577173   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.577997   633 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:06.579183   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:06.545956   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:06.550954  2035 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:06.516993  2095 consensus_queue.cc:1048] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:13:06.559502  2135 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.588570   555 raft_consensus.cc:2410] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:06.558118  2088 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:06.565258  1880 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:06.621498   556 raft_consensus.cc:1240] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:06.587757   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:06.623819  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 195922us
I20260709 13:13:06.594961  2135 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:06.587869   551 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
W20260709 13:13:06.632988  2129 log.cc:927] Time spent T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.358s	user 0.001s	sys 0.001s
I20260709 13:13:06.601655   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1365) took 1300 ms. Trace:
I20260709 13:13:06.560974   558 rpcz_store.cc:276] 0709 13:13:05.282635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.545850 (+263215us) service_pool.cc:224] Handling call
0709 13:13:06.542494 (+996644us) spinlock_profiling.cc:243] Waited 75.1 ms on lock 0x7b54002008d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:06.542627 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172724992}
I20260709 13:13:06.635469   625 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:13:06.619141  2009 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:06.635502   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1355) took 1352 ms. Trace:
I20260709 13:13:06.643154   556 rpcz_store.cc:276] 0709 13:13:05.276151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.583070 (+1306919us) service_pool.cc:224] Handling call
0709 13:13:06.596112 (+ 13042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:06.626061 (+ 29949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.628103 (+  2042us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:06.646163  1657 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.571175  2020 consensus_queue.cc:260] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:06.650211   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 704328us
W20260709 13:13:06.652865   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 204037us
I20260709 13:13:06.650668  1657 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:06.657990   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.658725   625 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:13:06.660118   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.660779   626 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:06.661293   630 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
W20260709 13:13:06.661628   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 118738us
I20260709 13:13:06.662446   525 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:06.664163  2101 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:06.664337   525 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:06.664691  2101 raft_consensus.cc:697] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:06.664909   551 raft_consensus.cc:1240] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:06.665745   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1356) took 1389 ms. Trace:
I20260709 13:13:06.666087   525 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:06.665805  2101 consensus_queue.cc:237] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:06.666216   551 rpcz_store.cc:276] 0709 13:13:05.276485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.664390 (+1387905us) service_pool.cc:224] Handling call
0709 13:13:06.664732 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:06.665362 (+   630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.665651 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:06.667336  1938 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:06.667527  1822 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:06.667675   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.667896  1938 raft_consensus.cc:697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:06.669330  2020 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:06.669015  1938 consensus_queue.cc:237] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:06.676908   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 164) took 1002 ms. Trace:
I20260709 13:13:06.461233   629 rpcz_store.cc:276] 0709 13:13:04.036960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.037972 (+  1012us) service_pool.cc:224] Handling call
0709 13:13:04.234357 (+196385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:04.634776 (+400419us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b480024e358. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6d342aa1 00007f4b6d339b37 00007f4b6d3399ca 00007f4b6d43126f 00007f4b6d430f37 00007f4b6d44555c 00007f4b6d445508 00007f4b6d445488 00007f4b6d445443 00007f4b6d4446ec 00007f4b6c36ea96
0709 13:13:04.698386 (+ 63610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.720636 (+ 22250us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:04.851615 (+130979us) log.cc:844] Serialized 26 byte log entry
0709 13:13:06.393233 (+1541618us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:06.393323 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.393468 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:06.393559 (+    91us) raft_consensus.cc:1685] finished
0709 13:13:06.393578 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:06.444332 (+ 50754us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":581,"raft.queue_time_us":176233,"raft.run_cpu_time_us":2691,"raft.run_wall_time_us":203169,"spinlock_wait_cycles":20380032,"thread_start_us":1766439,"threads_started":2,"wal-append.queue_time_us":811232}
I20260709 13:13:06.680450  2009 raft_consensus.cc:697] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:06.681682  2009 consensus_queue.cc:237] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:06.626966  1862 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:06.636880  1880 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.686132  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:06.686219  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:06.686926  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:06.687273  2072 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:06.687657  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:06.637256   552 rpcz_store.cc:276] 0709 13:13:05.298910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.478905 (+1179995us) service_pool.cc:224] Handling call
0709 13:13:06.598900 (+119995us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:06.689985  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:06.691323  2113 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:06.691174   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:06.685034  1822 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.693989  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:06.685184  2114 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:06.695923  2083 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:06.683701  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:06.696663   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:06.724143  1175 raft_consensus.cc:1813] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Handling vote request from an unknown peer 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:06.724400   556 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 1.
I20260709 13:13:06.725783  1171 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:13:06.726388  1880 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:06.727255  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:06.727819  1173 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:06.677517   477 rpcz_store.cc:276] 0709 13:13:05.674968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.675162 (+   194us) service_pool.cc:224] Handling call
0709 13:13:06.676651 (+1001489us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54000d52d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:06.676803 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":446446464}
I20260709 13:13:06.664330   558 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:06.716693  1822 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:06.726622   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:06.702633   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 45306.4us
W20260709 13:13:06.739722   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 177174us
I20260709 13:13:06.726903   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:06.731391   624 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:06.742290  1175 raft_consensus.cc:2393] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:06.728960  1880 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:06.724083  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.697026  2010 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:06.711620  1169 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:06.749395   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.703312  1949 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:06.753401  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 121878us
I20260709 13:13:06.740244   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.731181  2115 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:06.712069  1862 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:06.750867  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:06.776925   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.757699  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:06.764336   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 98329.2us
I20260709 13:13:06.779428   557 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:06.780849   632 raft_consensus.cc:1240] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:06.755965  2083 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:06.764003   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:06.782194  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 224922us
I20260709 13:13:06.815546   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.752087   552 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:13:06.750618   550 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:06.820801   525 leader_election.cc:304] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:06.822721   556 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:13:06.762033  2114 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:06.826226  2114 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:06.829098  2114 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:06.762686   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1357) took 1477 ms. Trace:
I20260709 13:13:06.814088  1167 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:06.783993  2010 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:06.840021   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:06.842149   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 139461us
I20260709 13:13:06.856670  1175 raft_consensus.cc:1240] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:13:06.842808   556 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 1.
I20260709 13:13:06.841658   624 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:06.863860   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:06.865638   525 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:06.834473   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1309) took 1129 ms. Trace:
I20260709 13:13:06.838179  1938 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:06.868135   556 raft_consensus.cc:2393] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 2: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:06.785948  2035 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:06.875552  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 92803.1us
I20260709 13:13:06.888038   525 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:06.888509  2127 raft_consensus.cc:2243] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:06.888998  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 77629.1us
I20260709 13:13:06.889681  2127 raft_consensus.cc:2272] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.889816   525 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:06.832432  2083 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:06.888897  2009 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:06.892292   597 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:06.869010  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:06.895764   523 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:06.881209  1938 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.837282   558 rpcz_store.cc:276] 0709 13:13:05.286197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.663418 (+1377221us) service_pool.cc:224] Handling call
0709 13:13:06.663898 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:06.730974 (+ 67076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.753954 (+ 22980us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:06.886138   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.910589   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:06.910914   597 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:06.893957  2009 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.898329  2114 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:13:06.924917   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 152533us
I20260709 13:13:06.927033   633 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:06.928161   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.928893   633 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:06.929347  2145 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:06.929764  2145 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.929875   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.930169  2145 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:06.901830  2113 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:06.936575   556 raft_consensus.cc:2393] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 2: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:06.905154  1938 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:06.904789  2010 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:06.899575   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:06.894876  2135 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:06.948004   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1367) took 1224 ms. Trace:
I20260709 13:13:06.944612   523 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:06.868906   550 rpcz_store.cc:276] 0709 13:13:05.704037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.519007 (+814970us) service_pool.cc:224] Handling call
0709 13:13:06.690964 (+171957us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b5800116198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:06.833660 (+142696us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6092672}
I20260709 13:13:06.918454  2009 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:06.955574   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:06.955515   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:06.956506  2157 log.cc:927] Time spent T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:13:06.956391   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:06.979828   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 54057.6us
I20260709 13:13:06.956832  2072 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:06.957132   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:06.957742   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:06.962630   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.963856   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:06.965973  2145 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:06.965989   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.977453   483 raft_consensus.cc:2393] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:06.968559   555 rpcz_store.cc:276] 0709 13:13:05.723688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.485948 (+762260us) service_pool.cc:224] Handling call
0709 13:13:06.942227 (+456279us) spinlock_profiling.cc:243] Waited 74.9 ms on lock 0x7b540031a6d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:06.947944 (+  5717us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172326784}
I20260709 13:13:06.978830   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:06.980587   523 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:06.944192  2113 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.943686  1949 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:06.968629  2010 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.954002  2101 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.009119   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:07.009913   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:07.013340  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 122767us
I20260709 13:13:07.015141   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:07.015537   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 169) took 1135 ms. Trace:
I20260709 13:13:07.016016   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1375) took 1180 ms. Trace:
I20260709 13:13:07.017644   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:07.018527   624 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.016358   480 rpcz_store.cc:276] 0709 13:13:05.879654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.893242 (+ 13588us) service_pool.cc:224] Handling call
0709 13:13:06.481592 (+588350us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4eee 0000000000375939 00007f4b6d3681e0 00007f4b6d4310c4 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:06.481766 (+   174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:06.482093 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:06.814047 (+331954us) log.cc:844] Serialized 14 byte log entry
0709 13:13:06.989172 (+175125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:07.015085 (+ 25913us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:07.015187 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.015310 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.015461 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12958,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":2616,"raft.queue_time_us":79375,"spinlock_wait_cycles":91434368,"thread_start_us":371757,"threads_started":2}
I20260709 13:13:07.020219   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.021412   480 raft_consensus.cc:2410] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:07.022683   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.024376   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.025581   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.026307   630 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:07.028204   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.028787   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:07.029449   483 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.029899   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.031641   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:07.032219   447 leader_election.cc:336] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 1.535s (SENT)
W20260709 13:13:07.033257   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.033003   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.033815   629 raft_consensus.cc:1813] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Handling vote request from an unknown peer 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:07.034567   629 raft_consensus.cc:2410] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:13:07.035913   629 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:07.037358   629 raft_consensus.cc:1275] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.024564   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1292) took 1745 ms. Trace:
I20260709 13:13:07.040161   557 rpcz_store.cc:276] 0709 13:13:05.279159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.678639 (+1399480us) service_pool.cc:224] Handling call
0709 13:13:06.679077 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:06.782470 (+103393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.024296 (+241826us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b540031abd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:07.024497 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230158720}
I20260709 13:13:07.016456   559 rpcz_store.cc:276] 0709 13:13:05.837456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.522598 (+685142us) service_pool.cc:224] Handling call
0709 13:13:07.014971 (+492373us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5800116198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:07.015955 (+   984us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29796608}
W20260709 13:13:07.042163   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 78401.4us
I20260709 13:13:07.048487   555 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:13:07.048512   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:07.051926   553 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1352) took 1740 ms (client timeout 1583 ms). Trace:
I20260709 13:13:06.993484  2110 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:07.053277   553 rpcz_store.cc:269] 0709 13:13:05.274743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.277681 (+  2938us) service_pool.cc:224] Handling call
0709 13:13:07.014520 (+1736839us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b54000ec754. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:07.014638 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2269117184}
I20260709 13:13:06.994306  2114 raft_consensus.cc:697] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:13:07.058627  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 112903us
I20260709 13:13:07.039783   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:06.986351   552 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:07.053606   597 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:06.935289  2142 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.189s
I20260709 13:13:07.061708   624 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:07.002347  2113 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.064625   523 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:07.069373   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.079407   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.069510   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:07.071043   554 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:07.082612   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1311) took 1377 ms. Trace:
I20260709 13:13:07.083088   554 rpcz_store.cc:276] 0709 13:13:05.704752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.523288 (+818536us) service_pool.cc:224] Handling call
0709 13:13:07.002801 (+479513us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5800116198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:07.082494 (+ 79693us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30540544}
W20260709 13:13:07.074344   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 73866.1us
I20260709 13:13:07.075309   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:07.008972   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:07.008914  2010 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:07.035132   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.088797   554 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:07.043716  1944 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:07.050289  1862 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:07.097932   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 55099.9us
I20260709 13:13:07.048087  1975 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.099422   523 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:07.059355  2110 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:07.079351  2140 log.cc:927] Time spent T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.421s	user 0.002s	sys 0.001s
I20260709 13:13:07.080001   628 raft_consensus.cc:2393] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:07.060935  2137 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:07.101150   523 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:07.103613   481 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.105731  1138 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:07.107556   523 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:07.111541   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 68745.4us
I20260709 13:13:07.099017   633 raft_consensus.cc:2393] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:07.049149  2101 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:07.125612   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1359) took 1838 ms. Trace:
I20260709 13:13:07.128583   557 rpcz_store.cc:276] 0709 13:13:05.296685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.070083 (+1773398us) service_pool.cc:224] Handling call
0709 13:13:07.089636 (+ 19553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:07.110945 (+ 21309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:07.110980 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:07.125194 (+ 14214us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:07.125239 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.125323 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.125523 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:07.135303   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.132923  1139 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:07.122653   523 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:07.100142  2151 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.107456  2110 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.125030  2011 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:07.106364   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:07.114852   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1291) took 1832 ms. Trace:
I20260709 13:13:07.114638  1915 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:07.102543  2072 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:07.159933   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.101833   480 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
W20260709 13:13:07.167095   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.184048   557 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:13:07.167531   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 59071.1us
I20260709 13:13:07.115621  1949 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:07.184720   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1299) took 1892 ms. Trace:
I20260709 13:13:07.189365   557 rpcz_store.cc:276] 0709 13:13:05.292603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.141439 (+1848836us) service_pool.cc:224] Handling call
0709 13:13:07.181353 (+ 39914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:07.184485 (+  3132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.184673 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:07.113893  2137 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.105415   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:07.173760   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 61427.4us
I20260709 13:13:07.175562  2155 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.176153  2029 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.125258  2125 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:07.179546   483 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:07.107631  1862 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:07.192332   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 89554.5us
I20260709 13:13:07.105641  1975 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:07.196779   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.180619  2011 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.202939   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.186142  1944 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.183710  2072 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:07.209496   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.217031   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.192523  2137 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.188764  1949 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.229732   522 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:13:07.227733  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 332860us
I20260709 13:13:07.172119  1822 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:07.235944  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 150398us
W20260709 13:13:07.209110  2132 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.028s	sys 0.042s
I20260709 13:13:07.203694  2083 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:07.202310   476 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:07.206204  1862 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:07.240681   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:07.215823  2011 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:07.246641   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.230046   552 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.189006  2151 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:07.233080  1949 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.227789  2072 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.328747   483 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:07.329000   557 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:07.242552   550 raft_consensus.cc:2410] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:13:07.339466  1138 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:07.243000  2135 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:07.234592   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.344842   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:07.327492  2159 log.cc:927] Time spent T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
W20260709 13:13:07.250708  2152 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
W20260709 13:13:07.251447  2149 log.cc:927] Time spent T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260709 13:13:07.247162  2132 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.028s	sys 0.043s
I20260709 13:13:07.209998  1915 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:07.329613  2125 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:07.208139  2114 consensus_queue.cc:237] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:07.330715  1862 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.372287   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:07.363653   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.338094   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:07.367933  2158 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:13:07.368206  1822 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:07.355528  2020 consensus_meta.cc:287] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.004s
I20260709 13:13:07.184023   551 rpcz_store.cc:276] 0709 13:13:05.278688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.667154 (+1388466us) service_pool.cc:224] Handling call
0709 13:13:06.713096 (+ 45942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:06.756972 (+ 43876us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:06.887215 (+130243us) log.cc:844] Serialized 14 byte log entry
0709 13:13:07.074684 (+187469us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:07.079989 (+  5305us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:07.091284 (+ 11295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.099884 (+  8600us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.111141 (+ 11257us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":363693,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":4276,"raft.queue_time_us":172,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"thread_start_us":151107,"threads_started":2,"wal-append.queue_time_us":313782}
I20260709 13:13:07.369999   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.370489  1915 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:07.371218   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.405428   448 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:07.360144  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 254147us
I20260709 13:13:07.414546   631 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.349212  2145 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:07.420966   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.250880  2029 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:07.246502  2155 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:07.587996   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1297) took 2300 ms. Trace:
I20260709 13:13:07.592250   554 rpcz_store.cc:276] 0709 13:13:05.287534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.084228 (+1796694us) service_pool.cc:224] Handling call
0709 13:13:07.088560 (+  4332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:07.101395 (+ 12835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.587715 (+486320us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b54002d8aa0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68390dc0 00007f4b6841ca02 00007f4b68418dd6 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2
0709 13:13:07.587940 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81789312}
I20260709 13:13:07.406653  1657 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:07.594745   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:07.472018   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 65090us
I20260709 13:13:07.591686   483 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
W20260709 13:13:07.601115   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 371450us
I20260709 13:13:07.602051   522 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:07.609345   632 raft_consensus.cc:2393] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:13:07.486449  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 158367us
I20260709 13:13:07.588243   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.425235   557 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
W20260709 13:13:07.405090  2167 log.cc:927] Time spent T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:13:07.613304   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:07.616183   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.620421   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:07.527462  2168 log.cc:927] Time spent T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.122s	user 0.002s	sys 0.001s
I20260709 13:13:07.621263   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.624429   557 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:07.623170   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:07.420488   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.371587   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1298) took 2063 ms. Trace:
I20260709 13:13:07.629478   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:07.640659   554 raft_consensus.cc:2410] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:07.483927  2179 raft_consensus.cc:2804] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:07.509133  1967 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:07.633617  2083 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:07.584756  1975 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:07.633929   597 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:07.635455   483 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:07.511317   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:07.635890   525 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:07.636976  2127 ts_tablet_manager.cc:1916] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:07.608278  2151 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:07.637284  2173 log.cc:927] Time spent T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.284s	user 0.000s	sys 0.003s
W20260709 13:13:07.676509  2010 consensus_meta.cc:287] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.000s
W20260709 13:13:07.676589  2175 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:13:07.514658   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.545113  2184 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:07.637622   447 leader_election.cc:336] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 1.841s (SENT)
I20260709 13:13:07.683468   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.684258   483 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:07.684181   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.432865   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1300) took 2123 ms. Trace:
I20260709 13:13:07.519747  2035 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:07.568197  2101 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:07.586679   628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54754 (request call id 111) took 1126 ms. Trace:
W20260709 13:13:07.639158  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 308752us
I20260709 13:13:07.741730   628 rpcz_store.cc:276] 0709 13:13:06.461144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.476933 (+ 15789us) service_pool.cc:224] Handling call
0709 13:13:07.586390 (+1109457us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b5400123754. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:07.586589 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1144109824}
I20260709 13:13:07.745929   624 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
W20260709 13:13:07.752362   481 consensus_meta.cc:287] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.001s
I20260709 13:13:07.752873   481 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:07.639330   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:07.743199   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.774495  1141 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:07.644268   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.473520   480 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:07.638417  1138 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:07.655496   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:07.646034   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.656478  1139 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:07.667712   525 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:07.673846   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.675917  2155 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:07.655959  1967 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.645742   475 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:07.692159   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:07.692620   597 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:07.640192   552 rpcz_store.cc:276] 0709 13:13:05.292166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.100327 (+1808161us) service_pool.cc:224] Handling call
0709 13:13:07.187314 (+ 86987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:07.338536 (+151222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.355865 (+ 17329us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:07.692612  2178 log.cc:927] Time spent T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:13:07.694934  2011 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:07.677013  2010 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:07.821841   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:07.822209   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 154580us
I20260709 13:13:07.708348  2192 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:07.822813   478 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:07.683437  2184 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:13:07.714219  1938 consensus_meta.cc:287] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.714s	user 0.009s	sys 0.000s
I20260709 13:13:07.655551  2179 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:07.670580  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:07.723800   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 359693us
W20260709 13:13:07.775480   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 173510us
I20260709 13:13:07.404445  2125 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:07.834451   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.818608   555 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.808355   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:07.820184  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 45773.7us
I20260709 13:13:07.676610   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 106) took 1399 ms. Trace:
I20260709 13:13:07.823333   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.823345   525 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:07.824222   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 154265us
I20260709 13:13:07.712450   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:07.684314  1975 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:07.852411  1975 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:07.853204  1975 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.826350  2189 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:07.856252   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:07.856794   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.822734   476 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:07.857509   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.829717   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:07.775424  1167 consensus_meta.cc:287] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.889s	user 0.011s	sys 0.000s
I20260709 13:13:07.826961   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.833777   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:07.823925  1967 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:07.776651   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.866760   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.867031   483 raft_consensus.cc:2393] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 4: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:07.868194   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:07.869611   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.870186   483 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:07.722465   558 rpcz_store.cc:276] 0709 13:13:05.292992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.171189 (+1878197us) service_pool.cc:224] Handling call
0709 13:13:07.230014 (+ 58825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:07.330722 (+100708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:07.336579 (+  5857us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:07.353650 (+ 17071us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:07.356798 (+  3148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.375098 (+ 18300us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.416097 (+ 40999us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:07.872102   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:07.872876   558 raft_consensus.cc:2393] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 4: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:07.800489  2029 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:07.874059   599 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:07.838142   626 raft_consensus.cc:2368] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4.
I20260709 13:13:07.829630  1938 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:07.838152   478 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 1.
I20260709 13:13:07.828487  2184 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:07.858059  2113 consensus_meta.cc:287] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.746s	user 0.006s	sys 0.002s
I20260709 13:13:07.838598   630 raft_consensus.cc:2393] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:07.825173  2192 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:13:07.839658  2137 consensus_meta.cc:287] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.592s	user 0.003s	sys 0.007s
I20260709 13:13:07.884269   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.884536  2137 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:07.885093   475 raft_consensus.cc:1813] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Handling vote request from an unknown peer 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:07.885989   475 raft_consensus.cc:2410] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:13:07.886754  2137 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:07.826987  2164 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:07.840111  2011 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:07.887434  2164 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.887898  2164 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:07.890951  2194 log.cc:927] Time spent T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:13:07.840404   448 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:07.891595   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 51295.3us
I20260709 13:13:07.840966  2187 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:07.894663  2187 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.841239   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.831600  2179 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.845028   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:07.849241  2009 consensus_meta.cc:287] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.845s	user 0.006s	sys 0.004s
I20260709 13:13:07.825460   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:07.858043   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.864298   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.842098   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.874217   483 raft_consensus.cc:1275] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.830756  2088 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:07.875137  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 246592us
I20260709 13:13:07.875012   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:07.895067  2187 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.926577  2199 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:07.911907   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.946123  2199 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.946503   628 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:07.946341  2009 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:07.946748  2199 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:07.921473   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:07.922598   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1152) took 1237 ms. Trace:
I20260709 13:13:07.948426  2009 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:07.933478   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.949312   475 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:07.950003   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.950331   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:07.911387   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 45157us
I20260709 13:13:07.876387   522 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:07.951812   551 raft_consensus.cc:2393] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
W20260709 13:13:07.952518   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 76241.9us
I20260709 13:13:07.878479  2151 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:07.878696   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.952723   477 raft_consensus.cc:1240] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:07.953068  2151 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.953308   480 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:07.953579  2151 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.953850   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1225) took 1002 ms. Trace:
I20260709 13:13:07.954241   480 rpcz_store.cc:276] 0709 13:13:06.951857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.861466 (+909609us) service_pool.cc:224] Handling call
0709 13:13:07.953789 (+ 92323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:07.924885   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:07.865923  1167 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
W20260709 13:13:07.879788  2197 log.cc:927] Time spent T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:13:07.955528   481 raft_consensus.cc:2410] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:13:07.925904   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1165) took 1060 ms. Trace:
I20260709 13:13:07.956445   480 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:07.877446   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:07.935221  2162 log.cc:927] Time spent T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.580s	user 0.002s	sys 0.003s
I20260709 13:13:07.836299   627 rpcz_store.cc:276] 0709 13:13:06.276884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.277624 (+   740us) service_pool.cc:224] Handling call
0709 13:13:06.435815 (+158191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:06.541729 (+105914us) spinlock_profiling.cc:243] Waited 9.17 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b6530f0ac 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b65329455 00007f4b68411060
0709 13:13:06.824234 (+282505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:06.830313 (+  6079us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:06.887544 (+ 57231us) log.cc:844] Serialized 26 byte log entry
0709 13:13:06.937606 (+ 50062us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:06.946130 (+  8524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.958503 (+ 12373us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:07.526798 (+568295us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:07.676270 (+149472us) raft_consensus.cc:1685] finished
0709 13:13:07.676294 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.676437 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":69403,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":1089,"spinlock_wait_cycles":35072640,"thread_start_us":410510,"threads_started":2,"wal-append.queue_time_us":348455}
W20260709 13:13:07.901129   448 connection.cc:256] RPC call timeout handler was delayed by -1.0755883300000733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24670000000000003s for a response
I20260709 13:13:07.916194   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:07.958253   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:07.958698   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.880255  2010 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:07.864701  2189 raft_consensus.cc:697] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:07.958878   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.956182   633 rpcz_store.cc:276] 0709 13:13:06.865449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.929592 (+ 64143us) service_pool.cc:224] Handling call
0709 13:13:07.925267 (+995675us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54001608d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:07.925822 (+   555us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281835392}
I20260709 13:13:07.959859   448 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:07.955555  1167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36724 (request call id 261) took 1268 ms. Trace:
I20260709 13:13:07.960198   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:07.878710   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.881107   482 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:07.900269  2201 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:07.880091  1938 leader_election.cc:290] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:07.961853  2201 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:07.962347  1938 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:07.962594  2201 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.962791  1938 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:13:07.883002  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 260735us
I20260709 13:13:07.887538   625 raft_consensus.cc:2393] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:07.963927  1139 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:07.964535  2110 consensus_meta.cc:287] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.770s	user 0.008s	sys 0.000s
I20260709 13:13:07.964917  2110 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:07.965368   625 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1151) took 1280 ms (client timeout 1703 ms). Trace:
W20260709 13:13:07.965744   625 rpcz_store.cc:269] 0709 13:13:06.685209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.859506 (+174297us) service_pool.cc:224] Handling call
0709 13:13:07.135097 (+275591us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b5800167198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:07.965199 (+830102us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b5400023354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:07.965317 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1734994560}
I20260709 13:13:07.966163  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:07.966792   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.967561  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:07.926949  2113 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:07.967808  2190 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:07.968173  1175 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:07.968309  2190 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:07.960098   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.968829  2190 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.960894  1167 rpcz_store.cc:276] 0709 13:13:06.687306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.702850 (+ 15544us) service_pool.cc:224] Handling call
0709 13:13:07.955491 (+1252641us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:07.969250   559 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:07.970012  2113 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:07.957258   552 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
W20260709 13:13:07.928817  2072 consensus_meta.cc:287] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.000s
I20260709 13:13:07.971119  2072 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:07.971468   553 raft_consensus.cc:1240] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 3. Ops: []
I20260709 13:13:07.969074   633 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:07.972990   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:07.908370  1980 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:07.973803   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1296) took 2690 ms. Trace:
I20260709 13:13:07.974112  1980 raft_consensus.cc:697] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:07.974061   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.974964   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.884313  2192 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:07.975587   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.975536  1980 consensus_queue.cc:237] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:07.976438   633 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:07.971481   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1321) took 1021 ms. Trace:
I20260709 13:13:07.977015   559 rpcz_store.cc:276] 0709 13:13:06.949354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.050693 (+101339us) service_pool.cc:224] Handling call
0709 13:13:07.971065 (+920372us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b54001ca054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:07.971184 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2039704320}
I20260709 13:13:07.977421   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.959982  2189 consensus_queue.cc:237] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:07.978899   522 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:07.899638  2193 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:07.980121   522 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:07.980485  2193 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.880698   556 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:07.980926  1822 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:07.980976  2193 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:07.876421   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.961213   631 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:07.975558   625 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:07.858477   550 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:08.004124  2151 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:08.006863  2151 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:07.971732   482 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:07.978207   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:07.958591   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.949376   476 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:07.960795   624 raft_consensus.cc:2368] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3.
W20260709 13:13:07.835150   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 203966us
I20260709 13:13:07.963413  1938 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.030138   559 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:07.982786   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1293) took 2702 ms. Trace:
I20260709 13:13:07.881745   599 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:13:08.031170   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 149490us
I20260709 13:13:07.903402  1141 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:08.032711  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 157756us
W20260709 13:13:08.033620   447 leader_election.cc:336] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 1.881s (SENT)
I20260709 13:13:07.836838  2125 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:08.032861  1949 consensus_meta.cc:287] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.671s	user 0.010s	sys 0.000s
I20260709 13:13:08.043605  2190 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:08.043715  1949 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:08.045759  2190 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:08.046159  1949 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:08.046833   554 raft_consensus.cc:2393] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
W20260709 13:13:07.875936   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 52729us
I20260709 13:13:08.047667   525 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:08.047714   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:08.048187   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:08.048534   627 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:08.048719   525 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:08.049305   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:08.049569   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.931330   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:07.984628   597 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:08.049963  2199 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:08.050665   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 66145.3us
I20260709 13:13:07.882853   632 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:08.051321   597 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:08.051852   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:08.052492   632 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:08.052896   597 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:08.053319   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.951092   475 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:08.054111   632 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:07.945875   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1223) took 1006 ms. Trace:
I20260709 13:13:07.989270   555 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:08.055379  2010 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:08.028172   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:08.055920  2010 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.056128   558 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:08.056332  2010 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.056740   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1301) took 2763 ms. Trace:
I20260709 13:13:08.057137   555 rpcz_store.cc:276] 0709 13:13:05.293375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.055853 (+2762478us) service_pool.cc:224] Handling call
0709 13:13:08.056179 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.056385 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.056414 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:08.056461 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:08.056494 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.056551 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:08.056670 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:08.057801   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1304) took 2763 ms. Trace:
I20260709 13:13:08.058228   558 rpcz_store.cc:276] 0709 13:13:05.294700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.056876 (+2762176us) service_pool.cc:224] Handling call
0709 13:13:08.057164 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.057461 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.057508 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:08.057551 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:08.057583 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.057647 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:08.057748 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:07.908900   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:08.059266   630 raft_consensus.cc:2368] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3.
I20260709 13:13:07.955549   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1218) took 1017 ms. Trace:
I20260709 13:13:08.059787   484 rpcz_store.cc:276] 0709 13:13:06.938182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.340601 (+402419us) service_pool.cc:224] Handling call
0709 13:13:07.924704 (+584103us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:07.955485 (+ 30781us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13142272}
I20260709 13:13:08.059852   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.974231   553 rpcz_store.cc:276] 0709 13:13:05.284434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.069308 (+1784874us) service_pool.cc:224] Handling call
0709 13:13:07.971318 (+902010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:07.972216 (+   898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.973629 (+  1413us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b54001ca050. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:07.973736 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2026992000}
I20260709 13:13:07.973795  2072 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:08.000501   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:08.058975   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1305) took 2764 ms. Trace:
I20260709 13:13:08.061812   625 raft_consensus.cc:2393] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 4: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
W20260709 13:13:07.899108  1944 consensus_meta.cc:287] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.664s	user 0.007s	sys 0.000s
I20260709 13:13:08.000720   522 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:07.974298  2088 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.944013  1862 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:07.978873   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:07.948140   626 rpcz_store.cc:276] 0709 13:13:06.685514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.951945 (+266431us) service_pool.cc:224] Handling call
0709 13:13:07.922348 (+970403us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b54001e3a54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:07.922527 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1953031936}
I20260709 13:13:08.062053   555 rpcz_store.cc:276] 0709 13:13:05.295131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.058163 (+2763032us) service_pool.cc:224] Handling call
0709 13:13:08.058475 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.058667 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.058693 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:08.058734 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:08.058763 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.058818 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:08.058924 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:08.007599   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:08.066745   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:08.010607  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:08.067776   447 leader_election.cc:336] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 1.882s (SENT)
I20260709 13:13:08.012202  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:08.068807   628 raft_consensus.cc:2393] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:13:08.069046   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.865408  2083 raft_consensus.cc:697] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:08.070086   628 raft_consensus.cc:1240] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:08.070175  2083 consensus_queue.cc:237] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:08.013952   378 catalog_manager.cc:5697] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 2 to 3, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 3 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:08.071380  1141 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:08.071447  2193 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:08.072391  1141 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:08.072242   378 catalog_manager.cc:5697] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 1 to 2, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 2 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:08.073220  1141 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:08.017473   379 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46008 (request call id 259) took 5997 ms. Trace:
W20260709 13:13:08.073948   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 73299.7us
I20260709 13:13:08.022295  2029 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.019465  2164 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:07.971433   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:07.951220   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:08.030800   556 rpcz_store.cc:276] 0709 13:13:05.280801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.953784 (+1672983us) service_pool.cc:224] Handling call
0709 13:13:06.991708 (+ 37924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:07.981339 (+989631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.982572 (+  1233us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b54000492d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:07.982734 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2044023552}
I20260709 13:13:08.081429   525 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:08.035444   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 75666.9us
I20260709 13:13:08.035595  2155 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:08.036723  1967 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:08.039402   482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:52312
I20260709 13:13:08.082998   482 raft_consensus.cc:606] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:08.083530   482 raft_consensus.cc:614] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:08.039505  2143 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:08.040688  2192 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:08.045832  2187 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:07.981766  1822 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:08.054898   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:08.020525   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:08.055383   483 rpcz_store.cc:276] 0709 13:13:06.939370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.870799 (+931429us) service_pool.cc:224] Handling call
0709 13:13:07.871048 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:07.945550 (+ 74502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.945768 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:08.003500   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:08.098939   631 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:08.066269   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:08.074854   522 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:08.018366  1138 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:08.059525   478 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:08.049880   554 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:08.074775  1944 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:08.084362  1949 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:08.059396  2009 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:08.081267   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:08.112489   559 raft_consensus.cc:2393] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:08.055425  2110 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:08.091137  2185 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:08.115267   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:08.088052   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:08.120968   625 raft_consensus.cc:2393] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 4: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:08.060139  2202 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:08.089093   448 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:08.064620  2088 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:08.096909   632 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:08.097496   553 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:08.099164   378 catalog_manager.cc:5697] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 1 to 2, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 2 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:08.078188   447 leader_election.cc:336] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 1.583s (SENT)
W20260709 13:13:08.125139   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 46970.2us
I20260709 13:13:08.084589  2020 consensus_queue.cc:1059] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:13:08.106050  2137 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:08.107343   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:08.129985   448 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:08.130201   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1363) took 2832 ms. Trace:
W20260709 13:13:08.105772  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 87461.1us
I20260709 13:13:08.131114   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:08.131716  1138 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:08.128633  1995 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:08.092265  2127 ts_tablet_manager.cc:1929] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:13:08.087677  2193 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:08.050869   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:08.109071   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:08.148134   482 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.096340   525 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:08.119655   551 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:08.085264  2143 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:08.085264  2155 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:08.087896  2095 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:08.134641  2137 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:08.159678   447 leader_election.cc:336] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 1.998s (SENT)
I20260709 13:13:08.168061   447 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:08.095713  2179 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:08.116329   631 raft_consensus.cc:1275] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:08.117288   557 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:08.038761  1975 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:08.123430   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 258294us
I20260709 13:13:08.172262   597 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:08.106801   522 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:08.105844  2114 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:08.127904   554 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:08.146333  2082 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:08.109934  1949 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.088681  2029 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:08.130729   553 rpcz_store.cc:276] 0709 13:13:05.298180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.084802 (+2786622us) service_pool.cc:224] Handling call
0709 13:13:08.097243 (+ 12441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.129887 (+ 32644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.130130 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:08.139287   556 raft_consensus.cc:1240] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:08.139515   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:08.201097   483 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.091634  1938 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:08.115200  2072 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:08.122432   558 raft_consensus.cc:1240] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:08.120478  1167 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:08.111935  2009 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:08.185827  2114 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:08.198751  1915 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:08.124101  2202 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:08.088100  2191 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:08.120677  2185 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:08.102864  2136 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:13:08.237174  1967 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:08.237248  2185 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.124274  2160 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:08.238184   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:08.238348  2160 raft_consensus.cc:697] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:08.239656  1171 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:08.239463  2160 consensus_queue.cc:237] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:08.240696   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:08.155084   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.116170   550 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
W20260709 13:13:08.161164  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.242990   550 raft_consensus.cc:1240] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:08.160295   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 64040.5us
I20260709 13:13:08.238189   631 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:08.111150  2151 consensus_queue.cc:1059] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:13:08.243777  1980 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.244249  2151 consensus_queue.cc:1243] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer 6ba2a9c02b534120bbf26e56a1e920ca log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:13:08.244355  1980 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:08.244954  2151 raft_consensus.cc:3055] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:08.245362  2151 raft_consensus.cc:740] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:08.165222  2110 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:08.165421  2155 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.247426   523 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:08.138371  1995 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:08.248451  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:08.248672  1995 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.172168   378 catalog_manager.cc:5697] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 1 to 2, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 2 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:08.133785   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:08.249784   523 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:08.149688  2035 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:08.243745   525 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:08.188336   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 81636.5us
I20260709 13:13:08.255089   525 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:08.135080  2142 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:13:08.170104  2143 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.202112  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:13:08.256158  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 74422.5us
I20260709 13:13:08.165596  2095 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.206061   597 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:08.219792  2199 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:08.208459   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1313) took 2503 ms. Trace:
I20260709 13:13:08.231796   552 raft_consensus.cc:1275] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:08.268451   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1369) took 2544 ms. Trace:
I20260709 13:13:08.268818   552 rpcz_store.cc:276] 0709 13:13:05.724402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.134745 (+2410343us) service_pool.cc:224] Handling call
0709 13:13:08.196585 (+ 61840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.268151 (+ 71566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.268363 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:08.074064   379 rpcz_store.cc:276] 0709 13:13:02.020079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.020245 (+   166us) service_pool.cc:224] Handling call
0709 13:13:02.103843 (+ 83598us) spinlock_profiling.cc:243] Waited 73.4 ms on lock 0x7b54000fbed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68383090 00007f4b68421f3a 00007f4b6e1d81cc 00007f4b6e2d637e 00007f4b6c7972a4 00007f4b6c797232 00007f4b6c797161 00007f4b6c7970dc 00007f4b6c796392 00007f4b6675448c 00007f4b667538c6
0709 13:13:08.017287 (+5913444us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:04.394463 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:04.554815 (+160352us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:04.566476 (+ 11661us) write_op.cc:435] Acquired schema lock
0709 13:13:04.596515 (+ 30039us) tablet.cc:662] Decoding operations
0709 13:13:04.697687 (+101172us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:04.731789 (+ 34102us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:04.741075 (+  9286us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:13:04.778355 (+ 37280us) tablet.cc:701] Row locks acquired
0709 13:13:04.778394 (+    39us) write_op.cc:260] PREPARE: finished
0709 13:13:04.834855 (+ 56461us) write_op.cc:270] Start()
0709 13:13:04.883758 (+ 48903us) write_op.cc:276] Timestamp: P: 1783602784829853 usec, L: 0
0709 13:13:04.889299 (+  5541us) op_driver.cc:348] REPLICATION: starting
0709 13:13:05.333104 (+443805us) log.cc:844] Serialized 536 byte log entry
0709 13:13:05.662833 (+329729us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54000fbed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68414e28 00007f4b6be4f581 00007f4b6be4ed58 00007f4b6be539f1 00007f4b6be539a9 00007f4b6be53939 00007f4b6be53901 00007f4b6be52b2d 000000000038f354 000000000038f199
0709 13:13:06.128949 (+466116us) op_driver.cc:464] REPLICATION: finished
0709 13:13:07.100555 (+971606us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b6530f0ac 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b6be4fef0
0709 13:13:07.407060 (+306505us) write_op.cc:301] APPLY: starting
0709 13:13:07.486810 (+ 79750us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:07.535306 (+ 48496us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:07.535362 (+    56us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:07.535798 (+   436us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:07.536110 (+   312us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:13:07.536186 (+    76us) write_op.cc:312] APPLY: finished
0709 13:13:07.536549 (+   363us) log.cc:844] Serialized 23 byte log entry
0709 13:13:07.641073 (+104524us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:07.641213 (+   140us) write_op.cc:454] Released schema lock
0709 13:13:07.641264 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:07.715103 (+ 73839us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:07.715143 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":157055,"reported_tablets":8,"spinlock_wait_cycles":168929024,"child_traces":[["op",{"apply.queue_time_us":1077066,"apply.run_cpu_time_us":12895,"apply.run_wall_time_us":366634,"num_ops":1,"prepare.queue_time_us":1369404,"prepare.run_cpu_time_us":50131,"prepare.run_wall_time_us":1284366,"raft.queue_time_us":442756,"raft.run_cpu_time_us":110206,"raft.run_wall_time_us":1297155,"replication_time_us":1201510,"spinlock_wait_cycles":1038130304,"thread_start_us":2279801,"threads_started":5,"wal-append.queue_time_us":492121,"wal-append.run_cpu_time_us":9466,"wal-append.run_wall_time_us":1219141}]]}
I20260709 13:13:08.088708  2184 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:08.248471  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:08.246274  2151 consensus_queue.cc:260] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:08.217980   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 185760us
I20260709 13:13:08.186390  2082 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:08.085044  2011 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:08.199386  1949 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.221812   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1385) took 1017 ms. Trace:
I20260709 13:13:08.224846   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:08.197933  2189 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:08.200136   551 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:08.228888   479 raft_consensus.cc:1240] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:08.207554  2072 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.206090  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:08.219573  2009 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.237483  1166 raft_consensus.cc:1240] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:08.247491  2110 raft_consensus.cc:697] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:08.180951   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1307) took 2531 ms. Trace:
I20260709 13:13:08.179831  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:08.250761   482 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:08.234069  2191 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.213181  2083 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:08.255972   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 111) took 1617 ms. Trace:
I20260709 13:13:08.343775   555 rpcz_store.cc:276] 0709 13:13:06.638312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.211997 (+1573685us) service_pool.cc:224] Handling call
0709 13:13:08.236221 (+ 24224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.255634 (+ 19413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.255662 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:08.255709 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:08.255739 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.255800 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:08.255918 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:08.344897  2208 log.cc:927] Time spent T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.095s	user 0.002s	sys 0.000s
I20260709 13:13:08.345046   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:08.345755   555 raft_consensus.cc:2393] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:08.346578   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:08.173070  2165 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:08.227438  2114 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:08.259847   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 53877.3us
I20260709 13:13:08.171303  2137 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.264045   556 rpcz_store.cc:276] 0709 13:13:05.705415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.124866 (+2419451us) service_pool.cc:224] Handling call
0709 13:13:08.138980 (+ 14114us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.208075 (+ 69095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.208322 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:08.187613  2127 log.cc:1199] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-2-root/wals/82382f158074497a857b03f9f87f9e86
I20260709 13:13:08.328493  2082 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.265480   545 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ade492740624caba667436aa666025c with delete_type TABLET_DATA_TOMBSTONED (TS 6ba2a9c02b534120bbf26e56a1e920ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59108
I20260709 13:13:08.265900  2113 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:08.380431  2165 raft_consensus.cc:697] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:08.266681   522 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:08.267567  2145 raft_consensus.cc:3055] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:08.267511   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:08.409179   631 raft_consensus.cc:2393] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 4: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:08.251264   483 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:08.235081  2190 raft_consensus.cc:2804] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:08.269932   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:08.307826   557 rpcz_store.cc:276] 0709 13:13:07.204511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.826906 (+622395us) service_pool.cc:224] Handling call
0709 13:13:07.931201 (+104295us) spinlock_profiling.cc:243] Waited 8.06 ms on lock 0x7b5800116198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4f8c 00007f4b652f4ef6 0000000000375939 00007f4b6d3681e0 00007f4b6d4310c4 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:08.221663 (+290462us) spinlock_profiling.cc:243] Waited 66.9 ms on lock 0x7b54000eb854. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:08.221757 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172356224}
I20260709 13:13:08.326751   554 rpcz_store.cc:276] 0709 13:13:05.649306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.123629 (+2474323us) service_pool.cc:224] Handling call
0709 13:13:08.123923 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.180687 (+ 56764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.180893 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:08.410554   625 raft_consensus.cc:2410] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:13:08.332041   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 198999us
I20260709 13:13:08.234675  2202 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.331738  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:08.272553   378 catalog_manager.cc:5697] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 1 to 2, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 2 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:08.255669   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1362) took 2952 ms. Trace:
I20260709 13:13:08.340063  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:08.340142  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:08.341413   448 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:08.269914   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:08.342363   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:08.342840   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1317) took 2449 ms. Trace:
I20260709 13:13:08.307219  2189 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:08.348449  2211 log.cc:927] Time spent T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.066s	user 0.001s	sys 0.001s
I20260709 13:13:08.263394  2095 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.273262   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 112) took 1625 ms. Trace:
I20260709 13:13:08.275868   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:08.275568  1915 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:08.273020  1944 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:08.276357  2203 log.cc:927] Time spent T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:13:08.273387  2156 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:08.353729  1173 raft_consensus.cc:2393] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:08.354418   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:08.265203  1862 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:08.326814  2011 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.361989  2010 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:08.458545  2143 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:08.263296  1822 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:08.364110   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1231) took 1378 ms. Trace:
I20260709 13:13:08.359794   599 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:08.254443  2035 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:08.360504  1168 raft_consensus.cc:2393] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:08.259585  2187 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:08.338909  2191 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:08.265355   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:08.281960  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:08.279290  1975 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:08.384805   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 129781us
W20260709 13:13:08.390520  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 54888.7us
I20260709 13:13:08.474161   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:08.474738   482 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.282685   475 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:08.266184  1980 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:08.463418  2199 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:08.407925   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 141323us
I20260709 13:13:08.413033   554 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:08.507761   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1320) took 1558 ms. Trace:
I20260709 13:13:08.508190   554 rpcz_store.cc:276] 0709 13:13:06.949118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.410948 (+1461830us) service_pool.cc:224] Handling call
0709 13:13:08.412854 (+  1906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.507450 (+ 94596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.507691 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:08.411619   447 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 2.141s (SENT) [suppressed 34 similar messages]
W20260709 13:13:08.510108   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 98505.8us
I20260709 13:13:08.417582   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:08.382692  2192 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:08.269800  2169 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.121s
W20260709 13:13:08.429487   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 88205.1us
I20260709 13:13:08.397804  2113 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.398720  2164 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:08.429636   378 catalog_manager.cc:5697] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 1 to 2, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 2 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:08.435218   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 53612.7us
I20260709 13:13:08.408443  2145 raft_consensus.cc:740] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:08.428201  2151 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.434815  2189 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.457979  2011 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.465112   624 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:08.463857   479 rpcz_store.cc:276] 0709 13:13:06.960207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.950240 (+990033us) service_pool.cc:224] Handling call
0709 13:13:08.022389 (+ 72149us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.319120 (+296731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.337903 (+ 18783us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400131d54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:08.338389 (+   486us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b5400131d50. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:08.338516 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565893888}
I20260709 13:13:08.453629  2136 consensus_queue.cc:1059] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:13:08.467907  1172 raft_consensus.cc:1240] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:08.440506  2214 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.419064   558 rpcz_store.cc:276] 0709 13:13:05.297852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.059202 (+2761350us) service_pool.cc:224] Handling call
0709 13:13:08.103257 (+ 44055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.213741 (+110484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.250582 (+ 36841us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:08.463721  1822 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:08.427706   551 rpcz_store.cc:276] 0709 13:13:05.893085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.170681 (+2277596us) service_pool.cc:224] Handling call
0709 13:13:08.171090 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.337075 (+165985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.342775 (+  5700us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:08.491858  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:08.493335  2190 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.494453   478 raft_consensus.cc:1275] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:08.464788   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1301) took 1330 ms. Trace:
I20260709 13:13:08.463965  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:08.554587   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:08.318992  2072 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:08.499696   484 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:08.475137  2219 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:13:08.556782   378 catalog_manager.cc:5697] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 2 to 3, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 3 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:08.468734  2035 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.473918   633 raft_consensus.cc:2393] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:08.512405   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:08.519796  1141 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:08.438055   550 rpcz_store.cc:276] 0709 13:13:06.647498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.242480 (+1594982us) service_pool.cc:224] Handling call
0709 13:13:08.242789 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.256552 (+ 13763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.273191 (+ 16639us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:08.491036  2029 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:08.530406   522 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:08.582890   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 52556.1us
I20260709 13:13:08.552817  1822 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.536142   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1303) took 1403 ms. Trace:
I20260709 13:13:08.589764   481 rpcz_store.cc:276] 0709 13:13:07.132577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.956396 (+823819us) service_pool.cc:224] Handling call
0709 13:13:07.956701 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.028404 (+ 71703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.028437 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:08.074915 (+ 46478us) log.cc:844] Serialized 26 byte log entry
0709 13:13:08.197101 (+122186us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:08.197171 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.197287 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:08.535942 (+338655us) raft_consensus.cc:1685] finished
0709 13:13:08.535962 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:08.536086 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26828,"raft.queue_time_us":76720,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":24993,"thread_start_us":69962,"threads_started":1,"wal-append.queue_time_us":170208}
I20260709 13:13:08.479065  1915 raft_consensus.cc:697] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:08.574774  2201 consensus_meta.cc:287] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.003s
I20260709 13:13:08.513065  2010 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:08.550388   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 190623us
I20260709 13:13:08.596082   599 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:08.527527  2113 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.554215  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:08.503041   482 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:08.540563  2156 consensus_queue.cc:1048] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:13:08.580209   631 raft_consensus.cc:2393] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 4: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:08.583822   522 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:08.443600  2110 consensus_queue.cc:237] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:08.585304   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 50807us
W20260709 13:13:08.586086  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 66400.7us
I20260709 13:13:08.582589   378 catalog_manager.cc:5697] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 1 to 2, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 2 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:08.515607  1938 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:08.554852  2190 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:08.569306   476 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:08.577243  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:08.611778   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 122) took 1674 ms. Trace:
I20260709 13:13:08.636330  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:08.636541   557 rpcz_store.cc:276] 0709 13:13:06.937081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.410573 (+1473492us) service_pool.cc:224] Handling call
0709 13:13:08.430519 (+ 19946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.472047 (+ 41528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.472084 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:08.472133 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:08.472162 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.611588 (+139426us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x7b540002a3d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:08.611629 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:08.611725 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88260992}
I20260709 13:13:08.576747  2225 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:08.505808  2165 consensus_queue.cc:237] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:08.636350  1173 raft_consensus.cc:2376] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3. Re-sending same reply.
I20260709 13:13:08.647727  1175 raft_consensus.cc:2393] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:08.580610  2088 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:08.607347  1141 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:08.591801  2199 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:08.621398   523 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:08.622720  2224 log.cc:927] Time spent T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:13:08.601004  2164 raft_consensus.cc:2749] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:08.606465  2125 consensus_meta.cc:287] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
I20260709 13:13:08.623677   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:08.645529   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1308) took 1223 ms. Trace:
I20260709 13:13:08.679337   624 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.679342   480 rpcz_store.cc:276] 0709 13:13:07.414735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.958497 (+543762us) service_pool.cc:224] Handling call
0709 13:13:07.958793 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.059934 (+101141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.059979 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:08.066020 (+  6041us) log.cc:844] Serialized 26 byte log entry
0709 13:13:08.177201 (+111181us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:08.344359 (+167158us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:08.438151 (+ 93792us) log.cc:844] Serialized 14 byte log entry
0709 13:13:08.559655 (+121504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.574986 (+ 15331us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:08.577264 (+  2278us) raft_consensus.cc:1685] finished
0709 13:13:08.605961 (+ 28697us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:08.637598 (+ 31637us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64475,"prepare.queue_time_us":74083,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":143574,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":5152,"spinlock_wait_cycles":37421952,"thread_start_us":351307,"threads_started":3,"wal-append.queue_time_us":129525}
W20260709 13:13:08.683368   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 62041.5us
I20260709 13:13:08.685036  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:13:08.674038   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 78010.6us
I20260709 13:13:08.689312   523 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:08.670323   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 86592.3us
I20260709 13:13:08.633276  2020 consensus_queue.cc:1059] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:13:08.622990  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:08.554584  2221 consensus_queue.cc:1059] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:13:08.688129   599 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:13:08.700681   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 143360us
I20260709 13:13:08.699280  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:08.708230  1175 raft_consensus.cc:2393] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 4: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:08.637835  2192 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:08.717824   597 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:08.718024   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:08.720803   525 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:08.711282   624 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:08.731105   522 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:08.604354  2201 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:08.649235   475 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:08.608199  2145 consensus_queue.cc:260] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:08.710224   599 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:08.693580  2199 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:08.644191  1995 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:08.690811  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:08.776275   631 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:08.778882  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:08.698930  2143 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:13:08.683986  1862 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:13:08.845314  2249 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:08.848543   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 138374us
W20260709 13:13:08.775293  2155 consensus_meta.cc:287] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.528s	user 0.011s	sys 0.002s
W20260709 13:13:08.859305   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 302330us
I20260709 13:13:08.691783  2125 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:08.853855   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 86100us
I20260709 13:13:08.863551   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:08.843938   628 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:08.709959  1938 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:08.772337  2020 consensus_queue.cc:1059] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.092s
W20260709 13:13:08.868076   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 147339us
I20260709 13:13:08.841320   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:08.886111  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 278838us
I20260709 13:13:08.849244  2145 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.772780  2187 consensus_queue.cc:1048] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 13:13:08.894124   525 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:08.854806  2234 raft_consensus.cc:3055] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:08.858799  2156 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:13:08.897902  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.898969  2228 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.294s
W20260709 13:13:08.899711  2236 log.cc:927] Time spent T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 13:13:08.702898  1915 consensus_queue.cc:237] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:08.859974  2243 raft_consensus.cc:3055] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:08.862008  2199 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:08.857901  1967 raft_consensus.cc:2804] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:08.854924  2225 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:08.905056   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:08.849632  1949 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:08.904124  2217 log.cc:927] Time spent T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
I20260709 13:13:08.893793  2127 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54246 (request call id 77) took 4124 ms. Trace:
I20260709 13:13:08.868708  2155 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:08.926633  2243 raft_consensus.cc:740] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:08.911584   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:08.931036   557 raft_consensus.cc:2393] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
W20260709 13:13:08.931579   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 60751.6us
I20260709 13:13:08.901649  1938 raft_consensus.cc:697] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:08.920596  2221 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:08.906585  2234 raft_consensus.cc:740] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:08.950927  2222 log.cc:927] Time spent T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.364s	user 0.001s	sys 0.000s
I20260709 13:13:08.951615  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:08.951475  2234 consensus_queue.cc:260] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:08.952266  2245 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:13:08.952793  2234 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:08.953323  2233 log.cc:927] Time spent T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:13:08.953747  2029 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:08.954454   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 118) took 2139 ms. Trace:
I20260709 13:13:08.955972  2201 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:08.939966   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:08.958288   557 raft_consensus.cc:2393] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 2: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:08.939805  2250 consensus_queue.cc:1059] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:13:08.932116  2185 consensus_meta.cc:287] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.000s
I20260709 13:13:08.930872  2225 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.940285  2226 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:08.948658   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 217639us
I20260709 13:13:08.934875  2127 rpcz_store.cc:276] 0709 13:13:04.727226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.737466 (+ 10240us) service_pool.cc:224] Handling call
0709 13:13:05.646921 (+909455us) ts_tablet_manager.cc:1151] Deleting tablet 82382f158074497a857b03f9f87f9e86
0709 13:13:05.647077 (+   156us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:13:07.918137 (+2271060us) tablet_metadata.cc:665] Metadata flushed
0709 13:13:08.084763 (+166626us) tablet_metadata.cc:665] Metadata flushed
0709 13:13:08.841059 (+756296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":877679,"tablet-delete.queue_time_us":732679,"thread_start_us":833850,"threads_started":1}
I20260709 13:13:08.958669   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 113) took 2272 ms. Trace:
I20260709 13:13:08.965956   555 rpcz_store.cc:276] 0709 13:13:06.697340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.358038 (+1660698us) service_pool.cc:224] Handling call
0709 13:13:08.362279 (+  4241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.362473 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.362500 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:08.362943 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:13:08.576870 (+213927us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:08.577054 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.577149 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:08.958452 (+381303us) raft_consensus.cc:1685] finished
0709 13:13:08.958471 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:08.958612 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":213416,"threads_started":1,"wal-append.queue_time_us":483250}
I20260709 13:13:08.954814   556 rpcz_store.cc:276] 0709 13:13:06.814743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.380222 (+1565479us) service_pool.cc:224] Handling call
0709 13:13:08.380589 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.380952 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.380981 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:08.381454 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:13:08.608643 (+227189us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:08.608702 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.608794 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:08.954266 (+345472us) raft_consensus.cc:1685] finished
0709 13:13:08.954287 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:08.954403 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50153,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":6462,"thread_start_us":226777,"threads_started":1,"wal-append.queue_time_us":302386}
I20260709 13:13:08.968652   522 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:08.967953   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:08.921213  2223 consensus_queue.cc:1059] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.346s
I20260709 13:13:08.867658  2249 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:08.980602   556 raft_consensus.cc:2393] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:08.984221   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:08.984925   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:08.985396  2220 log.cc:927] Time spent T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.375s	user 0.000s	sys 0.001s
I20260709 13:13:08.985711  2231 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:08.941856  1967 raft_consensus.cc:697] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:08.987807   555 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.987246   557 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:08.985642  2189 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:08.555114   477 rpcz_store.cc:276] 0709 13:13:07.131968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.953752 (+821784us) service_pool.cc:224] Handling call
0709 13:13:07.954139 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.027178 (+ 73039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.028095 (+   917us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:08.034766 (+  6671us) log.cc:844] Serialized 26 byte log entry
0709 13:13:08.145724 (+110958us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:08.383459 (+237735us) log.cc:844] Serialized 14 byte log entry
0709 13:13:08.417183 (+ 33724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.430423 (+ 13240us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:08.440067 (+  9644us) raft_consensus.cc:1685] finished
0709 13:13:08.440083 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:08.462285 (+ 22202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1935,"prepare.queue_time_us":109409,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":48282,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":17970,"thread_start_us":283357,"threads_started":2,"wal-append.queue_time_us":178012}
I20260709 13:13:08.963050  2226 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.992655   597 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:08.964556  2225 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.006029   522 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:09.007978   522 leader_election.cc:400] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4.
I20260709 13:13:09.024363   522 leader_election.cc:403] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:08.981316  2199 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:09.013963   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:09.015017   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:08.988647  2221 raft_consensus.cc:697] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:09.020320   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:09.034905   556 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:13:08.997313  2009 consensus_meta.cc:287] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.635s	user 0.008s	sys 0.002s
I20260709 13:13:09.022732   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:09.023578   553 raft_consensus.cc:1240] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:09.010819   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 147327us
I20260709 13:13:09.027555   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:09.038486   481 raft_consensus.cc:2393] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:09.000238  2187 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:09.040467   554 raft_consensus.cc:1240] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:09.037559   448 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:09.042855   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:08.965662  2185 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.004052  2226 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.045686   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:09.082607   447 leader_election.cc:336] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 1.856s (SENT)
W20260709 13:13:09.084834   447 leader_election.cc:336] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 1.930s (SENT)
W20260709 13:13:09.083015   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 180981us
I20260709 13:13:09.017568  2088 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:09.082702   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 45273.6us
W20260709 13:13:09.086577   368 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 227b93e1b31e4b058d5ec1fc69bd6849 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3d6f5b2f91e54c8c95f7b19c1b9ecee2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:09.086596   448 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:09.086875   599 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:09.091840  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:09.092160  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:09.093194  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:09.093995  1170 raft_consensus.cc:2393] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 4: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:09.093263  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:09.095026  1175 raft_consensus.cc:2393] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 4: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:09.078418  2020 raft_consensus.cc:3055] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:09.039528  2250 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:09.078781  2151 consensus_meta.cc:287] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.000s
I20260709 13:13:09.120754  1171 raft_consensus.cc:2393] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:09.026803  1995 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:09.094942   556 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:09.132459  2254 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:09.133169  2254 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:09.133718  2254 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.133842   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:09.135900  2237 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:09.084201  2125 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:09.136121  2250 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.137265  2265 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:09.136613  2237 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:09.139925  2250 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.140334  2237 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:09.123189  2185 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:09.143410   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 58604.3us
I20260709 13:13:09.047744   477 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:09.150748   368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 64415.5us
W20260709 13:13:09.151836   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 65039.4us
I20260709 13:13:09.153028   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:09.154618   632 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:09.152534   599 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:09.105406   448 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:09.158308   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 52994.7us
I20260709 13:13:09.139206  2125 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4.
W20260709 13:13:09.158753   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 152606us
I20260709 13:13:09.091840  1166 raft_consensus.cc:1240] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:09.098757  2011 consensus_meta.cc:287] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.000s
I20260709 13:13:09.172896   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:09.163816   599 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:09.163221   448 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:09.082461  2110 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:09.165913   626 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:09.168537  1138 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:09.176131   448 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:09.045049  2009 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.125623  2020 raft_consensus.cc:740] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:09.125115  2156 raft_consensus.cc:697] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:09.040706  2199 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:09.235772   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 59753.5us
I20260709 13:13:09.239758   448 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:09.096402  2246 raft_consensus.cc:2804] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:09.241159   632 raft_consensus.cc:2393] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:13:09.241163  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 72682.9us
I20260709 13:13:09.246922   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:09.244282   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:09.034974  1938 consensus_queue.cc:237] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:09.244313   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 80564.7us
I20260709 13:13:09.248070   626 raft_consensus.cc:2393] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:09.172557  2151 raft_consensus.cc:3055] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:09.287446  2246 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:09.292908  2246 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:09.260221  2020 consensus_queue.cc:260] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.237483  2256 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:09.295749  2256 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:09.296056  2169 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:09.237661  1949 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:09.162792  2201 raft_consensus.cc:2804] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:09.306916  2201 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:09.307699  2201 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.256554  2238 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:09.311421  2238 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:09.311854  2238 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.257130  2259 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:09.242455  1995 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:09.258180   365 catalog_manager.cc:5028] TS 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): tablet 82382f158074497a857b03f9f87f9e86 (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:13:09.258771  2249 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:09.259441  2009 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:09.314859  2259 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.248515  2255 consensus_queue.cc:1059] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.278s
I20260709 13:13:09.259313  2239 consensus_queue.cc:1059] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.215s
I20260709 13:13:09.098937  2187 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.314925  1995 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.157617  2088 consensus_queue.cc:1059] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:13:09.235918   476 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:09.315917  1995 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.315352  2259 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.171942  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:09.317451  2187 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:09.260027  2242 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:09.297993  1822 consensus_meta.cc:287] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.692s	user 0.004s	sys 0.003s
I20260709 13:13:09.318288  1822 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.320528  1822 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:09.298431   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:09.321516   633 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:09.322891   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:09.324429   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:09.236611  2011 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.304042   597 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:09.165831  2265 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:09.245370  2185 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:09.260468  2252 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.274s
I20260709 13:13:09.296145  2256 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.289143  2151 raft_consensus.cc:740] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:09.303824  2020 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.288285   448 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:09.342366   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 54163.4us
W20260709 13:13:09.343118  2095 consensus_meta.cc:287] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.887s	user 0.010s	sys 0.000s
W20260709 13:13:09.246245  2072 consensus_meta.cc:287] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.654s	user 0.007s	sys 0.003s
I20260709 13:13:09.343590  2095 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.344377  2072 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.345829  2095 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:09.346522  2072 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:09.347287  2083 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:09.254643   555 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:09.350034   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:09.350909   555 raft_consensus.cc:2393] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 4: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
W20260709 13:13:09.351761  2214 consensus_meta.cc:287] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.795s	user 0.002s	sys 0.009s
I20260709 13:13:09.352432   559 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:09.300801  2191 consensus_meta.cc:287] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.799s	user 0.008s	sys 0.002s
I20260709 13:13:09.301795  2269 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 13:13:09.315182   365 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 57247us
I20260709 13:13:09.353847  2191 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.303915   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:09.346609   629 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:09.352916  2214 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:09.356294  2191 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:09.356570  2214 consensus_queue.cc:1048] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:09.357033  1173 raft_consensus.cc:2393] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:09.244305  2155 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:09.351994   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:09.364624   555 raft_consensus.cc:2393] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 2: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:09.363096   522 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:09.372925   448 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:09.340217  2255 raft_consensus.cc:3055] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:09.227380  2225 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.167510  1967 consensus_queue.cc:237] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.383298   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:09.374959   597 raft_consensus.cc:2686] T 82382f158074497a857b03f9f87f9e86 P 50f7c2247be24f3685d7fbca7b6c71e3: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:13:09.387003   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 83266.5us
I20260709 13:13:09.388098   522 leader_election.cc:304] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:09.364940  2189 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:09.361375  2083 raft_consensus.cc:697] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:09.393216   522 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:09.417445  2011 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:09.423825   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:09.424443   632 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.374742  2265 raft_consensus.cc:697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:09.426918  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:09.427476  2011 consensus_queue.cc:1059] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:09.244496  2221 consensus_queue.cc:237] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.378882  2255 raft_consensus.cc:740] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:09.434631   448 connection.cc:256] RPC call timeout handler was delayed by -1.5186611629999334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
I20260709 13:13:09.434751   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:09.390825   630 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:13:09.441337   448 connection.cc:256] RPC call timeout handler was delayed by -1.4394611630000327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
W20260709 13:13:09.436285  2137 consensus_meta.cc:287] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.026s	user 0.009s	sys 0.002s
I20260709 13:13:09.425027  2155 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:09.424535  2072 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:09.374030  1995 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.302516  2263 consensus_queue.cc:1059] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.420s
I20260709 13:13:09.433806  1949 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:09.340006  2251 consensus_queue.cc:1059] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.144s
I20260709 13:13:09.449507  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:09.390327  2261 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 13:13:09.466629  2257 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:09.439484  1170 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:09.467144  2257 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:09.467558  2257 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:09.449644  2137 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:09.471552   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 168360us
I20260709 13:13:09.429394  2151 consensus_queue.cc:260] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.473404   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:09.480983   624 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.474618   599 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:09.464752  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:09.485682   597 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:09.379019  2156 consensus_queue.cc:237] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.488921  1975 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:09.493546 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:09.493721  1975 raft_consensus.cc:697] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:09.494617  2137 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:09.484939  2199 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:09.488830  2271 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:09.467864  2276 consensus_queue.cc:1059] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:13:09.521689  2257 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.503114  2137 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:09.563297  2137 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.563553  2276 raft_consensus.cc:3055] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:09.563807  2137 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:09.564152  2276 raft_consensus.cc:740] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:09.494748  1975 consensus_queue.cc:237] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.559549   624 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
W20260709 13:13:09.506256  2035 consensus_meta.cc:287] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.914s	user 0.008s	sys 0.003s
I20260709 13:13:09.568831   522 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:09.572609   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 90214.8us
I20260709 13:13:09.484782  2083 consensus_queue.cc:237] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.493076  2263 consensus_queue.cc:1059] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
W20260709 13:13:09.575623   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 90053us
I20260709 13:13:09.499661  2244 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.580889   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:09.572821  2261 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:09.589758   555 raft_consensus.cc:2393] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:09.591531 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:09.593672   476 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:09.594750   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:09.595575   476 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:09.595552  2238 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.596753   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:09.597335   476 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.597664  2238 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:09.598678  1995 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:09.585220  2225 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:09.573405  2035 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.624447   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:09.628217   624 raft_consensus.cc:2368] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 2. Current term is 3.
I20260709 13:13:09.488842  2255 consensus_queue.cc:260] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.566989  2237 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.490976  2265 consensus_queue.cc:237] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.570544  2259 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:09.622855  2202 consensus_meta.cc:287] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 1.189s	user 0.008s	sys 0.004s
I20260709 13:13:09.607542  2261 raft_consensus.cc:697] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:09.646391   522 leader_election.cc:400] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 2. Current term is 3.
I20260709 13:13:09.646859   522 leader_election.cc:403] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:13:09.642563   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:09.647920   624 raft_consensus.cc:2393] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:09.642087  2276 consensus_queue.cc:260] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:09.645898  2113 consensus_meta.cc:287] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 1.001s	user 0.007s	sys 0.003s
W20260709 13:13:09.640039  2082 consensus_meta.cc:287] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 1.231s	user 0.011s	sys 0.001s
I20260709 13:13:09.595131  2246 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.649026  2156 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 2. Current term is 3.
W20260709 13:13:09.669577   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.670035   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:09.637686  2201 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:09.661484  2270 log.cc:927] Time spent T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.177s	user 0.001s	sys 0.001s
I20260709 13:13:09.674957  2276 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:09.675385  2250 consensus_meta.cc:287] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.003s
W20260709 13:13:09.669078  2274 log.cc:927] Time spent T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.164s	user 0.001s	sys 0.001s
I20260709 13:13:09.663220  1944 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.648303  2202 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.677404  2257 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:09.679481   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:09.671738  2272 log.cc:927] Time spent T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:13:09.680860   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:09.662549  2282 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.683920   624 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.656919  2082 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.682500   479 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:09.655296  2113 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.685277  2035 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:09.686146  2254 consensus_meta.cc:287] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.552s	user 0.008s	sys 0.003s
I20260709 13:13:09.688959   632 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:09.693101   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:09.646927  2261 consensus_queue.cc:237] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.698297   484 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.680598  1944 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:09.686757  2114 consensus_meta.cc:287] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 1.277s	user 0.008s	sys 0.005s
I20260709 13:13:09.697547   556 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:09.700011   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:09.702344   632 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:09.689230   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:09.602393  2244 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.709964   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:09.710847   479 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.695492  2259 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:09.714593  2284 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.699414  2246 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:09.714948  2190 consensus_meta.cc:287] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 1.039s	user 0.003s	sys 0.007s
W20260709 13:13:09.715619  2281 log.cc:927] Time spent T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:13:09.716180  2113 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:09.717664   476 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:09.712792  2237 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:09.721692   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:09.739610   522 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:09.740761   522 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:09.742090  2156 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:09.742731  2156 raft_consensus.cc:697] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:09.743438  2271 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:09.743940  2271 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.744343  2271 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.748916  2156 consensus_queue.cc:237] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.720839   633 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
W20260709 13:13:09.716203  2145 consensus_meta.cc:287] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.811s	user 0.010s	sys 0.000s
I20260709 13:13:09.675796  2250 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.761166   522 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:09.720268  2284 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.708595  2114 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.767854   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:09.794845   632 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:09.782927   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:09.701927  2254 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.799813   624 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:09.696358  2282 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.791805   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:09.776942  1938 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:09.714618  2137 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.809379   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:09.809451  2293 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.819509  2293 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.810811   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:09.805104  2287 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:09.820494  2240 log.cc:927] Time spent T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 1.040s	user 0.008s	sys 0.007s
I20260709 13:13:09.823674   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:09.826611  2184 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:09.826769  2114 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:09.824736  1938 raft_consensus.cc:697] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:09.829401   632 raft_consensus.cc:1240] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:09.832804   632 raft_consensus.cc:1275] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:09.733409  2190 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.820739   552 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:09.842060   632 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:09.829049  2271 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.830776  2201 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:09.807438  2256 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.829665  1938 consensus_queue.cc:237] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.854630  2282 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:09.855973  2254 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:09.855917  2243 consensus_queue.cc:260] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.841950  2202 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:09.845043  2244 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:09.861860  2271 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:09.859548   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:09.857091  2243 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:09.880842  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:09.883635  1170 raft_consensus.cc:1240] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:09.846601  2082 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:09.889003   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:09.838706  2287 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:09.906976  2226 consensus_meta.cc:287] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.756s	user 0.012s	sys 0.001s
I20260709 13:13:09.907413  2226 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.908640   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:09.910075  2226 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:09.909988   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:09.910537  2284 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:09.895443  2250 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:09.910961   632 raft_consensus.cc:2393] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:09.912102   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:09.912616   632 raft_consensus.cc:2393] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 4: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:09.913154   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:09.913695   632 raft_consensus.cc:2393] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:09.914294   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:09.914709   632 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:09.885916  1168 raft_consensus.cc:1240] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:09.893958  1944 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.919608  2256 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:09.922508  2137 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:09.924371   599 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:09.915396   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:09.894727  2190 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:09.928727  2137 consensus_queue.cc:1059] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:09.929702  2142 consensus_queue.cc:1059] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:09.930316  1944 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:09.934110   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:09.933115  2226 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:09.936568  2226 raft_consensus.cc:697] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:09.936841   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:09.937422  2226 consensus_queue.cc:237] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.937405   632 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:09.940341   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:09.941452   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:09.942147   632 raft_consensus.cc:2393] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:09.942914   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:09.943883   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:09.944514   632 raft_consensus.cc:2368] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3.
I20260709 13:13:09.945174   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:09.945840   632 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:09.946727   632 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:09.948036   632 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:13:09.948380   632 pending_rounds.cc:85] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 1
I20260709 13:13:09.948689   632 pending_rounds.cc:107] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:13:09.948972   632 raft_consensus.cc:2889] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:09.945174   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:09.951108   558 raft_consensus.cc:2393] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:09.951514   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1331) took 1296 ms. Trace:
I20260709 13:13:09.951810   558 rpcz_store.cc:276] 0709 13:13:08.654968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.944950 (+1289982us) service_pool.cc:224] Handling call
0709 13:13:09.951438 (+  6488us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.952715   624 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:09.952742   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:09.953536   558 raft_consensus.cc:2393] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:09.954053   624 raft_consensus.cc:1240] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:09.954433   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:09.955127   558 raft_consensus.cc:2393] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:09.955864   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:09.956478   558 raft_consensus.cc:2368] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4.
I20260709 13:13:09.957306   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:09.958298   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:09.959957   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1306) took 2316 ms. Trace:
I20260709 13:13:09.960322   629 rpcz_store.cc:276] 0709 13:13:07.643618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.093845 (+450227us) service_pool.cc:224] Handling call
0709 13:13:08.094217 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.356020 (+1261803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.959759 (+603739us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000bf4d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:09.959905 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2879697152}
I20260709 13:13:09.961663   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:09.962226   558 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:09.963901  2266 log.cc:927] Time spent T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.949s	user 0.003s	sys 0.000s
I20260709 13:13:09.956543  2277 raft_consensus.cc:3055] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:09.966749  2277 raft_consensus.cc:740] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:09.967283   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 128) took 1489 ms. Trace:
I20260709 13:13:09.967561  2277 consensus_queue.cc:260] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:09.968928  2277 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.969012   558 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:09.970041   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:09.970732   558 raft_consensus.cc:2393] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 4: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:13:09.971369  2192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.118s	user 0.000s	sys 0.003s
W20260709 13:13:09.971731  2192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.121s	user 0.000s	sys 0.003s
I20260709 13:13:09.972139  2192 raft_consensus.cc:697] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:09.955140   624 raft_consensus.cc:1240] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:09.973105  2192 consensus_queue.cc:237] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.971719   558 raft_consensus.cc:1240] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:09.967675   627 rpcz_store.cc:276] 0709 13:13:08.477625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.482527 (+  4902us) service_pool.cc:224] Handling call
0709 13:13:08.488757 (+  6230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.488997 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:08.566567 (+ 77570us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.966847 (+1400280us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b18003a9a20. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b67fc14bc 00007f4b6530f48b 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b65329455 00007f4b68411060 00007f4b68423716 00007f4b68434287
0709 13:13:09.966934 (+    87us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.966987 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:09.967027 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.967106 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.967211 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31204,"prepare.queue_time_us":92739,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":122316,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":57278,"spinlock_wait_cycles":9209600,"thread_start_us":203702,"threads_started":3,"wal-append.queue_time_us":38376,"wal-append.run_cpu_time_us":2023,"wal-append.run_wall_time_us":1328018}
I20260709 13:13:09.980119   632 raft_consensus.cc:1240] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:09.981523   632 raft_consensus.cc:1240] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:09.977898   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1339) took 1285 ms. Trace:
I20260709 13:13:09.985852   558 rpcz_store.cc:276] 0709 13:13:08.692315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.971219 (+1278904us) service_pool.cc:224] Handling call
0709 13:13:09.971542 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.977633 (+  6091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.977821 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.991634   558 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:09.991555  2088 raft_consensus.cc:3055] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:09.992672  2088 raft_consensus.cc:740] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:09.993628  2253 log.cc:927] Time spent T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.914s	user 0.000s	sys 0.002s
I20260709 13:13:09.993608  2088 consensus_queue.cc:260] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:09.994594  2088 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.003739   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1342) took 1299 ms. Trace:
I20260709 13:13:10.004233   558 rpcz_store.cc:276] 0709 13:13:08.704128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.991073 (+1286945us) service_pool.cc:224] Handling call
0709 13:13:09.991398 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:10.003405 (+ 12007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.003671 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:10.005754   558 raft_consensus.cc:1240] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:10.006313   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1343) took 1301 ms. Trace:
I20260709 13:13:10.006609   558 rpcz_store.cc:276] 0709 13:13:08.704402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.005060 (+1300658us) service_pool.cc:224] Handling call
0709 13:13:10.005522 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:10.006063 (+   541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.006263 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:10.018177   484 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:10.022919  2293 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:10.027194  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:10.027346  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:10.028064  1170 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:10.028306   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1346) took 1315 ms. Trace:
I20260709 13:13:10.027536  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:10.028748   558 rpcz_store.cc:276] 0709 13:13:08.712710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.007280 (+1294570us) service_pool.cc:224] Handling call
0709 13:13:10.007557 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:10.007741 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:10.007764 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:10.008187 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:13:10.023056 (+ 14869us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:10.023101 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.023186 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:10.028069 (+  4883us) raft_consensus.cc:1685] finished
0709 13:13:10.028108 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.028250 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":14469,"threads_started":1,"wal-append.queue_time_us":14792}
I20260709 13:13:10.028439  1168 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 4: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:10.036749  1170 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:10.039088   597 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:10.040035  2242 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:10.040596  2242 raft_consensus.cc:697] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:10.041493  2242 consensus_queue.cc:237] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:10.044852   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 887380us
I20260709 13:13:10.045535  1172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 420) took 1812 ms. Trace:
I20260709 13:13:10.045881  1172 rpcz_store.cc:276] 0709 13:13:08.233338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.233544 (+   206us) service_pool.cc:224] Handling call
0709 13:13:08.266020 (+ 32476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.540771 (+274751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.045327 (+1504556us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400655ed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:10.045483 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463863040}
I20260709 13:13:10.046418   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:10.047197   627 raft_consensus.cc:2393] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:10.047566   558 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:10.048625   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 131) took 1570 ms. Trace:
I20260709 13:13:10.048979   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:10.049134   631 rpcz_store.cc:276] 0709 13:13:08.478545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.603480 (+124935us) service_pool.cc:224] Handling call
0709 13:13:08.633266 (+ 29786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.853761 (+220495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.048430 (+1194669us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54000bead4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:10.048573 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327866112}
I20260709 13:13:10.048677   558 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:10.051690   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:10.052522   558 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:10.054252   627 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:10.055658   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1378) took 2861 ms. Trace:
I20260709 13:13:10.056013   553 rpcz_store.cc:276] 0709 13:13:07.194873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.427561 (+1232688us) service_pool.cc:224] Handling call
0709 13:13:08.438353 (+ 10792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.036819 (+598466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.055334 (+1018515us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b540034ce54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:10.055476 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345461120}
I20260709 13:13:10.057281  2293 consensus_queue.cc:1059] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:10.058384   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:10.058630   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:10.059118   629 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:10.060478   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:10.061548   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:10.061812   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:10.062654   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:10.062969   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:10.063510   632 raft_consensus.cc:2410] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:10.063671   627 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 2.
I20260709 13:13:10.061654   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:10.066258   447 leader_election.cc:336] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 2.011s (SENT)
I20260709 13:13:10.066706   447 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:10.067534  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:10.068111  2277 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:10.069458   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.070118  1173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36724 (request call id 272) took 1811 ms. Trace:
I20260709 13:13:10.070494  1173 rpcz_store.cc:276] 0709 13:13:08.258466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.647177 (+388711us) service_pool.cc:224] Handling call
0709 13:13:10.069913 (+1422736us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b540069f5d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:10.070038 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1542729600}
I20260709 13:13:10.067209  2160 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:10.067723   447 leader_election.cc:336] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 2.133s (SENT)
I20260709 13:13:10.071892  2160 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:10.072839   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.073964   447 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:10.074836  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:10.075421  2232 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:10.076031  2232 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:10.076385  2232 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:10.077477   447 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:10.078469  2277 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:10.079001  2256 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:10.079454  2256 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:10.079806  2256 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.080354  2160 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:10.085089  2082 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:10.086407  2082 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:10.088261   447 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:10.089181  2082 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:10.091094   447 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:10.091847  2082 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:10.092331   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1325) took 2669 ms. Trace:
I20260709 13:13:10.092950   447 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:10.092826   552 rpcz_store.cc:276] 0709 13:13:07.422492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.497414 (+1074922us) service_pool.cc:224] Handling call
0709 13:13:08.497817 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.842329 (+1344512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.092076 (+249747us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540031a6d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:10.092261 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3005372160}
I20260709 13:13:10.093811  2082 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:10.098316   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1322) took 2391 ms. Trace:
I20260709 13:13:10.098757   630 rpcz_store.cc:276] 0709 13:13:07.707012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.065998 (+358986us) service_pool.cc:224] Handling call
0709 13:13:10.098079 (+2032081us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002bd4d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:10.098237 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2848549632}
W20260709 13:13:10.100267  1169 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36724 (request call id 270) took 1921 ms (client timeout 1556 ms). Trace:
W20260709 13:13:10.100694  1169 rpcz_store.cc:269] 0709 13:13:08.179015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.180391 (+  1376us) service_pool.cc:224] Handling call
0709 13:13:10.100072 (+1919681us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b540067d9d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:10.100201 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1502727424}
I20260709 13:13:10.101182  2082 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:10.102449   447 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:10.104380  2082 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:10.106395   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 662350us
W20260709 13:13:10.106952   448 connection.cc:256] RPC call timeout handler was delayed by -1.0623611629998777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
W20260709 13:13:10.116482   448 connection.cc:256] RPC call timeout handler was delayed by -1.0362611630000629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
W20260709 13:13:10.116907   448 connection.cc:256] RPC call timeout handler was delayed by -1.0173611630000323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
I20260709 13:13:10.122381   599 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:13:10.128253  1171 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 302) took 1885 ms (client timeout 1586 ms). Trace:
W20260709 13:13:10.128717  1171 rpcz_store.cc:269] 0709 13:13:08.242931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.260095 (+ 17164us) service_pool.cc:224] Handling call
0709 13:13:10.128014 (+1867919us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54005eea54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:10.128171 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619679104}
I20260709 13:13:10.129794  1175 raft_consensus.cc:1240] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:10.136613   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:10.137398   558 raft_consensus.cc:2393] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 4: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:10.137262   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:10.137414  2227 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:10.138056   552 raft_consensus.cc:2393] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 4: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:10.138329   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:10.140010  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 65651.8us
I20260709 13:13:10.145574  1139 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:10.146754  1139 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:10.147012  2190 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:10.147919  2190 consensus_queue.cc:1059] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:10.148603   522 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:10.157357   551 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:10.157532  2125 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:10.157914   522 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:10.158036   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1396) took 1905 ms. Trace:
I20260709 13:13:10.158121  2125 raft_consensus.cc:697] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:10.158432   551 rpcz_store.cc:276] 0709 13:13:08.252409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.592543 (+340134us) service_pool.cc:224] Handling call
0709 13:13:10.156959 (+1564416us) spinlock_profiling.cc:243] Waited 7.6 ms on lock 0x7b5800116198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4eee 0000000000375939 00007f4b6d3681e0 00007f4b6d4310c4 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:10.157169 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:10.157783 (+   614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.157982 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17489280}
I20260709 13:13:10.159384  2192 consensus_queue.cc:1059] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:10.159809  1980 raft_consensus.cc:3055] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:10.160245  1980 raft_consensus.cc:740] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:10.160306  2264 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:10.161135  1980 consensus_queue.cc:260] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:10.162127  1980 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.149271  2184 consensus_queue.cc:1059] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:10.163971  2184 raft_consensus.cc:3055] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:10.164332  2184 raft_consensus.cc:740] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:10.165174  2184 consensus_queue.cc:260] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:10.165748  2232 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:10.103844   447 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:10.151194  2293 consensus_queue.cc:1059] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:10.168862  2293 raft_consensus.cc:3055] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:10.169232  2293 raft_consensus.cc:740] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:10.170153  2293 consensus_queue.cc:260] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:10.174997  2293 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.175060  2179 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:10.149991  1967 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:10.153412   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:10.179363   484 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:10.135118  2256 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:10.182911  2256 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:10.159312  2125 consensus_queue.cc:237] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:10.183820  2214 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:10.184192  2214 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:10.184508  2214 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:10.158895  2219 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:10.151818  2227 raft_consensus.cc:697] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:10.116168   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.307077   484 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
W20260709 13:13:09.836977   477 consensus_meta.cc:287] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.687s	user 0.007s	sys 0.004s
I20260709 13:13:10.468961   477 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
W20260709 13:13:10.304698   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 200919us
I20260709 13:13:10.469523   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:10.470716   447 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:10.471228   525 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:10.471515   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:10.472045   447 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:10.472682   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:10.473179   447 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:10.473354   484 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
W20260709 13:13:10.312525   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 124982us
I20260709 13:13:10.320778   553 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:10.474298   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:10.476250   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1366) took 5177 ms. Trace:
I20260709 13:13:10.476639   559 rpcz_store.cc:276] 0709 13:13:05.299313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.113238 (+2813925us) service_pool.cc:224] Handling call
0709 13:13:08.126015 (+ 12777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.352911 (+1226896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.476040 (+1123129us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540034d854. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:10.476198 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2819948416}
I20260709 13:13:10.308373  1938 consensus_queue.cc:1059] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:13:10.326768  1944 consensus_queue.cc:1059] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:13:10.626536  1938 raft_consensus.cc:3055] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:10.626929  1938 raft_consensus.cc:740] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:10.343830  2113 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:10.326550  2192 consensus_queue.cc:1059] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:13:10.368918  2287 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:10.337934  2219 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.854723  2219 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:10.856860  2219 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:10.358529  2227 consensus_queue.cc:237] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:10.340219  2230 tablet_replica.cc:333] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:13:10.360648  2232 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:10.377743  2302 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:10.308869  2264 raft_consensus.cc:3055] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:10.325690  2243 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:13:10.387858   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:10.882421   476 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:10.883330  2125 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:10.884367   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:10.400914   479 consensus_meta.cc:287] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.689s	user 0.008s	sys 0.004s
I20260709 13:13:10.885531   479 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:10.886036   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1326) took 1301 ms. Trace:
I20260709 13:13:10.886353   479 rpcz_store.cc:276] 0709 13:13:09.584246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.709634 (+125388us) service_pool.cc:224] Handling call
0709 13:13:10.885979 (+1176345us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:10.461656   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.469550   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1244) took 1456 ms. Trace:
I20260709 13:13:10.887634   477 rpcz_store.cc:276] 0709 13:13:09.013519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.013652 (+   133us) service_pool.cc:224] Handling call
0709 13:13:10.469469 (+1455817us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:10.888857   477 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:10.890691  2243 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.891213   477 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:10.480371   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.482967  2156 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:10.891553  2243 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:10.496480  2319 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:10.892541  2319 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:10.892903  2319 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:10.893654   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.893940  2243 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:10.896476  2287 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:10.897002  2287 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:10.501842  2318 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.899374  2239 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.899868  2239 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:10.896641 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:10.901882  2239 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:10.502911   447 leader_election.cc:400] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3.
I20260709 13:13:10.904064   447 leader_election.cc:403] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:13:10.904829   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 402019us
I20260709 13:13:10.504366   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:10.907626   559 raft_consensus.cc:2393] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 5: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:10.505810   551 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:10.505739   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:10.507696  2324 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:10.508265   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:10.364260  2214 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:10.519783   481 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:10.523974   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:10.532593   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:10.899082  2287 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:10.539171   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1338) took 1847 ms. Trace:
I20260709 13:13:10.542806   478 raft_consensus.cc:1240] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:10.546787   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:10.550467   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43548 (request call id 128) took 1261 ms. Trace:
W20260709 13:13:10.553457   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.560122  2271 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:10.565896  2095 raft_consensus.cc:3055] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:10.934649   378 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48622 (request call id 248) took 8840 ms. Trace:
I20260709 13:13:10.578449   482 raft_consensus.cc:1240] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:10.936786   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1325) took 1355 ms. Trace:
I20260709 13:13:10.584326   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:10.937619   633 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:10.937216   482 rpcz_store.cc:276] 0709 13:13:09.581708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.581838 (+   130us) service_pool.cc:224] Handling call
0709 13:13:10.577996 (+996158us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:10.578206 (+   210us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:10.936530 (+358324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.936736 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6143360}
I20260709 13:13:10.586539   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:10.593165  2164 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:13:10.593276  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 446568us
I20260709 13:13:10.940446   484 raft_consensus.cc:2393] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 4: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:10.611781   628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1304) took 3107 ms. Trace:
I20260709 13:13:10.111558  2082 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:10.628356  1938 consensus_queue.cc:260] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:10.633371  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 484929us
W20260709 13:13:10.658986   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:10.995131  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.996414   599 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:10.658901  2226 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:10.662214  2020 raft_consensus.cc:3055] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:13:10.663087  1141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.013s	sys 0.028s
I20260709 13:13:10.665367   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1326) took 3242 ms. Trace:
I20260709 13:13:11.002228   479 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:13:10.659068   523 connection.cc:256] RPC call timeout handler was delayed by -1.0794706449999012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
I20260709 13:13:11.002723   599 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:11.003317  1175 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:10.676908  2293 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.681147  2151 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.682448   597 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:10.726095   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:10.744082  1980 consensus_meta.cc:287] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.582s	user 0.014s	sys 0.000s
I20260709 13:13:10.754683  2011 raft_consensus.cc:3055] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:10.759344   632 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:11.018013   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 335617us
I20260709 13:13:11.018934   632 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:11.020356   632 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:10.784842  2223 raft_consensus.cc:3055] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:10.787964   475 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:10.792555  2255 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.032116  2230 raft_consensus.cc:2243] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.024204  1975 consensus_queue.cc:1059] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:13:11.018959  2252 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.034047  2252 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.034631  2239 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:10.660195   448 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:11.069682   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 409532us
I20260709 13:13:11.070564   448 leader_election.cc:400] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4.
I20260709 13:13:11.070849   448 leader_election.cc:403] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:13:10.832161   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:10.836298   550 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1345) took 2131 ms (client timeout 1669 ms). Trace:
I20260709 13:13:10.851800  2113 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:10.854184  2192 raft_consensus.cc:3055] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:10.857712   557 raft_consensus.cc:2410] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:10.863569  2302 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:10.880115  2264 raft_consensus.cc:740] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:11.078887  1975 raft_consensus.cc:3055] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:11.079326  1975 raft_consensus.cc:740] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:11.079723  2264 consensus_queue.cc:260] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.080734  2264 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:10.867458  2244 raft_consensus.cc:3055] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:11.080963  2302 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:10.906932   447 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:10.908046   476 raft_consensus.cc:1275] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:13:11.081871   476 pending_rounds.cc:85] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 1
I20260709 13:13:11.082137   476 pending_rounds.cc:107] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 13:13:11.082216   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 175343us
I20260709 13:13:11.082434   476 raft_consensus.cc:2889] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:10.909744  2323 consensus_queue.cc:1059] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:11.083506  2323 consensus_queue.cc:1243] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:13:11.083461  2277 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:10.910022   380 catalog_manager.cc:5697] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 1 to 2, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 2 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.085426   380 catalog_manager.cc:5697] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:10.914965   558 raft_consensus.cc:2393] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:11.088105   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:11.089134   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:11.090085   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:11.090732   558 raft_consensus.cc:2393] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:10.931499   556 rpcz_store.cc:276] 0709 13:13:08.692087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.135414 (+443327us) service_pool.cc:224] Handling call
0709 13:13:09.135823 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.702140 (+566317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.538865 (+836725us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54000eae54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:10.539098 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1291261696}
I20260709 13:13:11.092074   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:10.931962   555 rpcz_store.cc:276] 0709 13:13:09.289487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.389246 (+ 99759us) service_pool.cc:224] Handling call
0709 13:13:10.550279 (+1161033us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54000eb354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:10.550407 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340397312}
I20260709 13:13:10.933558   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 177) took 2767 ms. Trace:
I20260709 13:13:10.912256  2232 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3.
I20260709 13:13:10.935415   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:11.074498   550 rpcz_store.cc:269] 0709 13:13:08.704914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.911297 (+206383us) service_pool.cc:224] Handling call
0709 13:13:10.836057 (+1924760us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54001ca054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:10.836222 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3873666816}
I20260709 13:13:11.098515   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:11.098685   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:11.099560   551 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:11.099972   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:11.101473   550 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:10.939851  1139 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:10.939138   627 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:11.103719  2143 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:13:11.103848  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 164076us
I20260709 13:13:10.950631   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:11.105369  2143 consensus_queue.cc:1059] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:11.105968   629 raft_consensus.cc:1240] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:11.106338  2143 raft_consensus.cc:3055] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:11.106215  2179 consensus_queue.cc:1059] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:11.106748  2143 raft_consensus.cc:740] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:11.107403  2170 raft_consensus.cc:3055] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:11.107432  2164 consensus_queue.cc:1059] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:10.967900   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:11.108080   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.108246  2164 consensus_queue.cc:1243] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer 6ba2a9c02b534120bbf26e56a1e920ca log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:13:11.109324   625 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:13:10.970381  2221 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:10.977219   633 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:10.945971   552 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:11.110472  2221 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.111301  2113 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:11.111416   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:11.077348  2192 raft_consensus.cc:740] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:11.112171   552 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.112528  2221 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:11.112809  2192 consensus_queue.cc:260] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.114786   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:10.936308  2095 raft_consensus.cc:740] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:11.115869  2095 consensus_queue.cc:260] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.116139   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:11.116880  2095 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:11.117275   555 raft_consensus.cc:2410] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:11.118340   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:11.118948   555 raft_consensus.cc:2393] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:10.936393   378 rpcz_store.cc:276] 0709 13:13:02.089712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.089861 (+   149us) service_pool.cc:224] Handling call
0709 13:13:02.102961 (+ 13100us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b54000fbed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68383090 00007f4b68421f3a 00007f4b6e1d81cc 00007f4b6e2d637e 00007f4b6c7972a4 00007f4b6c797232 00007f4b6c797161 00007f4b6c7970dc 00007f4b6c796392 00007f4b6675448c 00007f4b667538c6
0709 13:13:10.930360 (+8827399us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:09.005958 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:09.006683 (+   725us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:09.006730 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:13:09.006747 (+    17us) tablet.cc:662] Decoding operations
0709 13:13:09.007715 (+   968us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:09.007822 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:09.007856 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:13:09.008764 (+   908us) tablet.cc:701] Row locks acquired
0709 13:13:09.008823 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:13:09.009035 (+   212us) write_op.cc:270] Start()
0709 13:13:09.009217 (+   182us) write_op.cc:276] Timestamp: P: 1783602789008959 usec, L: 0
0709 13:13:09.009247 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:13:09.010124 (+   877us) log.cc:844] Serialized 3244 byte log entry
0709 13:13:09.158514 (+148390us) spinlock_profiling.cc:243] Waited 86 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b6530f0ac 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b
0709 13:13:09.591074 (+432560us) op_driver.cc:464] REPLICATION: finished
0709 13:13:09.685813 (+ 94739us) write_op.cc:301] APPLY: starting
0709 13:13:09.685902 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:09.686112 (+   210us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:09.686132 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:09.762434 (+ 76302us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:09.796126 (+ 33692us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:13:09.801278 (+  5152us) write_op.cc:312] APPLY: finished
0709 13:13:09.825863 (+ 24585us) log.cc:844] Serialized 65 byte log entry
0709 13:13:09.826061 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:09.826178 (+   117us) write_op.cc:454] Released schema lock
0709 13:13:09.826226 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:09.826587 (+   361us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:09.826617 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5122,"reported_tablets":13,"spinlock_wait_cycles":9841024,"child_traces":[["op",{"apply.queue_time_us":84947,"apply.run_cpu_time_us":4045,"apply.run_wall_time_us":144412,"num_ops":8,"prepare.queue_time_us":78383,"prepare.run_cpu_time_us":10004,"prepare.run_wall_time_us":300675,"raft.queue_time_us":157869,"raft.run_cpu_time_us":27930,"raft.run_wall_time_us":71975,"replication_time_us":581676,"spinlock_wait_cycles":197819776,"thread_start_us":534317,"threads_started":4,"wal-append.queue_time_us":407304,"wal-append.run_cpu_time_us":86774,"wal-append.run_wall_time_us":1411009}]]}
I20260709 13:13:11.119644   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:10.941015  2271 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:10.939478  2319 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:10.991415  2214 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:10.997817  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:11.122197   556 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:11.124640   557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1335) took 2411 ms (client timeout 2435 ms). Trace:
W20260709 13:13:11.126525   557 rpcz_store.cc:269] 0709 13:13:08.684853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.994906 (+310053us) service_pool.cc:224] Handling call
0709 13:13:11.094605 (+2099699us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b54001c9b54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:11.096605 (+  2000us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4210133376}
I20260709 13:13:11.125041   630 raft_consensus.cc:1240] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: [1.4-3.5]
I20260709 13:13:11.120662   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:11.127403   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:10.999151   483 raft_consensus.cc:1240] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.001080   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:11.131779   481 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:10.946172   628 rpcz_store.cc:276] 0709 13:13:07.508294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.071172 (+562878us) service_pool.cc:224] Handling call
0709 13:13:08.100908 (+ 29736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.898546 (+797638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.611499 (+1712953us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b540011a654. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:10.611707 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1533357312}
I20260709 13:13:11.002319   554 rpcz_store.cc:276] 0709 13:13:07.422823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.509144 (+1086321us) service_pool.cc:224] Handling call
0709 13:13:08.509476 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.083111 (+573635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.665136 (+1582025us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b54000ec754. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:10.665311 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220729216}
I20260709 13:13:11.007462   631 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.015666   523 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:11.002038  2020 raft_consensus.cc:740] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:11.024127  2010 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:11.027947   597 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:13:11.152534   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 132951us
I20260709 13:13:11.028395  2279 consensus_queue.cc:1059] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.023993  2223 raft_consensus.cc:740] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:11.033432  1167 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:11.161032   484 raft_consensus.cc:3055] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:11.161367   484 raft_consensus.cc:740] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:11.162001   484 consensus_queue.cc:260] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.163009   484 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:11.036336  2252 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:10.827903  2088 raft_consensus.cc:3055] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:11.036482   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1247) took 2012 ms. Trace:
I20260709 13:13:11.023682  2011 raft_consensus.cc:740] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:11.019057  2243 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.037585  2250 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:11.038375  1862 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:11.040019  1171 raft_consensus.cc:1240] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:11.044593  1141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.014s	sys 0.028s
I20260709 13:13:11.007475  1938 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.007540  2234 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:11.046303  2230 raft_consensus.cc:2272] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.020059  2082 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.073012  2239 raft_consensus.cc:697] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:11.073331  2324 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.073861  2155 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4.
I20260709 13:13:11.074929   626 raft_consensus.cc:2393] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:11.210048   484 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:13:11.210747   626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1194) took 1949 ms (client timeout 1603 ms). Trace:
W20260709 13:13:11.211266   626 rpcz_store.cc:269] 0709 13:13:09.261161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.296252 (+ 35091us) service_pool.cc:224] Handling call
0709 13:13:10.803833 (+1507581us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b5800167198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:11.210663 (+406830us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9239296}
I20260709 13:13:11.001561  2226 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.072400   448 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:11.220063   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 147731us
I20260709 13:13:11.220753   448 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.220917  2226 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:11.081223  2244 raft_consensus.cc:740] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:10.908479   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:11.082965   447 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.083670   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:11.017863  2293 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.107925  2170 raft_consensus.cc:740] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:11.109777  2264 consensus_queue.cc:1059] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.094475   478 rpcz_store.cc:276] 0709 13:13:08.166051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.557262 (+391211us) service_pool.cc:224] Handling call
0709 13:13:10.542280 (+1985018us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:10.542561 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:10.933335 (+390774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.933508 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4649344}
I20260709 13:13:11.087033   380 catalog_manager.cc:5697] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 2 to 3, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 3 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.147403  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:11.148833  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:11.095067   480 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:13:11.153791   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 138221us
I20260709 13:13:11.155660  2125 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:11.156534  2020 consensus_queue.cc:260] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:11.226478   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 143569us
I20260709 13:13:11.223992   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:11.119603   550 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:11.231225   447 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.163735   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:11.121624  2319 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:11.164232   628 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.121619  2271 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:11.165212   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 137332us
I20260709 13:13:11.240206   597 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:11.166116   556 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:11.167850  1139 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.168815   631 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:11.169260   633 raft_consensus.cc:1240] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:13:11.225538  2323 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:13:11.178897   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1239) took 3108 ms. Trace:
I20260709 13:13:11.179040   625 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:11.125880  1967 consensus_queue.cc:1059] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:13:11.184187  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 1.06861e+06us
I20260709 13:13:11.109989  2143 consensus_queue.cc:260] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.261950  2143 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.158533  2287 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.194922   599 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:13:11.264408   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 69557.5us
I20260709 13:13:11.264254  2287 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.264963  2184 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:11.201751   558 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.266572   558 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.267108   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:11.267797   558 raft_consensus.cc:1275] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:11.267725  2277 consensus_queue.cc:1059] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:11.175957  2088 raft_consensus.cc:740] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:11.183115  2332 log.cc:927] Time spent T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:13:11.212957   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:11.319535   630 raft_consensus.cc:2393] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:11.182725  2151 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:11.195716  2337 consensus_queue.cc:1059] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:13:11.320309  2151 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:11.215518  2318 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.320715  2151 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.320755   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.217502   624 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:11.217324  2339 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.218078  2338 consensus_queue.cc:1048] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:11.159801  2223 consensus_queue.cc:260] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.325121  2223 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.158154  1169 raft_consensus.cc:1240] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: [1.4-3.5]
I20260709 13:13:11.227021   482 raft_consensus.cc:2393] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 4: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:11.229044  1175 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:11.225646   448 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:11.328241   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 102669us
I20260709 13:13:11.229158   523 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:11.330310   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1207) took 1768 ms. Trace:
W20260709 13:13:11.330479   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 101391us
I20260709 13:13:11.127486  2192 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.331660  1862 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:11.331934   523 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:11.334491   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.226222   559 raft_consensus.cc:2393] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:11.335282   482 raft_consensus.cc:1240] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.335696   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.336395   479 raft_consensus.cc:2393] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 4: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:11.336784  2323 consensus_queue.cc:1059] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:10.796942  1944 raft_consensus.cc:3055] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:11.339403  1944 raft_consensus.cc:740] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:11.340270  1944 consensus_queue.cc:260] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.341478  1944 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.229655   380 catalog_manager.cc:5697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 1 to 2, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 2 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.343773   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:11.344025   380 catalog_manager.cc:5697] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 2 to 3, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 3 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.345257   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.345829   479 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:11.345808   380 catalog_manager.cc:5697] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 1 to 2, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 2 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.259611   483 rpcz_store.cc:276] 0709 13:13:08.070449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.518656 (+448207us) service_pool.cc:224] Handling call
0709 13:13:10.498537 (+1979881us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:10.498739 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.131418 (+632679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.178659 (+ 47241us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54000d48d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:11.178821 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1157202560}
I20260709 13:13:11.355688   483 raft_consensus.cc:1240] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:11.268193   484 raft_consensus.cc:2393] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:11.356415   479 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:11.269340   558 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:13:11.357431   558 pending_rounds.cc:85] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 2
I20260709 13:13:11.357758   558 pending_rounds.cc:107] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:13:11.358057   558 raft_consensus.cc:2889] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:11.080413  1975 consensus_queue.cc:260] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.441756   553 raft_consensus.cc:2410] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:11.256815  2256 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.270957  2088 consensus_queue.cc:260] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.273830  2277 raft_consensus.cc:3055] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:11.275640  2170 consensus_queue.cc:260] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.282397   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:11.438145  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:11.227744  2276 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.241971  2214 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:11.285842  2219 raft_consensus.cc:670] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 13:13:11.295842  2302 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:11.297706  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 129940us
I20260709 13:13:11.298390  1967 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.299921  2244 consensus_queue.cc:260] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.302354  2095 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:11.303153  2239 consensus_queue.cc:237] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.169365   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:11.305874   555 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:11.208968  2252 consensus_queue.cc:1059] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:13:11.303952  2255 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:13:11.483421   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.483826  2255 raft_consensus.cc:697] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:11.309398  2334 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:13:11.309310  2231 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:11.309386   476 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.491506 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:11.309706   477 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:11.237895  2010 consensus_queue.cc:1059] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:13:11.256179  2011 consensus_queue.cc:260] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.500105  2011 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.500499  2010 consensus_queue.cc:1243] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:13:11.501551  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:11.502763  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:11.476059  2276 raft_consensus.cc:3055] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:11.503928  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:11.504472  2276 raft_consensus.cc:740] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:11.505337  2276 consensus_queue.cc:260] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.505647  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:11.506510  2276 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.506716  1166 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:11.213629  2082 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.529241  2219 raft_consensus.cc:3055] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:11.529670  2219 raft_consensus.cc:740] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:11.530125  2082 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:11.299942   550 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:11.316687   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.316951   557 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:11.268455  2336 raft_consensus.cc:3055] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:11.532205  2336 raft_consensus.cc:740] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:11.533042  2336 consensus_queue.cc:260] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.534020  2336 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.317716  2160 consensus_queue.cc:1059] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:11.535652   631 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:11.535858   627 raft_consensus.cc:1275] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:11.536528  2160 raft_consensus.cc:3055] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:11.536900  2160 raft_consensus.cc:740] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:11.537930   631 raft_consensus.cc:1275] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:11.537660  2160 consensus_queue.cc:260] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.530514  2219 consensus_queue.cc:260] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:11.318424   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 78331.1us
I20260709 13:13:11.540525  2219 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:11.541131   597 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:11.541553   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.527400  2324 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.542747   597 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.336221   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:11.544521   482 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:13:11.342968  2293 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:11.347529  2318 consensus_queue.cc:1059] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.546569  2318 consensus_queue.cc:1243] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 6ba2a9c02b534120bbf26e56a1e920ca log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:13:11.189349  2243 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.348532   630 raft_consensus.cc:1275] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:13:11.547403   630 pending_rounds.cc:85] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 1
I20260709 13:13:11.547763   630 pending_rounds.cc:107] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:13:11.548027   630 raft_consensus.cc:2889] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:11.350256  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:11.350386  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:11.350756  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:11.352293   625 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:11.350925  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:11.352682   552 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:11.258010   447 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.559952  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:13:11.560449   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 302537us
I20260709 13:13:11.561343   447 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.561416  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:11.320806  2337 raft_consensus.cc:3055] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:13:11.391703   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.330731   624 rpcz_store.cc:276] 0709 13:13:09.562174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.973589 (+411415us) service_pool.cc:224] Handling call
0709 13:13:09.974032 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.322417 (+1348385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.330112 (+  7695us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002e68d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:11.330257 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2858900864}
I20260709 13:13:11.229405  2232 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:11.411485   558 raft_consensus.cc:1240] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:11.385038   580 debug-util.cc:398] Leaking SignalData structure 0x7b080018b780 after lost signal to thread 31817
I20260709 13:13:11.412724   483 raft_consensus.cc:1275] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:11.538932  2160 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.178067   475 rpcz_store.cc:276] 0709 13:13:09.023775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.026121 (+  2346us) service_pool.cc:224] Handling call
0709 13:13:10.787529 (+1761408us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:10.787763 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.036176 (+248413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.036406 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26681728}
I20260709 13:13:11.406301  1175 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:11.421293   484 raft_consensus.cc:1240] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.438122   380 catalog_manager.cc:5697] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 1 to 2, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 2 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.572388   380 catalog_manager.cc:5697] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 1 to 2, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 2 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:11.269479  2331 log.cc:927] Time spent T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:13:11.562896  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:13:11.445472   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.437594  1862 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.464733  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:11.586077  1172 raft_consensus.cc:2393] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 2: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:11.419562  2151 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:11.467409   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.543637  2342 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.601971   597 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.470156   554 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
W20260709 13:13:11.601907   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.472218  1139 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:11.603159   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:11.603652  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 131524us
I20260709 13:13:11.469659  2095 consensus_queue.cc:1243] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:13:11.486037  2230 ts_tablet_manager.cc:1916] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:11.449712  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:11.463299   480 raft_consensus.cc:1240] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:11.491127   478 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.459776  2234 raft_consensus.cc:697] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:11.470132  2170 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.470275  2088 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.463217  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:11.471575  1975 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.240473  2155 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.476382  2287 leader_election.cc:290] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:11.511811  2255 consensus_queue.cc:237] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.448041  2256 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.467635  2302 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.497951  2319 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:11.614184  1967 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:11.520931  2244 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:11.525491   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.586915  2011 consensus_queue.cc:1059] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:13:11.547446   631 raft_consensus.cc:1275] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:11.563212   447 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.566542   559 raft_consensus.cc:1240] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.566875  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:11.574049  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.574079   380 catalog_manager.cc:5697] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 1 to 2, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 2 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:11.636360   580 debug-util.cc:398] Leaking SignalData structure 0x7b08000333a0 after lost signal to thread 415
I20260709 13:13:11.576653  1175 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:11.441115  1174 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:11.649547  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:11.588235   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.650995  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:11.651178   522 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:11.651827  1167 raft_consensus.cc:2393] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 4: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:11.638165  2192 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.437791   551 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:11.652595  2256 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:11.653304  1938 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:11.653827  1938 raft_consensus.cc:697] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:11.654451  2302 leader_election.cc:290] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:11.654656  1938 consensus_queue.cc:237] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.652614   522 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:11.655885  2319 raft_consensus.cc:697] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:11.656773  2317 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.656829  2319 consensus_queue.cc:237] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.607180  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:11.659179   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 96048.6us
I20260709 13:13:11.659518  2232 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:11.659979   447 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.660995   447 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:11.661703  2256 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.662408  2256 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:11.555722  2318 raft_consensus.cc:3055] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:11.663395  2318 raft_consensus.cc:740] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:11.664038   475 raft_consensus.cc:1240] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:11.664207  2318 consensus_queue.cc:260] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.663072   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.665545  2318 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.666847  2317 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:13:11.608072   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.652637  2192 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.609386   523 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:11.669833   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 60513us
I20260709 13:13:11.670281  2192 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:11.670428   523 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:11.600951  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:11.607131  2239 consensus_queue.cc:1059] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:13:11.601016  2252 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:11.566357  2143 consensus_queue.cc:1048] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:13:11.611871  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:11.612098  2151 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:11.673133  2264 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:11.673516  2264 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.578745  2324 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.564414  2337 raft_consensus.cc:740] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:11.615195   597 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.586380  2082 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:11.587500  2227 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:11.636081  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:11.682303   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 352825us
W20260709 13:13:11.684140   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.685503   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:11.686378   448 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.687664   448 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:11.640089   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.614367  2226 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:11.518160  2020 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:11.696873   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 81763.4us
I20260709 13:13:11.697683   597 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.479584  2323 consensus_queue.cc:1059] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:13:11.446384  2277 raft_consensus.cc:740] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:11.657447   553 raft_consensus.cc:1240] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:11.557233  2293 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.565088  2243 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:11.676105   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.673857  2264 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:11.671481  2256 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:11.718734   478 raft_consensus.cc:2393] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:11.716595  2239 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.725149   476 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:11.726552   476 raft_consensus.cc:1240] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:11.702427  2227 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.729213  2227 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:11.702461  2184 consensus_queue.cc:1059] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:13:11.731076  2184 raft_consensus.cc:3055] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:11.731463  2184 raft_consensus.cc:740] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:11.732355  2184 consensus_queue.cc:260] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.733554  2184 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:11.734336  1170 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:11.735777  1166 raft_consensus.cc:1240] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:11.738209   484 raft_consensus.cc:2410] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:11.682587  2125 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:13:11.749989   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.751272   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.752053   476 raft_consensus.cc:2393] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:11.752465  2151 raft_consensus.cc:3055] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:11.752862   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.753597   476 raft_consensus.cc:2393] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:11.754344   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.672362  2317 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:11.755477   476 raft_consensus.cc:2410] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:11.755999   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.756321   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:11.756721   482 raft_consensus.cc:2393] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:11.757117   476 raft_consensus.cc:2393] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:11.757495   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:11.758183   482 raft_consensus.cc:2393] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:11.757946   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:11.758701   476 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:11.639253  2335 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:11.759634   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:11.760370  2335 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:11.760854  2335 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:11.714176  1967 consensus_queue.cc:1059] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:13:11.761428   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.762126  1967 raft_consensus.cc:3055] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:11.713604  2324 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.762521  1967 raft_consensus.cc:740] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:11.763346  2347 consensus_queue.cc:1059] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:11.763424  1967 consensus_queue.cc:260] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.764729  1967 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.765424   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:11.714975   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.767078   480 raft_consensus.cc:2410] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:11.767941   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.768720   480 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:11.703984  2338 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.769476   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:11.769568  2337 consensus_queue.cc:260] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.770665   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.693513   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:11.700049   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:11.704981  1141 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:11.707662   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:11.712365  2271 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:11.672235  2252 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.751510  2234 consensus_queue.cc:237] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.696627  2232 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.774539   632 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:13:11.773550  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 68645.1us
I20260709 13:13:11.779446  1141 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:11.772545   483 raft_consensus.cc:2393] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
W20260709 13:13:11.775328   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 57547.6us
W20260709 13:13:11.780582   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.780928   597 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.776934   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:11.690513   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.784407   597 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.785421   597 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:11.786378   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.786837   597 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:11.787686  1141 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.758922   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.790006   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:11.793011   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.793402   597 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.793735   483 raft_consensus.cc:2393] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 2: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:11.794497   597 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:11.695369  2302 consensus_queue.cc:1048] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
W20260709 13:13:11.802129   368 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 227b93e1b31e4b058d5ec1fc69bd6849 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3d6f5b2f91e54c8c95f7b19c1b9ecee2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:11.806147   632 raft_consensus.cc:1240] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:13:11.775606   580 debug-util.cc:398] Leaking SignalData structure 0x7b080035eb40 after lost signal to thread 508
I20260709 13:13:11.755398  2317 raft_consensus.cc:697] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:11.797799  1141 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.807193   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.813050   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:11.813625   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:11.814254  1172 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:13:11.814383   483 raft_consensus.cc:2393] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:11.807792   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:11.814610  1172 pending_rounds.cc:85] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: Aborting all ops after (but not including) 4
I20260709 13:13:11.809116   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.814913  1172 pending_rounds.cc:107] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:13:11.771214   480 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:13:11.809538   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:11.813869   481 raft_consensus.cc:2410] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:11.722747  2256 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.752874  2151 raft_consensus.cc:740] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:11.815058   478 raft_consensus.cc:2376] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4. Re-sending same reply.
I20260709 13:13:11.696815  2192 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 13:13:11.794636  2293 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:13:11.813746   580 debug-util.cc:398] Leaking SignalData structure 0x7b080035ed60 after lost signal to thread 509
I20260709 13:13:11.778455  2155 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.778294   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:11.817199   625 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:11.817328   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 143696us
I20260709 13:13:11.818360   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:11.818751   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:11.815202  1172 raft_consensus.cc:2889] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:11.820936   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.773517  1967 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.794761  2338 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.802380   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:11.796139  2160 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:11.791522  2170 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:11.824429   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:11.866588   484 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:11.808764  2179 consensus_queue.cc:1059] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:13:11.875152   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:11.876190  2179 raft_consensus.cc:3055] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:11.796198  2143 consensus_queue.cc:1059] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:13:11.828841   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:11.876799  2179 raft_consensus.cc:740] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:11.877419   481 raft_consensus.cc:2393] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:11.833122  2219 consensus_queue.cc:1059] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.878501  2219 raft_consensus.cc:3055] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:11.877960  2179 consensus_queue.cc:260] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.878862  2219 raft_consensus.cc:740] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:11.879933  2287 raft_consensus.cc:3055] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:11.879717  2219 consensus_queue.cc:260] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.880302  2287 raft_consensus.cc:740] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:11.881033  2219 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:11.881162  2287 consensus_queue.cc:260] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.812306  2277 consensus_queue.cc:260] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.883800  2277 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.883575  2317 consensus_queue.cc:237] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.885016   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:11.885293  2143 raft_consensus.cc:3055] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:11.885656  2143 raft_consensus.cc:740] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:11.886091   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:11.886399  2143 consensus_queue.cc:260] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.888605   631 raft_consensus.cc:2410] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:11.889899   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:11.871567  1170 raft_consensus.cc:1240] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.824818  2223 consensus_queue.cc:1048] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:13:11.834052  1168 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:11.795886  2226 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.859589   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:11.834434   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.809556  2231 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:11.894157   628 raft_consensus.cc:1240] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.799499  2010 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:11.895444   632 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:11.896517   632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:11.897202   632 raft_consensus.cc:606] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:11.897583   632 raft_consensus.cc:614] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:13:11.839475   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 151760us
I20260709 13:13:11.900198  2346 raft_consensus.cc:3055] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:11.900601  2346 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:11.901031   448 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:11.816021   525 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:11.901340  2346 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.762519   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.805553  2342 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:11.903076  2192 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.903117   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:11.903797   630 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:11.904171   633 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:13:11.904682   633 pending_rounds.cc:85] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 2
I20260709 13:13:11.904956   633 pending_rounds.cc:107] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:13:11.905234   633 raft_consensus.cc:2889] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:11.906869  2346 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:11.791554  2232 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.855681   553 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:13:11.908282   553 pending_rounds.cc:85] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 1
I20260709 13:13:11.908562   553 pending_rounds.cc:107] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:13:11.908869   553 raft_consensus.cc:2889] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:11.856451   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:11.858273   624 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:13:11.910497   580 debug-util.cc:398] Leaking SignalData structure 0x7b080041b960 after lost signal to thread 583
I20260709 13:13:11.912317  2271 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:11.851137  2252 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:11.912276   448 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:11.913812  2347 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:11.914124  2357 raft_consensus.cc:2804] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:11.914301  2347 raft_consensus.cc:697] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:11.914976  2357 raft_consensus.cc:697] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:11.915357  2347 consensus_queue.cc:237] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.916200   448 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:11.917078  2324 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:11.916412  2357 consensus_queue.cc:237] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.917596  2324 raft_consensus.cc:697] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:11.919013   448 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.921907  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:11.922679  1174 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
W20260709 13:13:11.922966   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 107026us
I20260709 13:13:11.846997  1980 raft_consensus.cc:2804] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:11.860445   478 raft_consensus.cc:1275] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:13:11.923578   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.862195   556 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:13:11.924032   556 pending_rounds.cc:85] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 1
I20260709 13:13:11.923988   525 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:11.924489   556 pending_rounds.cc:107] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:13:11.849735  2359 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:13:11.924820   556 raft_consensus.cc:2889] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:11.863152  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:11.863857   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:11.858976  2293 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
W20260709 13:13:11.868961   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.869835   625 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:11.820456  2243 consensus_queue.cc:1059] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:13:11.951627  2243 raft_consensus.cc:3055] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:11.952010  2243 raft_consensus.cc:740] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:11.952546   597 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:11.952821  2243 consensus_queue.cc:260] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.953758  2342 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:11.954041  2243 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.871023  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:11.955533  1173 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:11.871551  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:11.955744  2342 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:11.872644  1169 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:11.872997  2227 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.957607  2227 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.958164   597 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:11.859947   552 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:11.854424  2339 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.873786   550 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.874071  2338 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.874440  2302 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:11.874581   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:11.805424  2125 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:13:11.876328  2082 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:11.827553  2151 consensus_queue.cc:260] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:11.844354   482 raft_consensus.cc:1275] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:11.914920  2214 consensus_queue.cc:1059] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:11.925192   525 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:11.926091   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:11.926831   633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:11.887142   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:11.854008   483 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:11.981997   633 raft_consensus.cc:606] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:11.982424   633 raft_consensus.cc:614] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:11.983024   483 raft_consensus.cc:1275] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:13:11.983414   483 pending_rounds.cc:85] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 1
I20260709 13:13:11.983961   483 pending_rounds.cc:107] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:13:11.963022  1980 raft_consensus.cc:697] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:11.944566   551 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:11.945353  2276 consensus_queue.cc:1059] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.946130   447 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:11.946368   627 raft_consensus.cc:1240] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.946655  2323 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:11.918493  2324 consensus_queue.cc:237] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:11.948279  2143 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.906697   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:11.963654   597 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:11.963976   630 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
W20260709 13:13:11.968052   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 118257us
I20260709 13:13:11.970108   484 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 13:13:12.022401   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 63172.2us
I20260709 13:13:11.943750  2252 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:11.976819   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:11.963724  1975 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:11.991107  2337 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:11.970490   580 debug-util.cc:398] Leaking SignalData structure 0x7b08003afcc0 after lost signal to thread 657
I20260709 13:13:11.984285   483 raft_consensus.cc:2889] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:11.941111  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 143369us
W20260709 13:13:11.985024   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 59891.8us
I20260709 13:13:11.985958   599 leader_election.cc:304] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:11.972129  2227 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:11.983160   628 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.978003  2339 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.975133  2179 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:11.991503  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.974967   480 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:12.024712  1975 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.973205  2338 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:12.021169   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 95149us
I20260709 13:13:12.022526   484 pending_rounds.cc:85] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 1
I20260709 13:13:12.069649   484 pending_rounds.cc:107] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:13:12.070012   484 raft_consensus.cc:2889] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:12.070329  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.943516  2155 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:12.023648   482 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:11.991616  2151 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.072870   448 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:11.980049   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.026889   597 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:12.037164   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 51301.9us
I20260709 13:13:12.021785  2276 raft_consensus.cc:2804] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:12.042719   525 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:12.044270  1141 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:12.048064   483 raft_consensus.cc:1240] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:12.081998   483 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:12.074458   523 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:12.083457   483 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:12.086664   630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:12.047762   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:12.049739  2170 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:13:12.048547  2249 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:12.051877  2371 raft_consensus.cc:3055] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:12.026170  2226 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:11.988548  1944 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:13:12.074617   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.105525   599 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:13:12.074573   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 47749.9us
W20260709 13:13:12.106595  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.107034   597 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:12.108299   597 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:12.086678   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 44068.3us
I20260709 13:13:12.087663   630 raft_consensus.cc:606] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:12.109949   630 raft_consensus.cc:614] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:12.110147   525 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:11.974905  2302 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:12.088958  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 44751.3us
I20260709 13:13:12.025959  1862 consensus_queue.cc:1048] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:13:12.090560   484 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:12.096140   631 raft_consensus.cc:2410] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:12.034961  2223 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:13:12.094781  2249 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.094792  2371 raft_consensus.cc:740] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:12.089672  2234 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:12.062914  1975 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.035135  2231 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:13:12.100059  2323 raft_consensus.cc:2749] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:13:12.102501   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 74252.8us
I20260709 13:13:12.094570  2362 raft_consensus.cc:2764] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:13:12.121300   550 raft_consensus.cc:1275] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:12.102828  2155 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:12.102617  2125 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:12.094975  2276 raft_consensus.cc:697] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:12.121320  2192 raft_consensus.cc:2764] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:13:12.230000   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.215896   580 debug-util.cc:398] Leaking SignalData structure 0x7b0800395dc0 after lost signal to thread 1199
I20260709 13:13:12.201568  2239 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:12.219609  2361 log.cc:927] Time spent T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 13:13:12.069214  2339 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:12.411626  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.413378  2339 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:12.414922  2365 log.cc:927] Time spent T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 13:13:12.074692  2264 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:12.215009  2336 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.388000  2250 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:12.226305   484 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:12.240664  2010 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:12.297998   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:12.205964  2249 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:12.239852  2164 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.243595   475 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:12.201756  2227 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:12.122434  2020 raft_consensus.cc:2764] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:13:12.240046  1967 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.304309   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:12.205415  2088 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:13:12.200079  2335 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:12.215372  2160 consensus_queue.cc:1048] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
W20260709 13:13:12.353986   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.354892  2318 consensus_queue.cc:1059] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 13:13:12.415858  2364 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 13:13:12.415768  2276 consensus_queue.cc:237] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:12.396598  2371 consensus_queue.cc:260] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:12.411679  2369 log.cc:927] Time spent T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 13:13:12.358891  2155 raft_consensus.cc:697] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:13:12.200811  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 89341us
I20260709 13:13:12.364050   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:12.204970  1980 consensus_queue.cc:237] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:12.396842   580 debug-util.cc:398] Leaking SignalData structure 0x7b0800339a40 after lost signal to thread 1200
W20260709 13:13:12.507658   580 debug-util.cc:398] Leaking SignalData structure 0x7b08000f2140 after lost signal to thread 2083
W20260709 13:13:12.508072   580 debug-util.cc:398] Leaking SignalData structure 0x7b08001db980 after lost signal to thread 2114
W20260709 13:13:12.508335   580 debug-util.cc:398] Leaking SignalData structure 0x7b08001ae900 after lost signal to thread 2136
W20260709 13:13:12.508620   580 debug-util.cc:398] Leaking SignalData structure 0x7b08000a6980 after lost signal to thread 2145
W20260709 13:13:12.509038   580 debug-util.cc:398] Leaking SignalData structure 0x7b08003eb920 after lost signal to thread 2201
W20260709 13:13:12.509343   580 debug-util.cc:398] Leaking SignalData structure 0x7b08003daba0 after lost signal to thread 2220
W20260709 13:13:12.509857   580 debug-util.cc:398] Leaking SignalData structure 0x7b08003a1280 after lost signal to thread 2254
I20260709 13:13:12.472795  1967 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:12.513689  1967 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:12.518850   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.355443  2366 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 13:13:12.293320   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.421056  2256 consensus_meta.cc:287] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.577s	user 0.008s	sys 0.003s
I20260709 13:13:12.414961  2302 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:12.458206   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 512090us
I20260709 13:13:12.364993  2362 consensus_queue.cc:1059] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:13:12.457017  2227 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:12.481053   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 370940us
I20260709 13:13:12.546056  2227 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:12.546463   525 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:12.546744  2373 log.cc:927] Time spent T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:13:12.487262   483 raft_consensus.cc:1240] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:12.446938  2336 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:12.547962  2256 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:12.491190   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 388853us
I20260709 13:13:12.498572  2155 consensus_queue.cc:237] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:12.496760   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 423923us
I20260709 13:13:12.530753  1174 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:12.456432  2164 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:12.539165   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.545535   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.487812  2277 consensus_meta.cc:287] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.596s	user 0.014s	sys 0.001s
I20260709 13:13:12.468768  1975 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:12.576223   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 354417us
I20260709 13:13:12.490876  2338 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:12.552062   525 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:12.569576  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:12.537468  2243 consensus_meta.cc:287] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.583s	user 0.006s	sys 0.003s
I20260709 13:13:12.583770   525 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:12.584985   525 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:12.570588   448 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:12.576177  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.528367  2371 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.587556   481 raft_consensus.cc:1240] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:12.587841   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.588335   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.592754   525 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:12.574563  2346 consensus_meta.cc:287] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.000s
I20260709 13:13:12.614351   525 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:12.551970  2382 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.596324   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:12.582820  1172 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:12.630638   525 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:12.630998   447 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:12.612314  2223 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.625746  2302 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:12.636207   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.625735   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:12.642541   629 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
W20260709 13:13:12.636106   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 65591.1us
I20260709 13:13:12.637687   447 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:13:12.644831   448 leader_election.cc:336] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Timed out: RequestConsensusVote RPC to 127.31.17.132:39939 timed out after 1.506s (SENT)
I20260709 13:13:12.595435  2250 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:12.594633  2339 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.647670   554 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:13:12.650528   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:12.576936  2160 consensus_queue.cc:1059] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:13:12.647270   525 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:12.624979  2243 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.651278   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:12.660720   558 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:12.612501  2336 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:12.640614  2192 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.618430  1944 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:12.660049   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.667420   556 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:12.665381   525 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:12.594216  2358 consensus_queue.cc:1059] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:13:12.636569  2125 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:12.670331   525 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:12.667901   482 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.002s	sys 0.053s
I20260709 13:13:12.614840  2234 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:13:12.635370  2388 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:13:12.676790   482 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.003s	sys 0.053s
I20260709 13:13:12.657254  1862 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:12.652179  2346 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:12.657225   628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:12.636652  2223 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:12.667922  2366 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:12.654472  2379 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:12.662891  2374 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:12.658504  2339 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:12.682436   477 raft_consensus.cc:2410] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:13:12.694761   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 48794.8us
I20260709 13:13:12.676597  2277 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:12.678093  2317 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:12.701159   525 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:12.647289  2382 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:12.744082   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:12.674968  2192 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:12.692222  2125 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:12.693879  2381 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.699815   628 raft_consensus.cc:606] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Received request to transfer leadership to TS 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:12.787449   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1277) took 1034 ms. Trace:
I20260709 13:13:12.787978   482 rpcz_store.cc:276] 0709 13:13:11.753294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.072794 (+319500us) service_pool.cc:224] Handling call
0709 13:13:12.073096 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:12.088992 (+ 15896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:12.089034 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:12.100890 (+ 11856us) log.cc:844] Serialized 26 byte log entry
0709 13:13:12.678991 (+578101us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:12.679085 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.679342 (+   257us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:12.787190 (+107848us) raft_consensus.cc:1685] finished
0709 13:13:12.787222 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.787389 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26462,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":577522,"threads_started":1,"wal-append.queue_time_us":684652}
I20260709 13:13:12.769250   448 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:12.794615   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:12.795029  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 493025us
W20260709 13:13:12.797195  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.797957  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.800529  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:12.700722  2379 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:12.803128  2381 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:12.806841  2379 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:12.807487  2387 log.cc:927] Time spent T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
W20260709 13:13:12.808815  2390 log.cc:927] Time spent T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:13:12.741662  2020 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.691833  2346 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:12.805284   523 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:12.805351   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:12.761608  2239 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.831660   482 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 1.
I20260709 13:13:12.831722  2239 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:12.791993  2389 log.cc:927] Time spent T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:13:12.833103   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:12.834329  2239 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:12.834515   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:12.836369   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 135396us
W20260709 13:13:12.829195   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 60061.7us
I20260709 13:13:12.838148   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:12.836958  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:12.838517   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:12.839103  1174 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:12.843714   482 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:12.844746   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:12.845367   482 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:12.832226   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:12.848045   479 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:12.849690   479 raft_consensus.cc:1275] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:12.852170  1174 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:12.852814   482 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:12.855813  2232 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:12.853170  2082 raft_consensus.cc:3055] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:12.860299   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:12.872073   556 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:13:12.861542   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 56351.8us
I20260709 13:13:12.772046  2277 raft_consensus.cc:697] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:12.803277  2230 ts_tablet_manager.cc:1929] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:12.862732   525 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:12.866199   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 69882us
I20260709 13:13:12.804880  2366 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.877027  2366 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:12.878360   558 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:12.803736  2335 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:12.870458   448 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:12.872074   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 127706us
I20260709 13:13:12.880347   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:12.881163  2319 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.880672   448 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:12.888557  2318 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:12.892457  2366 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:12.892692  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:12.893229  2366 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:12.893357  1174 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:12.893956  2366 consensus_queue.cc:1048] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:13:12.894722   523 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:12.889725   448 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:12.900161  2318 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:12.908612   554 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:12.912020   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:12.916095   554 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:12.919585  2319 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:12.923338   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:12.862690  2384 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.994565  2384 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:12.997095  2323 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.997241  2384 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:12.862353  2214 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:12.871356  2386 log.cc:927] Time spent T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:13:12.997879  2323 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:12.862879  1944 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:12.999387  1944 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.999871  1944 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.000880  2323 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:12.861182  2020 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:12.927006  2405 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:13:12.937963  2398 log.cc:927] Time spent T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:13:12.937884   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 148) took 1152 ms. Trace:
I20260709 13:13:12.938939  2411 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:13.005795  2020 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:12.939733  2380 log.cc:927] Time spent T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:13:13.002398   448 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:12.940573  2392 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:13:13.008500  2405 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:13.008971  2405 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.008890   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:13.009528  2405 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.010270   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:12.924824  2249 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:13.011811   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.013357  2249 leader_election.cc:290] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:12.943436  1975 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:12.871841  2082 raft_consensus.cc:740] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:12.874428  2164 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:13.015296   630 raft_consensus.cc:2393] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:12.944551  2379 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.015834  2082 consensus_queue.cc:260] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.017805  2379 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:12.945633  2277 consensus_queue.cc:237] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:12.930197  2372 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:12.930531  2353 log.cc:927] Time spent T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:13:12.930371  2230 log.cc:1199] T 9ade492740624caba667436aa666025c P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-1-root/wals/9ade492740624caba667436aa666025c
I20260709 13:13:13.023451  2230 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:59108 (request call id 74) took 4841 ms. Trace:
I20260709 13:13:13.023931  2230 rpcz_store.cc:276] 0709 13:13:08.226337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.265172 (+ 38835us) service_pool.cc:224] Handling call
0709 13:13:08.676152 (+410980us) ts_tablet_manager.cc:1151] Deleting tablet 9ade492740624caba667436aa666025c
0709 13:13:10.308231 (+1632079us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:13:11.942351 (+1634120us) tablet_metadata.cc:665] Metadata flushed
0709 13:13:12.771774 (+829423us) tablet_metadata.cc:665] Metadata flushed
0709 13:13:13.023350 (+251576us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":164873,"tablet-delete.queue_time_us":231869,"thread_start_us":83357,"threads_started":1}
I20260709 13:13:12.947666  2170 raft_consensus.cc:3055] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:13.025853  2170 raft_consensus.cc:740] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
W20260709 13:13:12.949487  2337 consensus_meta.cc:287] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.904s	user 0.011s	sys 0.000s
I20260709 13:13:13.026713  2379 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:12.950596  2223 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:12.951099   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1259) took 1255 ms. Trace:
I20260709 13:13:13.027721   625 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:13.027935   477 rpcz_store.cc:276] 0709 13:13:11.697078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.711289 (+ 14211us) service_pool.cc:224] Handling call
0709 13:13:11.906552 (+195263us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:12.950881 (+1044329us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54001419d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:12.951040 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1423098112}
I20260709 13:13:12.952883  2184 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.029659  2184 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.032480  2184 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:12.955466   556 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:12.961885  2346 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:12.963613  2192 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:12.966578   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.969337  2264 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:12.970865  2302 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:13.034723  2323 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:13.035444  2302 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:12.971994  2339 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:12.973104  2256 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:12.975099  1862 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:13.037446  1862 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.037961   559 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:13.038259  1862 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.979321  2287 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.979909  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:12.980248   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1386) took 1160 ms. Trace:
I20260709 13:13:13.003677  1169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 290) took 1025 ms. Trace:
I20260709 13:13:13.039942   631 rpcz_store.cc:276] 0709 13:13:11.819611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.889674 (+ 70063us) service_pool.cc:224] Handling call
0709 13:13:12.979984 (+1090310us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54002e68d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:12.980177 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472135040}
I20260709 13:13:13.039912  1174 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:13.041343   631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:13.042150   631 raft_consensus.cc:606] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:13.042543   631 raft_consensus.cc:614] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:12.984875  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:13.027060  2170 consensus_queue.cc:260] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.044114  1168 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.988303   553 raft_consensus.cc:1240] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:13.040365  1169 rpcz_store.cc:276] 0709 13:13:11.978895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.985964 (+  7069us) service_pool.cc:224] Handling call
0709 13:13:12.034663 (+ 48699us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:12.089494 (+ 54831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:12.093289 (+  3795us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:12.265446 (+172157us) log.cc:844] Serialized 26 byte log entry
0709 13:13:12.575200 (+309754us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:12.575273 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.575356 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:13.003369 (+428013us) raft_consensus.cc:1685] finished
0709 13:13:13.003406 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.003609 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12449,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":5502,"thread_start_us":195781,"threads_started":1,"wal-append.queue_time_us":449898}
I20260709 13:13:13.011000   633 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 2.
I20260709 13:13:13.004540   627 rpcz_store.cc:276] 0709 13:13:11.785040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.791218 (+  6178us) service_pool.cc:224] Handling call
0709 13:13:11.946184 (+154966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.016911 (+ 70727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.937674 (+920763us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400010c50. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:12.937823 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286375168}
I20260709 13:13:13.063331  2346 consensus_queue.cc:1059] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.064126  2346 consensus_queue.cc:1243] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Peer 6ba2a9c02b534120bbf26e56a1e920ca log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:13:13.062924  2170 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:12.988318   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 66978.5us
I20260709 13:13:13.068694   599 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:13.072983  1174 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:13.074867   523 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:13.078200   482 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:13.078634  1174 raft_consensus.cc:3055] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:13.079020  1174 raft_consensus.cc:740] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
W20260709 13:13:12.990666   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 353030us
I20260709 13:13:12.991140  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:13.080730  1171 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:13.039314   366 catalog_manager.cc:5028] TS 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): tablet 9ade492740624caba667436aa666025c (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:13:13.082952   556 raft_consensus.cc:1275] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:13:13.082862   366 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 43722.7us
I20260709 13:13:13.085336  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:13.085681   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:13.086058  1175 raft_consensus.cc:2376] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3. Re-sending same reply.
W20260709 13:13:13.086738   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.085350   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:13.088415   553 raft_consensus.cc:2410] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:13.090286  1175 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:12.928279  2271 consensus_queue.cc:1048] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
W20260709 13:13:13.096575   368 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 227b93e1b31e4b058d5ec1fc69bd6849 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3d6f5b2f91e54c8c95f7b19c1b9ecee2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:13.097170   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:13.088153   628 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:13.146450   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 78016.8us
I20260709 13:13:13.195003   599 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:13.166363  2384 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.101925  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:13.196738  2384 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.197275  1170 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:13.198726  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:13.199746  1170 raft_consensus.cc:2393] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:13.102246   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:13.169097 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:13.202895   555 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:13.102173  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:13.147905  2214 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:13:13.131317  2249 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.169726  1138 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:13.092550  2372 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:13:13.100812  2179 consensus_meta.cc:287] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 1.032s	user 0.009s	sys 0.003s
I20260709 13:13:13.096086  1141 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:13.124231   597 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:13.168598  2151 consensus_meta.cc:287] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.080s	user 0.010s	sys 0.003s
I20260709 13:13:13.213732  2164 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:13.081065  2264 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.081566  2317 raft_consensus.cc:697] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:13.219952   599 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:13.232613  1967 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:13.221698  2382 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:13.223891   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.190265  2223 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.166034  2319 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:13.225211  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 129236us
I20260709 13:13:13.130734  1975 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.161506  2342 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:13.123174  2256 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.230674  2088 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:13.230773   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 106627us
W20260709 13:13:13.246974   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.221292   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:13.252871  1171 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:13.228499  2164 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:13.231156  2227 consensus_meta.cc:287] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.684s	user 0.011s	sys 0.000s
I20260709 13:13:13.148077  2339 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:13:13.270718  2405 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.232856  2020 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:13.268291  2243 consensus_meta.cc:287] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.000s
I20260709 13:13:13.273201  2384 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:13.340004   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:13.340694   476 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:13.341337   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:13.341897   482 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.295673  2223 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.345057  2223 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:13.345638  1168 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:13.346391  2302 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.225781  2372 raft_consensus.cc:697] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:13.348348  2372 consensus_queue.cc:237] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.350771  1862 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.320626  2227 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:13.277279   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 395190us
W20260709 13:13:13.353350   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.353525  2227 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:13.353634  1862 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:13.267108  2151 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:13.354357  2151 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.321542  2412 consensus_queue.cc:1059] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:13:13.354816  2151 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.355399  2412 raft_consensus.cc:3055] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:13.355789  2412 raft_consensus.cc:740] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:13.355921   558 raft_consensus.cc:1240] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:13.357261   558 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 13:13:13.357581   558 pending_rounds.cc:85] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 3
I20260709 13:13:13.273681  2410 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:13.249482  2264 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.365159   553 raft_consensus.cc:1240] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:13.368353  2401 raft_consensus.cc:3055] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:13.362818  2243 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:13.369143  2271 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.373597  2243 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.316809  2164 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.280205  1967 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.311911  2256 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:13.298439  2357 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.201s	user 0.006s	sys 0.012s
W20260709 13:13:13.290968  1167 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.192s	user 0.023s	sys 0.059s
I20260709 13:13:13.308604   597 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:13.374328  2432 log.cc:927] Time spent T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:13:13.378842   550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.027s	sys 0.012s
I20260709 13:13:13.130864  2323 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:13:13.324530   447 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:13.402400   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 78001.2us
W20260709 13:13:13.332909  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.335664   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:13.307226  2342 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.307798  2088 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.351333  2338 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:13:13.273313  2409 consensus_queue.cc:1048] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:13:13.217926  2249 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.410342  2244 consensus_queue.cc:1059] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:13:13.409020  2374 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:13.410521  2088 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.413748  2249 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:13.357882   558 pending_rounds.cc:107] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.4
I20260709 13:13:13.414419   558 raft_consensus.cc:2917] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Aborting config change with OpId 1.4: Aborted: Op aborted by new leader
I20260709 13:13:13.359491   632 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:13.360091   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:13.421666   556 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
W20260709 13:13:13.360579  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.360837  2192 consensus_queue.cc:1059] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.361752   482 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:13.300550  2319 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:13.278563  1166 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.021s	sys 0.007s
I20260709 13:13:13.305853  2362 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:13:13.378671  2243 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.356760  2412 consensus_queue.cc:260] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.385635   555 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:13.380313  2020 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.297894  2382 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:13.321341  2335 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 13:13:13.398406   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 89922.7us
W20260709 13:13:13.404663   550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.029s	sys 0.013s
I20260709 13:13:13.376461  2337 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.440961  2374 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:13.382947  1173 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.014s	sys 0.010s
I20260709 13:13:13.293648  2214 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.400120  2287 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:13.406401   484 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:13.408046   599 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:13.306600  2317 consensus_queue.cc:237] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.379148   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:13.399648  1167 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.301s	user 0.023s	sys 0.059s
W20260709 13:13:13.397667  2357 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.301s	user 0.007s	sys 0.012s
I20260709 13:13:13.396133  1967 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:13.411579  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:13.419406   558 raft_consensus.cc:2889] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:13.373962  2271 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.368884  2401 raft_consensus.cc:740] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:13.420073  2160 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.433209   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:13.305380  1975 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.410663  2342 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.440274   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:13.428252  1166 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.021s	sys 0.008s
I20260709 13:13:13.443296  1139 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:13.489461  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 46301.6us
I20260709 13:13:13.447183  2382 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.275985  1944 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.449617  2302 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:13.461916  1173 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.015s	sys 0.010s
W20260709 13:13:13.467253   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 59297.7us
I20260709 13:13:13.513813   599 leader_election.cc:304] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:13.464175  2287 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.515259  2287 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.520848   447 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:13.521911  2323 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:13.522303  2227 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:13.522934  2227 raft_consensus.cc:697] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:13.524101  2227 consensus_queue.cc:237] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.468171  2249 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:13.469324   525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.003s	sys 0.025s
I20260709 13:13:13.527489  2249 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:13.527695   525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.003s	sys 0.025s
I20260709 13:13:13.528041  2249 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:13.528139   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 648485us
W20260709 13:13:13.470443   479 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.008s	sys 0.016s
W20260709 13:13:13.530969   479 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.008s	sys 0.016s
I20260709 13:13:13.374574  2410 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.533778  2410 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:13.469412  2214 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.450489  2337 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.487907   482 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:13.489663   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:13.445998   597 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:13.500051   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:13.543313   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 97401.2us
I20260709 13:13:13.543331   484 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.549595   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:13.550307   553 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.553495   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:13.554277   633 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:13.500084   477 raft_consensus.cc:1240] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:13.500651  2170 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:13.479031  2151 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:13.540287  2359 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.005s	sys 0.024s
I20260709 13:13:13.468847  2374 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.571578   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:13.543432  1170 raft_consensus.cc:1275] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:13.557596  2143 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:13.585479   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1247) took 1013 ms. Trace:
I20260709 13:13:13.585422   556 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:13.488917  2160 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.556669  2223 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:13.602432   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:13.575313  2359 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.006s	sys 0.024s
W20260709 13:13:13.584473  2415 log.cc:927] Time spent T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:13:13.604939   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:13.603606   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59108 (request call id 73) took 20410 ms. Trace:
I20260709 13:13:13.570788  2170 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.612679   482 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:13.613873   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:13.614784   482 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:13.583262  2264 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:13.621837   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:13.606209  1980 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.017s	sys 0.024s
I20260709 13:13:13.570708  2192 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:13:13.600080   629 rpcz_store.cc:276] 0709 13:13:12.572488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.764117 (+191629us) service_pool.cc:224] Handling call
0709 13:13:12.764392 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.764529 (+   137us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:13.084181 (+319652us) log.cc:844] Serialized 14 byte log entry
0709 13:13:13.585160 (+500979us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:13.585212 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:13.585251 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.585310 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.585429 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22453,"prepare.queue_time_us":160637,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"thread_start_us":757597,"threads_started":2}
I20260709 13:13:13.610698   558 rpcz_store.cc:276] 0709 13:12:53.165069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.165233 (+   164us) service_pool.cc:224] Handling call
0709 13:12:53.202053 (+ 36820us) log.cc:844] Serialized 501 byte log entry
0709 13:13:13.559313 (+20357260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10957,"raft.run_cpu_time_us":1530,"raft.run_wall_time_us":10646,"thread_start_us":2618212,"threads_started":1,"wal-append.queue_time_us":407722,"wal-append.run_cpu_time_us":1824,"wal-append.run_wall_time_us":1001831}
I20260709 13:13:13.570938  2302 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:13:13.607594  2256 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:13.560312  2423 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:13:13.606599  2223 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.642035   484 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:13.612274  2170 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:13.642892   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:13.600390  2409 consensus_queue.cc:1048] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:13:13.612804   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:13.618185  2359 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.646265   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:13.631970  1980 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.017s	sys 0.025s
I20260709 13:13:13.646642   558 pending_rounds.cc:107] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:13:13.639998   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:13.648484   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:13.602929  2143 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.653211   558 raft_consensus.cc:2889] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:13.649683   482 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:13.644325  2223 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.691879   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:13.703094   484 raft_consensus.cc:1240] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:13.695879   554 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.018s	sys 0.025s
I20260709 13:13:13.643428  2243 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:13.636555  2319 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:13.706120   556 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:13.642258  2396 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:13.709609  2088 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.703161  2244 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:13:13.711140  2425 log.cc:927] Time spent T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:13:13.711539   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1390) took 1122 ms. Trace:
I20260709 13:13:13.698129  2420 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:13.714071   554 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.018s	sys 0.026s
I20260709 13:13:13.727442   482 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:13.728124   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1248) took 1150 ms. Trace:
I20260709 13:13:13.673699  2214 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:13.752367   631 rpcz_store.cc:276] 0709 13:13:12.589360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.048137 (+458777us) service_pool.cc:224] Handling call
0709 13:13:13.048430 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:13.130826 (+ 82396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:13.130857 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:13.131396 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:13:13.501086 (+369690us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:13.501145 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.501238 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:13.711318 (+210080us) raft_consensus.cc:1685] finished
0709 13:13:13.711340 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.711476 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115217,"raft.queue_time_us":97190,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"spinlock_wait_cycles":683264,"thread_start_us":353191,"threads_started":1,"wal-append.queue_time_us":500219}
I20260709 13:13:13.658299  2359 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.769344   629 raft_consensus.cc:2393] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:13.761029   553 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:13.757922   626 rpcz_store.cc:276] 0709 13:13:12.577796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.835325 (+257529us) service_pool.cc:224] Handling call
0709 13:13:12.835648 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:12.836002 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:12.836032 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:12.836524 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:13:13.301623 (+465099us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:13.301651 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.301757 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:13.727848 (+426091us) raft_consensus.cc:1685] finished
0709 13:13:13.727877 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.728044 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14759,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"thread_start_us":464734,"threads_started":1,"wal-append.queue_time_us":467649}
I20260709 13:13:13.622543  2401 consensus_queue.cc:260] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.773459   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:13.763695   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:13.725425   551 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:13.752231  2319 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:13.752791  2271 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:13.783082   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:13.771894  1944 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:13.784405   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:13.764503  1975 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:13.783990  2426 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:13:13.763392  2362 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.807546  2362 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.809695  2362 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:13.809306  2223 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.774399  2366 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:13.810669  2366 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.812852   626 raft_consensus.cc:2368] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4.
W20260709 13:13:13.813349  2422 log.cc:927] Time spent T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:13:13.813558  2359 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:13.800294   631 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:13.763628  2244 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.790427  2418 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.814967  2418 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.815951  2244 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:13.817144   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:13.797065  2437 log.cc:927] Time spent T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:13:13.817739   631 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:13.784719  2382 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:13.804148   525 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:13.766921  2420 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.790439  2401 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.820771   624 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:13.794747  2226 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:13.839993  2428 log.cc:927] Time spent T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 13:13:13.844148   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 274706us
I20260709 13:13:13.810911  2287 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.789471  2164 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:13.863664   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 59643.1us
I20260709 13:13:13.865609   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1245) took 1512 ms. Trace:
I20260709 13:13:13.867410   525 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:13.867195   624 rpcz_store.cc:276] 0709 13:13:12.353381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.353521 (+   140us) service_pool.cc:224] Handling call
0709 13:13:13.820319 (+1466798us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b5800167198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:13.820507 (+   188us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:13.865248 (+ 44741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.865538 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2329344}
I20260709 13:13:13.868978   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:13.869684   624 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:13.870668   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:13.819279  2160 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:13.873406   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1380) took 1352 ms. Trace:
I20260709 13:13:13.874032   550 rpcz_store.cc:276] 0709 13:13:12.520639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.528056 (+  7417us) service_pool.cc:224] Handling call
0709 13:13:12.593999 (+ 65943us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:12.948787 (+354788us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b1800415120. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6532c3f3 00007f4b6532e7c1 00007f4b6532e779 00007f4b6532e709 00007f4b6532e6d1 00007f4b6532d9cd 000000000038f354 000000000038f199 00007f4b6530f83a
0709 13:13:13.450439 (+501652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:13.450474 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:13.475669 (+ 25195us) log.cc:844] Serialized 26 byte log entry
0709 13:13:13.773291 (+297622us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:13.773331 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.773414 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:13.837826 (+ 64412us) raft_consensus.cc:1685] finished
0709 13:13:13.837859 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.873311 (+ 35452us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5515,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":6408576,"thread_start_us":1081765,"threads_started":2,"wal-append.queue_time_us":340150}
I20260709 13:13:13.795198  2319 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.878012   597 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:13.844226  2421 log.cc:927] Time spent T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.243s	user 0.001s	sys 0.001s
I20260709 13:13:13.876991   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 201) took 1322 ms. Trace:
I20260709 13:13:13.820830  2418 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:13.862272  1975 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.843501  2151 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:13.882710   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:13.817484  2381 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:13.842597  1166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 448) took 1326 ms. Trace:
I20260709 13:13:13.836055  2374 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:13.880455   624 raft_consensus.cc:1240] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:13.877985  2406 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:13:13.902024  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.896309   631 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 2.
I20260709 13:13:13.895813  1174 consensus_queue.cc:260] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.903537   624 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:13.904039   483 raft_consensus.cc:1240] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:13.891944  2223 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:13.905920  1174 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.878213  2226 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.895351  2382 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:13.901818  2434 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:13:13.898728   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1253) took 1206 ms. Trace:
I20260709 13:13:13.918588   597 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:13.897032  2450 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:13.909104  1168 raft_consensus.cc:2393] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:13.904017  1980 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.904963  2381 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:13.931699   597 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:13.895478  1975 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:13.923543  2431 log.cc:927] Time spent T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:13:13.905426  2449 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.905774  2160 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.933019   597 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:13.903844  2249 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.941023  2160 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.943656  2160 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:13.935107  2227 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:13.946604   482 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:13.948303  2226 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:13.948711   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:13.948869   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:13.949929   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:13.948590  2338 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:13.952658  1174 raft_consensus.cc:1240] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:13:13.950588   554 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:13.962304   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:13.927140  2184 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:13.962903   553 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.920262  2382 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.923607  2223 consensus_queue.cc:1059] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 13:13:13.940064  2442 log.cc:927] Time spent T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:13:13.928037  2450 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.972782  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:13.974416  1172 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.973502   553 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
W20260709 13:13:13.975656  2433 log.cc:927] Time spent T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.172s	user 0.001s	sys 0.001s
I20260709 13:13:13.939807   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 203) took 1382 ms. Trace:
I20260709 13:13:13.959411  2381 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:13.989411   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:13.990126   626 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:13.991036   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:13.965140  2338 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.934276  2170 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.966884   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:14.004258   626 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:13.936450  1980 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.970785  2184 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:13.975782  2455 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:14.006475  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.977779  2450 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.959190  2449 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:13.988461  2381 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.992678  2420 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:14.010609   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1382) took 1098 ms. Trace:
W20260709 13:13:14.044994  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.993522  2287 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:13.994596  2338 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.983644  2453 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.082203   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:14.009250  2164 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.086563   479 rpcz_store.cc:276] 0709 13:13:12.911885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.915527 (+  3642us) service_pool.cc:224] Handling call
0709 13:13:12.916122 (+   595us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:12.917061 (+   939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:12.917146 (+    85us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:12.918472 (+  1326us) log.cc:844] Serialized 26 byte log entry
0709 13:13:13.531452 (+612980us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:13.531519 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.531612 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:14.010299 (+478687us) raft_consensus.cc:1685] finished
0709 13:13:14.010330 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:14.010530 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":164,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":612081,"threads_started":1,"wal-append.queue_time_us":713626}
I20260709 13:13:14.013706   551 raft_consensus.cc:1240] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:14.083173  2447 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.008299  2227 raft_consensus.cc:697] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:14.085688  2381 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:14.092849   550 raft_consensus.cc:2393] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:14.112464   478 pending_rounds.cc:85] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 5
I20260709 13:13:14.113725   478 pending_rounds.cc:107] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:13:14.085248  2319 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.115856   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:14.116864   552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1381) took 1595 ms (client timeout 2056 ms). Trace:
W20260709 13:13:14.117297   552 rpcz_store.cc:269] 0709 13:13:12.521032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.549447 (+ 28415us) service_pool.cc:224] Handling call
0709 13:13:14.115658 (+1566211us) spinlock_profiling.cc:243] Waited 6.94 ms on lock 0x7b5800116198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:14.116792 (+  1134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15971072}
I20260709 13:13:14.119223  2227 consensus_queue.cc:237] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.121440   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 200) took 1570 ms. Trace:
I20260709 13:13:14.121933   483 rpcz_store.cc:276] 0709 13:13:12.550772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.551137 (+   365us) service_pool.cc:224] Handling call
0709 13:13:12.551431 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:13.904693 (+1353262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.121202 (+216509us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54000d5cd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:14.121382 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3110268160}
I20260709 13:13:14.124969   478 raft_consensus.cc:2889] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:13.920812   627 rpcz_store.cc:276] 0709 13:13:12.691271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.064238 (+372967us) service_pool.cc:224] Handling call
0709 13:13:13.084015 (+ 19777us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:13.164957 (+ 80942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:13.167483 (+  2526us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:13.223550 (+ 56067us) log.cc:844] Serialized 26 byte log entry
0709 13:13:13.608515 (+384965us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:13.613212 (+  4697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.620278 (+  7066us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:13.889044 (+268766us) raft_consensus.cc:1685] finished
0709 13:13:13.889065 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.897541 (+  8476us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72269,"raft.queue_time_us":43572,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3026,"thread_start_us":359899,"threads_started":1,"wal-append.queue_time_us":557792}
I20260709 13:13:13.884423   480 rpcz_store.cc:276] 0709 13:13:12.555065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.576889 (+ 21824us) service_pool.cc:224] Handling call
0709 13:13:12.943475 (+366586us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:12.943677 (+   202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:12.944040 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:12.944099 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:12.944587 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:13:13.288206 (+343619us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:13.320190 (+ 31984us) log.cc:844] Serialized 14 byte log entry
0709 13:13:13.367070 (+ 46880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.374691 (+  7621us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:13.820319 (+445628us) raft_consensus.cc:1685] finished
0709 13:13:13.842058 (+ 21739us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.864558 (+ 22500us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19153,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":25012,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":181,"spinlock_wait_cycles":14942592,"thread_start_us":333645,"threads_started":1,"wal-append.queue_time_us":507959}
I20260709 13:13:14.132578  2449 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.112785  2453 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.142210  2453 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:14.143872  2382 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:14.145243  1980 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:14.147890  2082 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.898741  1166 rpcz_store.cc:276] 0709 13:13:12.516379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.516529 (+   150us) service_pool.cc:224] Handling call
0709 13:13:12.516891 (+   362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:12.569293 (+ 52402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:12.573735 (+  4442us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:12.677884 (+104149us) log.cc:844] Serialized 52 byte log entry
0709 13:13:13.539843 (+861959us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:13.551799 (+ 11956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.559775 (+  7976us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:13.818232 (+258457us) raft_consensus.cc:1685] finished
0709 13:13:13.820386 (+  2154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.841438 (+ 21052us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17630,"raft.queue_time_us":34140,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6560,"thread_start_us":808916,"threads_started":1,"wal-append.queue_time_us":860284}
I20260709 13:13:14.137218  2461 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.172955  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:14.173367   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:14.173698  1166 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.174077   559 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:14.177814   597 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:14.178957   597 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:14.179805   597 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:14.183653  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:14.184584  1174 raft_consensus.cc:2410] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:14.114024  2447 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.185302   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:14.090907  2455 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.190302   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:14.185992   550 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:14.191694   557 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.171165  2362 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.170233  1975 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:14.186801  2249 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:13.979671   475 rpcz_store.cc:276] 0709 13:13:12.555861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.569670 (+ 13809us) service_pool.cc:224] Handling call
0709 13:13:12.653171 (+ 83501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:12.680404 (+ 27233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:12.682600 (+  2196us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:12.793420 (+110820us) log.cc:844] Serialized 26 byte log entry
0709 13:13:13.332223 (+538803us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:13.379329 (+ 47106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.395548 (+ 16219us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:13.929504 (+533956us) raft_consensus.cc:1685] finished
0709 13:13:13.929526 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.938176 (+  8650us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":7149,"thread_start_us":392065,"threads_started":1,"wal-append.queue_time_us":647878}
I20260709 13:13:14.169826  2461 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.195474   552 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:13:14.214080  2342 consensus_meta.cc:287] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.714s	user 0.009s	sys 0.001s
I20260709 13:13:14.196594   551 raft_consensus.cc:1240] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:14.217470   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:14.222985   484 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:13:14.223419   484 pending_rounds.cc:85] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 1
I20260709 13:13:14.223654   484 pending_rounds.cc:107] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:13:14.223716   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1368) took 2407 ms. Trace:
I20260709 13:13:14.223909   484 raft_consensus.cc:2889] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:14.214574  2342 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.224169   478 rpcz_store.cc:276] 0709 13:13:11.816213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.124102 (+307889us) service_pool.cc:224] Handling call
0709 13:13:14.112053 (+1987951us) spinlock_profiling.cc:243] Waited 78.1 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:14.112251 (+   198us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:14.127005 (+ 14754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:14.127034 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:14.137523 (+ 10489us) log.cc:844] Serialized 52 byte log entry
0709 13:13:14.195755 (+ 58232us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:14.195795 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.195872 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:14.223357 (+ 27485us) raft_consensus.cc:1685] finished
0709 13:13:14.223380 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:14.223643 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1255,"raft.queue_time_us":1360,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":4318,"spinlock_wait_cycles":179650432,"thread_start_us":57907,"threads_started":1,"wal-append.queue_time_us":81228}
I20260709 13:13:14.202881  2362 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.229123  2362 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.230046  2455 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:14.231886  2342 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:14.232410  1967 consensus_meta.cc:287] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.748s	user 0.011s	sys 0.000s
I20260709 13:13:14.232493  2342 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:14.232947  2342 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.232892  1967 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.233402  2342 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.204676  2336 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:14.203202  2170 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:14.208019  2227 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:14.235960   597 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:14.234982  2336 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.237001   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:14.202785  2465 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:14.234529  2450 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:14.285604   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 49710.3us
I20260709 13:13:14.286154  2464 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:14.290326  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:14.308633  1174 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:14.307004  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.215548  2381 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.323840  2447 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:14.324481  2447 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.325006  2339 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:14.325270  2461 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:14.325477  2381 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:14.230551  1975 consensus_queue.cc:1059] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:13:14.243619  2336 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:14.334389  2466 log.cc:927] Time spent T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:13:14.344805   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:14.307910  2464 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.325678  2339 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.352519   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:14.352707  1172 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:14.352932  1174 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:14.353737  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:14.354058  1174 raft_consensus.cc:1240] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:13:14.354578   597 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:14.358103   597 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:14.349812  2464 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:14.364208   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:14.364936  2020 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:14.370337  2143 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.375885  2404 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:14.388008  2020 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:14.391376  2449 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.391558  2020 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.391880  2449 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.391399  2404 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.393796  2449 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:14.394451   551 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:14.395829   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1254) took 1041 ms. Trace:
I20260709 13:13:14.396190   629 rpcz_store.cc:276] 0709 13:13:13.354551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.634795 (+280244us) service_pool.cc:224] Handling call
0709 13:13:14.395657 (+760862us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54002bd9d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:14.395777 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266132736}
I20260709 13:13:14.397393   597 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:14.363453  2447 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:14.351548   550 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:14.383095   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:14.414969   553 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:14.389477   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:14.348591  1967 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.393818  2020 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:14.381022  1975 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:14.413446   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:14.416994   597 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:14.357677  2461 consensus_queue.cc:1059] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:13:14.426860  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:14.431463   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:14.412545  2381 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:14.430721  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:14.452611  1174 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:14.388939  2469 consensus_queue.cc:1059] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:13:14.414412  2319 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.414004  2404 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.423040  2447 raft_consensus.cc:697] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:14.448262  2346 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:14.447804  2450 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.496763   557 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:14.451031  2020 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:14.454041  1975 raft_consensus.cc:697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:14.454751  2381 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.500269  2082 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.486402  2143 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.500917  1171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 338) took 1407 ms. Trace:
I20260709 13:13:14.498517   597 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:14.509944  1171 rpcz_store.cc:276] 0709 13:13:13.095719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.205865 (+110146us) service_pool.cc:224] Handling call
0709 13:13:13.224308 (+ 18443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:13.308077 (+ 83769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.500693 (+1192616us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b540048d5d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:14.500865 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5766016}
I20260709 13:13:14.447043  2336 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.511478  2143 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.512305  2470 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:13:14.512936  2397 log.cc:927] Time spent T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 1.706s	user 0.015s	sys 0.010s
I20260709 13:13:14.512733  2082 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.453824  2227 raft_consensus.cc:697] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:14.521435  2470 raft_consensus.cc:697] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:14.503463  2374 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.511147  2381 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:14.502893  2020 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.499199  2346 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.460368  2319 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:14.539718  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.540162  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.545949   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:14.533838  2020 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.537472  2476 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.549929  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:14.533895  2339 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:14.530561  2463 raft_consensus.cc:3055] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:14.515528  1975 consensus_queue.cc:237] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.550547  1171 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:14.532907  2374 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.537308  2227 consensus_queue.cc:237] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.552927  2463 raft_consensus.cc:740] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:14.554831  2476 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.578945  2463 consensus_queue.cc:260] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.579983  2476 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.580206  2463 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:14.581898  2475 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.582386  2475 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.583181  2336 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:14.586217  2401 consensus_meta.cc:287] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.722s	user 0.010s	sys 0.001s
I20260709 13:13:14.586957  1172 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:14.588227  2319 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.588348  2338 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.588836  2319 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:14.588975  2125 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:14.589416  2319 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.589529  2125 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.531601  2447 consensus_queue.cc:237] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.548660  2170 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:13:14.566509  2339 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:14.601370   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:14.602150  2319 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.602236  2125 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.602777  2319 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.592998  2476 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.603155   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:14.603281  2319 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.603641  2476 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.603899   480 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:14.616951  2338 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:14.624775  2476 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.630530  2319 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.631453  2088 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:14.636215   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 1.12123e+06us
I20260709 13:13:14.596989  2082 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.576046  2470 consensus_queue.cc:237] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.657169   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:14.657722   483 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:14.599190  2339 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.662550   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:14.664242   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:14.665143   626 raft_consensus.cc:2410] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:14.666512   599 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:14.669471   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:14.671032   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:14.659581  2082 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.655226   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:14.677989   625 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1242) took 2374 ms (client timeout 1949 ms). Trace:
W20260709 13:13:14.678407   625 rpcz_store.cc:269] 0709 13:13:12.297601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.297732 (+   131us) service_pool.cc:224] Handling call
0709 13:13:14.672208 (+2374476us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b54001ae5d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:14.672325 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335146880}
I20260709 13:13:14.656390  2336 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.676210   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:14.680639   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:14.681854   479 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:14.654078   550 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:14.670509  2234 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.670907  2319 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:14.672330  2473 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.672497  2143 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:14.679896   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:14.688925  2234 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.699193   627 raft_consensus.cc:2410] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:14.679854  2082 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.680009  2088 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:14.700093  2088 raft_consensus.cc:697] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:14.700307  2464 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.700888  2082 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.692350  2125 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.685511  2239 consensus_queue.cc:1059] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:13:14.701924  2125 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.702373   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:14.702939  2464 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:14.695706  1141 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:14.703976  2125 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.704241  1141 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:14.694532  2450 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:14.705020  2450 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.654184  2381 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.706377  2404 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:14.706794  2404 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.715111   479 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:14.680099  2346 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.700949  2088 consensus_queue.cc:237] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.707121  2404 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.707497  2143 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:14.707059  2450 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:14.730346  2143 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:14.730953  2416 log.cc:927] Time spent T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 1.097s	user 0.000s	sys 0.003s
I20260709 13:13:14.717063  2473 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.730907  2143 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.729475  1138 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:14.732193  1167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 291) took 2640 ms. Trace:
I20260709 13:13:14.732121  2170 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:14.733191  2401 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:14.733747  2401 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.734100  2401 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.732688  1167 rpcz_store.cc:276] 0709 13:13:12.091879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.094388 (+  2509us) service_pool.cc:224] Handling call
0709 13:13:12.097223 (+  2835us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:12.097700 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:12.097734 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:12.098222 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:13:12.848327 (+750105us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b6530f0ac 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b
0709 13:13:13.476244 (+627917us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:13.476288 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.476366 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:14.730383 (+1254017us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:14.731941 (+  1558us) raft_consensus.cc:1685] finished
0709 13:13:14.731965 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:14.732115 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":327,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":20630656,"thread_start_us":1373628,"threads_started":1,"wal-append.queue_time_us":1463797}
I20260709 13:13:14.710121  2381 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:14.741776  2374 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.747893  2475 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.686431  2336 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:14.728093   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 60437.6us
I20260709 13:13:14.710598   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:14.749471   448 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:14.749979   475 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:14.711383  2319 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.752533   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1434) took 1532 ms. Trace:
I20260709 13:13:14.752908   555 rpcz_store.cc:276] 0709 13:13:13.219719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.219844 (+   125us) service_pool.cc:224] Handling call
0709 13:13:14.752391 (+1532547us) spinlock_profiling.cc:243] Waited 77.8 ms on lock 0x7b5400048dd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:14.752481 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178896768}
I20260709 13:13:14.769210  1141 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:14.775614  1967 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:14.776095  1967 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.776430  1967 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:14.771523  1141 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:14.777757  2454 log.cc:927] Time spent T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.826s	user 0.005s	sys 0.002s
W20260709 13:13:14.778728   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 101992us
I20260709 13:13:14.803751   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1386) took 1464 ms. Trace:
I20260709 13:13:14.806344  2462 raft_consensus.cc:3055] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:14.806814  2462 raft_consensus.cc:740] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:14.819943   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 70533us
I20260709 13:13:14.828745   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:14.829540   479 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:14.830762   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:14.831326   479 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.838825   479 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:14.809589   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1392) took 1260 ms. Trace:
I20260709 13:13:14.841524   448 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:14.847550   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:14.874774   478 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.849746   448 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:14.848163   558 rpcz_store.cc:276] 0709 13:13:13.548853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.712792 (+163939us) service_pool.cc:224] Handling call
0709 13:13:13.713178 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:13.752714 (+ 39536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:13.752760 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:13.753321 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:13:13.880166 (+126845us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:13.880204 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.880270 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:14.777231 (+896961us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:14.806750 (+ 29519us) raft_consensus.cc:1685] finished
0709 13:13:14.806774 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:14.809520 (+  2746us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43682,"raft.queue_time_us":42206,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":5275,"spinlock_wait_cycles":104335616,"thread_start_us":126499,"threads_started":1,"wal-append.queue_time_us":184151}
W20260709 13:13:14.849646   630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1238) took 2605 ms (client timeout 3094 ms). Trace:
W20260709 13:13:14.847201  2277 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.826s	user 0.020s	sys 0.017s
W20260709 13:13:14.893332   630 rpcz_store.cc:269] 0709 13:13:12.293811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.304083 (+ 10272us) service_pool.cc:224] Handling call
0709 13:13:14.849447 (+2545364us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b54002bbbd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:14.849578 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1258992512}
I20260709 13:13:14.899482   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:14.900125   479 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.839792  2249 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:14.842489  2480 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:14.874315  2475 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:14.873695  2388 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:14.846046   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:14.914489  2480 raft_consensus.cc:697] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:13:14.909185  1166 consensus_meta.cc:287] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.010s
I20260709 13:13:14.914865  2234 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:14.897826  2277 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.877s	user 0.025s	sys 0.020s
I20260709 13:13:14.849525  2462 consensus_queue.cc:260] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.873744  2447 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:14.916159  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.942067  1138 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:14.943710  1138 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:14.921231   479 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:14.922008   483 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:14.904708  2346 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:13:14.927038  2480 consensus_queue.cc:237] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.920573  2170 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:14.951004  2170 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.953115  2170 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.954813  2170 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:14.898018  2481 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:14.955449  2481 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.955817  2481 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:14.956274  2342 consensus_meta.cc:287] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.722s	user 0.011s	sys 0.006s
I20260709 13:13:14.956665  2342 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.956890  2143 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.958650  2342 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:14.959218  2447 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.960115  2408 raft_consensus.cc:2749] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:14.961881  2447 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:14.962001  1170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 339) took 1660 ms. Trace:
I20260709 13:13:14.949271  2462 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.964083  2337 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:14.962467  1170 rpcz_store.cc:276] 0709 13:13:13.301317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.307862 (+  6545us) service_pool.cc:224] Handling call
0709 13:13:13.339389 (+ 31527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:13.599791 (+260402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.961751 (+1361960us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54005d02d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:14.961939 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322003200}
I20260709 13:13:14.964277  2020 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.965029 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:14.933522   478 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:14.966095   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:14.966246  2020 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:14.966682   478 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:14.947010  2319 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:14.910030  2473 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:14.939226   481 raft_consensus.cc:1240] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:14.947538  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:14.968925  1175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 337) took 1875 ms (client timeout 2065 ms). Trace:
I20260709 13:13:14.968991  2412 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:14.969327  1175 rpcz_store.cc:269] 0709 13:13:13.093088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.101212 (+  8124us) service_pool.cc:224] Handling call
0709 13:13:14.947383 (+1846171us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:14.968872 (+ 21489us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9800576}
I20260709 13:13:14.970075   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 206) took 1893 ms. Trace:
I20260709 13:13:14.970427   481 rpcz_store.cc:276] 0709 13:13:13.077178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.077912 (+   734us) service_pool.cc:224] Handling call
0709 13:13:13.078134 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:14.968665 (+1890531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.969864 (+  1199us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b5400370ad4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:14.970026 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4279654784}
I20260709 13:13:14.948134   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:14.968307   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:14.971494   479 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:14.971920   483 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:14.972402   632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1244) took 2671 ms. Trace:
I20260709 13:13:14.972755   632 rpcz_store.cc:276] 0709 13:13:12.301143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.301243 (+   100us) service_pool.cc:224] Handling call
0709 13:13:12.301583 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:13.421433 (+1119850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.972177 (+1550744us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400161cd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:14.972349 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2428586880}
I20260709 13:13:14.973417  2465 raft_consensus.cc:3055] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:14.973806  2465 raft_consensus.cc:740] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:14.947749  2366 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:14.976238  1938 raft_consensus.cc:3055] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:14.976647  1938 raft_consensus.cc:740] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:14.977466  1938 consensus_queue.cc:260] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.978546  1938 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.927379  2491 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:14.974574  2465 consensus_queue.cc:260] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:14.846400  2374 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:13:14.958976  2143 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:14.985380   479 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:14.981010   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:14.996863   481 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:14.931972  1166 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
W20260709 13:13:14.992393  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 48771.8us
W20260709 13:13:14.993721  2223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.022s	sys 0.045s
I20260709 13:13:14.964648  2481 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:14.975270   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 205) took 1898 ms. Trace:
I20260709 13:13:14.998581   475 raft_consensus.cc:2410] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:14.910784  2249 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:15.005121   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:14.994792  2421 log.cc:927] Time spent T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:13:15.022969  2456 log.cc:927] Time spent T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 1.053s	user 0.006s	sys 0.003s
I20260709 13:13:15.024554   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.025457   482 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:15.026563   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.027330   482 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:15.028280   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.028921   482 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:15.029968   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:14.955654  2336 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:14.979833  2339 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:14.979893  2491 raft_consensus.cc:697] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:15.002803   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:15.006704   483 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:15.036739   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.007838   478 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:15.011879   632 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:15.038036   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.038798   479 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.012537   481 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:15.017680   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1258) took 1656 ms. Trace:
W20260709 13:13:15.003137  2223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.023s	sys 0.046s
I20260709 13:13:15.043371   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:14.999938  2465 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.044013   483 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.019196   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:15.021426  2489 log.cc:927] Time spent T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:13:15.021319  2249 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:15.053428   483 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:15.031607   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:14.804340   476 rpcz_store.cc:276] 0709 13:13:13.339794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.341355 (+  1561us) service_pool.cc:224] Handling call
0709 13:13:13.341666 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:13.559618 (+217952us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:13.612634 (+ 53016us) log.cc:844] Serialized 14 byte log entry
0709 13:13:14.629135 (+1016501us) spinlock_profiling.cc:243] Waited 8.6 ms on lock 0x7b180037a5c0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb923a 00007f4b68423a2a
0709 13:13:14.717944 (+ 88809us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:14.722637 (+  4693us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:14.724706 (+  2069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.803432 (+ 78726us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540020e4d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:14.803498 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:14.803675 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31560,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":4814,"raft.queue_time_us":19921,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":3105,"spinlock_wait_cycles":474568704,"thread_start_us":60815,"threads_started":1,"wal-append.queue_time_us":1132566}
I20260709 13:13:15.055787   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.057018   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.057641   476 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:15.058465   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.034096  2317 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.059073   476 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:15.059541  2317 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:15.061635  2317 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:15.061939   482 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:15.002306   477 rpcz_store.cc:276] 0709 13:13:13.076794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.094668 (+ 17874us) service_pool.cc:224] Handling call
0709 13:13:13.168177 (+ 73509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:13.571163 (+402986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.975016 (+1403853us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b540022d154. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:14.975195 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725814528}
I20260709 13:13:15.064636  2481 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:15.065392  2491 consensus_queue.cc:237] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:15.069747  2287 raft_consensus.cc:3055] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:15.070268  2287 raft_consensus.cc:740] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:15.072152  2401 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:15.074620  2401 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:15.076087  1967 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:15.077808  1168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36724 (request call id 297) took 1673 ms. Trace:
I20260709 13:13:15.078238  1967 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:15.042586   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:15.039913   631 rpcz_store.cc:276] 0709 13:13:13.361317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.923066 (+561749us) service_pool.cc:224] Handling call
0709 13:13:13.932492 (+  9426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:13.932823 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:14.081546 (+148723us) log.cc:844] Serialized 14 byte log entry
0709 13:13:15.016976 (+935430us) spinlock_profiling.cc:243] Waited 962 us on lock 0x7b18003aa7a0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b67fc14bc 00007f4b6530f48b 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb923a
0709 13:13:15.017232 (+   256us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:15.017301 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:15.017358 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.017447 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:15.017597 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24188,"prepare.queue_time_us":202077,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":1162,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":14334,"spinlock_wait_cycles":2212608,"thread_start_us":220415,"threads_started":2,"wal-append.queue_time_us":110199}
I20260709 13:13:15.048003   599 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:15.051605   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:14.932775  2388 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:15.081792   481 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:15.078208  1168 rpcz_store.cc:276] 0709 13:13:13.404146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.408877 (+  4731us) service_pool.cc:224] Handling call
0709 13:13:15.077605 (+1668728us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b540048d354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:15.077746 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937491200}
I20260709 13:13:15.089907  2388 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:15.091624  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 320164us
I20260709 13:13:15.086386   479 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
W20260709 13:13:15.097348  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.097138   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:15.097756  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.101874  2404 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:15.103820  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:15.105013   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 57077.7us
I20260709 13:13:15.105194  2381 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:15.105789  2381 raft_consensus.cc:697] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:15.105831  2388 consensus_queue.cc:1059] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.106940   481 raft_consensus.cc:2410] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:15.107618  2151 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.110116   599 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:15.112895  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:15.113579  1172 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.116475   599 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:15.117977   599 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:15.120963  2082 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:15.121495  1166 raft_consensus.cc:1240] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:15.121685  2462 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:15.122166  2462 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.122519  2462 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.123350  2480 consensus_queue.cc:1059] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:15.124011   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:15.124199  2480 raft_consensus.cc:3055] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:15.124559  2480 raft_consensus.cc:740] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:15.109705  2481 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:13:15.125365  2480 consensus_queue.cc:260] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:15.126500  2480 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.127548  2338 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:15.127975  2338 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:15.128336  2338 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.131724  1168 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:15.121516  2082 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:15.106956  2388 raft_consensus.cc:3055] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:15.132712  2388 raft_consensus.cc:740] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:15.133584  2388 consensus_queue.cc:260] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:15.134740  2388 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.138491  2480 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:15.106829  2381 consensus_queue.cc:237] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:15.139883   599 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:15.142159  2317 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:15.142351  2082 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:15.099347  2287 consensus_queue.cc:260] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:15.148162   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:15.148983   479 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.093431  1967 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.148686  2231 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:15.153226   599 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:13:15.153441  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.120276   447 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:15.150611  2231 raft_consensus.cc:697] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:15.161542  1172 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:15.115839  2374 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.155771   599 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:15.116262  2404 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:15.145321  2396 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:15.162978   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:15.170089   481 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.159535   447 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:15.149932  2470 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:15.171810   447 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:15.181093   447 leader_election.cc:400] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4.
I20260709 13:13:15.181458   447 leader_election.cc:403] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:15.182389   448 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:15.189762   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.173069   479 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:15.190814   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:15.176339  2462 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:15.177084  2287 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.177415  2396 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.193425   599 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:15.161832  2151 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:15.164695  2082 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:15.195941   478 raft_consensus.cc:2393] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:15.191183  1141 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:15.200799   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.201678   482 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:15.196386   481 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:15.179924  2223 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:15.206512   481 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:15.183248  2470 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:15.183009  2319 raft_consensus.cc:2749] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:15.209887   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.199162   599 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:15.212822   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.228042   479 raft_consensus.cc:2393] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:15.229025   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.230324   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:15.204063  1141 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:15.186568  2346 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:15.157367  1967 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:15.184540  2481 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:15.195698  2277 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4.
I20260709 13:13:15.200521  2082 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:15.236325   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.203070  2465 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:15.168888  2374 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:15.237566   599 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:15.226121  2404 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.227666  2470 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.220944  2151 raft_consensus.cc:697] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:15.226367   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.221665  2500 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:15.237995  2481 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.236707  2223 raft_consensus.cc:697] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:15.244488  2255 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:15.262053   477 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:15.247277  2231 consensus_queue.cc:237] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:15.264257  2184 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:15.252365   599 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:15.248329  2412 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:15.248914  2082 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:15.273499   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.251047  2249 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:15.249701  2478 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:15.280009   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1295) took 1713 ms. Trace:
I20260709 13:13:15.286991   484 rpcz_store.cc:276] 0709 13:13:13.566548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.714124 (+147576us) service_pool.cc:224] Handling call
0709 13:13:13.714470 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:14.224420 (+509950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.279783 (+1055363us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b5400370fd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:15.279954 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1168660352}
I20260709 13:13:15.288343   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.254046  2465 raft_consensus.cc:697] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:15.266495  2481 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:15.279683  2451 log.cc:927] Time spent T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 1.304s	user 0.005s	sys 0.000s
I20260709 13:13:15.269555  2255 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.289455   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.293180   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:15.298089   522 connection.cc:256] RPC call timeout handler was delayed by -1.2957179380000525s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
I20260709 13:13:15.298328   630 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:15.296208   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:15.298960   629 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.299196   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.299883   630 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:15.294152   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.294992   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:15.301240   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.301334   632 raft_consensus.cc:2410] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:15.302644   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:15.295354   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.277362  2500 raft_consensus.cc:697] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:15.315147   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.315027  2500 consensus_queue.cc:237] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:15.316057   477 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:15.317298   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:15.318933  2502 log.cc:927] Time spent T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:13:15.319195   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.320900   480 raft_consensus.cc:1240] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:13:15.305648   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:15.322996   555 raft_consensus.cc:2410] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:15.323606   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.306913   554 raft_consensus.cc:1240] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:15.324865   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.325278   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.325564   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.288074  1975 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:15.314010  2462 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:15.320713   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.325824   625 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:15.308955  2374 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:15.305078   484 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:15.333424   632 raft_consensus.cc:2393] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 4: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:15.286345  2249 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.254810  2404 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:15.156937  2448 consensus_queue.cc:1175] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6e6df7e8ed204f1db5c371536b5b0683" responder_term: 5 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: [4.6-4.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:15.304101   558 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:15.329869   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.331713   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.288389  2412 raft_consensus.cc:697] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:15.347918  2412 consensus_queue.cc:237] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:15.348730  2508 log.cc:927] Time spent T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:13:15.326363   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.333945  1975 raft_consensus.cc:697] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:15.334517  2223 consensus_queue.cc:237] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:15.339654   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:15.340427   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.341383   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.366485   484 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:15.321907   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:15.345877   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:15.302572  2255 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.390069   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:15.350033   630 raft_consensus.cc:2393] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:15.351470   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:15.390702   478 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.351542   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.350389   525 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:15.393244   525 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:15.363178   625 raft_consensus.cc:2393] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:15.395974   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.370733   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:15.397205   554 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:15.379097  2381 consensus_queue.cc:1059] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:15.400079   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.400414   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:15.401007   630 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.390885   558 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:15.392720   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.333094  2371 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:15.412369   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:15.336012  2249 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.394793   525 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:15.423354   525 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:15.292410  2478 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:15.427130   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:15.431087   558 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.429422   630 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:15.429282   478 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:15.429853   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:15.438544   599 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:15.441109   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:15.441783   554 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:15.413818  1938 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:15.412041  2346 raft_consensus.cc:697] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:15.448522   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:15.420878  2317 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:15.448414   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:15.451701   558 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:15.459415   447 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:15.330435  2151 consensus_queue.cc:237] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:15.431937  2366 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:15.391767  2338 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:15.441810  1862 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:15.442724  2339 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.480320   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.482800   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:15.459860   550 raft_consensus.cc:2393] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:15.550599   631 raft_consensus.cc:2393] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 4: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:15.414175  2388 consensus_queue.cc:1059] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:13:15.547703   559 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.454200  2461 raft_consensus.cc:3055] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:15.458318  1938 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:15.421329  2411 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:13:15.463861  2317 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.556005   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:15.561568   626 raft_consensus.cc:1240] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:15.561811   558 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.565704  1138 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:15.556321   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.554581   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:15.431293  2371 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:15.472187  2020 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:13:15.560704   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 101333us
I20260709 13:13:15.546797  1862 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.481420  2366 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:15.547655  1967 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:15.646610   522 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:15.573791   558 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:15.430387  2465 consensus_queue.cc:237] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:15.580956   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.559275  1938 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.486323   552 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
W20260709 13:13:15.585222  2510 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:13:15.589500   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:15.733094   554 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.578415   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.583624  2500 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:15.575604  2317 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.576498  2381 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:15.556736  2461 raft_consensus.cc:740] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:15.735173   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:15.594218   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:15.743594   557 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:15.596585  2366 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.592571  1862 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.551823  2339 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:15.770761   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 307028us
W20260709 13:13:15.773850  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.595337  2020 raft_consensus.cc:697] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:15.746515  2501 log.cc:927] Time spent T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.414s	user 0.002s	sys 0.000s
I20260709 13:13:15.550590  1975 consensus_queue.cc:237] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:15.744302   631 raft_consensus.cc:2393] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 4: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:15.741246  2335 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:15.740679  2500 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:15.779887  2475 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:15.836988   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.851806   631 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:15.852936   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.853663   631 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
W20260709 13:13:15.854290   629 consensus_meta.cc:287] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.555s	user 0.006s	sys 0.001s
I20260709 13:13:15.854562   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.854776   629 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:15.860203   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.861634   629 raft_consensus.cc:2410] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:15.863482  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:15.873623   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.874154  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:15.875056   629 raft_consensus.cc:2410] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:13:15.905812  2515 log.cc:927] Time spent T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260709 13:13:15.910622  2457 log.cc:927] Time spent T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
W20260709 13:13:15.912259   366 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4e472c1c82c9467a9a5563d6b06e3b53 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6ba2a9c02b534120bbf26e56a1e920ca is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:15.919855  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:15.921273  2469 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:15.921491  1166 raft_consensus.cc:1240] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:15.921669  2125 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:15.921783  2469 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:15.922701  2125 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.924181  2469 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:15.776741  2346 consensus_queue.cc:237] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:15.927536  1173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 447) took 3411 ms. Trace:
I20260709 13:13:15.876008   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.931697   629 raft_consensus.cc:2410] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:15.851112  2500 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.798629  2381 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:15.871277  2503 log.cc:927] Time spent T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.474s	user 0.001s	sys 0.000s
I20260709 13:13:15.930351  1173 rpcz_store.cc:276] 0709 13:13:12.516104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.517905 (+  1801us) service_pool.cc:224] Handling call
0709 13:13:12.545841 (+ 27936us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:13.542049 (+996208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:13.542088 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:13.559897 (+ 17809us) log.cc:844] Serialized 26 byte log entry
0709 13:13:13.915986 (+356089us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:13.925915 (+  9929us) log.cc:844] Serialized 14 byte log entry
0709 13:13:13.926224 (+   309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.926305 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:14.153998 (+227693us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b180032a3a0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6532c3f3 00007f4b6532e7c1 00007f4b6532e779 00007f4b6532e709 00007f4b6532e6d1 00007f4b6532d9cd 000000000038f354 000000000038f199 00007f4b6530f83a
0709 13:13:15.563595 (+1409597us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b180032a3a0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6532c3f3 00007f4b6532e7c1 00007f4b6532e779 00007f4b6532e709 00007f4b6532e6d1 00007f4b6532d9cd 000000000038f354 000000000038f199 00007f4b6530f83a
0709 13:13:15.927283 (+363688us) raft_consensus.cc:1685] finished
0709 13:13:15.927310 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:15.927470 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32385,"prepare.queue_time_us":9657,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":215848,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":23708,"spinlock_wait_cycles":33380992,"thread_start_us":1242526,"threads_started":2,"wal-append.queue_time_us":354504}
I20260709 13:13:15.960465   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:15.965663   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.981220  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:15.982192  1173 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:15.944380  2525 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.858814  2335 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:15.986608   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:15.935708  2125 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.011339  2388 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:13:16.018960  2481 consensus_meta.cc:287] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.718s	user 0.008s	sys 0.000s
I20260709 13:13:16.019611  2338 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:16.021811  2317 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:15.967710  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:16.023774   631 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:16.024804  2335 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:16.069656  2381 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:16.026263  2396 consensus_meta.cc:287] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.805s	user 0.003s	sys 0.008s
I20260709 13:13:16.071264  2396 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.073285  2396 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:15.967180  2020 consensus_queue.cc:237] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:16.028062  2255 consensus_meta.cc:287] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.000s
I20260709 13:13:16.076272  2255 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.077147  2366 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.078336  2255 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:15.997205  2512 log.cc:927] Time spent T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
I20260709 13:13:16.030781  2500 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:16.062040  2082 consensus_meta.cc:287] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.770s	user 0.014s	sys 0.005s
I20260709 13:13:16.080063  2125 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:15.926285  2461 consensus_queue.cc:260] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:16.061749  2388 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.081189  2461 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:15.996930  2525 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.082593  2388 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:16.061514  2404 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:16.083456  1169 raft_consensus.cc:1240] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:16.067587  2287 consensus_meta.cc:287] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.870s	user 0.007s	sys 0.004s
I20260709 13:13:16.084605  1170 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:16.080561  2500 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:16.088013  1938 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.080271  2082 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.090811  2339 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:16.062741  2481 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:16.116756  2470 consensus_meta.cc:287] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.850s	user 0.011s	sys 0.000s
I20260709 13:13:16.117368  2470 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.105700  2525 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:16.125954  2481 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:16.159289   522 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.022s	sys 0.007s
W20260709 13:13:16.207078   522 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.023s	sys 0.007s
I20260709 13:13:16.207851  1938 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:16.160429   448 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.17.130:41159 timed out after 1.611s (SENT) [suppressed 35 similar messages]
I20260709 13:13:16.209314  1938 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:13:16.209335   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 562766us
I20260709 13:13:16.213810  2317 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:16.213948   522 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:16.214730  2082 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:16.168642   479 raft_consensus.cc:2393] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:16.031458   554 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:16.172220   481 raft_consensus.cc:2393] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:16.178602   523 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:16.182282   478 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:16.210311  1938 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:16.192286   624 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:13:16.064994   628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 167) took 1235 ms. Trace:
I20260709 13:13:16.194420   633 raft_consensus.cc:2368] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4.
W20260709 13:13:16.200268  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:16.161387   525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.013s	sys 0.027s
W20260709 13:13:16.191542   596 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.005s	sys 0.018s
W20260709 13:13:16.259122   525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.014s	sys 0.027s
I20260709 13:13:16.235396   624 pending_rounds.cc:85] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 5
W20260709 13:13:16.271137   596 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.006s	sys 0.018s
I20260709 13:13:16.267663   624 pending_rounds.cc:107] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:13:16.275374   624 raft_consensus.cc:2889] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:16.282196   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 107105us
W20260709 13:13:16.288940   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 128773us
W20260709 13:13:16.297467   559 consensus_meta.cc:287] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.745s	user 0.008s	sys 0.010s
I20260709 13:13:16.298048   559 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
W20260709 13:13:16.298616  2249 consensus_meta.cc:287] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.853s	user 0.011s	sys 0.004s
I20260709 13:13:16.299320  2544 raft_consensus.cc:2764] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:13:16.299934  2540 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.301009  2540 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.302351  1967 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.303323  1967 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:16.308881  2538 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:16.309784  2538 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.293208   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:16.316274   478 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:16.317554   447 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:16.317952   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:16.318490   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:16.319379  2523 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:16.320015  2523 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.320485  2523 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.320976  1938 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:16.293123  2531 raft_consensus.cc:2764] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:13:16.287189  2366 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:16.294340   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 78091.1us
I20260709 13:13:16.325161  1138 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:16.328488  2540 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:16.314599  2534 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:13:16.333799   523 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:16.335037  2475 raft_consensus.cc:697] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:16.335556  2366 consensus_queue.cc:1059] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:16.336382   552 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:16.287065   628 rpcz_store.cc:276] 0709 13:13:14.829744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.840013 (+ 10269us) service_pool.cc:224] Handling call
0709 13:13:14.897851 (+ 57838us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:15.004211 (+106360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:15.011853 (+  7642us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:15.055418 (+ 43565us) log.cc:844] Serialized 26 byte log entry
0709 13:13:15.236966 (+181548us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:15.244585 (+  7619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.048935 (+804350us) spinlock_profiling.cc:243] Waited 75.1 ms on lock 0x7b54002e63d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:16.049000 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:16.049084 (+    84us) raft_consensus.cc:1685] finished
0709 13:13:16.049097 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:16.061217 (+ 12120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":28506,"spinlock_wait_cycles":172648192,"thread_start_us":170643,"threads_started":1,"wal-append.queue_time_us":221224}
W20260709 13:13:16.299015   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.338104   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1271) took 1043 ms. Trace:
W20260709 13:13:16.338589   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.340121   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:16.340938   558 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:16.344959   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1424) took 1047 ms. Trace:
I20260709 13:13:16.345605   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:16.346665   554 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:16.345494   480 rpcz_store.cc:276] 0709 13:13:15.297185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.548112 (+250927us) service_pool.cc:224] Handling call
0709 13:13:15.562458 (+ 14346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:15.582272 (+ 19814us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:15.701689 (+119417us) log.cc:844] Serialized 14 byte log entry
0709 13:13:16.169731 (+468042us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:16.171171 (+  1440us) log.cc:844] Serialized 26 byte log entry
0709 13:13:16.177992 (+  6821us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:16.178045 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.178193 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:16.344487 (+166294us) raft_consensus.cc:1685] finished
0709 13:13:16.344524 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:16.344753 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19391,"prepare.queue_time_us":316540,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":9946,"raft.queue_time_us":303592,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":30760,"thread_start_us":437969,"threads_started":1,"wal-append.queue_time_us":369605}
I20260709 13:13:16.348035  2538 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:16.349390   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:16.349700   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.329521   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1308) took 1134 ms. Trace:
I20260709 13:13:16.351538   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:16.351428   483 rpcz_store.cc:276] 0709 13:13:15.194778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.194922 (+   144us) service_pool.cc:224] Handling call
0709 13:13:15.204440 (+  9518us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:15.221260 (+ 16820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:15.221291 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:15.229278 (+  7987us) log.cc:844] Serialized 52 byte log entry
0709 13:13:15.414885 (+185607us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:15.454175 (+ 39290us) log.cc:844] Serialized 14 byte log entry
0709 13:13:16.328523 (+874348us) spinlock_profiling.cc:243] Waited 7.41 ms on lock 0x7b1800173200. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b67fc14bc 00007f4b6530f48b 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b65329455 00007f4b68411060 00007f4b68423716 00007f4b68434287
0709 13:13:16.328817 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.328909 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:16.329002 (+    93us) raft_consensus.cc:1685] finished
0709 13:13:16.329088 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:16.329330 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43075,"prepare.queue_time_us":38319,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":159282,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":39860,"spinlock_wait_cycles":17032960,"thread_start_us":469147,"threads_started":2,"wal-append.queue_time_us":315668}
I20260709 13:13:16.353720   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.354558  1171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:50818 (request call id 0) took 1704 ms. Trace:
I20260709 13:13:16.354688   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:16.356738   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.358870   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1314) took 1145 ms. Trace:
I20260709 13:13:16.359032  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:16.337150  2475 consensus_queue.cc:237] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:16.356757   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.357730   551 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:16.363605   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:16.352849   557 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:16.369414   480 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.355005  1171 rpcz_store.cc:276] 0709 13:13:14.649768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.649940 (+   172us) service_pool.cc:224] Handling call
0709 13:13:16.353945 (+1704005us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b5400720e54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841f735 00007f4b684179fa 00007f4b6d3df4c9 00007f4b6695bc54 00007f4b6695bbe2 00007f4b6695bb11 00007f4b6695ba8c 00007f4b6695ad42 00007f4b6675448c 00007f4b667538c6
0709 13:13:16.354332 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992405760}
I20260709 13:13:16.382959   447 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:16.338661   626 rpcz_store.cc:276] 0709 13:13:15.294145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.294253 (+   108us) service_pool.cc:224] Handling call
0709 13:13:15.294555 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:15.562084 (+267529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.337583 (+775499us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54001626d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:16.337870 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613604736}
I20260709 13:13:16.360693  1166 raft_consensus.cc:2393] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:16.307081  1967 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:16.360329  2339 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.362432   552 raft_consensus.cc:1240] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:16.372566  2366 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:16.366070  2179 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:16.417711   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 124490us
I20260709 13:13:16.417900  2371 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:16.416904  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 77333.5us
I20260709 13:13:16.420107  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:16.420257   483 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.422041  1168 raft_consensus.cc:1240] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:13:16.377923  2411 raft_consensus.cc:3055] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:16.360080   476 rpcz_store.cc:276] 0709 13:13:15.213782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.220980 (+  7198us) service_pool.cc:224] Handling call
0709 13:13:16.318180 (+1097200us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4eee 0000000000375939 00007f4b6d3681e0 00007f4b6d4310c4 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:16.358651 (+ 40471us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16925568}
I20260709 13:13:16.406665  2317 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:13:16.433676   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 108549us
I20260709 13:13:16.414741   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:16.436041   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.299077  2249 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.370549  2531 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:13:16.420145  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:16.445128   477 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:16.448136   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:16.452786  1862 consensus_meta.cc:287] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.629s	user 0.006s	sys 0.009s
I20260709 13:13:16.453305  1862 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.454666   550 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 4: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:16.454698  2277 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.455845  2277 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:16.457290   523 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:16.458680   523 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:16.455901  2317 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.460152   625 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 4: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:16.461437  2317 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:16.461790   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:16.462188  2277 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:16.463677  2339 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.465180   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:16.466022  2339 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:16.466629   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:16.467729   555 raft_consensus.cc:2393] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 4: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:16.467922  2249 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:16.469530   551 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:16.477843   559 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:16.428743  2411 raft_consensus.cc:740] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:16.466650   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:16.482184   554 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:16.462668   628 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:16.493726  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 47788us
I20260709 13:13:16.489956   558 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
W20260709 13:13:16.495103   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 64312.3us
I20260709 13:13:16.495970   522 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:16.497421   522 leader_election.cc:304] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:16.508730   483 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:16.485350  2366 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:16.532335  1173 raft_consensus.cc:2393] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 4: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:16.549472  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:16.549975   480 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:16.493954  2317 consensus_queue.cc:1059] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:13:16.555678   478 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
W20260709 13:13:16.558173  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.502430  1938 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:16.562498   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.565603   631 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:13:16.566059   631 pending_rounds.cc:85] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 6
W20260709 13:13:16.568337   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.568622   631 pending_rounds.cc:107] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:13:16.569834  2317 raft_consensus.cc:3055] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:16.569195   631 raft_consensus.cc:2889] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:16.570434  2317 raft_consensus.cc:740] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:16.573516   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:16.578490   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 99666.9us
I20260709 13:13:16.558288   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:16.562752   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:16.582372   523 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:16.578970  2388 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:16.582027  2346 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:16.569236  2192 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.577636  2531 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:16.597571  2192 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.599793  1938 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.600464  1938 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.577332  2411 consensus_queue.cc:260] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.603516  2346 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.604521  2411 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.607481  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:16.608263  1172 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:16.608461  2192 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:16.602943  1938 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:16.612222  1862 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:16.613004   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1269) took 1319 ms. Trace:
I20260709 13:13:16.619448   478 raft_consensus.cc:1240] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:13:16.594178  2388 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:16.621712   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:16.622326   554 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.613461   627 rpcz_store.cc:276] 0709 13:13:15.293493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.297310 (+  3817us) service_pool.cc:224] Handling call
0709 13:13:16.612587 (+1315277us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b54001ad6d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:16.612791 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2036537216}
I20260709 13:13:16.624424   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1326) took 1274 ms. Trace:
I20260709 13:13:16.625777   557 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:16.626663   555 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:16.628901   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1266) took 1336 ms. Trace:
I20260709 13:13:16.629359   633 rpcz_store.cc:276] 0709 13:13:15.292402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.295067 (+  2665us) service_pool.cc:224] Handling call
0709 13:13:16.628689 (+1333622us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54000bf9d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:16.628845 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2046526336}
I20260709 13:13:16.628386  2317 consensus_queue.cc:260] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:16.621135  2388 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:16.627009   478 rpcz_store.cc:276] 0709 13:13:15.345558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.561784 (+1216226us) service_pool.cc:224] Handling call
0709 13:13:16.590353 (+ 28569us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:16.619910 (+ 29557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.620129 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:16.618886   551 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.623947  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:16.641419   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 144146us
I20260709 13:13:16.618561  2516 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:16.618639   476 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:16.664338   558 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 2.
I20260709 13:13:16.670989   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:16.679540   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 137018us
I20260709 13:13:16.639487  2531 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:16.679358   448 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:16.662757  2516 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:16.664417  1862 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.682279  2179 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.701732  2448 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.702108  2179 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:16.702497  2448 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:16.703488   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.704584  1172 raft_consensus.cc:1275] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:13:16.704958  2448 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:16.708114  2082 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:16.708649  2082 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.709107  2082 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:16.709645   525 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:16.704991  2179 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:13:16.710621   525 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:16.711992  2558 log.cc:927] Time spent T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:13:16.712241   522 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:16.713440  2192 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:16.713658   522 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:16.714087  2192 raft_consensus.cc:697] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:16.715864  2366 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:16.716300  2366 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.716662  2366 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.719338  2192 consensus_queue.cc:237] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.721613   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:16.723184   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:16.723399  2480 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:16.724239  2480 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:16.724694   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:16.725477   478 raft_consensus.cc:2368] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4.
I20260709 13:13:16.726432   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:16.713362   447 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:16.727438  2317 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:16.727761   552 raft_consensus.cc:1275] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:13:16.728473  2525 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:16.696559  2516 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:16.729015  2521 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.729776  2521 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.728979  2525 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:16.731709  2525 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:16.718590  2523 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.735426  2410 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.736110  2410 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.737509   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1416) took 1248 ms. Trace:
I20260709 13:13:16.737888  1967 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:16.695572  1167 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:16.739678   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:16.739684  2179 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:16.740819  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:16.741127  1862 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.741828  1169 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:16.741557  2179 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:16.742874  1171 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:13:16.743175   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 45397.7us
I20260709 13:13:16.745030   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:16.745441   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.745733   555 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:16.746254  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.745898  2535 consensus_queue.cc:1059] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:13:16.758008  1167 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:16.760505   447 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:16.761438  2277 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:16.763886   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.764688   556 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:16.765244  1862 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:16.765573   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.766867   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.767705   556 raft_consensus.cc:2393] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:16.768102  2521 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:16.768494   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.769335   556 raft_consensus.cc:2393] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:16.769381   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.769645  2410 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:16.770180   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.770591   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.771317   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:16.772598   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:16.773782   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.775143   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1423) took 1479 ms. Trace:
I20260709 13:13:16.775295   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:16.775528   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 64988.6us
I20260709 13:13:16.776307   556 raft_consensus.cc:2410] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:16.776451   525 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:16.777237   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.777446  2531 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:16.778008  2531 raft_consensus.cc:697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:16.778175   556 raft_consensus.cc:2393] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 5: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:16.778637  2523 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:16.778573   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:16.749385   559 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:16.771176   553 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:16.779057  2531 consensus_queue.cc:237] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:16.735116   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.783121   478 raft_consensus.cc:2393] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:16.719009  2411 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:16.784235   554 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:16.796334   555 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:16.737946   629 rpcz_store.cc:276] 0709 13:13:15.374801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.997147 (+622346us) service_pool.cc:224] Handling call
0709 13:13:16.056267 (+ 59120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:16.056518 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:16.292429 (+235911us) log.cc:844] Serialized 14 byte log entry
0709 13:13:16.563377 (+270948us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:16.574710 (+ 11333us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:16.591045 (+ 16335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.593903 (+  2858us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:16.623588 (+ 29685us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36312,"prepare.queue_time_us":335671,"prepare.run_cpu_time_us":164,"prepare.run_wall_time_us":9586,"raft.queue_time_us":22200,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":14641,"thread_start_us":190097,"threads_started":2,"wal-append.queue_time_us":233301}
I20260709 13:13:16.769511  2179 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:16.793071  2532 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:16.800006   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:16.809273   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 94206.8us
I20260709 13:13:16.812947   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.797246  2411 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:16.818017   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.819938   559 raft_consensus.cc:2393] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 4: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:16.824054   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.825416   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.826218   559 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 4: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:16.823553   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.820885  2411 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:16.827059   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:16.768469  2366 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.830588   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:16.830905   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:16.830935   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.158432 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:16.804152  2410 consensus_queue.cc:1059] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:13:16.775615   477 rpcz_store.cc:276] 0709 13:13:15.296922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.477986 (+181064us) service_pool.cc:224] Handling call
0709 13:13:15.576338 (+ 98352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:16.446987 (+870649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.774849 (+327862us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b54002dc654. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:16.775063 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1948531968}
I20260709 13:13:16.819629   550 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:16.839946   633 raft_consensus.cc:2393] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 4: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:16.838967  2388 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.819818  2448 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.838939   380 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41332 (request call id 154) took 11131 ms. Trace:
I20260709 13:13:16.852173   522 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:16.843475   599 leader_election.cc:400] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4.
I20260709 13:13:16.813828  2532 raft_consensus.cc:697] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:16.819511  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:16.848603   559 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:16.847378   632 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:16.864274   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.864238   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:16.854488   599 leader_election.cc:403] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:16.865639   559 raft_consensus.cc:2410] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:16.861872  2388 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:16.867309  2480 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:16.868360   627 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.868530   597 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:16.779098   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.877411   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:16.884310   555 raft_consensus.cc:1275] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:16.883744   632 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:16.887496  2088 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:16.887930  2088 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:16.888232   550 raft_consensus.cc:1240] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:16.888870   633 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.889017   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:16.889847   477 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.891448  2223 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.892834   597 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:16.888348  2088 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:16.902073   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:16.902948   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1418) took 1527 ms. Trace:
I20260709 13:13:16.903389   630 rpcz_store.cc:276] 0709 13:13:15.375431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.341426 (+965995us) service_pool.cc:224] Handling call
0709 13:13:16.341860 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:16.342222 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:16.342244 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:16.342724 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:13:16.426801 (+ 84077us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:16.426832 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.426892 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:16.902590 (+475698us) raft_consensus.cc:1685] finished
0709 13:13:16.902613 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:16.902778 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":83685,"threads_started":1,"wal-append.queue_time_us":452518}
I20260709 13:13:16.904237   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:16.864513  2448 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:16.904901   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:16.905650  2462 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.920006   597 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:16.927663   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:16.930227   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 104751us
I20260709 13:13:16.880316  2082 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:16.916138  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:16.907040   628 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:16.919780  2480 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:16.952062   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 171664us
I20260709 13:13:16.952914   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1325) took 1617 ms. Trace:
I20260709 13:13:16.951357   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:16.953313   480 rpcz_store.cc:276] 0709 13:13:15.331414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.560247 (+1228833us) service_pool.cc:224] Handling call
0709 13:13:16.589634 (+ 29387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:16.643831 (+ 54197us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:16.688590 (+ 44759us) log.cc:844] Serialized 14 byte log entry
0709 13:13:16.948796 (+260206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:16.948847 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:16.948884 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.948959 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:16.949096 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4159,"prepare.queue_time_us":27683,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":18420,"thread_start_us":191652,"threads_started":1}
I20260709 13:13:16.959968   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:16.960704   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.961091   597 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:16.968137   447 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:16.971220   480 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:16.852795   380 rpcz_store.cc:276] 0709 13:13:05.708021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.708346 (+   325us) service_pool.cc:224] Handling call
0709 13:13:16.838681 (+11130335us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:11.834771 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:11.835360 (+   589us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:11.835402 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:13:11.835420 (+    18us) tablet.cc:662] Decoding operations
0709 13:13:11.836340 (+   920us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:11.836417 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:11.836444 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:13:11.837156 (+   712us) tablet.cc:701] Row locks acquired
0709 13:13:11.837174 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:13:11.837313 (+   139us) write_op.cc:270] Start()
0709 13:13:11.837423 (+   110us) write_op.cc:276] Timestamp: P: 1783602791837270 usec, L: 0
0709 13:13:11.837437 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 13:13:11.838050 (+   613us) log.cc:844] Serialized 3664 byte log entry
0709 13:13:12.780070 (+942020us) op_driver.cc:464] REPLICATION: finished
0709 13:13:13.103811 (+323741us) write_op.cc:301] APPLY: starting
0709 13:13:13.103896 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:13.104148 (+   252us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:13.129767 (+ 25619us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:13.147758 (+ 17991us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:13.163758 (+ 16000us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:13:13.165875 (+  2117us) write_op.cc:312] APPLY: finished
0709 13:13:13.168711 (+  2836us) log.cc:844] Serialized 71 byte log entry
0709 13:13:13.168898 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:13.169025 (+   127us) write_op.cc:454] Released schema lock
0709 13:13:13.169073 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:13.191663 (+ 22590us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:13.201918 (+ 10255us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28158,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":323448,"apply.run_cpu_time_us":3957,"apply.run_wall_time_us":75395,"num_ops":9,"prepare.queue_time_us":162146,"prepare.run_cpu_time_us":64664,"prepare.run_wall_time_us":521344,"raft.queue_time_us":262054,"raft.run_cpu_time_us":13179,"raft.run_wall_time_us":94238,"replication_time_us":942455,"thread_start_us":756334,"threads_started":4,"wal-append.queue_time_us":604188,"wal-append.run_cpu_time_us":26526,"wal-append.run_wall_time_us":1740765}]]}
I20260709 13:13:16.975019   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:16.981782  2339 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:16.982810  2223 raft_consensus.cc:2749] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4.
W20260709 13:13:16.983731  2571 log.cc:927] Time spent T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:13:16.987207  1975 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:16.987573  2410 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:16.987882  2498 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:16.987965  2410 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.988394  2410 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:16.988966  2513 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.989527  2513 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.992533  1138 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:16.993458  2532 consensus_queue.cc:237] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.996619  2082 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:16.997186  2082 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:16.997421  2448 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:16.966104  2480 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:16.997507  2516 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:16.999464  2362 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:16.999827  2480 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:17.000078  2362 raft_consensus.cc:697] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:16.950155  2462 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:17.001400   522 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:16.983063   633 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:17.005059   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:17.006361   447 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:16.960346   551 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:16.948005  2525 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:17.018438   447 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:16.960057  2249 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:13:17.023264   447 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:17.003652  2366 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:17.005829  2125 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:17.026219   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:17.027752   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:17.014750  2277 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:17.028772  2339 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:13:17.004436  2535 consensus_queue.cc:1243] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer 6e6df7e8ed204f1db5c371536b5b0683 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:13:17.034528  2459 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:17.036569   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 92937.2us
I20260709 13:13:17.007575  2082 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:17.025658  2480 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:17.021940  2192 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:17.036123   597 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:17.001142  2362 consensus_queue.cc:237] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:17.075249   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:17.076237   483 raft_consensus.cc:2393] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:17.047873  2476 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.048378  2516 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:17.048885  2513 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:17.072031  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:17.051405  2511 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:17.090205  1167 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:17.090301  2511 raft_consensus.cc:697] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:17.091372  2511 consensus_queue.cc:237] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:17.095641   554 raft_consensus.cc:2410] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:17.096745   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:17.097039  1170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 306) took 1132 ms. Trace:
I20260709 13:13:17.097463   556 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:17.098461   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:17.098338  2476 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:17.100580  2476 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:17.101321  2500 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.101842  2500 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:17.103255   599 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:17.103449   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:17.104097   483 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:17.104449  2500 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:17.104892  2551 log.cc:927] Time spent T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.563s	user 0.002s	sys 0.000s
I20260709 13:13:17.105077   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:17.105752   483 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:17.106731   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1268) took 1813 ms. Trace:
I20260709 13:13:17.106935  1141 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:17.107823   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:17.108373   556 raft_consensus.cc:2376] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4. Re-sending same reply.
I20260709 13:13:17.109333   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:17.109841   556 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
W20260709 13:13:17.051594   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:17.111828   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.051923  2125 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.107120   624 rpcz_store.cc:276] 0709 13:13:15.293130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.295432 (+  2302us) service_pool.cc:224] Handling call
0709 13:13:15.295743 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:16.287906 (+992163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.106455 (+818549us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54001e3a54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:17.106650 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2059013888}
I20260709 13:13:17.038075  1862 consensus_queue.cc:1059] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 13:13:17.059574  2518 log.cc:927] Time spent T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 1.001s	user 0.004s	sys 0.000s
I20260709 13:13:17.112658  2125 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:17.110571   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:17.114733   556 raft_consensus.cc:2393] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 3: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:17.114950   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1307) took 1924 ms. Trace:
I20260709 13:13:17.061494  2405 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:17.115561   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:17.058383  2411 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:17.115481   475 rpcz_store.cc:276] 0709 13:13:15.190259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.195719 (+  5460us) service_pool.cc:224] Handling call
0709 13:13:15.251697 (+ 55978us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:15.279180 (+ 27483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:15.281264 (+  2084us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:15.335019 (+ 53755us) log.cc:844] Serialized 26 byte log entry
0709 13:13:15.444732 (+109713us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:15.857562 (+412830us) log.cc:844] Serialized 14 byte log entry
0709 13:13:15.884466 (+ 26904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.938016 (+ 53550us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:16.892188 (+954172us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b18001e0ee0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6532c522 00007f4b6532e7c1 00007f4b6532e779 00007f4b6532e709 00007f4b6532e6d1 00007f4b6532d9cd 000000000038f354 000000000038f199 00007f4b6530f83a
0709 13:13:16.986896 (+ 94708us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:17.114606 (+127710us) raft_consensus.cc:1685] finished
0709 13:13:17.114631 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.114790 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":146633,"prepare.queue_time_us":288516,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":8836,"raft.queue_time_us":119418,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":18910,"spinlock_wait_cycles":71546496,"thread_start_us":407205,"threads_started":2,"wal-append.queue_time_us":632251}
I20260709 13:13:17.117561   627 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:17.118238  2411 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:17.064133  2478 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:17.067418   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:17.068392   479 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1316) took 1854 ms (client timeout 1978 ms). Trace:
I20260709 13:13:17.118970   555 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:17.070595   481 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1311) took 1865 ms (client timeout 2167 ms). Trace:
I20260709 13:13:17.032433  2277 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:17.040335  2459 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:17.050241   477 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:17.087942   480 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:17.089148  2082 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:17.089097  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:17.118261   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:17.111590   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 88899.6us
I20260709 13:13:17.111640  2249 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:17.116412   556 raft_consensus.cc:2393] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 4: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:17.063596  2462 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:17.069253   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:17.080829   550 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:17.119989   481 rpcz_store.cc:269] 0709 13:13:15.208683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.209578 (+   895us) service_pool.cc:224] Handling call
0709 13:13:17.070346 (+1860768us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b54000d48d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:17.070526 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2170124672}
W20260709 13:13:17.140861   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 65504.8us
I20260709 13:13:17.122861   599 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:17.106771   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:17.119020   447 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:13:17.119837   479 rpcz_store.cc:269] 0709 13:13:15.214498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.230076 (+ 15578us) service_pool.cc:224] Handling call
0709 13:13:17.068181 (+1838105us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b54002b2ad4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:17.068339 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2153563904}
I20260709 13:13:17.086786  2534 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:17.114961  2125 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:17.147723   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:17.122499  2459 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:17.116340  2405 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:13:17.139869   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 99070.7us
I20260709 13:13:17.120925  2277 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:17.155400  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:17.155670  1175 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:13:17.158792  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:17.143481   483 raft_consensus.cc:2393] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:17.132977   475 raft_consensus.cc:2393] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 5: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:17.163586   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:17.164988   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:17.165706   475 raft_consensus.cc:2393] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:17.166476   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:17.148582   522 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:17.132727   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:17.168107   557 raft_consensus.cc:2368] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4.
I20260709 13:13:17.169132   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:17.123687  2500 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:17.170351  2500 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.170943  2500 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:17.097669  1170 rpcz_store.cc:276] 0709 13:13:15.964375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.967428 (+  3053us) service_pool.cc:224] Handling call
0709 13:13:15.983854 (+ 16426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:16.085011 (+101157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.096516 (+1011505us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54004d3354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:17.096826 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231233920}
I20260709 13:13:17.176913   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:17.178330   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:17.167059   475 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:17.181293   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:17.182791   475 raft_consensus.cc:2393] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:17.188027   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:17.192863   475 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:17.186234  2500 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:17.181906   483 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:17.194113   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1312) took 1985 ms. Trace:
W20260709 13:13:17.194725  2581 log.cc:927] Time spent T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:13:17.196362  2525 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:17.191700  2277 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:17.140800  2249 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:17.201084   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 66893.3us
I20260709 13:13:17.203619   599 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:17.204710   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:17.202010   482 rpcz_store.cc:276] 0709 13:13:15.209096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.212971 (+  3875us) service_pool.cc:224] Handling call
0709 13:13:17.068973 (+1856002us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:17.194017 (+125044us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8820480}
W20260709 13:13:17.206240   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 47078.2us
I20260709 13:13:17.200266   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:17.211117  2463 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:17.211645  2463 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.211377  2405 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:17.213778  2405 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:17.214540   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:17.214970   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:17.215693   479 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:13:17.211140   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 62715.5us
I20260709 13:13:17.216785  1141 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:17.208403   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:17.218436   556 raft_consensus.cc:2393] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 4: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:17.220124   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:17.220937   557 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 4: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:17.208387   480 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:17.199306  2478 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:17.223853   599 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:17.212006  2463 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:17.138695  1167 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:17.215510  2125 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:17.229874   522 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:17.230494   599 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:17.207527  2476 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.215427  2249 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:17.235023  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:17.234112   599 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:17.235893   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:17.239575   481 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:17.240710   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:17.243211   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:17.246634   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:17.219077  2082 consensus_queue.cc:1059] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:13:17.235062  2534 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:17.238323  2411 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:17.238394  2462 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:17.243790  2339 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:17.258564   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:17.260236   557 raft_consensus.cc:2393] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:17.262305   482 raft_consensus.cc:2393] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:17.244161  2478 raft_consensus.cc:697] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:17.235918  2088 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:17.267023  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.259603   448 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:17.246068  2476 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:17.278365  2184 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:17.256570   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:17.257093  2462 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.275171   522 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:17.284442  2577 log.cc:927] Time spent T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.255s	user 0.002s	sys 0.000s
W20260709 13:13:17.284521  2583 log.cc:927] Time spent T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:13:17.259876  2339 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.291711   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:17.300340   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 228) took 1132 ms. Trace:
I20260709 13:13:17.300724   482 rpcz_store.cc:276] 0709 13:13:16.168717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.282543 (+1113826us) service_pool.cc:224] Handling call
0709 13:13:17.299808 (+ 17265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:17.299990 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:17.300016 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:17.300078 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:17.300108 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.300160 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.300271 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:17.302237   482 raft_consensus.cc:1240] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:17.302682   475 raft_consensus.cc:1240] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:17.303483   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1327) took 1957 ms. Trace:
I20260709 13:13:17.303810   475 rpcz_store.cc:276] 0709 13:13:15.345887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.237344 (+1891457us) service_pool.cc:224] Handling call
0709 13:13:17.282439 (+ 45095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:17.303189 (+ 20750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.303429 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:17.304472  2584 log.cc:927] Time spent T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:13:17.305598   475 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:17.306213   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 231) took 1104 ms. Trace:
I20260709 13:13:17.279217  2540 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:17.286809  2462 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:17.280318  2082 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:17.309036  2082 raft_consensus.cc:697] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:17.310016  2082 consensus_queue.cc:237] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:17.313807   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 72345.2us
I20260709 13:13:17.306582   475 rpcz_store.cc:276] 0709 13:13:16.202387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.304907 (+1102520us) service_pool.cc:224] Handling call
0709 13:13:17.305250 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:17.305946 (+   696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.306142 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:17.302611  2557 log.cc:927] Time spent T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.752s	user 0.000s	sys 0.002s
I20260709 13:13:17.316787   479 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:13:17.317039   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 52986.3us
I20260709 13:13:17.280126  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:17.297430  2374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.750s	user 0.031s	sys 0.041s
I20260709 13:13:17.319892   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1328) took 1643 ms. Trace:
I20260709 13:13:17.391508   479 rpcz_store.cc:276] 0709 13:13:15.676556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.263046 (+1586490us) service_pool.cc:224] Handling call
0709 13:13:17.314341 (+ 51295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:17.319640 (+  5299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.319840 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:17.391942   481 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:17.320401   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 230) took 1112 ms. Trace:
I20260709 13:13:17.323457  2411 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:17.263767  2410 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:17.327165   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 232) took 1124 ms. Trace:
I20260709 13:13:17.327685   556 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:17.298820  2339 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:17.409552   479 raft_consensus.cc:1275] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:17.329197  2470 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:17.423664   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:17.341447  2465 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:13:17.343525   625 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1412) took 1969 ms (client timeout 1560 ms). Trace:
W20260709 13:13:17.346781  2517 log.cc:927] Time spent T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 1.293s	user 0.000s	sys 0.002s
I20260709 13:13:17.424995  2465 raft_consensus.cc:697] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:17.424880   625 rpcz_store.cc:269] 0709 13:13:15.373601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.395723 (+ 22122us) service_pool.cc:224] Handling call
0709 13:13:17.336996 (+1941273us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002bd4d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:17.343451 (+  6455us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2444615552}
I20260709 13:13:17.360913   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1427) took 1049 ms. Trace:
I20260709 13:13:17.326980  1938 raft_consensus.cc:3055] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:17.426613  1938 raft_consensus.cc:740] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:17.365496  2277 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:17.365511  1169 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:13:17.367523  2570 log.cc:927] Time spent T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.556s	user 0.000s	sys 0.003s
I20260709 13:13:17.369932  2088 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:17.371665   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:17.372730   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:17.374097   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:17.374200   550 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:13:17.378378  2249 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:17.379870   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1318) took 2164 ms. Trace:
W20260709 13:13:17.387562   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 69876us
I20260709 13:13:17.341702  2478 consensus_queue.cc:237] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:17.392608   482 rpcz_store.cc:276] 0709 13:13:16.201853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.301765 (+1099912us) service_pool.cc:224] Handling call
0709 13:13:17.302056 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:17.313815 (+ 11759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.313991 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:17.382606  2462 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:17.392925  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 71208.3us
I20260709 13:13:17.398069   483 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:17.387522   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:17.407779   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 93355.2us
I20260709 13:13:17.432333   550 pending_rounds.cc:85] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 5
W20260709 13:13:17.393504  2374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.944s	user 0.035s	sys 0.041s
I20260709 13:13:17.420765  2410 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:17.421353   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:17.452991   558 raft_consensus.cc:2393] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 5: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:17.421885   599 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:17.422365  2589 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:17.423310  2411 raft_consensus.cc:697] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:17.459671   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1330) took 1159 ms. Trace:
I20260709 13:13:17.460107  2411 consensus_queue.cc:237] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:17.462072   480 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:17.463963   480 raft_consensus.cc:1275] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:17.353927  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:17.466511  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 145579us
I20260709 13:13:17.467381   522 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:17.426071   475 rpcz_store.cc:276] 0709 13:13:16.311848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.350454 (+1038606us) service_pool.cc:224] Handling call
0709 13:13:17.350843 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:17.351138 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.351180 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:17.351229 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:17.351300 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.351361 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.360845 (+  9484us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:17.426192  2465 consensus_queue.cc:237] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:17.431581   555 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:17.430542   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 138442us
I20260709 13:13:17.406525   477 rpcz_store.cc:276] 0709 13:13:16.202868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.326184 (+1123316us) service_pool.cc:224] Handling call
0709 13:13:17.326583 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:17.326782 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.326812 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:17.326881 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:17.326910 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.326978 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.327091 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:17.410223   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 234) took 1082 ms. Trace:
I20260709 13:13:17.472518   479 rpcz_store.cc:276] 0709 13:13:16.327696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.399812 (+1072116us) service_pool.cc:224] Handling call
0709 13:13:17.409231 (+  9419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:17.409931 (+   700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.410142 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:17.474490   479 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:17.445598   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:17.455049   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:17.476456   556 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:13:17.458009   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 60266.2us
I20260709 13:13:17.436542   484 rpcz_store.cc:276] 0709 13:13:15.215105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.367339 (+152234us) service_pool.cc:224] Handling call
0709 13:13:15.367737 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:15.368170 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:15.368209 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:15.368766 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:13:15.762853 (+394087us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:15.814266 (+ 51413us) log.cc:844] Serialized 14 byte log entry
0709 13:13:15.837539 (+ 23273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.837652 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:17.377292 (+1539640us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b180039d000. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6532c3f3 00007f4b6532e7c1 00007f4b6532e779 00007f4b6532e709 00007f4b6532e6d1 00007f4b6532d9cd 000000000038f354 000000000038f199 00007f4b6530f83a
0709 13:13:17.379402 (+  2110us) raft_consensus.cc:1685] finished
0709 13:13:17.379513 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.379695 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49492,"prepare.queue_time_us":200462,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":321225,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":8966,"spinlock_wait_cycles":95670144,"thread_start_us":312129,"threads_started":1,"wal-append.queue_time_us":597896}
I20260709 13:13:17.443320  2500 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:13:17.457947  1862 consensus_queue.cc:1059] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:17.458474  2523 raft_consensus.cc:3055] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:17.458632  2589 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:17.462244  2554 log.cc:927] Time spent T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 1.015s	user 0.002s	sys 0.000s
I20260709 13:13:17.424538   557 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:17.464033  2088 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:17.450805   550 pending_rounds.cc:107] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:13:17.330451  2346 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:17.465476  2463 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:17.428757   481 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:13:17.483045   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1420) took 1806 ms. Trace:
I20260709 13:13:17.486480   482 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:13:17.489360   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:17.470708  2550 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.011s	user 0.006s	sys 0.016s
I20260709 13:13:17.487448  1172 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:17.496992   480 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:17.497191   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 233) took 1170 ms. Trace:
I20260709 13:13:17.500545   481 rpcz_store.cc:276] 0709 13:13:16.327294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.393125 (+1065831us) service_pool.cc:224] Handling call
0709 13:13:17.413677 (+ 20552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:17.496972 (+ 83295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.497138 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:17.475069   477 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:17.480623  2192 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:17.485725   551 raft_consensus.cc:2410] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:13:17.504186   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 59283.8us
I20260709 13:13:17.482908  2523 raft_consensus.cc:740] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:17.507094   484 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:17.498615  1168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 355) took 1002 ms. Trace:
I20260709 13:13:17.502606  2088 raft_consensus.cc:697] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:17.527706  2088 consensus_queue.cc:237] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:17.528436   525 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:17.484709  1938 consensus_queue.cc:260] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:17.495532   550 raft_consensus.cc:2889] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:17.484900   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:17.530412  2580 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:17.501713  2550 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.007s	sys 0.017s
I20260709 13:13:17.534776   556 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:17.535272   597 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:17.496359   626 rpcz_store.cc:276] 0709 13:13:15.676972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.416837 (+739865us) service_pool.cc:224] Handling call
0709 13:13:16.490774 (+ 73937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:16.540056 (+ 49282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:16.540111 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:16.563293 (+ 23182us) log.cc:844] Serialized 26 byte log entry
0709 13:13:16.676948 (+113655us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:16.676980 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.677049 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:17.335064 (+658015us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:17.478121 (+143057us) raft_consensus.cc:1685] finished
0709 13:13:17.478166 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.482983 (+  4817us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6207360,"thread_start_us":84545,"threads_started":1,"wal-append.queue_time_us":214308}
I20260709 13:13:17.460116   476 rpcz_store.cc:276] 0709 13:13:16.300495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.494113 (+193618us) service_pool.cc:224] Handling call
0709 13:13:17.459463 (+965350us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b5400183b54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:17.459566 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67974400}
I20260709 13:13:17.502179  2125 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:17.477296  2184 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:13:17.559643   599 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:17.561403   482 raft_consensus.cc:1275] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:13:17.564471   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 115764us
I20260709 13:13:17.570039   476 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:17.571389  1938 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:17.574774   366 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 227b93e1b31e4b058d5ec1fc69bd6849 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6e6df7e8ed204f1db5c371536b5b0683 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:17.555894   552 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:17.544401  2580 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.580325   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:17.578567  2523 consensus_queue.cc:260] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:17.596128   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.596668   555 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
W20260709 13:13:17.596705   366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 43999.2us
W20260709 13:13:17.607420   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 102530us
I20260709 13:13:17.610284   597 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:17.611951   522 leader_election.cc:400] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4.
I20260709 13:13:17.615897   477 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:13:17.615804   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 108150us
I20260709 13:13:17.593451  2317 raft_consensus.cc:3055] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:17.627528   525 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:17.634195  2470 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:17.607582  2580 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:17.637327  2223 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:17.663666  2409 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:17.655769  2192 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:17.672169   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 61971.8us
I20260709 13:13:17.640210  2317 raft_consensus.cc:740] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:17.671128  2463 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:17.684268   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 56810.6us
I20260709 13:13:17.701908   483 raft_consensus.cc:1240] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:17.659307  2249 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:17.709772   525 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:17.667369  2020 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:17.685586  2597 log.cc:927] Time spent T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:13:17.699259  2596 log.cc:927] Time spent T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.068s	user 0.000s	sys 0.002s
I20260709 13:13:17.679970  2523 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:17.684744  2595 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:13:17.717971   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:17.759570   555 raft_consensus.cc:2410] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:17.718255   480 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:17.718515   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:17.760836   556 raft_consensus.cc:2393] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 4: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:13:17.713698   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.731792   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:17.732798  2409 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:17.735528   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:17.711483  2223 raft_consensus.cc:697] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:17.740758  2125 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:17.742252   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:17.744222  1139 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:17.804251  1141 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:17.757705  2600 log.cc:927] Time spent T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:13:17.750747  2192 consensus_queue.cc:1059] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:17.753492  2462 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:17.754693  2412 consensus_queue.cc:1059] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:17.755527   557 raft_consensus.cc:1275] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:17.719554  1862 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:17.805629   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 108405us
I20260709 13:13:17.836606   597 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:17.805153   525 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:17.747031   448 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:17.705966  2411 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
W20260709 13:13:17.810308   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 167070us
I20260709 13:13:17.691164  2540 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.110s
I20260709 13:13:17.823726  2589 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:17.834832   475 raft_consensus.cc:1240] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:13:17.835835  1862 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.813196  2184 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:13:17.812525  2599 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:13:17.853114  2516 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:17.856444  2179 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:13:17.880012   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 133051us
I20260709 13:13:17.856673  2409 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:17.876489  2470 raft_consensus.cc:697] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:17.862788  2459 consensus_meta.cc:287] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.001s
I20260709 13:13:17.843811  2463 consensus_queue.cc:1059] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:13:17.864570  1862 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:17.874189  2500 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:17.851173  2249 consensus_queue.cc:1048] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
W20260709 13:13:17.924006   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 87502.1us
W20260709 13:13:17.925197   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 120111us
I20260709 13:13:17.929244   553 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:17.931097   448 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:17.910959  2534 consensus_meta.cc:287] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.649s	user 0.008s	sys 0.002s
W20260709 13:13:17.938355  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 194158us
I20260709 13:13:17.938880  2465 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:17.909324  1938 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:17.944409   597 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:17.949149  1172 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:13:17.922129  2500 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.912459  2179 raft_consensus.cc:697] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:17.910152   378 catalog_manager.cc:5697] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 3 to 4, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 4 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:17.949820  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:17.861348  2317 consensus_queue.cc:260] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:17.925138  2478 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.968719  2544 raft_consensus.cc:3055] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:13:17.970461   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 56696.3us
I20260709 13:13:17.922586  2088 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:13:17.930197  2409 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:13:17.955312  2538 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:17.947136  2534 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:17.955670  2339 consensus_meta.cc:287] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
I20260709 13:13:17.980556   448 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:17.946758  1938 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:17.950110  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:17.985867   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 52214.9us
I20260709 13:13:17.991827   597 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:17.960857  2500 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:17.959142  2516 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:17.977519  2411 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:17.974069   378 catalog_manager.cc:5697] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 1 to 2, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 2 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:17.908617  2223 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:17.943940  2462 consensus_queue.cc:1059] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:13:17.947427  2192 consensus_queue.cc:1243] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:13:17.985962  2602 log.cc:927] Time spent T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:13:17.913004  2459 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:18.040364   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 59932.6us
I20260709 13:13:18.010442   625 raft_consensus.cc:1240] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:18.041500   448 leader_election.cc:400] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4.
I20260709 13:13:18.041893   448 leader_election.cc:403] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:17.980033  2544 raft_consensus.cc:740] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:17.990928  1938 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:17.991389  2538 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:18.045921   378 catalog_manager.cc:5697] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 2 to 3, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 3 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.048249  2516 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4.
W20260709 13:13:18.048962   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 57243.1us
I20260709 13:13:18.039733  2478 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:18.052011  2609 log.cc:927] Time spent T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:13:18.053875  2478 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:18.043215  2608 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:18.058202   448 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:18.059377  2459 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:18.048252   378 catalog_manager.cc:5697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 1 to 2, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 2 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:18.072525   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 146449us
I20260709 13:13:18.009122  2020 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:18.043299  2523 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:13:18.093621   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 214112us
I20260709 13:13:18.065444  2538 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:18.100854  2612 log.cc:927] Time spent T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:13:18.044883  2179 consensus_queue.cc:237] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:18.110016  2478 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:18.110805  2478 consensus_queue.cc:1059] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:18.007326  1167 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:18.098517   378 catalog_manager.cc:5697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 2 to 3, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 3 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:18.113006   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 55984.6us
I20260709 13:13:18.117070   523 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:18.118697   448 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:18.000665  2339 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:18.122182   597 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:18.130089   378 catalog_manager.cc:5697] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 1 to 2, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 2 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.141026  2628 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.141708  2628 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:18.116061  2540 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:13:18.142228  2088 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:17.523137  1168 rpcz_store.cc:276] 0709 13:13:16.496234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.508576 (+ 12342us) service_pool.cc:224] Handling call
0709 13:13:17.284791 (+776215us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4eee 0000000000375939 00007f4b6d3681e0 00007f4b6d4310c4 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:17.284965 (+   174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:17.285267 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:17.285636 (+   369us) log.cc:844] Serialized 14 byte log entry
0709 13:13:17.482603 (+196967us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:17.484371 (+  1768us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:17.487691 (+  3320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.498421 (+ 10730us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.498535 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1893,"prepare.queue_time_us":6195,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":16926,"raft.run_wall_time_us":8101,"spinlock_wait_cycles":48736000,"thread_start_us":183640,"threads_started":1,"wal-append.queue_time_us":217222}
I20260709 13:13:18.156626   627 raft_consensus.cc:1240] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:18.157084   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:18.158548   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:18.158919  2623 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:18.126741  2617 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:13:18.159524  2628 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:18.149366  2192 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:13:18.153321  2088 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.160460  2088 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:18.160588  2586 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:18.161108  2586 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:18.161546  2586 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:18.009404  2470 consensus_queue.cc:237] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:18.178251   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 61296.7us
I20260709 13:13:18.175788   378 catalog_manager.cc:5697] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 1 to 2, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 2 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:13:18.179914   523 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:18.151958  2476 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:18.182732   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 44922.1us
I20260709 13:13:18.123083  2544 consensus_queue.cc:260] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:18.188235   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:18.186326   448 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:18.097030  2580 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:18.189550   448 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:18.190828   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:18.190202   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:18.192325   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:18.194481   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:18.195700   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:18.196205   629 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:18.197428   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:18.174907  2249 consensus_queue.cc:1048] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:13:18.183403  2631 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:18.211493   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 55775.4us
I20260709 13:13:18.218592   631 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:18.204473   448 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:18.192871  2476 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:18.228577   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:18.221195   378 catalog_manager.cc:5697] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 1 to 2, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 2 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.234661   632 raft_consensus.cc:2393] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:13:18.235112   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.238054  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:18.228483  2476 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.235795  2192 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.235697  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:18.240772  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:13:18.259256   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 54812.9us
I20260709 13:13:18.217828  2631 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.243394  2544 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:18.233668  2634 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:18.260996   551 raft_consensus.cc:2368] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5.
I20260709 13:13:18.235688   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:18.274250   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.283670   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:18.275305   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.276404   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.286682   557 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:18.286376   553 raft_consensus.cc:2393] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 5: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:18.273070   448 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:18.273645   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:18.278602   559 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:18.278968   555 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:18.260165  2521 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:18.265157  2580 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:18.281248   552 raft_consensus.cc:1275] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:18.287520  2082 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:13:18.269403   378 catalog_manager.cc:5697] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130), VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131), VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 3 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:18.282684  2192 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:18.270363  2476 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:18.286355   550 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 4: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:18.302073   558 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:18.303442  2223 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:18.307545  2223 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:18.288707  2500 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:18.307962  2192 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:18.309653  2500 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:18.310393  1169 raft_consensus.cc:1240] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:18.311338  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:18.312144  1171 raft_consensus.cc:2410] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:18.307979  2223 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:18.313097  2088 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:18.274811  2249 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:13:18.278561  2631 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:18.316862   631 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:18.318650   378 catalog_manager.cc:5697] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.325374  2538 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:18.327715   629 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:18.327951  1862 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:18.330516  1862 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:18.320950   378 catalog_manager.cc:5697] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 1 to 2, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 2 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.305608  2521 raft_consensus.cc:697] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:18.340181   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.342576   483 raft_consensus.cc:1240] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:18.344363  2500 consensus_queue.cc:1059] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:18.345218  2317 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:18.345129   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 72153.1us
I20260709 13:13:18.346733   448 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:18.357016  1938 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:18.338640  2550 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:18.359560  2550 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:18.360072  2550 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:18.368199   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:18.368868   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.369534  2192 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.370261   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.370877   558 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:18.371002   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:18.371809  2192 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:18.372519  1862 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.373075  1862 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:18.371002   555 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:13:18.374400   555 pending_rounds.cc:85] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 5
I20260709 13:13:18.374739   555 pending_rounds.cc:107] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:13:18.374986   555 raft_consensus.cc:2889] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:18.376045  2521 consensus_queue.cc:237] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:18.379825   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.382931   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:18.383342   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.383622   558 raft_consensus.cc:2368] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 5. Current term is 6.
I20260709 13:13:18.383944   557 raft_consensus.cc:2376] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4. Re-sending same reply.
I20260709 13:13:18.384243   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.385947   555 raft_consensus.cc:2410] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:13:18.403681   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 57012.9us
I20260709 13:13:18.346244  2476 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:18.401347   378 catalog_manager.cc:5697] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 2 to 3, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 3 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.408315   448 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:18.411166 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:18.412957   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.413481   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.413650   558 raft_consensus.cc:2376] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4. Re-sending same reply.
I20260709 13:13:18.405663  2082 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:18.413074  2580 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.426810   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.429502   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:18.430315   558 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:18.431896   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:18.434510   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:18.435359   558 raft_consensus.cc:2376] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4. Re-sending same reply.
I20260709 13:13:18.457476   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:18.458756   480 raft_consensus.cc:2410] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:18.418076  2516 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:18.463785   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.465698   553 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:18.465958   624 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:13:18.410379  2634 consensus_queue.cc:1048] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:13:18.426728  2636 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:18.467087   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:18.476346  2082 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:18.479192  2523 raft_consensus.cc:3055] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:18.434484  1938 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:18.423347  2409 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:13:18.483542   559 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:18.488576   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:18.489540   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.490238   553 raft_consensus.cc:2376] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4. Re-sending same reply.
I20260709 13:13:18.491096   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:18.428820  2619 consensus_queue.cc:1059] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:13:18.456959  2580 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:18.500218   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:18.500919   556 raft_consensus.cc:2393] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 5: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:18.501008   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:18.498682   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:18.504480   483 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:13:18.505856   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:18.506062   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:18.506577   482 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:13:18.485265  2523 raft_consensus.cc:740] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:18.480173  2636 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:18.512463   478 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:18.516726   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:18.517310   556 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:18.521275   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 51068.1us
I20260709 13:13:18.524312   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.538255   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:18.538967   477 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:18.483211  2223 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:18.518335  2606 log.cc:927] Time spent T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.562s	user 0.004s	sys 0.000s
I20260709 13:13:18.543219   599 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:18.543943   553 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:18.547432   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1443) took 1746 ms. Trace:
I20260709 13:13:18.547724   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.512478  2619 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:18.551779   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.552412   555 raft_consensus.cc:2376] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5. Re-sending same reply.
W20260709 13:13:18.553970  2637 log.cc:927] Time spent T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:13:18.554735  2580 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:18.519724  1938 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:18.562573   556 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:18.563951   597 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:18.565551   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.566572   555 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:18.568807   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 183) took 1014 ms. Trace:
I20260709 13:13:18.569741   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:18.547801   479 rpcz_store.cc:276] 0709 13:13:16.801227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.475415 (+674188us) service_pool.cc:224] Handling call
0709 13:13:17.475782 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:17.476940 (+  1158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:17.476969 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:17.482193 (+  5224us) log.cc:844] Serialized 26 byte log entry
0709 13:13:17.770984 (+288791us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:17.771022 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.771094 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:18.517710 (+746616us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:18.547133 (+ 29423us) raft_consensus.cc:1685] finished
0709 13:13:18.547152 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:18.547367 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":728,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4214,"spinlock_wait_cycles":23485696,"thread_start_us":211389,"threads_started":1,"wal-append.queue_time_us":372589}
I20260709 13:13:18.571619   625 rpcz_store.cc:276] 0709 13:13:17.554001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.554136 (+   135us) service_pool.cc:224] Handling call
0709 13:13:17.565852 (+ 11716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.041625 (+475773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.568595 (+526970us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54000bead4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:18.568742 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021967744}
I20260709 13:13:18.523800  2586 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:18.620858   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 44549.2us
W20260709 13:13:18.568050   366 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 227b93e1b31e4b058d5ec1fc69bd6849 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6e6df7e8ed204f1db5c371536b5b0683 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:18.621611   483 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
W20260709 13:13:18.622004   366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 54005.5us
W20260709 13:13:18.617415  1139 leader_election.cc:336] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Timed out: RequestConsensusVote RPC to 127.31.17.130:41159 timed out after 1.524s (SENT)
I20260709 13:13:18.629814  1139 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:18.632349   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:18.575899  2540 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:18.597728  2608 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:18.622512  2476 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:18.661475   447 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:18.666145   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.597699  2534 consensus_queue.cc:1059] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:13:18.646996  2624 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:18.568387  1938 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:18.675671  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 58332.2us
I20260709 13:13:18.567941  2523 consensus_queue.cc:260] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:18.654798  2540 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:18.679128  1139 leader_election.cc:336] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Timed out: RequestConsensusVote RPC to 127.31.17.130:41159 timed out after 1.549s (SENT)
I20260709 13:13:18.688361  1139 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:18.649577  2538 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:18.564188  2619 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:18.685743   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.702684   555 raft_consensus.cc:2393] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 5: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:18.683175   447 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:18.712900   447 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:18.714344   447 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:18.647119  2621 consensus_queue.cc:1059] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:13:18.717348   447 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:18.690101  2540 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:18.738680   556 raft_consensus.cc:2410] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:18.736580   447 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:18.688651  2516 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:18.742478   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:18.693935  2523 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:18.677901  2646 consensus_queue.cc:1059] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:13:18.711550  2362 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:18.733732  2476 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:18.684128  2631 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:18.735064  2644 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:18.735980  2521 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:18.771034   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:18.748090  2317 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:18.784845   447 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:18.745239  2475 raft_consensus.cc:2749] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:18.771967  2223 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:18.781956  2636 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:18.755012  2550 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:18.812022  2644 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:18.852533   597 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:18.818020  2586 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:18.802196  2317 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:18.855165   597 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:18.867892   477 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:18.868754   597 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:18.851451  2641 log.cc:927] Time spent T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:13:18.870291   625 raft_consensus.cc:1240] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:18.830807  2643 log.cc:927] Time spent T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
W20260709 13:13:18.878356  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 219032us
I20260709 13:13:18.885030   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:18.889375   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:18.892372   597 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:18.893839   631 raft_consensus.cc:1240] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:18.895057   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:18.852156   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:18.855569  2020 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:18.907630  2662 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:18.908398  2662 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:18.911437  2662 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:18.913561   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:18.914086   479 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:18.866775  2634 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:18.895036  2362 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:13:18.900532  2650 log.cc:927] Time spent T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:13:18.903652  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 224566us
W20260709 13:13:18.927145  1139 leader_election.cc:336] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Timed out: RequestConsensusVote RPC to 127.31.17.130:41159 timed out after 1.622s (SENT)
I20260709 13:13:18.894932  2500 consensus_queue.cc:1059] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:13:18.917625   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:18.835065  2628 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:13:18.868911  2644 raft_consensus.cc:697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:18.832706  2223 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:13:18.921062   482 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:18.855602  2470 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:13:18.928807   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:18.932569   624 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:18.933919   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:18.833014  2621 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:13:18.950699   631 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:18.956954   629 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:18.964905  1139 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:18.966024   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:18.966456  1139 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:18.967031   482 raft_consensus.cc:2393] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:18.946007  2619 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:18.967620  2619 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.967413  2659 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:18.968099  2619 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:18.968475   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1489) took 1250 ms. Trace:
I20260709 13:13:18.969182  2659 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:18.968943   551 rpcz_store.cc:276] 0709 13:13:17.718430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.719432 (+  1002us) service_pool.cc:224] Handling call
0709 13:13:18.968238 (+1248806us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b540031abd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:18.968378 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975954176}
I20260709 13:13:18.970077  2659 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:18.970240  2619 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:18.970703   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:18.987594   551 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:18.931061  2362 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:18.987871  2088 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:18.989018   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1451) took 1888 ms. Trace:
I20260709 13:13:18.989711  2362 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:18.990006  2605 raft_consensus.cc:3055] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:18.971473  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:18.991591  2654 log.cc:927] Time spent T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:13:18.993532  1139 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:18.993947   476 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:13:18.994346  1862 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:18.976840  1938 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:18.945442  2020 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:19.004773   479 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:18.981144   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:18.982391   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:18.982959   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:18.983633   554 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:13:18.984263   629 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:19.015381   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:19.016016   629 raft_consensus.cc:2368] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4.
I20260709 13:13:18.984625   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:18.985389   477 raft_consensus.cc:1275] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:18.986335   632 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:18.986413   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:18.986698   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:18.987051   631 raft_consensus.cc:1240] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:18.970839   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:18.990420  2605 raft_consensus.cc:740] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:18.994753  1139 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:18.986361   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:19.022852   625 raft_consensus.cc:2393] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:13:18.996899  2656 log.cc:927] Time spent T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 13:13:18.997148  2651 log.cc:927] Time spent T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:13:18.997592  2649 log.cc:927] Time spent T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:13:18.998234  2463 raft_consensus.cc:3055] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:19.000010  2339 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:19.001921  2644 consensus_queue.cc:237] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:18.932482  2657 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:19.012413   558 raft_consensus.cc:1240] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:13:19.013512   447 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:19.021008   559 raft_consensus.cc:2393] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 3: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:19.027688  1139 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:18.989418   475 rpcz_store.cc:276] 0709 13:13:17.100741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.755286 (+654545us) service_pool.cc:224] Handling call
0709 13:13:17.770375 (+ 15089us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:17.862241 (+ 91866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.988824 (+1126583us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b54002dc650. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:18.988954 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13848960}
I20260709 13:13:19.029464   557 raft_consensus.cc:3055] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:19.049424   557 raft_consensus.cc:740] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:19.049690  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:18.946166  2658 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:19.030877   525 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:19.032565   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:19.052163   479 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:18.945838  2465 consensus_queue.cc:1059] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
W20260709 13:13:19.041898   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 149576us
I20260709 13:13:19.019490  2659 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:19.049043   558 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
W20260709 13:13:19.070878   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 57437.7us
I20260709 13:13:19.060523   632 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:13:19.072108   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:19.075151   558 pending_rounds.cc:85] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 1
I20260709 13:13:19.070472   624 raft_consensus.cc:2368] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 4. Current term is 5.
I20260709 13:13:19.076707   559 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:19.065117   557 consensus_queue.cc:260] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:19.078261   557 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:19.075941   447 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:19.077009   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:19.040230  2463 raft_consensus.cc:740] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:19.044173  2631 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:19.081815   447 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:19.088913   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:19.071564   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:19.076730   558 pending_rounds.cc:107] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:13:19.091334   558 raft_consensus.cc:2889] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.061976   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:19.085860   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:19.086434   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.094198   630 raft_consensus.cc:2393] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:19.095170   597 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:19.097211   629 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:19.100009   558 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:19.078320  2619 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:19.071139  2082 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.103937   558 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:13:19.113411   558 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:19.076244  2179 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:19.106549   479 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:19.039815  2362 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:19.059789  1938 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.084281  2589 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:19.086769  2125 raft_consensus.cc:3055] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:19.098762  2521 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:19.119342   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:19.095595  2668 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.111209   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:19.119902   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:19.120561  1139 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:19.089439  2658 raft_consensus.cc:697] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:19.123346   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:19.124017   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:19.127569   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.131019   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:19.093276   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:19.134519   557 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:19.103935  2223 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.097949  2659 raft_consensus.cc:697] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:19.136996   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:19.153121   481 raft_consensus.cc:2410] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:19.105465  2550 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:19.090415  2646 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:13:19.115965  2362 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.160934   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:19.162469   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:19.135723  2619 raft_consensus.cc:697] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:19.135584  2125 raft_consensus.cc:740] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:19.109580  2586 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:13:19.136341  2179 raft_consensus.cc:697] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:19.138267  2589 raft_consensus.cc:697] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:19.138128   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:19.190286   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:19.191092   632 raft_consensus.cc:2393] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:19.169833  2362 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:19.110435  2475 consensus_queue.cc:1059] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
W20260709 13:13:19.187003  2615 log.cc:927] Time spent T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 1.135s	user 0.004s	sys 0.002s
I20260709 13:13:19.199102  2475 raft_consensus.cc:3055] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:19.199481  2475 raft_consensus.cc:740] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:19.136749  1938 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:19.178143   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:19.200203  2475 consensus_queue.cc:260] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:19.200678   630 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:19.201121  2667 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.201380  2475 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:19.201639  2667 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:19.202831  2661 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.203413  2661 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:19.203900  2667 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:19.205387  2661 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:19.206578  2020 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:19.210866   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.213316   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:19.220691  2635 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:13:19.222685  2658 consensus_queue.cc:237] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:19.224545  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 104057us
I20260709 13:13:19.225922   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:19.226351  1139 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:19.171388  2669 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.098054  2605 consensus_queue.cc:260] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:19.192728   476 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 3: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:19.168320  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:19.198344   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:19.179014   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:19.263633   479 raft_consensus.cc:2410] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:19.159415  2610 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:13:19.231729  1174 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:19.158048  2465 consensus_queue.cc:1059] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:13:19.233461   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:19.269420   558 raft_consensus.cc:2376] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5. Re-sending same reply.
I20260709 13:13:19.270301   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:19.137890  2668 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:19.235229  2339 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:19.250361   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:19.250203   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:19.253400   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:19.271729   522 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:19.272044   553 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:19.137923  2671 consensus_queue.cc:1048] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:13:19.254905  2661 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:19.167214  2670 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:13:19.255647  2659 consensus_queue.cc:237] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:19.230885   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:19.307456   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:19.334679  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 124145us
I20260709 13:13:19.299693   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:19.337087   557 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:19.172463  2463 consensus_queue.cc:260] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:19.346921   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:19.339210   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 67609.3us
I20260709 13:13:19.344606   553 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:19.348759   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:19.344996   448 leader_election.cc:400] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5.
I20260709 13:13:19.354979   448 leader_election.cc:403] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:19.355916   482 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:19.362385   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:19.363317   553 raft_consensus.cc:2393] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 5: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:19.383271   632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:19.384075   632 raft_consensus.cc:606] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:19.384442   632 raft_consensus.cc:614] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:19.385211  2463 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:19.329957  2661 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:19.388230   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.388924  2411 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.392325   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:19.396123  2681 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.298002  2339 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:19.427445   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:19.427809  2672 log.cc:927] Time spent T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:13:19.351691  2550 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.428860   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:19.265655  2667 consensus_queue.cc:1059] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:13:19.429917  2667 raft_consensus.cc:3055] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:19.430271  2667 raft_consensus.cc:740] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:19.400787   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:19.401273  2589 consensus_queue.cc:237] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:19.403017  2619 consensus_queue.cc:237] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:19.410293  1168 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:19.356876  2634 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.298965  2669 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 13:13:19.410831   482 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:19.269495   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:19.423221   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:19.446188   553 raft_consensus.cc:2368] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5.
I20260709 13:13:19.446731   522 leader_election.cc:400] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4.
I20260709 13:13:19.447031   522 leader_election.cc:403] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:13:19.425097  1169 raft_consensus.cc:1240] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:13:19.329648  2580 consensus_queue.cc:1059] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:13:19.428503  2550 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:19.402180  2179 consensus_queue.cc:237] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:19.431782   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:19.434616   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 280041us
I20260709 13:13:19.436160   479 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:13:19.353889   551 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:19.444593   550 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:19.427465  2339 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:19.453027   628 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:19.453923  1138 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:19.454600   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:19.454815  2667 consensus_queue.cc:260] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:19.455536  2634 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:19.434082  2644 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5.
I20260709 13:13:19.456862   633 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:19.465165   479 pending_rounds.cc:85] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 3
I20260709 13:13:19.490106   479 pending_rounds.cc:107] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:13:19.490523   479 raft_consensus.cc:2889] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.447901   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:19.299455  2125 consensus_queue.cc:260] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:19.449479   522 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:19.486485   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:19.495478   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 46126.6us
W20260709 13:13:19.476665  2540 consensus_meta.cc:287] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.727s	user 0.009s	sys 0.002s
W20260709 13:13:19.460261   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 115389us
I20260709 13:13:19.457872  2631 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:19.505748  1168 raft_consensus.cc:1240] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:13:19.506399  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:19.507006   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:19.507639   550 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:19.509122   552 consensus_meta.cc:287] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.575s	user 0.004s	sys 0.003s
I20260709 13:13:19.509512   552 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:19.488626   557 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:19.521183   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:19.524371   626 raft_consensus.cc:1240] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:19.484272  2463 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:13:19.526638  2586 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.527136  2586 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:19.529351  2586 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:19.529827  2362 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:19.484434  2681 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.531004  1174 raft_consensus.cc:1240] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:13:19.460795  2628 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:13:19.535693   448 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:19.537391   553 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:13:19.539265   553 pending_rounds.cc:85] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 1
I20260709 13:13:19.541477   553 pending_rounds.cc:107] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:13:19.541895   553 raft_consensus.cc:2889] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.475857  2465 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
W20260709 13:13:19.542882  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 316582us
I20260709 13:13:19.554701  1139 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:19.556479   448 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:19.558893   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:19.535645  2667 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:19.503360  2411 consensus_queue.cc:1059] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:13:19.537401  2463 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.564772   448 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:19.564057   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.569020  1139 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:19.525365  2540 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:19.576829   626 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:19.556828  2586 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:19.562505  2644 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:19.579973   448 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:19.578637   559 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:19.572683  2653 raft_consensus.cc:2749] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.585578  2653 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.566290  2681 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.587934  1139 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:19.593376   626 raft_consensus.cc:1275] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:19.593405   448 leader_election.cc:400] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5.
I20260709 13:13:19.595112   448 leader_election.cc:403] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:19.583335  2619 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.587335  2624 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.602744  2589 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5.
I20260709 13:13:19.596304  2339 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.604991  1938 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:19.605232  2550 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:19.606846   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:19.591358  2661 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:19.593516  2684 raft_consensus.cc:2804] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:19.579907  2463 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:19.720896   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:19.726760   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 133465us
I20260709 13:13:19.649777   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:19.730515   448 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:19.727061   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 229654us
I20260709 13:13:19.697606   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:19.650909   481 raft_consensus.cc:1240] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:19.733027   629 raft_consensus.cc:2393] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:19.698843   484 raft_consensus.cc:1240] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:19.610805   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 184) took 1087 ms. Trace:
I20260709 13:13:19.734916   554 rpcz_store.cc:276] 0709 13:13:18.523277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.523677 (+   400us) service_pool.cc:224] Handling call
0709 13:13:18.983320 (+459643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.014418 (+ 31098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.610584 (+596166us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b5400387f50. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:19.610719 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020582144}
I20260709 13:13:19.729482   478 raft_consensus.cc:1240] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:19.738144   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:19.740399   554 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:19.742972  2179 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:19.743573  2179 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:19.745656  2179 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:19.747692   522 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:19.731345   626 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:19.607187  2540 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:19.611183  2608 raft_consensus.cc:3055] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:19.593761  2644 raft_consensus.cc:697] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:13:19.705197  2682 log.cc:927] Time spent T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:13:19.598147  2192 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:19.752528   554 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:19.688135  2516 raft_consensus.cc:3055] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:19.758244   597 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:19.674479  2362 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:19.765442   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:19.766166   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 98140.5us
I20260709 13:13:19.647919  2580 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.728691  2684 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:19.757928   448 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:19.647586  2693 consensus_queue.cc:1059] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.160s
I20260709 13:13:19.763103  2317 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:19.763824  2644 consensus_queue.cc:237] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:19.764598   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1466) took 1035 ms. Trace:
W20260709 13:13:19.764693  2523 consensus_meta.cc:287] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 1.015s	user 0.013s	sys 0.000s
I20260709 13:13:19.765381   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43548 (request call id 188) took 1204 ms. Trace:
I20260709 13:13:19.771068   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:19.607930  2634 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:19.687721  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:19.771329   556 rpcz_store.cc:276] 0709 13:13:18.563749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.565271 (+  1522us) service_pool.cc:224] Handling call
0709 13:13:19.765185 (+1199914us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54001caf54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:19.765325 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":395027328}
I20260709 13:13:19.770165   448 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:19.769825   559 rpcz_store.cc:276] 0709 13:13:18.729206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.077505 (+348299us) service_pool.cc:224] Handling call
0709 13:13:19.089302 (+ 11797us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.585269 (+495967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.764367 (+179098us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b5400387a54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:19.764536 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124932352}
I20260709 13:13:19.754335  2608 raft_consensus.cc:740] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:19.756287  1938 consensus_queue.cc:1059] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:13:19.771966  2653 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:19.770390  2684 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:19.775652   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:19.776446   550 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:19.777645   632 raft_consensus.cc:1240] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:19.779090  2463 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:19.759208  2631 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4.
I20260709 13:13:19.757874  2636 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:19.729368  2339 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:19.760645  2516 raft_consensus.cc:740] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:19.766265  2550 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:19.793120   483 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:19.793803  1938 raft_consensus.cc:3055] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:19.809520  1938 raft_consensus.cc:740] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:19.770222  2580 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:19.794581  2700 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.770737  2658 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:19.768985  2661 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:19.800382   448 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:19.800879   626 raft_consensus.cc:3055] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:13:19.803800   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 56229.7us
I20260709 13:13:19.806181   555 raft_consensus.cc:2410] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:19.830739   626 raft_consensus.cc:740] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:19.792589  2653 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.808766  2339 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:19.809151   483 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:19.810423  1938 consensus_queue.cc:260] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:19.811856   525 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:19.811981   629 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:13:19.800104  2523 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:19.792850  2540 consensus_queue.cc:1059] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:13:19.831594   522 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:19.832966  1938 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:19.821291   597 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:19.837664   522 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:19.838042  2631 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:19.839561  2631 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.839895  2631 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:19.829748  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:19.841373  1169 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:19.842293  2550 raft_consensus.cc:2764] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:13:19.832927   552 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:13:19.801364  2634 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:13:19.842355  2540 consensus_queue.cc:1243] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer 6ba2a9c02b534120bbf26e56a1e920ca log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:13:19.854187   447 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:19.836407  2608 consensus_queue.cc:260] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:19.820214  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:19.832381  2653 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:19.847345  2523 raft_consensus.cc:697] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:19.834707   626 consensus_queue.cc:260] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:19.869745  2608 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:19.870194   597 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:19.855391   522 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:19.834383  2661 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:19.871138   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:19.872943  2661 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:19.856169  2088 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.873553  2088 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:19.875065  2249 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:19.875593  2088 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:19.875674  2249 raft_consensus.cc:697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:19.876039   597 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:19.876242  2088 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.868753  2631 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:19.805534  2636 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:19.878028   366 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 227b93e1b31e4b058d5ec1fc69bd6849 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6e6df7e8ed204f1db5c371536b5b0683 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:19.876922   597 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:19.838481  2192 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.877746  2589 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.859784  2700 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:19.876921  2088 consensus_queue.cc:1059] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:13:19.877162  2694 consensus_queue.cc:1059] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:13:19.889007   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:19.838116  2658 raft_consensus.cc:697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:19.891319   522 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:19.856065  2020 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:19.902841   522 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:19.906356   522 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:19.877548  2470 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:19.877115  2580 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:19.820237  2516 consensus_queue.cc:260] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:19.905320  2713 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:19.908267  2475 consensus_meta.cc:287] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.701s	user 0.010s	sys 0.003s
W20260709 13:13:19.944984   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.887897   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:19.970139   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:19.983115   483 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:19.856474  2667 consensus_queue.cc:1059] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:13:19.893707  2478 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.876765  2249 consensus_queue.cc:237] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:19.916832   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.898705  2700 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.909567  2693 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.900120  2628 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:20.003321   477 raft_consensus.cc:2410] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:19.973590  2088 consensus_queue.cc:1243] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Peer 6e6df7e8ed204f1db5c371536b5b0683 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:13:19.978349  2020 raft_consensus.cc:697] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:19.981163  2580 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:20.052760  1938 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:20.054160  1938 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:20.011448   550 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:20.070894  1938 leader_election.cc:290] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:20.069454   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 163175us
I20260709 13:13:20.122711  1938 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:20.124323   522 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:20.128070  1938 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:20.009460  2700 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:20.072962   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.121170  2516 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:20.002327  2478 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:20.050993  2713 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:20.055557  2628 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.029325  2667 consensus_queue.cc:1243] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:13:20.176283  2713 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:20.179129  2713 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:20.174329   525 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:20.162626   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 253516us
I20260709 13:13:20.171675  2680 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.149793  2705 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:20.183670   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:20.133881  2693 consensus_queue.cc:1059] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:13:20.158807  2619 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:20.196946  2475 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:13:20.208215  2619 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.208724  2619 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:20.210736  2657 raft_consensus.cc:3055] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:20.210875  2619 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:20.142599  2544 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:13:20.068733  2020 consensus_queue.cc:237] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:20.215404  2708 log.cc:927] Time spent T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 13:13:20.216841   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1473) took 1177 ms. Trace:
I20260709 13:13:20.176079  2628 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:20.192555   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.991171  2658 consensus_queue.cc:237] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:20.157325  2580 consensus_queue.cc:1048] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:13:20.128347  2523 consensus_queue.cc:237] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:20.194015   448 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:20.182073  2521 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.232095  2478 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:20.231890  2521 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:20.234022  2521 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:20.235653   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:20.235900  2644 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:20.236284   483 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:20.237126   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:20.237763   483 raft_consensus.cc:2393] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:20.196794  2711 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:20.243495  2711 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:20.245704  2711 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:20.196394  2684 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:20.248088  2684 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:20.250487   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.195767   557 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
W20260709 13:13:20.198069  2673 log.cc:927] Time spent T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:13:20.203136  2704 log.cc:927] Time spent T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 13:13:19.991447  2550 consensus_queue.cc:1175] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" responder_term: 5 status { last_received { term: 4 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:20.207402  2693 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:20.253316  2693 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.253782  2693 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:20.254537  2710 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:13:20.186780  1938 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:20.211256  2657 raft_consensus.cc:740] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:20.212218  2667 raft_consensus.cc:3055] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:20.217837   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 189) took 1031 ms. Trace:
I20260709 13:13:20.264005   629 rpcz_store.cc:276] 0709 13:13:19.186594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.752823 (+566229us) service_pool.cc:224] Handling call
0709 13:13:19.753115 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.832819 (+ 79704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.217602 (+384783us) spinlock_profiling.cc:243] Waited 58.5 ms on lock 0x7b54000528d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:20.217777 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134599424}
I20260709 13:13:20.184945  2589 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:20.187132  2634 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:13:20.230259   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.231082  2714 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:13:20.218649   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:20.256963   525 leader_election.cc:304] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:20.265929   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 136456us
I20260709 13:13:20.273377  1938 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:20.273768  1938 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:20.274096  1938 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:20.281342   632 raft_consensus.cc:1275] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:20.283620   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:20.287177   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:20.282840   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:20.292834   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:20.293187   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:20.294034   557 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:20.294922   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:20.293529   633 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:20.295959   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:20.297135   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:20.298249   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:20.299427   630 raft_consensus.cc:1240] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:20.301286   630 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:20.302842   522 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:20.303886   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:20.305116   633 raft_consensus.cc:3055] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:20.305394   633 raft_consensus.cc:740] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:20.306064   633 consensus_queue.cc:260] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:20.197515  2680 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:20.307121   633 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:20.309203  2680 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:20.263794  2667 raft_consensus.cc:740] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:20.319311   522 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:20.321841   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:20.322610   557 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:20.246013  2700 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:20.217265   476 rpcz_store.cc:276] 0709 13:13:19.039664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.587506 (+547842us) service_pool.cc:224] Handling call
0709 13:13:19.674005 (+ 86499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:19.728178 (+ 54173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:19.729216 (+  1038us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:19.787753 (+ 58537us) log.cc:844] Serialized 26 byte log entry
0709 13:13:19.906885 (+119132us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:19.906918 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.906984 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:20.216599 (+309615us) raft_consensus.cc:1685] finished
0709 13:13:20.216627 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.216776 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":111586,"threads_started":1,"wal-append.queue_time_us":112088}
I20260709 13:13:20.328670   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:20.344316   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:20.345238   557 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:20.318984   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:20.327042   550 raft_consensus.cc:2393] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 5: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:20.320701  2695 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:20.324232  2544 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.410452   633 raft_consensus.cc:1275] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:20.297415  2634 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:20.285382  2589 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:20.415947   633 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:20.390924   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:20.403496   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 75844.2us
W20260709 13:13:20.372707   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.418319   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:20.349686  2538 raft_consensus.cc:3055] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:20.412815  2465 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.346786  2644 consensus_queue.cc:1048] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 13:13:20.432500  1938 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:20.403796  2619 consensus_queue.cc:1059] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:13:20.417853  2339 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.420616   628 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
W20260709 13:13:20.447386  2463 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:13:20.442589   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:20.451751  1174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 376) took 1095 ms. Trace:
I20260709 13:13:20.451845   557 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:20.445851  2700 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:20.423795  2538 raft_consensus.cc:740] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:20.452211  1174 rpcz_store.cc:276] 0709 13:13:19.356531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.356652 (+   121us) service_pool.cc:224] Handling call
0709 13:13:19.399294 (+ 42642us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:19.531438 (+132144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.451511 (+920073us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540069f5d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:20.451690 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302333824}
I20260709 13:13:20.459640  2589 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:20.460880  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:20.463471  2716 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:20.427809  2667 consensus_queue.cc:260] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:20.433559  2705 consensus_queue.cc:1059] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:13:20.464854  2668 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:20.464506  2667 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:20.471524   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:20.472132   628 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:20.478307   557 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:20.479039   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1473) took 1007 ms. Trace:
I20260709 13:13:20.479393   557 rpcz_store.cc:276] 0709 13:13:19.471954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.477776 (+1005822us) service_pool.cc:224] Handling call
0709 13:13:20.478128 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:20.478789 (+   661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.478983 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:20.480763  2339 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:20.483003  2339 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:20.483971  1938 leader_election.cc:290] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:20.391963  2653 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:20.418901  2544 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:20.319710  2657 consensus_queue.cc:260] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:20.443265  2608 consensus_meta.cc:287] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.002s
I20260709 13:13:20.470665  2628 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:20.435410  2580 consensus_queue.cc:1048] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:13:20.505409   447 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:20.438989  2465 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:20.508849   632 raft_consensus.cc:2393] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:13:20.507167   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:20.510267   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:20.485592  2192 consensus_queue.cc:1175] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" responder_term: 4 status { last_received { term: 3 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:20.503919  2580 consensus_queue.cc:1243] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:13:20.506711  2657 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:20.508446  2711 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:20.529230  2634 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:20.523464  2711 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.531286  2711 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:20.531402  2691 log.cc:927] Time spent T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.928s	user 0.002s	sys 0.002s
W20260709 13:13:20.533836   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.535724  2125 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:20.537299  2523 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:20.537951  2523 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:20.538445  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:20.541205  2589 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:20.541298   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:20.541741  2589 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:20.543942  2589 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:20.547876  2693 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:20.548537  2544 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:20.552376   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1510) took 1289 ms. Trace:
I20260709 13:13:20.552767   552 rpcz_store.cc:276] 0709 13:13:19.262792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.763213 (+500421us) service_pool.cc:224] Handling call
0709 13:13:19.801254 (+ 38041us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:19.843415 (+ 42161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.552178 (+708763us) spinlock_profiling.cc:243] Waited 8.36 ms on lock 0x7b54001d6350. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:20.552315 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19220224}
I20260709 13:13:20.553529  2465 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:20.553967   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:20.556274  2693 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:20.556617   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:20.564013   555 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:20.564690   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1470) took 1556 ms. Trace:
I20260709 13:13:20.565130   555 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:13:20.565025   477 rpcz_store.cc:276] 0709 13:13:19.008700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.213014 (+204314us) service_pool.cc:224] Handling call
0709 13:13:20.564519 (+1351505us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b54002dd054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:20.564639 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1800714112}
I20260709 13:13:20.557313  2684 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:20.566465  2684 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:20.565824   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1478) took 1092 ms. Trace:
I20260709 13:13:20.567456   555 rpcz_store.cc:276] 0709 13:13:19.473355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.564616 (+1091261us) service_pool.cc:224] Handling call
0709 13:13:20.564923 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:20.565605 (+   682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.565777 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:20.580818   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:20.581497   555 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:20.566921  2695 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:20.592397  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:20.579952   597 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:20.528148   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 66094.5us
I20260709 13:13:20.553910  2628 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:20.558311  2711 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:20.562213   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.562141  2523 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:20.563400   557 raft_consensus.cc:1240] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:13:20.568861  2653 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:20.570982  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:20.571736  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:20.571880  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:20.572561  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:20.557853   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:20.597630   448 leader_election.cc:336] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Timed out: RequestConsensusVote RPC to 127.31.17.130:41159 timed out after 2.073s (SENT)
I20260709 13:13:20.593292  1173 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:20.605317   555 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
W20260709 13:13:20.618695  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 84932.9us
I20260709 13:13:20.622561   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:20.620800   597 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:20.629081   555 raft_consensus.cc:2393] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 5: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:20.602147  2465 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:20.643392  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:20.644176   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:20.645695   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:20.647159   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:20.602487   628 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:20.653095  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:20.654441  1174 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
W20260709 13:13:20.658703   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.611958  2658 consensus_queue.cc:1059] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:13:21.086177   559 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:20.891184   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:21.095916   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1481) took 1621 ms. Trace:
W20260709 13:13:21.096125  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:20.889302   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.096326   559 rpcz_store.cc:276] 0709 13:13:19.474238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.085490 (+1611252us) service_pool.cc:224] Handling call
0709 13:13:21.085939 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.095654 (+  9715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.095859 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:20.830940   478 raft_consensus.cc:1240] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:21.005363   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.004370   556 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:20.951589   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.668422  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:21.101233  1174 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:20.823582   624 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1288) took 1873 ms (client timeout 1887 ms). Trace:
W20260709 13:13:20.933560   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.096127   483 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:20.773706   522 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:20.680140   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:20.854728   448 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:21.099021   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1511) took 1819 ms. Trace:
I20260709 13:13:20.892930   626 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:21.106120   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 251501us
I20260709 13:13:21.106376   556 rpcz_store.cc:276] 0709 13:13:19.287165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.773129 (+485964us) service_pool.cc:224] Handling call
0709 13:13:20.213757 (+440628us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b5800116198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:21.003720 (+789963us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b5800116198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4e9c 00007f4b652f4a5b 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:21.004112 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.098805 (+ 94693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.098970 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50890240}
I20260709 13:13:21.107956   448 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:20.667904  1175 raft_consensus.cc:1240] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:13:21.105448   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 331857us
I20260709 13:13:20.846414   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 248) took 1816 ms. Trace:
W20260709 13:13:20.939949   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 287621us
I20260709 13:13:21.109335   482 rpcz_store.cc:276] 0709 13:13:19.029722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.445416 (+415694us) service_pool.cc:224] Handling call
0709 13:13:20.843441 (+1398025us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:20.845773 (+  2332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:20.846000 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:20.846037 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:20.846091 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:20.846159 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.846230 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.846348 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5790592}
W20260709 13:13:21.104202   624 rpcz_store.cc:269] 0709 13:13:18.950348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.950503 (+   155us) service_pool.cc:224] Handling call
0709 13:13:20.823384 (+1872881us) spinlock_profiling.cc:243] Waited 44 ms on lock 0x7b54001608d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:20.823523 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101198080}
I20260709 13:13:21.111931   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:21.116215   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:21.117141   448 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:21.118296   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.119393   597 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:21.117235   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:20.641670  2465 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:21.068881  2733 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.296s	user 0.002s	sys 0.000s
I20260709 13:13:20.652452  2462 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:21.126202  1171 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:20.828836   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:20.675595  2725 log.cc:927] Time spent T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.238s	user 0.003s	sys 0.000s
I20260709 13:13:21.125005   630 raft_consensus.cc:2368] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 4. Current term is 5.
I20260709 13:13:20.653926   552 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:20.898710  2317 raft_consensus.cc:3055] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:21.133857   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:20.904335   551 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:21.147778   624 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:20.834537  2550 consensus_queue.cc:1059] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.308s
I20260709 13:13:21.152972   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:20.793861  2249 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.780815  2684 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:20.800534  2621 raft_consensus.cc:3055] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:20.842403  2671 raft_consensus.cc:3055] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:20.845827  2700 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:20.750648  2735 log.cc:927] Time spent T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:13:20.771729  2693 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:20.778870  2580 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.140409   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:20.842636  2711 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:20.641515  2662 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.488s
I20260709 13:13:21.124588  2605 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:20.801764  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:21.135149   448 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:21.185716   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 50699.4us
I20260709 13:13:21.124734  2646 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:21.125738  2644 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:21.124179  2635 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:21.124357  2125 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.194602  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:21.202806  2125 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:21.203706  1170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 494) took 1306 ms. Trace:
I20260709 13:13:21.204093  1170 rpcz_store.cc:276] 0709 13:13:19.897341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.898675 (+  1334us) service_pool.cc:224] Handling call
0709 13:13:21.194444 (+1295769us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:21.203597 (+  9153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117807872}
I20260709 13:13:21.204996  2125 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:21.197180   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:21.205737  2463 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:13:21.206629   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.125953  2534 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:21.201427   633 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:13:21.207259  2534 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.207515   633 pending_rounds.cc:85] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 1
I20260709 13:13:21.207654  2534 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:21.207791   633 pending_rounds.cc:107] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:13:21.208231   633 raft_consensus.cc:2889] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:21.201455  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:21.210680  1169 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 3.
I20260709 13:13:21.127020  2082 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:21.211191  1169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 379) took 1332 ms. Trace:
I20260709 13:13:21.211440  2082 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.211879  2082 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:21.211585  1169 rpcz_store.cc:276] 0709 13:13:19.878931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.887637 (+  8706us) service_pool.cc:224] Handling call
0709 13:13:21.201341 (+1313704us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4eee 0000000000375939 00007f4b6d3681e0 00007f4b6d4310c4 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:21.211118 (+  9777us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347772288}
I20260709 13:13:21.202132   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 193) took 2014 ms. Trace:
I20260709 13:13:21.213094   627 rpcz_store.cc:276] 0709 13:13:19.187750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.771106 (+583356us) service_pool.cc:224] Handling call
0709 13:13:19.779760 (+  8654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.895970 (+116210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:19.899201 (+  3231us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:19.907844 (+  8643us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:19.911893 (+  4049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.201901 (+1290008us) spinlock_profiling.cc:243] Waited 97.8 ms on lock 0x7b54002bc5d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:21.201951 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.202072 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224860928}
I20260709 13:13:21.213836  2523 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:21.214867   627 pending_rounds.cc:85] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 1
I20260709 13:13:21.214561  2523 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:21.215227   627 pending_rounds.cc:107] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:13:21.216949   627 raft_consensus.cc:2889] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:20.774683  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:20.766299  2653 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:21.149009  1174 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:21.217958  1168 raft_consensus.cc:2393] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:21.202553  2635 raft_consensus.cc:697] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:21.173283   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1514) took 1827 ms. Trace:
I20260709 13:13:21.147430  2317 raft_consensus.cc:740] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:21.219100   633 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:21.191469  2646 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:21.218951  2635 consensus_queue.cc:237] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:21.219832  2646 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:21.172047  2621 raft_consensus.cc:740] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:21.192045   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.192225   522 leader_election.cc:400] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 4. Current term is 5.
I20260709 13:13:21.186391   448 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:21.173655  2671 raft_consensus.cc:740] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:21.181114  2700 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:21.149717  2658 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:13:21.183979  2580 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:21.206216  2463 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:21.193779   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1450) took 2149 ms. Trace:
I20260709 13:13:21.171406   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:20.840878  2538 consensus_queue.cc:260] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:21.132817  2465 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:21.173038  2249 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:21.219851  2317 consensus_queue.cc:260] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:21.765146   559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.004s	sys 0.021s
W20260709 13:13:22.059043   559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.025s	sys 0.030s
W20260709 13:13:21.992885   366 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 227b93e1b31e4b058d5ec1fc69bd6849 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6e6df7e8ed204f1db5c371536b5b0683 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:21.220417   633 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:22.060500   366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 67699.4us
I20260709 13:13:21.503859   480 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:22.061915   633 raft_consensus.cc:1240] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:21.722468  2534 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.064059  2534 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:21.217859  2523 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:21.187542   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:21.883880   450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.008s	sys 0.004s
W20260709 13:13:22.071561   450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.008s	sys 0.007s
W20260709 13:13:21.761766   626 consensus_meta.cc:287] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.654s	user 0.005s	sys 0.006s
I20260709 13:13:22.071762   630 raft_consensus.cc:2368] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 5. Current term is 6.
I20260709 13:13:22.072424   626 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:13:22.072853   626 pending_rounds.cc:85] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 5
I20260709 13:13:22.073216   626 pending_rounds.cc:107] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:13:22.073290  2523 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:22.073547   626 raft_consensus.cc:2889] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:22.073750  2523 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.074195  2523 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:22.074512   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 191) took 2887 ms. Trace:
I20260709 13:13:22.074923   626 rpcz_store.cc:276] 0709 13:13:19.187208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.766828 (+579620us) service_pool.cc:224] Handling call
0709 13:13:19.773069 (+  6241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:20.892440 (+1119371us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b540015eda0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6838ea1d 00007f4b683751a4 00007f4b683f7447 00007f4b6840ffe7 00007f4b684117de 00007f4b6841bb49 00007f4b6841c416 00007f4b68418d8f 00007f4b6841883e 00007f4b6d3dd419
0709 13:13:22.074285 (+1181845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.074459 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383002496}
W20260709 13:13:21.715364  2742 log.cc:927] Time spent T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.540s	user 0.000s	sys 0.001s
W20260709 13:13:21.899405   599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.016s	sys 0.015s
I20260709 13:13:22.067917  2671 consensus_queue.cc:260] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:21.910511   555 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.016s	sys 0.000s
W20260709 13:13:21.759150  1172 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.007s	sys 0.018s
W20260709 13:13:21.848841  2722 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.010s	sys 0.006s
I20260709 13:13:21.434248  2223 raft_consensus.cc:3055] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:13:21.875597   625 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.001s	sys 0.017s
W20260709 13:13:22.097465   599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.016s	sys 0.018s
W20260709 13:13:22.099526   625 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.005s	sys 0.019s
I20260709 13:13:21.202243  2644 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.112921  2617 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.113248  2644 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:22.113476  2617 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:22.083323  2462 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.931s	user 0.007s	sys 0.013s
W20260709 13:13:22.115823  2462 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.008s	sys 0.013s
I20260709 13:13:22.116088  2462 raft_consensus.cc:697] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:22.117111  2462 consensus_queue.cc:237] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.119915  2761 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:21.795674  2184 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:22.120292  2753 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.120566  2761 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.120756  2184 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.120985  2753 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.122880  2184 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:22.082716   631 rpcz_store.cc:276] 0709 13:13:19.044722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.044830 (+   108us) service_pool.cc:224] Handling call
0709 13:13:19.061303 (+ 16473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.061543 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:19.088153 (+ 26610us) log.cc:844] Serialized 14 byte log entry
0709 13:13:20.908294 (+1820141us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b1800442a80. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb923a 00007f4b68423a2a
0709 13:13:21.193299 (+285005us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:21.193362 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:21.193471 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.193584 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.193700 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26413,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":6988,"raft.queue_time_us":163,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":146960,"spinlock_wait_cycles":12184320,"thread_start_us":284561,"threads_started":1,"wal-append.queue_time_us":2420328}
W20260709 13:13:21.859990  2746 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 13:13:22.072738   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 886345us
I20260709 13:13:22.075876   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1472) took 2604 ms. Trace:
I20260709 13:13:21.217859  2653 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:21.591732  1167 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 380) took 1675 ms (client timeout 1960 ms). Trace:
W20260709 13:13:21.228159   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.218727   551 rpcz_store.cc:276] 0709 13:13:19.344522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.787373 (+442851us) service_pool.cc:224] Handling call
0709 13:13:20.903563 (+1116190us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b5800116198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:20.903867 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.151274 (+247407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.171965 (+ 20691us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7808896}
W20260709 13:13:21.884122   556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.007s	sys 0.006s
I20260709 13:13:22.134593   523 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:21.708793  2646 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:21.508234   478 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:13:22.088397   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.137313   523 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:22.138324   523 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:22.097751  1172 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.010s	sys 0.021s
W20260709 13:13:22.098249   555 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.430s	user 0.019s	sys 0.001s
W20260709 13:13:22.104086  2605 consensus_meta.cc:287] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.918s	user 0.008s	sys 0.003s
W20260709 13:13:22.109680  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 49007.1us
W20260709 13:13:22.110358   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.884853  2711 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.059834   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1466) took 1434 ms. Trace:
W20260709 13:13:22.110893  2722 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.015s	sys 0.008s
I20260709 13:13:22.058883   522 leader_election.cc:403] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:22.082362  2670 consensus_queue.cc:1059] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:13:22.112747  2671 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.131692   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:21.735917  2743 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
W20260709 13:13:21.834580  2737 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.643s	user 0.001s	sys 0.000s
I20260709 13:13:22.146358  2636 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:22.147876   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1474) took 3102 ms. Trace:
W20260709 13:13:22.132694  1139 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.036s	user 0.013s	sys 0.025s
I20260709 13:13:21.221575  2550 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:22.148245   479 rpcz_store.cc:276] 0709 13:13:19.045897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.549050 (+1503153us) service_pool.cc:224] Handling call
0709 13:13:20.549416 (+   366us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:20.549786 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:20.549814 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:20.550394 (+   580us) log.cc:844] Serialized 52 byte log entry
0709 13:13:20.682536 (+132142us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:21.103649 (+421113us) log.cc:844] Serialized 14 byte log entry
0709 13:13:21.103895 (+   246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.103962 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:22.147655 (+1043693us) raft_consensus.cc:1685] finished
0709 13:13:22.147675 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.147799 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":154023,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":2378,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":6795,"thread_start_us":484498,"threads_started":2,"wal-append.queue_time_us":598813}
I20260709 13:13:22.135095   558 raft_consensus.cc:2410] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:22.148381   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:21.186805   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1475) took 1713 ms. Trace:
W20260709 13:13:22.135646   556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.009s	sys 0.007s
W20260709 13:13:21.978627  1862 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.014s	sys 0.003s
I20260709 13:13:21.182684  2693 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.151672   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:22.131692   550 rpcz_store.cc:276] 0709 13:13:19.471645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.485341 (+1013696us) service_pool.cc:224] Handling call
0709 13:13:20.513042 (+ 27701us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:20.554107 (+ 41065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:20.554170 (+    63us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:20.554931 (+   761us) log.cc:844] Serialized 52 byte log entry
0709 13:13:20.641761 (+ 86830us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:21.193722 (+551961us) log.cc:844] Serialized 14 byte log entry
0709 13:13:21.368690 (+174968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.432331 (+ 63641us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:21.512073 (+ 79742us) raft_consensus.cc:1685] finished
0709 13:13:21.512098 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.075808 (+563710us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13934,"prepare.queue_time_us":1427977,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":15778,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":243,"thread_start_us":465632,"threads_started":2,"wal-append.queue_time_us":124405}
I20260709 13:13:22.153046  2693 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.153658   550 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:22.154383   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1486) took 2556 ms. Trace:
I20260709 13:13:22.154681   550 rpcz_store.cc:276] 0709 13:13:19.597771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.153153 (+2555382us) service_pool.cc:224] Handling call
0709 13:13:22.153465 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.154124 (+   659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.154328 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:22.138775  2762 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:22.139156  2192 raft_consensus.cc:2764] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:13:22.155469   552 rpcz_store.cc:276] 0709 13:13:19.472481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.555161 (+1082680us) service_pool.cc:224] Handling call
0709 13:13:20.616051 (+ 60890us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:21.149441 (+533390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.185344 (+ 35903us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:22.143368  2711 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.156517   550 raft_consensus.cc:1275] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:13:22.156958   550 pending_rounds.cc:85] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 2
I20260709 13:13:22.157312   550 pending_rounds.cc:107] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:13:22.111291  2223 raft_consensus.cc:740] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:22.143522  2713 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 4. Current term is 5.
I20260709 13:13:22.158286  2223 consensus_queue.cc:260] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.159415  2223 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.159868  2646 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:22.160444  2646 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.160892  2646 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:22.162228  1862 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.015s	sys 0.004s
I20260709 13:13:22.162853  2646 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:22.133852  1167 rpcz_store.cc:269] 0709 13:13:19.887164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.889422 (+  2258us) service_pool.cc:224] Handling call
0709 13:13:20.801562 (+912140us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:21.562620 (+761058us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4573568}
I20260709 13:13:22.164039  2653 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:22.158290  2711 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.123327  2753 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:22.132812  2317 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:22.142576   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 950433us
I20260709 13:13:22.140861  2532 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:22.069872  2621 consensus_queue.cc:260] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.127408  2617 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:22.149508  1139 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.053s	user 0.014s	sys 0.025s
I20260709 13:13:22.123176  2761 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.143378  2605 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:22.140898   624 rpcz_store.cc:276] 0709 13:13:20.625829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.171060 (+545231us) service_pool.cc:224] Handling call
0709 13:13:22.059775 (+888715us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:22.157142   479 raft_consensus.cc:2376] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5. Re-sending same reply.
I20260709 13:13:22.165930   550 raft_consensus.cc:2889] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:22.139504   523 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:22.171838   478 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:22.178104   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:22.183342  2532 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.180823   632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1316) took 1905 ms. Trace:
I20260709 13:13:22.182030   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:22.184819   633 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
W20260709 13:13:22.188743   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 49318.1us
I20260709 13:13:22.185647   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:22.189208   522 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:22.189531   523 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:22.185185   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1488) took 2566 ms. Trace:
I20260709 13:13:22.190224   550 rpcz_store.cc:276] 0709 13:13:19.618516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.155710 (+2537194us) service_pool.cc:224] Handling call
0709 13:13:22.156166 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.184581 (+ 28415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.185104 (+   523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:22.190513   523 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:22.182735  2184 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:22.191351  2184 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.191771  2636 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:22.185237   632 rpcz_store.cc:276] 0709 13:13:20.275704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.298040 (+ 22336us) service_pool.cc:224] Handling call
0709 13:13:22.180685 (+1882645us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54002bd9d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:22.180779 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482486144}
I20260709 13:13:22.192203  2636 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.180905  2671 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.194504  2636 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.200730   523 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:22.185839  2082 consensus_meta.cc:287] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.972s	user 0.006s	sys 0.006s
I20260709 13:13:22.201625   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:22.184044  2754 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:22.200312   475 raft_consensus.cc:2410] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:22.194684  2713 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:22.199726  2411 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:22.205616  2761 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:22.192679  2532 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.204934  2192 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:22.194010  2605 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.224148  2754 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.254225   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:22.244372  2693 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:22.204257  2671 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.246975  2550 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:22.205021  2082 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.257843   478 raft_consensus.cc:2410] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:22.199529  2764 consensus_queue.cc:1059] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:13:22.260210   550 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:22.250368  2713 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:13:22.257412  2756 log.cc:927] Time spent T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:13:22.259459  2249 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:22.268431  2759 log.cc:927] Time spent T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:13:22.283813   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.270895   477 raft_consensus.cc:1240] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:22.256878  2184 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.269749  2644 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.287384  2754 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.255442  2523 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.287987  2754 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.288663  2644 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.288481  2754 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.290191  2523 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:22.290693  2754 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.292879  2605 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:22.295643  2727 log.cc:927] Time spent T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 1.851s	user 0.002s	sys 0.023s
I20260709 13:13:22.298849  1166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 381) took 2034 ms. Trace:
I20260709 13:13:22.300312  2538 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:22.299366  1166 rpcz_store.cc:276] 0709 13:13:20.264243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.266360 (+  2117us) service_pool.cc:224] Handling call
0709 13:13:20.304007 (+ 37647us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:20.304503 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:20.304532 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:20.305331 (+   799us) log.cc:844] Serialized 52 byte log entry
0709 13:13:20.434711 (+129380us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:20.437856 (+  3145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.453219 (+ 15363us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:22.246270 (+1793051us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:22.296763 (+ 50493us) raft_consensus.cc:1685] finished
0709 13:13:22.296790 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.298770 (+  1980us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":48210688,"thread_start_us":126071,"threads_started":1,"wal-append.queue_time_us":138549}
I20260709 13:13:22.302145   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1483) took 2705 ms. Trace:
I20260709 13:13:22.285545  2765 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.262941  2580 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:22.255924  2465 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:22.326244   447 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 1.659s (SENT) [suppressed 45 similar messages]
I20260709 13:13:22.307931  2082 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.338888   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:22.341674   481 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
W20260709 13:13:22.312685   599 connection.cc:256] RPC call timeout handler was delayed by -1.649848226000131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
I20260709 13:13:22.336792   556 rpcz_store.cc:276] 0709 13:13:19.597021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.136022 (+1539001us) service_pool.cc:224] Handling call
0709 13:13:21.147635 (+ 11613us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:21.151675 (+  4040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:21.151717 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:21.154022 (+  2305us) log.cc:844] Serialized 26 byte log entry
0709 13:13:22.151264 (+997242us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:22.151317 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.151387 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:22.301886 (+150499us) raft_consensus.cc:1685] finished
0709 13:13:22.301910 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.302071 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5084,"raft.run_cpu_time_us":10951,"raft.run_wall_time_us":17754,"thread_start_us":958405,"threads_started":1,"wal-append.queue_time_us":955932}
I20260709 13:13:22.255714  2761 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.297436   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:22.263005  2550 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.345422   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1462) took 1835 ms. Trace:
I20260709 13:13:22.352854   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1482) took 2878 ms. Trace:
I20260709 13:13:22.353397   559 rpcz_store.cc:276] 0709 13:13:19.474507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.097812 (+1623305us) service_pool.cc:224] Handling call
0709 13:13:21.127196 (+ 29384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:21.127525 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:21.127572 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:21.128249 (+   677us) log.cc:844] Serialized 26 byte log entry
0709 13:13:22.059619 (+931370us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:22.059658 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.059726 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:22.352605 (+292879us) raft_consensus.cc:1685] finished
0709 13:13:22.352633 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.352784 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":931056,"threads_started":1,"wal-append.queue_time_us":1073043}
I20260709 13:13:22.355957   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:22.357023   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:22.358700   628 raft_consensus.cc:2393] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:22.357787   481 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:22.279074  2713 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.345760  2223 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.366940   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:22.368963   559 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:22.362581  2717 log.cc:927] Time spent T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 2.036s	user 0.011s	sys 0.018s
I20260709 13:13:22.379491  2671 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.379859  2532 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.381533  2713 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.383507   556 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:22.387646   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:22.388473   481 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:22.376475  2465 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:22.376956  2223 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.378681   475 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:13:22.341223  2765 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.409173   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1507) took 3139 ms. Trace:
I20260709 13:13:22.352550   625 rpcz_store.cc:276] 0709 13:13:20.509993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.198283 (+688290us) service_pool.cc:224] Handling call
0709 13:13:21.198590 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.198814 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:21.199120 (+   306us) log.cc:844] Serialized 14 byte log entry
0709 13:13:22.344642 (+1145522us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.344717 (+    75us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:22.344782 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.345207 (+   425us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.345350 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":159,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":81068,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":3318,"thread_start_us":1145071,"threads_started":2,"wal-append.queue_time_us":951818}
I20260709 13:13:22.410166  1172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 325) took 1760 ms. Trace:
I20260709 13:13:22.409571   554 rpcz_store.cc:276] 0709 13:13:19.245743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.767342 (+521599us) service_pool.cc:224] Handling call
0709 13:13:19.769085 (+  1743us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:19.772290 (+  3205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:19.772316 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:19.773444 (+  1128us) log.cc:844] Serialized 26 byte log entry
0709 13:13:20.135220 (+361776us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:20.135290 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.135394 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:22.335830 (+2200436us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:22.384504 (+ 48674us) raft_consensus.cc:1685] finished
0709 13:13:22.384533 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.384810 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2302,"raft.queue_time_us":17976,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":5582,"spinlock_wait_cycles":318799744,"thread_start_us":321585,"threads_started":1,"wal-append.queue_time_us":469034}
I20260709 13:13:22.414121   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:22.399214   559 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:22.366030  2761 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.420078   481 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:13:22.424955  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 284126us
I20260709 13:13:22.427338  1138 leader_election.cc:400] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 5. Current term is 6.
I20260709 13:13:22.429803  1138 leader_election.cc:403] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:22.410773  1172 rpcz_store.cc:276] 0709 13:13:20.649655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.650896 (+  1241us) service_pool.cc:224] Handling call
0709 13:13:20.651172 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:20.651399 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:22.139688 (+1488289us) log.cc:844] Serialized 14 byte log entry
0709 13:13:22.409823 (+270135us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.409870 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:22.409925 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.409981 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.410102 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1451905,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"thread_start_us":1283490,"threads_started":2}
I20260709 13:13:22.425959   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1479) took 2949 ms. Trace:
I20260709 13:13:22.431763   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:22.409055  2715 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.974s	user 0.009s	sys 0.042s
W20260709 13:13:22.436347   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 92803.5us
I20260709 13:13:22.421311  2713 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:22.430569   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 93726us
W20260709 13:13:22.437265   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.432577   559 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:22.438967   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:22.438980   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:22.422955  2523 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:22.439838   559 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:22.435034  2715 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.002s	user 0.009s	sys 0.043s
I20260709 13:13:22.446714   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:22.440902   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:22.447535   626 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:22.427922  2644 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:22.444396   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:22.440742   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 114530us
I20260709 13:13:22.445518   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:22.448500  2644 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.431455  2761 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.449604   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:22.449811   447 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:22.449790  2761 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.450398   633 raft_consensus.cc:2393] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 4: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:22.451109  1138 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:22.452261   625 raft_consensus.cc:2393] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 4: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:22.446728  2671 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.462494   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1489) took 2843 ms. Trace:
I20260709 13:13:22.462821  2671 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.463042   552 rpcz_store.cc:276] 0709 13:13:19.618870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.156370 (+2537500us) service_pool.cc:224] Handling call
0709 13:13:22.156666 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.156912 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:22.203171 (+ 46259us) log.cc:844] Serialized 14 byte log entry
0709 13:13:22.424605 (+221434us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.430695 (+  6090us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:22.434848 (+  4153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.439984 (+  5136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.452037 (+ 12053us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14781,"prepare.queue_time_us":40328,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":520,"spinlock_wait_cycles":11811456,"thread_start_us":164553,"threads_started":1,"wal-append.queue_time_us":189141}
I20260709 13:13:22.465473   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:22.465780  2671 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.466146   552 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
W20260709 13:13:22.467509   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.468416  2765 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:22.468890  2223 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:22.468961  2644 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:22.436698  2605 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:13:22.470593  2771 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:13:22.471535  2761 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.471840  2636 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.474129  2636 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.452176  2465 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.476694  2465 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.478789  2465 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:22.479421  2766 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.479755   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:22.479983  2766 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.480567  2463 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:22.482436   554 raft_consensus.cc:2368] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5.
I20260709 13:13:22.482995   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:22.483901   625 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.487149   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:22.490815   559 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
W20260709 13:13:22.495074   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:22.496312   599 connection.cc:256] RPC call timeout handler was delayed by -1.0536072180000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 13:13:22.497452  2712 log.cc:927] Time spent T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 2.303s	user 0.020s	sys 0.023s
I20260709 13:13:22.517311  2771 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:22.517812  2771 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:22.518201  2771 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:22.497562  2521 raft_consensus.cc:3055] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:22.631703  2521 raft_consensus.cc:740] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:22.633037  2521 consensus_queue.cc:260] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.634639  2521 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:22.493839  2768 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.495223  2785 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.144s
I20260709 13:13:22.635581  2768 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.636631  2605 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 5. Current term is 6.
I20260709 13:13:22.502260  1172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:57004
I20260709 13:13:22.637669  1172 raft_consensus.cc:606] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:22.638016  1172 raft_consensus.cc:614] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:22.638375  2768 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.499671  2783 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:22.639165  2783 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.503358  2766 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:22.504498  2694 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.431860   555 rpcz_store.cc:276] 0709 13:13:19.473626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.648273 (+1174647us) service_pool.cc:224] Handling call
0709 13:13:20.648630 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:20.648880 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:22.139816 (+1490936us) log.cc:844] Serialized 14 byte log entry
0709 13:13:22.422220 (+282404us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.422287 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:22.422364 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.422440 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.422562 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5846,"prepare.queue_time_us":1432224,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":6086,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5914,"thread_start_us":1748069,"threads_started":2}
I20260709 13:13:22.639635  2783 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:22.639941  2694 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.640401   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:22.641077   555 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:22.641990   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:22.441080  2713 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.645179  2713 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:22.509732   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 63419.7us
I20260709 13:13:22.510932  1139 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:22.646148   448 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:22.646490  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 135651us
I20260709 13:13:22.646984   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:22.452054  2523 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.647506  1139 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:22.648074   448 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:22.648656  1139 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:22.648890   448 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:22.649293  2523 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:22.511389   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 61649us
I20260709 13:13:22.649946  2523 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:22.650604  2523 raft_consensus.cc:697] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:22.650758  2646 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:22.513948   625 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
W20260709 13:13:22.514786   599 connection.cc:256] RPC call timeout handler was delayed by -1.0415099300000747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
W20260709 13:13:22.540426   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.635416   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:22.512553   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.512477   482 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:22.651676  1139 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:22.670168   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:22.670760   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.643081   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:22.713738   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:22.714298   555 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:22.716401   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 65406.4us
I20260709 13:13:22.717451   447 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:22.719403  2757 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:22.736835  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:22.737900  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:22.738564  1174 raft_consensus.cc:2393] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:22.741281   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1474) took 3269 ms. Trace:
I20260709 13:13:22.741662   557 rpcz_store.cc:276] 0709 13:13:19.472222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.480298 (+1008076us) service_pool.cc:224] Handling call
0709 13:13:20.480630 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:20.613848 (+133218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.741007 (+2127159us) spinlock_profiling.cc:243] Waited 82.5 ms on lock 0x7b5400228654. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:22.741216 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189744384}
I20260709 13:13:22.721117  2605 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:22.756062   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:22.757054   557 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:22.669282  2764 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:22.720989   552 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:22.735443  2768 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.748049  2500 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:13:22.771749  2726 log.cc:927] Time spent T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 2.325s	user 0.019s	sys 0.037s
I20260709 13:13:22.774006   523 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:22.774778   558 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1498) took 3545 ms (client timeout 2073 ms). Trace:
W20260709 13:13:22.775175   558 rpcz_store.cc:269] 0709 13:13:19.229667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.270062 (+ 40395us) service_pool.cc:224] Handling call
0709 13:13:22.774534 (+3504472us) spinlock_profiling.cc:243] Waited 2.86 s on lock 0x7b54001d6854. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:22.774691 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6586139904}
I20260709 13:13:22.775743   448 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:22.776288   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:22.776886   558 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:22.777020  2532 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.777498  2532 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.777736   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:22.778318   558 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:22.780320  2411 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:22.780594   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:22.781198   559 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:22.781975   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:22.782866   553 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:13:22.783218   553 pending_rounds.cc:85] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 1
I20260709 13:13:22.783430  2523 consensus_queue.cc:237] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.785079  2792 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:22.785557  2792 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:22.785928  2792 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.783465   553 pending_rounds.cc:107] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:13:22.788724   553 raft_consensus.cc:2889] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:22.735646  2671 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:22.712852  2711 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:22.674126  2646 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:22.721150  2785 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:13:22.790566  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:22.759588  2715 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:22.747924  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:22.751683  2362 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:22.779222   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:22.792574  2631 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.739545  2653 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:13:22.804692  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:22.769625  2761 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:22.809902  2792 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.810174  2771 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.810732   557 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:22.761750   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 255) took 3259 ms. Trace:
I20260709 13:13:22.795594  2711 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.759099   522 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:22.820410   558 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:22.839839  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:22.840888   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:22.841157   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:22.841639   558 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:22.842794  2711 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:22.845957   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:22.831096  2362 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.849854  2362 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.838147   484 rpcz_store.cc:276] 0709 13:13:19.493870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.734009 (+240139us) service_pool.cc:224] Handling call
0709 13:13:19.734357 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:19.761304 (+ 26947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:19.761342 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:19.767214 (+  5872us) log.cc:844] Serialized 26 byte log entry
0709 13:13:20.023276 (+256062us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:20.023341 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.023450 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:22.496867 (+2473417us) spinlock_profiling.cc:243] Waited 7.87 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:22.667886 (+171019us) raft_consensus.cc:1685] finished
0709 13:13:22.667923 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.752955 (+ 85032us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20923,"raft.queue_time_us":26789,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":3562,"spinlock_wait_cycles":18103680,"thread_start_us":235637,"threads_started":1,"wal-append.queue_time_us":383603}
I20260709 13:13:22.798811  2671 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:22.853129   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 94159.2us
I20260709 13:13:22.854774  1139 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:22.856284  1139 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:22.857611  1139 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:22.830193   555 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
W20260709 13:13:22.816184  2788 log.cc:927] Time spent T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:13:22.789111  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:22.806638  2411 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:22.797487  2646 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.872844  1172 raft_consensus.cc:3055] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:22.876106  1172 raft_consensus.cc:740] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:22.836966  1167 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:22.866619  2362 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:22.837595  2761 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.881665   559 raft_consensus.cc:2410] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:22.867457  2785 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:22.883952   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:22.884464   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:22.885053   481 raft_consensus.cc:2410] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:22.866434  2764 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:22.877216  1172 consensus_queue.cc:260] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.929352   523 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:22.930333  1172 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.930619   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59108 (request call id 80) took 3037 ms. Trace:
W20260709 13:13:22.933826   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 47794.5us
I20260709 13:13:22.933845   555 rpcz_store.cc:276] 0709 13:13:19.848534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.872854 (+3024320us) service_pool.cc:224] Handling call
0709 13:13:22.886029 (+ 13175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:22.935627   555 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:13:22.936164   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1495) took 3080 ms. Trace:
I20260709 13:13:22.936455   555 rpcz_store.cc:276] 0709 13:13:19.855858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.935064 (+3079206us) service_pool.cc:224] Handling call
0709 13:13:22.935408 (+   344us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:22.935943 (+   535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.936119 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:22.937657   555 raft_consensus.cc:1240] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:22.938308   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1518) took 3057 ms. Trace:
I20260709 13:13:22.938614   555 rpcz_store.cc:276] 0709 13:13:19.880792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.937165 (+3056373us) service_pool.cc:224] Handling call
0709 13:13:22.937445 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.938096 (+   651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.938249 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:22.940356   555 raft_consensus.cc:1275] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:22.940841   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1519) took 2694 ms. Trace:
I20260709 13:13:22.941124   555 rpcz_store.cc:276] 0709 13:13:20.246196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.939791 (+2693595us) service_pool.cc:224] Handling call
0709 13:13:22.940038 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.940654 (+   616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.940796 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:22.878892  2757 raft_consensus.cc:697] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:22.882845  2362 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:22.945017  2362 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:22.946379   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:22.947890   476 raft_consensus.cc:1275] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:22.886103  2785 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:22.882767  2767 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:22.930621  2411 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:22.931815  2764 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:22.879948  2711 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.948400  2635 raft_consensus.cc:2804] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:22.966691  2635 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:22.967149  2635 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.968257  2792 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.958868  2767 raft_consensus.cc:697] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:22.969301   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1490) took 3257 ms. Trace:
I20260709 13:13:22.969973  2767 consensus_queue.cc:237] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:22.971822  2621 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.973531  2761 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.974769  2671 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.971782  2771 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.969656   550 rpcz_store.cc:276] 0709 13:13:19.712114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.190877 (+2478763us) service_pool.cc:224] Handling call
0709 13:13:22.191175 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.263058 (+ 71883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.969070 (+706012us) spinlock_profiling.cc:243] Waited 68.8 ms on lock 0x7b54001d6d54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:22.969236 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158213888}
I20260709 13:13:22.968173   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:22.978457   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:22.948910  2532 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.979009   483 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 3.
I20260709 13:13:22.980432   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:22.952783  2785 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:22.980633  2711 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:22.986181   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:22.983645  2411 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.991045  2411 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:22.992759   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1475) took 1808 ms. Trace:
I20260709 13:13:22.993166   477 rpcz_store.cc:276] 0709 13:13:21.184131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.184268 (+   137us) service_pool.cc:224] Handling call
0709 13:13:21.193951 (+  9683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.286232 (+1092281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.992505 (+706273us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540020dfd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:22.992698 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2476293376}
I20260709 13:13:22.993969   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1491) took 3281 ms. Trace:
I20260709 13:13:22.994349   557 rpcz_store.cc:276] 0709 13:13:19.712469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.846962 (+3134493us) service_pool.cc:224] Handling call
0709 13:13:22.851323 (+  4361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:22.854312 (+  2989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:22.854342 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:22.874034 (+ 19692us) log.cc:844] Serialized 26 byte log entry
0709 13:13:22.949941 (+ 75907us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:22.949990 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.950053 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:22.993780 (+ 43727us) raft_consensus.cc:1685] finished
0709 13:13:22.993800 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.993917 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1025,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":13410,"thread_start_us":63847,"threads_started":1,"wal-append.queue_time_us":97087}
W20260709 13:13:22.987480  2791 log.cc:927] Time spent T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.054s	user 0.000s	sys 0.002s
I20260709 13:13:22.999226   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:22.999858   481 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:22.983948  2764 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:22.960471  2757 consensus_queue.cc:237] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:22.950155  2783 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:23.046000  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.006130  1172 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:13:23.106390  1172 pending_rounds.cc:85] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683: Aborting all ops after (but not including) 4
I20260709 13:13:23.099884   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:23.106766  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.107687   625 raft_consensus.cc:2410] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:23.106771  1172 pending_rounds.cc:107] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:13:23.101126   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:23.108388  1172 raft_consensus.cc:2889] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:23.103018   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:23.108944  1172 pending_rounds.cc:107] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:13:23.109320  1172 raft_consensus.cc:2889] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:23.092931   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 440397us
I20260709 13:13:23.109263   626 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:23.103891   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.114332   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:23.115181   624 raft_consensus.cc:2410] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:23.116011   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:23.116586   624 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:23.117424   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:23.117661   625 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:23.118289   477 raft_consensus.cc:2410] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:23.123517   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:23.139084   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:23.143200   477 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:23.138593   480 raft_consensus.cc:1275] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:23.145628   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1482) took 1642 ms. Trace:
I20260709 13:13:23.146019   480 rpcz_store.cc:276] 0709 13:13:21.503282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.113569 (+1610287us) service_pool.cc:224] Handling call
0709 13:13:23.138276 (+ 24707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:23.145395 (+  7119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.145573 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:23.148854   481 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:23.155097   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:23.155778   481 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
W20260709 13:13:23.132870  2754 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
W20260709 13:13:23.157727   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 46231.4us
W20260709 13:13:23.163905   378 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46024 (request call id 250) took 11829 ms (client timeout 15000 ms). Trace:
I20260709 13:13:23.164418  2700 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:23.166036  2768 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.168078   522 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:23.164376   378 rpcz_store.cc:269] 0709 13:13:11.334177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.336202 (+  2025us) service_pool.cc:224] Handling call
0709 13:13:23.163817 (+11827615us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:18.851863 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:19.003296 (+151433us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:19.003362 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:13:19.003379 (+    17us) tablet.cc:662] Decoding operations
0709 13:13:19.123868 (+120489us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:19.123964 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:19.123995 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:13:19.412683 (+288688us) tablet.cc:701] Row locks acquired
0709 13:13:19.412736 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:13:19.412906 (+   170us) write_op.cc:270] Start()
0709 13:13:19.413069 (+   163us) write_op.cc:276] Timestamp: P: 1783602799412843 usec, L: 0
0709 13:13:19.413116 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:13:19.413936 (+   820us) log.cc:844] Serialized 5056 byte log entry
0709 13:13:20.130159 (+716223us) op_driver.cc:464] REPLICATION: finished
0709 13:13:20.434865 (+304706us) write_op.cc:301] APPLY: starting
0709 13:13:20.454103 (+ 19238us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:20.483640 (+ 29537us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:20.483773 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:20.535882 (+ 52109us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:20.536190 (+   308us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:13:20.536240 (+    50us) write_op.cc:312] APPLY: finished
0709 13:13:20.536754 (+   514us) log.cc:844] Serialized 89 byte log entry
0709 13:13:20.536936 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:20.537060 (+   124us) write_op.cc:454] Released schema lock
0709 13:13:20.537112 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:20.545163 (+  8051us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:20.545193 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18066,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":273718,"apply.run_cpu_time_us":4572,"apply.run_wall_time_us":124024,"num_ops":12,"prepare.queue_time_us":287655,"prepare.run_cpu_time_us":22706,"prepare.run_wall_time_us":754926,"raft.queue_time_us":230895,"raft.run_cpu_time_us":17172,"raft.run_wall_time_us":324212,"replication_time_us":640735,"thread_start_us":483617,"threads_started":4,"wal-append.queue_time_us":178945,"wal-append.run_cpu_time_us":21081,"wal-append.run_wall_time_us":1964972}]]}
I20260709 13:13:23.126892  2714 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:13:23.177034  2714 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:23.177438  2714 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.177767  2714 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:23.182476  2411 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.182773   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:23.183017  2411 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:23.183636   480 raft_consensus.cc:2410] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:23.158213   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1333) took 2546 ms. Trace:
I20260709 13:13:23.184764   631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:23.185426   631 raft_consensus.cc:606] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:23.185830   631 raft_consensus.cc:614] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:23.186570  2462 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:23.187079  2462 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:23.176654  2646 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:23.143200  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:23.150702   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1484) took 3551 ms. Trace:
I20260709 13:13:23.206717   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:23.207392   481 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:23.207448   522 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:23.208876   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 46369.1us
W20260709 13:13:23.169708   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.243178   626 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:23.274039   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:23.274910   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:23.285578   626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:23.286137   626 raft_consensus.cc:606] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:23.273185   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:23.288834   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:23.289609   483 raft_consensus.cc:2393] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 5: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
W20260709 13:13:23.260541   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:23.283591   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 48441.5us
I20260709 13:13:23.287539   525 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:23.298128   525 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:23.299093   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:23.272342  2411 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:23.281494   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:23.245404  2700 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.252548   522 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:23.305171   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.283072  2462 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:23.280422   552 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:23.320961   554 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:23.298521  1166 raft_consensus.cc:2393] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:23.284458  2657 consensus_queue.cc:1059] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:13:23.330597  2657 raft_consensus.cc:3055] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:23.273933  2785 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:23.324393   599 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:23.337431   599 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:23.338290   626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:23.338871   626 raft_consensus.cc:606] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:23.184731   627 rpcz_store.cc:276] 0709 13:13:20.612241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.214290 (+602049us) service_pool.cc:224] Handling call
0709 13:13:21.214650 (+   360us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:21.400145 (+185495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:21.432190 (+ 32045us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:21.502465 (+ 70275us) log.cc:844] Serialized 52 byte log entry
0709 13:13:22.773024 (+1270559us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b18003ab8e0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb90d1 00007f4b683d4a0f
0709 13:13:22.930290 (+157266us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:22.933917 (+  3627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.944364 (+ 10447us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:23.127268 (+182904us) raft_consensus.cc:1685] finished
0709 13:13:23.127293 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.155389 (+ 28096us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3525,"raft.queue_time_us":50130,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":62974,"spinlock_wait_cycles":27398016,"thread_start_us":108177,"threads_started":1,"wal-append.queue_time_us":1497268}
I20260709 13:13:23.327811   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 196) took 2730 ms. Trace:
I20260709 13:13:23.346889   599 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:23.328262  2766 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:23.324553  2411 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.330984  2657 raft_consensus.cc:740] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:23.244939  2767 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:13:23.349574   631 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:23.346535   557 rpcz_store.cc:276] 0709 13:13:20.597100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.995788 (+2398688us) service_pool.cc:224] Handling call
0709 13:13:22.996114 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:22.996603 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:22.996632 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:22.997622 (+   990us) log.cc:844] Serialized 26 byte log entry
0709 13:13:23.134914 (+137292us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:23.134969 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.135070 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:23.327606 (+192536us) raft_consensus.cc:1685] finished
0709 13:13:23.327629 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.327751 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5494,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":101006,"thread_start_us":136832,"threads_started":1,"wal-append.queue_time_us":289276}
I20260709 13:13:23.351497   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:23.360183   480 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:23.288689  2729 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:13:23.208973   551 rpcz_store.cc:276] 0709 13:13:19.597293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.150588 (+2553295us) service_pool.cc:224] Handling call
0709 13:13:22.192574 (+ 41986us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:22.441311 (+248737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:22.444643 (+  3332us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:22.445644 (+  1001us) log.cc:844] Serialized 26 byte log entry
0709 13:13:22.830895 (+385251us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:22.830951 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.832516 (+  1565us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:23.126976 (+294460us) raft_consensus.cc:1685] finished
0709 13:13:23.126995 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.148271 (+ 21276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1583,"raft.queue_time_us":44309,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":672,"thread_start_us":601112,"threads_started":2,"wal-append.queue_time_us":430228}
I20260709 13:13:23.303956  2671 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.277661  2635 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:23.380180   557 raft_consensus.cc:1240] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:23.380986   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1500) took 2499 ms. Trace:
I20260709 13:13:23.381316   557 rpcz_store.cc:276] 0709 13:13:20.882041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.359906 (+2477865us) service_pool.cc:224] Handling call
0709 13:13:23.379993 (+ 20087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:23.380735 (+   742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.380929 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:23.356137   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:23.382493   626 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:23.301777  2753 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:13:23.391675   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:23.398128  2801 log.cc:927] Time spent T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:13:23.398524   627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:23.399181   627 raft_consensus.cc:606] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:23.399657   627 raft_consensus.cc:614] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:23.399976   626 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:23.401057  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:23.401508   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:23.401669  1167 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:23.402686 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:23.404493 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:23.404877   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:23.406224   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:23.398530  2635 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:23.410195   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:23.410857   627 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:23.414227  1167 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:23.417665  2657 consensus_queue.cc:260] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:23.419117  2657 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:23.421761  2550 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:23.437328   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:23.438717   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:23.439549   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:23.439826  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:23.440442   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:23.440884  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:23.439926   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:23.442410   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:23.444147   479 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1488) took 1331 ms (client timeout 1553 ms). Trace:
W20260709 13:13:23.444612   479 rpcz_store.cc:269] 0709 13:13:22.114018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.150718 (+ 36700us) service_pool.cc:224] Handling call
0709 13:13:23.443976 (+1293258us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b54000d70d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:23.444085 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10530048}
I20260709 13:13:23.446260   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:23.446923   558 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:23.447810   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:23.448325   558 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:23.452404   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:23.453158   559 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:23.454140   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:23.454793   559 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:23.455832   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:23.456547   484 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:13:23.457283  2764 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:23.459745   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1492) took 3747 ms. Trace:
W20260709 13:13:23.460280  2362 consensus_meta.cc:287] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.000s
I20260709 13:13:23.460877  2362 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:23.462893   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:23.463799   631 raft_consensus.cc:2368] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5.
I20260709 13:13:23.464681   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:23.465227   631 raft_consensus.cc:2376] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6. Re-sending same reply.
I20260709 13:13:23.466007   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:23.466336   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1526) took 1262 ms. Trace:
I20260709 13:13:23.467525   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:23.468575  2362 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:23.471736   628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1334) took 2859 ms (client timeout 1603 ms). Trace:
W20260709 13:13:23.472287   628 rpcz_store.cc:269] 0709 13:13:20.612474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.793763 (+181289us) service_pool.cc:224] Handling call
0709 13:13:23.471464 (+2677701us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54000528d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:23.471626 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2798847360}
W20260709 13:13:23.473214   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.473645   630 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:13:23.473723  2694 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:23.473977   625 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:23.353559  2223 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:23.353705  2462 raft_consensus.cc:2764] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:13:23.459978  2751 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.353253  2670 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.475965   448 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:23.478564   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:23.479358   523 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:23.432809   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1521) took 3186 ms. Trace:
W20260709 13:13:23.504606   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 206596us
I20260709 13:13:23.504794   550 rpcz_store.cc:276] 0709 13:13:20.246832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.976793 (+2729961us) service_pool.cc:224] Handling call
0709 13:13:22.977064 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.997575 (+ 20511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:22.997605 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.997645 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:22.997688 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.432540 (+434852us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b540002a3d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:23.432588 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.432711 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46695680}
I20260709 13:13:23.505659   525 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:23.424582   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1505) took 4179 ms. Trace:
W20260709 13:13:23.481987   599 connection.cc:256] RPC call timeout handler was delayed by -1.1166279139999915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
W20260709 13:13:23.507076   599 connection.cc:256] RPC call timeout handler was delayed by -1.11026590199981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2256s for a response
W20260709 13:13:23.507715   599 leader_election.cc:336] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.553s (SENT)
I20260709 13:13:23.486666   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:23.460215   554 rpcz_store.cc:276] 0709 13:13:19.712773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.848728 (+3135955us) service_pool.cc:224] Handling call
0709 13:13:23.320612 (+471884us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:23.321531 (+   919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.459550 (+138019us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b540034d850. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:23.459684 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084188928}
I20260709 13:13:23.510107   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:23.356272  2714 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:23.506997   553 rpcz_store.cc:276] 0709 13:13:19.245165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.565398 (+320233us) service_pool.cc:224] Handling call
0709 13:13:22.782523 (+3217125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.795326 (+ 12803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.424346 (+629020us) spinlock_profiling.cc:243] Waited 3.22 s on lock 0x7b54001d6850. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:23.424493 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7397832576}
I20260709 13:13:23.512799   525 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:23.491552   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.495204  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:23.379740  2700 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:23.379248  2465 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:23.399675  2800 log.cc:927] Time spent T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:13:23.524130   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:23.524940   554 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:23.512933   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:23.527729   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:23.506456   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:23.529599   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:23.530356   550 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:23.531738   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 279319us
I20260709 13:13:23.498912  2751 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:23.516512  1171 raft_consensus.cc:2393] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 6: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
W20260709 13:13:23.520402   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 44513.1us
I20260709 13:13:23.538714   448 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:23.520512   525 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:23.522336   597 connection.cc:256] RPC call timeout handler was delayed by -1.5636902470000678s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
I20260709 13:13:23.497566  1168 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
W20260709 13:13:23.533998   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.514712  2635 raft_consensus.cc:2804] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:13:23.514721  1141 connection.cc:256] RPC call timeout handler was delayed by -1.0099748509999245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
I20260709 13:13:23.489372   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:23.541186  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.496047  2771 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.543103   525 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:23.544324   558 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:23.546502  2736 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:23.534494   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:23.535015  2550 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:23.552271   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:23.516139  2631 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:23.518463  2785 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:23.466833   551 rpcz_store.cc:276] 0709 13:13:22.203690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.465388 (+1261698us) service_pool.cc:224] Handling call
0709 13:13:23.465740 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:23.465961 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:23.465992 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:23.466044 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:23.466084 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.466155 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.466275 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:23.559818   525 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:23.560321   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:23.561314   559 raft_consensus.cc:2393] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 5: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:23.551491   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:23.594157   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:23.563524   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:23.595686   626 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:23.554610   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:23.566450  2804 log.cc:927] Time spent T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 13:13:23.606153   558 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:23.521572  2763 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:23.531497  2462 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:23.531569  2605 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:23.532845  2465 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:23.583470   554 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:23.517189  2762 consensus_queue.cc:1048] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:13:23.554301  2411 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:23.558969  2757 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:23.605643   553 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:23.572980   631 raft_consensus.cc:2393] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 4: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:23.610940   626 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:23.621824   550 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:23.536820  2362 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.622464   559 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:23.558355  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:23.552981  2764 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:23.562103  2729 consensus_queue.cc:1048] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:13:23.629992   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1520) took 3383 ms. Trace:
I20260709 13:13:23.672320   555 rpcz_store.cc:276] 0709 13:13:20.246478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.941780 (+2695302us) service_pool.cc:224] Handling call
0709 13:13:22.942052 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:22.949655 (+  7603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:22.949900 (+   245us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:22.950331 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:13:23.149432 (+199101us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:23.149471 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.149536 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:23.629735 (+480199us) raft_consensus.cc:1685] finished
0709 13:13:23.629756 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.629923 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":430,"raft.queue_time_us":8795,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":85,"thread_start_us":185947,"threads_started":1,"wal-append.queue_time_us":206762}
I20260709 13:13:23.574723  2646 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:23.575028  2621 consensus_queue.cc:1059] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:13:23.562840  2694 consensus_queue.cc:1059] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:13:23.619637   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:23.593294  2550 raft_consensus.cc:697] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:13:23.650233   556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1528) took 1446 ms (client timeout 1659 ms). Trace:
W20260709 13:13:23.709779   556 rpcz_store.cc:269] 0709 13:13:22.204157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.344555 (+140398us) service_pool.cc:224] Handling call
0709 13:13:23.650016 (+1305461us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b54001f27d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:23.650156 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61507328}
I20260709 13:13:23.626020  2763 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:23.658612  1173 raft_consensus.cc:1240] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:13:23.663702  2803 log.cc:927] Time spent T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.306s	user 0.003s	sys 0.000s
I20260709 13:13:23.637013  2411 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:23.630775  2631 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:23.647078  1138 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:23.670229   484 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:23.573850  2771 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:23.592516  2657 consensus_queue.cc:1059] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:13:23.575347  2736 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:23.630345  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:23.679559   558 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:23.730847   558 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:13:23.636135  2757 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:23.734464  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:23.690244   555 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:13:23.626219  2462 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:23.650213   550 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:23.745709   550 raft_consensus.cc:1240] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:13:23.629328  2605 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:23.749130   558 raft_consensus.cc:1240] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:23.749850   555 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:23.718950   556 raft_consensus.cc:1275] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
W20260709 13:13:23.726926  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 79976.7us
I20260709 13:13:23.700722   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:23.731833   554 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:23.725309  2411 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:23.684407  2362 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:23.732758  2809 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:23.744500  2757 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:23.770212   624 raft_consensus.cc:2410] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:23.776046  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:23.733386  2764 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:13:23.778997   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 270408us
W20260709 13:13:23.781258   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 236972us
I20260709 13:13:23.767058  2714 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:23.796803  1141 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:23.805408   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:23.807876   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:23.809857  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:23.812453   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 273782us
I20260709 13:13:23.777761   551 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:23.814296   448 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:23.816473   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:23.817054   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.820703   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:23.821513   480 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:23.822691  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:23.791419  2808 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:23.837461   632 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:23.790493  2751 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:23.843988   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:23.815105  2700 raft_consensus.cc:697] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:23.785310  1170 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:23.851001   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:23.851599   483 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:23.846499   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 286749us
I20260709 13:13:23.854892   525 leader_election.cc:304] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:23.840322  2808 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:23.850514  2694 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.845899  2785 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:23.817787  2521 consensus_queue.cc:1048] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
W20260709 13:13:23.878079  2812 log.cc:927] Time spent T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:13:23.878535  2771 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:23.785398  2550 consensus_queue.cc:237] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:23.849527  2658 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:23.880029  2605 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:23.881659  2811 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:13:23.818364  2646 consensus_queue.cc:1059] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:13:23.894412   483 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:23.856747   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:23.887125   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:23.896454   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 320170us
I20260709 13:13:23.897763   633 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:23.899119  1138 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:23.909338   597 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:23.911859   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:23.912539   478 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
W20260709 13:13:23.913111   478 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1493) took 1740 ms (client timeout 2047 ms). Trace:
W20260709 13:13:23.913544   478 rpcz_store.cc:269] 0709 13:13:22.172748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.287069 (+114321us) service_pool.cc:224] Handling call
0709 13:13:23.911712 (+1624643us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:23.913046 (+  1334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24475392}
I20260709 13:13:23.873241  2635 raft_consensus.cc:697] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:23.914731  2184 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:23.916182  2184 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:23.916018  2635 consensus_queue.cc:237] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:23.916589  2184 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:23.917038  2817 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.917518  2817 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:23.918977  2711 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:23.919540   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.919479  2823 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:23.919795  2809 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:23.920390  2809 raft_consensus.cc:697] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:23.921208  2809 consensus_queue.cc:237] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:23.922930  2646 raft_consensus.cc:3055] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:23.889848  2808 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:23.926772   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 108566us
I20260709 13:13:23.928748  2538 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:23.928889   597 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:23.929219  2538 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.929728  2538 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:23.929836   597 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:23.930794  2249 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:23.931416  2534 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:23.931488  2657 consensus_queue.cc:1059] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:23.931926  2534 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:23.932323  2534 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:23.932571  2657 raft_consensus.cc:3055] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:23.932927  2657 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:23.933791  2657 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:23.931162  2249 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.936354  2249 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:23.937562   597 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:23.937896   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1545) took 1148 ms. Trace:
I20260709 13:13:23.938232   559 rpcz_store.cc:276] 0709 13:13:22.789486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.668021 (+878535us) service_pool.cc:224] Handling call
0709 13:13:23.668339 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:23.668530 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:23.892396 (+223866us) log.cc:844] Serialized 14 byte log entry
0709 13:13:23.937586 (+ 45190us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:23.937637 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:23.937678 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.937740 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.937843 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":225453,"threads_started":2}
I20260709 13:13:23.974727   553 raft_consensus.cc:1240] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:23.975339  2764 raft_consensus.cc:697] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
W20260709 13:13:23.977838  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 180931us
W20260709 13:13:23.980233   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 51248.1us
I20260709 13:13:23.909253  2631 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:23.988926   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.926275  2646 raft_consensus.cc:740] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:23.893759  2694 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:24.024585  2736 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:23.919487  2711 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:24.057999  2820 log.cc:927] Time spent T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:13:23.978607  2763 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:23.907931  2658 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:23.984572  2657 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:23.924973  2661 consensus_queue.cc:1059] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 13:13:23.924697   475 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:23.911801  2816 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:24.116849   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:24.152297   632 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:24.123023   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:24.153523   483 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:24.123297   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:24.049664  2812 log.cc:927] Time spent T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:13:24.048609  2817 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:24.128610  1141 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:24.147442   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:23.989888  2751 consensus_queue.cc:1059] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.140s
I20260709 13:13:24.156072   522 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:24.128074   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:23.948895  2700 consensus_queue.cc:237] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:24.128268  2605 consensus_queue.cc:1059] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:13:24.168743  1141 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:24.181048   366 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4e472c1c82c9467a9a5563d6b06e3b53 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6ba2a9c02b534120bbf26e56a1e920ca is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:24.149469  2362 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:24.120438  2631 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:24.162586  2819 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.208230  1141 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:24.197718   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 258652us
W20260709 13:13:24.201735   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 216136us
I20260709 13:13:24.167598  2521 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:13:24.210446   448 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:24.217419   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 362602us
I20260709 13:13:24.174906  2462 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:24.229419   525 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:24.179615  2816 raft_consensus.cc:697] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:24.236268   525 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:24.238720   525 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:24.215821  2635 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:24.189520  2837 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:24.230165  2768 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:24.229923  2833 raft_consensus.cc:2749] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:24.272881   525 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:24.273509   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 63106.7us
I20260709 13:13:24.242043  2763 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:24.274744   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:24.261631  2635 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:24.302701   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.265129  2821 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:24.272058  2768 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:24.271054  2818 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:24.297791   525 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:24.231958  2829 consensus_queue.cc:1048] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:13:24.185175  2646 consensus_queue.cc:260] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:24.216382  2764 consensus_queue.cc:237] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:24.265755  2462 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:13:24.285472  2763 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:13:24.345145   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 134762us
I20260709 13:13:24.300100  2817 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:24.286219  2827 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:24.232019  2819 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:24.346599   448 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:24.302960  2854 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:24.405442 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:24.409102   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:24.413951   550 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:13:24.361234   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 63512.6us
W20260709 13:13:24.371840  2843 log.cc:927] Time spent T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:13:24.372318  2082 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:24.374145  2538 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:24.375075  2711 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:24.375798  2822 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
W20260709 13:13:24.375900  1166 consensus_meta.cc:287] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.668s	user 0.012s	sys 0.003s
W20260709 13:13:24.379630  2826 log.cc:927] Time spent T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.251s	user 0.001s	sys 0.001s
I20260709 13:13:24.380236  2658 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:24.380791   478 raft_consensus.cc:1240] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:24.378412  2694 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:24.384105   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1543) took 1595 ms. Trace:
W20260709 13:13:24.386183   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 111529us
I20260709 13:13:24.298825   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 197) took 3701 ms. Trace:
I20260709 13:13:24.428928   525 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:24.314884  2768 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:24.305050  2635 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:24.337796  2521 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:13:24.485069   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 178320us
W20260709 13:13:24.455178  2757 consensus_meta.cc:287] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.656s	user 0.012s	sys 0.000s
I20260709 13:13:24.487040  2605 consensus_queue.cc:1243] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:13:24.453992  2827 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:24.357833  2763 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:24.273138  2837 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:24.457214   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.363183  2817 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:24.466637   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:24.473748   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 47553.1us
I20260709 13:13:24.461556   557 rpcz_store.cc:276] 0709 13:13:22.789020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.660089 (+871069us) service_pool.cc:224] Handling call
0709 13:13:23.660546 (+   457us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:23.661112 (+   566us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:23.895825 (+234713us) log.cc:844] Serialized 14 byte log entry
0709 13:13:24.159124 (+263299us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:24.173957 (+ 14833us) log.cc:844] Serialized 52 byte log entry
0709 13:13:24.174128 (+   171us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:24.174167 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.174238 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:24.383884 (+209646us) raft_consensus.cc:1685] finished
0709 13:13:24.383904 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.384048 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1345,"prepare.queue_time_us":480124,"prepare.run_wall_time_us":8259,"raft.queue_time_us":150660,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":19252,"spinlock_wait_cycles":28594944,"thread_start_us":467778,"threads_started":2,"wal-append.queue_time_us":462596}
I20260709 13:13:24.475063  2711 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:24.507726   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:24.508406   557 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
W20260709 13:13:24.446565  2411 consensus_meta.cc:287] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.660s	user 0.015s	sys 0.001s
W20260709 13:13:24.448069  2184 consensus_meta.cc:287] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.531s	user 0.013s	sys 0.006s
W20260709 13:13:24.448900  2534 consensus_meta.cc:287] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.506s	user 0.005s	sys 0.013s
I20260709 13:13:24.316844  2818 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.453284  2646 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:24.496693   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 67862.4us
I20260709 13:13:24.445861  1166 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:24.507390   556 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:24.514969   597 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:24.572973   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 58092.7us
I20260709 13:13:24.496665  2082 raft_consensus.cc:697] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:24.497273  2757 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:24.519796   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:24.577088   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:24.582597   557 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:24.584519   597 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:24.500133  2605 consensus_queue.cc:1059] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:13:24.611810  2605 raft_consensus.cc:3055] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:24.612185  2605 raft_consensus.cc:740] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:24.613014  2605 consensus_queue.cc:260] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:24.614187  2605 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:24.503172  2470 consensus_queue.cc:1059] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:13:24.589498   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:24.590531   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:24.592689   484 raft_consensus.cc:1240] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:24.392846  2816 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:24.439815  2854 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:24.605221  2840 log.cc:927] Time spent T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:13:24.606103  1167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 507) took 1169 ms. Trace:
I20260709 13:13:24.606415  2661 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:24.606585  2837 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:24.605235  2082 consensus_queue.cc:237] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:24.607483  2819 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:24.488986  2521 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:24.511541  2817 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:24.505983   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:24.621008   557 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:24.607476  2867 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:24.510756  2462 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:24.551453  2856 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:24.519891  2631 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:24.545423  2821 raft_consensus.cc:697] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:24.578913  2818 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:24.577044  2842 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.585645  1166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 508) took 1148 ms. Trace:
I20260709 13:13:24.545011  2534 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:24.519333  2411 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:24.615729  2857 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.551638  2184 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:24.519279  2855 consensus_queue.cc:1048] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.164s
I20260709 13:13:24.760368  1171 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:13:24.668517   597 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:24.765071  1171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 516) took 1216 ms. Trace:
I20260709 13:13:24.644606  2661 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.765781  1171 rpcz_store.cc:276] 0709 13:13:23.548867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.548993 (+   126us) service_pool.cc:224] Handling call
0709 13:13:24.758747 (+1209754us) spinlock_profiling.cc:243] Waited 9.29 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:24.758945 (+   198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:24.762954 (+  4009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.765007 (+  2053us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21373312}
I20260709 13:13:24.656266  2809 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:24.758524  2249 consensus_meta.cc:287] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.822s	user 0.006s	sys 0.005s
I20260709 13:13:24.779843  2249 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:24.782205  2249 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:24.780897   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 282134us
I20260709 13:13:24.655934  2867 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:24.779132  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:24.783564   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 115138us
I20260709 13:13:24.731920  2538 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:24.754153  2550 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:24.772765  2661 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:24.740355   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:24.788275  1171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 391) took 1193 ms. Trace:
I20260709 13:13:24.764922  2857 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:24.726878  2635 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:24.793917   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 174947us
I20260709 13:13:24.759303  2865 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:24.760697  1166 rpcz_store.cc:276] 0709 13:13:23.437284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.499757 (+ 62473us) service_pool.cc:224] Handling call
0709 13:13:24.580686 (+1080929us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792}
I20260709 13:13:24.769172  2757 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:24.808015  1171 rpcz_store.cc:276] 0709 13:13:23.595146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.778854 (+1183708us) service_pool.cc:224] Handling call
0709 13:13:24.788212 (+  9358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:24.720266  2711 raft_consensus.cc:697] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:24.825408  2711 consensus_queue.cc:237] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:24.826663  2635 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:24.660380  2462 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.827566  2462 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:24.827976  2876 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:24.465605   552 rpcz_store.cc:276] 0709 13:13:20.597463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.333461 (+2735998us) service_pool.cc:224] Handling call
0709 13:13:23.333825 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:23.334097 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:23.334129 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:23.334620 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:13:23.566425 (+231805us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:23.572042 (+  5617us) log.cc:844] Serialized 14 byte log entry
0709 13:13:23.627126 (+ 55084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.636471 (+  9345us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:24.289394 (+652923us) raft_consensus.cc:1685] finished
0709 13:13:24.292212 (+  2818us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.298760 (+  6548us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2284,"prepare.queue_time_us":161,"prepare.run_wall_time_us":49,"raft.queue_time_us":165751,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":6569,"spinlock_wait_cycles":7409024,"thread_start_us":231394,"threads_started":1,"wal-append.queue_time_us":393052}
I20260709 13:13:24.830073   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:24.820839   448 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:24.832486  2465 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:24.833839  2876 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:24.834265  2876 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.834581  2876 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:24.837110  2808 consensus_meta.cc:287] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.856s	user 0.010s	sys 0.000s
I20260709 13:13:24.837566  2808 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:24.838192  2817 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:24.825306  2865 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:24.839224   556 raft_consensus.cc:1240] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:24.841291  2865 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:24.842934   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:24.846127  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:24.846930  1166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 393) took 1194 ms. Trace:
I20260709 13:13:24.644409  1167 rpcz_store.cc:276] 0709 13:13:23.437010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.541351 (+104341us) service_pool.cc:224] Handling call
0709 13:13:23.605423 (+ 64072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:23.753486 (+148063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:23.767522 (+ 14036us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:23.776927 (+  9405us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:23.779165 (+  2238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.605852 (+826687us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54005b4354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:24.605897 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.606041 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":318961536}
I20260709 13:13:24.790751  2867 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:24.855618  1166 rpcz_store.cc:276] 0709 13:13:23.652834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.845862 (+1193028us) service_pool.cc:224] Handling call
0709 13:13:24.846869 (+  1007us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:24.789736  2534 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:24.850400  2876 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:24.789564  2854 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:24.858165  2657 consensus_meta.cc:287] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.711s	user 0.009s	sys 0.000s
I20260709 13:13:24.774766  2842 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:24.863979  2857 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:24.757843  2768 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:24.865304   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:24.816020  2550 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:24.866988  1139 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:24.868010  2662 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:13:24.868266  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.870308  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:24.864445  2850 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.788697  2860 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:24.820139   551 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:24.819201  2856 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.842113  2763 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:24.789688  2821 consensus_queue.cc:237] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:24.871186   599 leader_election.cc:336] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.563s (SENT)
I20260709 13:13:24.873063   478 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:24.875030   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:24.878050   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 264) took 1086 ms. Trace:
I20260709 13:13:24.848351  2411 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:24.879688  2827 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:24.888429   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1464) took 4377 ms. Trace:
I20260709 13:13:24.887890   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1532) took 2682 ms. Trace:
I20260709 13:13:24.854768  2661 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:24.929975   479 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:13:25.172946  2868 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:24.786523  2521 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:25.177989  2868 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:24.991693  2837 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:25.178965  2837 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:25.179684   599 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:25.180112  2868 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:25.180568   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 309401us
I20260709 13:13:25.181023  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:25.181841   484 rpcz_store.cc:276] 0709 13:13:23.792217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.792392 (+   175us) service_pool.cc:224] Handling call
0709 13:13:23.792672 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:24.620668 (+827996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.877848 (+257180us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b5400132254. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:24.877995 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1839444352}
W20260709 13:13:25.181751  1175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 386) took 1621 ms (client timeout 2102 ms). Trace:
I20260709 13:13:25.184021   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:25.183054   553 rpcz_store.cc:276] 0709 13:13:22.205279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.636740 (+1431461us) service_pool.cc:224] Handling call
0709 13:13:23.637062 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:23.975257 (+338195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.887640 (+912383us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54000ebd54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:24.887830 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":775979776}
I20260709 13:13:25.185076   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:25.185189   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:25.186218   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:25.187142   553 raft_consensus.cc:2393] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 6: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
W20260709 13:13:25.184100  1175 rpcz_store.cc:269] 0709 13:13:23.560187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.560323 (+   136us) service_pool.cc:224] Handling call
0709 13:13:25.180883 (+1620560us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:25.181692 (+   809us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3536640}
W20260709 13:13:25.117529   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.196564   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 199) took 3136 ms. Trace:
I20260709 13:13:25.002969   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:25.197396   630 rpcz_store.cc:276] 0709 13:13:22.059886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.074841 (+ 14955us) service_pool.cc:224] Handling call
0709 13:13:23.473366 (+1398525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:23.474197 (+   831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:25.026931 (+1552734us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54000528d0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:25.196487 (+169556us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3215454080}
I20260709 13:13:24.949918   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:25.215788   558 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:25.224334   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:25.228562   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:25.229758   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.229696   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:25.181699   629 rpcz_store.cc:276] 0709 13:13:20.510577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.206425 (+695848us) service_pool.cc:224] Handling call
0709 13:13:21.206860 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:22.126403 (+919543us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:22.447626 (+321223us) log.cc:844] Serialized 14 byte log entry
0709 13:13:23.097681 (+650055us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:23.137425 (+ 39744us) log.cc:844] Serialized 26 byte log entry
0709 13:13:23.137615 (+   190us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:23.137649 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.888061 (+1750412us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54001621d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:24.888109 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:24.888154 (+    45us) raft_consensus.cc:1685] finished
0709 13:13:24.888246 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.888376 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":421599,"prepare.queue_time_us":370385,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":483647,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":16265,"spinlock_wait_cycles":2113821568,"thread_start_us":565957,"threads_started":2,"wal-append.queue_time_us":306041,"wal-append.run_cpu_time_us":2753,"wal-append.run_wall_time_us":1394849}
W20260709 13:13:25.190560  2605 consensus_meta.cc:287] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.576s	user 0.014s	sys 0.000s
I20260709 13:13:25.228790   448 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:24.872534  2658 raft_consensus.cc:3055] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:13:24.946223  2883 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:13:24.878865   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:24.878885  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:24.955672  2621 raft_consensus.cc:3055] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:24.931851  2833 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.244800   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:24.883056  2462 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:24.885286  2817 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:24.951470  2771 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:25.173382  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:24.956786  2849 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.887183  2808 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:24.882258  2783 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:25.235445  2854 consensus_queue.cc:1059] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:13:25.251839   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.284688   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.285506   484 raft_consensus.cc:2410] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:25.252199   631 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:25.252962   597 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:25.270537   552 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.205158  2860 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.955407  2646 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.878721   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:25.086442   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:25.266764  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:25.296618  1175 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
W20260709 13:13:25.230690  1170 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 514) took 1688 ms (client timeout 1939 ms). Trace:
I20260709 13:13:25.241933   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:25.271205   553 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:25.298959   558 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:25.271526   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 464512us
I20260709 13:13:25.224028  2764 consensus_queue.cc:1059] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:13:25.240899  2864 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.251411  2857 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:25.277839   483 raft_consensus.cc:1240] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:25.223273  2754 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:13:25.245939  2658 raft_consensus.cc:740] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:25.289319  2842 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:24.886647  2818 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:25.263525  2605 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:25.316516   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:25.317544  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:25.254894  2880 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.119809  2792 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.223644  2662 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:25.299580   628 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.204547  2855 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:25.288015  2876 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:25.287844   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.338812   484 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
W20260709 13:13:25.288445  1169 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 513) took 1777 ms (client timeout 1821 ms). Trace:
I20260709 13:13:25.288450  2462 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:25.288977  2635 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:13:25.289489   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 108249us
I20260709 13:13:25.268040  2621 raft_consensus.cc:740] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:25.205004  2856 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:25.276595  2837 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:25.223541  2850 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:25.265141  2534 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:13:25.309803   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:25.390318   553 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.234368  2868 consensus_queue.cc:1059] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:13:25.305914  2465 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:25.301687  2881 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:25.391607  2754 raft_consensus.cc:3055] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:25.391728  2465 raft_consensus.cc:697] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:25.320650   555 raft_consensus.cc:2393] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 4: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:25.392028  2754 raft_consensus.cc:740] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:25.294307  2860 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.392704  2465 consensus_queue.cc:237] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:25.392933  2754 consensus_queue.cc:260] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:25.394145  2754 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.302798  2854 consensus_queue.cc:1243] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 6ba2a9c02b534120bbf26e56a1e920ca log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:13:25.395802  2662 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:25.329891   558 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:25.304030  2857 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.283077  2771 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:25.316705  2661 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:25.296838  2646 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:25.347335  2877 log.cc:927] Time spent T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:13:25.347226  2757 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.347977  1167 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:25.348861  2818 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:25.386485  2223 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.349678  2658 consensus_queue.cc:260] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:25.335145  2880 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:25.298420  1170 rpcz_store.cc:269] 0709 13:13:23.541920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.557593 (+ 15673us) service_pool.cc:224] Handling call
0709 13:13:25.178326 (+1620733us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b54003a3ed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:25.223958 (+ 45632us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110961920}
I20260709 13:13:25.442678  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:25.366051  1169 rpcz_store.cc:269] 0709 13:13:23.508453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.510510 (+  2057us) service_pool.cc:224] Handling call
0709 13:13:24.878770 (+1368260us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4eee 0000000000375939 00007f4b6d3681e0 00007f4b6d4310c4 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:25.285811 (+407041us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35124608}
I20260709 13:13:25.444258  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:25.445686  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:25.439924  2223 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:25.449100  2646 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:25.449457  2223 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:25.449743  2771 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:25.450428  2658 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:25.452697  2856 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:25.353763  2763 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:25.307803  2783 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:25.278019  2833 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:25.307060  2864 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:25.318742  2764 consensus_queue.cc:1243] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:13:25.355698   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:25.356256  2768 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:25.285766  2849 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:25.357441   476 raft_consensus.cc:1240] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:25.357627  2550 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:25.358449   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.359480   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:25.397863  2635 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:25.478978   479 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.479154   478 raft_consensus.cc:2410] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:25.479031   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:25.480172   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:25.480988   478 raft_consensus.cc:2410] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:25.361464   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1383) took 2432 ms. Trace:
I20260709 13:13:25.382314   631 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:25.387488   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.391043  2850 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:25.325819  1175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 397) took 1531 ms. Trace:
I20260709 13:13:25.482947  1175 rpcz_store.cc:276] 0709 13:13:23.794969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.303696 (+1508727us) service_pool.cc:224] Handling call
0709 13:13:25.325734 (+ 22038us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:25.400861  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 533905us
W20260709 13:13:25.399416  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 151931us
I20260709 13:13:25.483974  1139 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:25.485270  1138 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:25.403374   558 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:25.406589   599 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:25.486281   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 79806.1us
I20260709 13:13:25.349249  2605 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:25.466403  2818 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:25.425709  2757 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:25.391893  2881 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:25.439610  2621 consensus_queue.cc:260] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:25.459854  1171 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
W20260709 13:13:25.455176   447 connection.cc:256] RPC call timeout handler was delayed by -1.7458683780000683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
W20260709 13:13:25.495461   447 connection.cc:256] RPC call timeout handler was delayed by -1.560682302000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
I20260709 13:13:25.405620  2857 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:25.464246   553 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:25.464901   525 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:25.471784   477 raft_consensus.cc:2376] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4. Re-sending same reply.
I20260709 13:13:25.472239   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:25.492619   630 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:25.497051   632 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:25.499395  2621 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:25.500296  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:25.501091  2833 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:25.493813  2818 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:25.501856  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:25.502615  1170 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:25.503619  2818 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:25.503682   627 raft_consensus.cc:1275] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:25.505156   448 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:25.506551  2771 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:25.507009  2771 raft_consensus.cc:697] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:25.507710  2827 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:25.508167  2827 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.507898  2771 consensus_queue.cc:237] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:25.508512  2757 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:25.509742  2670 raft_consensus.cc:3055] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:25.509881  2881 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:25.510201  2670 raft_consensus.cc:740] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:25.488819  2766 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:25.511113  2670 consensus_queue.cc:260] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:25.512252  2670 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:25.515913   447 connection.cc:256] RPC call timeout handler was delayed by -1.4002644390000114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
W20260709 13:13:25.516300   447 connection.cc:256] RPC call timeout handler was delayed by -1.3995823019999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260709 13:13:25.516572  2864 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:25.517346   629 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:25.475399   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:25.455094  2863 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:25.521617  1139 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:25.521474  2863 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:25.522506  1139 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:25.481416   482 rpcz_store.cc:276] 0709 13:13:22.928822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.929311 (+   489us) service_pool.cc:224] Handling call
0709 13:13:24.905217 (+1975906us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:25.360747 (+455530us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4e9c 00007f4b652f4a5b 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:25.360916 (+   169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:25.361092 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:25.361119 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:25.361219 (+   100us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:25.361252 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:25.361306 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:25.361410 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36787968}
I20260709 13:13:25.523803   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.524155   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:25.524437   482 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:25.524544   522 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:25.525315   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.526222   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.392957   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:25.486903   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:25.483199   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.526993   631 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:25.527128   476 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:25.465999  2783 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:25.488443   599 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:25.488298   479 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:25.489018   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:25.528465   558 raft_consensus.cc:2410] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:25.338814  2792 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:25.490404   481 raft_consensus.cc:1275] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:13:25.529204   481 pending_rounds.cc:85] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 1
I20260709 13:13:25.529448   481 pending_rounds.cc:107] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:13:25.529678   481 raft_consensus.cc:2889] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:25.530025   481 pending_rounds.cc:107] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:13:25.530067   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.530505   481 raft_consensus.cc:2889] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:25.491719  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:25.494715  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:25.517205  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:25.538445  2635 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:25.454068  2860 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:25.516607   447 connection.cc:256] RPC call timeout handler was delayed by -1.373268378000148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
W20260709 13:13:25.539460   447 connection.cc:256] RPC call timeout handler was delayed by -1.3574097210000673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260709 13:13:25.539834   447 connection.cc:256] RPC call timeout handler was delayed by -1.221166519999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260709 13:13:25.540098   447 connection.cc:256] RPC call timeout handler was delayed by -1.0231665199999043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
I20260709 13:13:25.516605   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:25.540757   625 raft_consensus.cc:2368] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5.
W20260709 13:13:25.472929   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 220032us
W20260709 13:13:25.541147   625 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54754 (request call id 211) took 1969 ms (client timeout 1981 ms). Trace:
W20260709 13:13:25.541536   625 rpcz_store.cc:269] 0709 13:13:23.571993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.588171 (+ 16178us) service_pool.cc:224] Handling call
0709 13:13:25.516479 (+1928308us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b5800167198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4e9c 00007f4b652f4a5b 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:25.541088 (+ 24609us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75897472}
I20260709 13:13:25.516324   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 270) took 1680 ms. Trace:
I20260709 13:13:25.531443   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.542865   482 raft_consensus.cc:2393] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 6: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:25.542542   480 rpcz_store.cc:276] 0709 13:13:23.836199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.846106 (+  9907us) service_pool.cc:224] Handling call
0709 13:13:25.515639 (+1669533us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:25.515822 (+   183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:25.516013 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:25.516038 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:25.516085 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:25.516118 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:25.516170 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:25.516262 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8973568}
I20260709 13:13:25.544445   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:25.544819   480 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:25.531962  1175 raft_consensus.cc:2393] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 4: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:25.547079  2550 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:25.547611  1175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 396) took 1779 ms. Trace:
I20260709 13:13:25.547950  1175 rpcz_store.cc:276] 0709 13:13:23.767917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.489599 (+1721682us) service_pool.cc:224] Handling call
0709 13:13:25.547551 (+ 57952us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:25.539014  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:25.548803  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:25.534631  2764 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:25.534797  2890 raft_consensus.cc:3055] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:25.549522  1175 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:25.549611  2764 raft_consensus.cc:697] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:25.549554  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:25.550379  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:25.508509  2827 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:25.535285  2868 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:25.551016  2764 consensus_queue.cc:237] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:25.551563  2868 raft_consensus.cc:697] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:25.552738  2868 consensus_queue.cc:237] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:25.535449   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.535890  2662 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:25.530851  2881 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:25.535923   628 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:25.548803   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:25.556380   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 69216.3us
I20260709 13:13:25.563169   625 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:25.563458   599 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:25.549760  2890 raft_consensus.cc:740] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:25.571826  1175 raft_consensus.cc:2410] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:25.573370   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.533844   632 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:25.564076   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.558068  2465 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:25.542315   522 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:25.578276   476 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:25.574613   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:25.575613   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:25.579069  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 54948.1us
I20260709 13:13:25.577539   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:25.561215   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.580084   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:25.580165   482 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:25.580751   633 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.581369   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.582373   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:25.582806   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:25.521626  2849 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:25.583925   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:25.584394   522 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:25.495581  2893 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:25.586136   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.586621   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:25.584503   476 raft_consensus.cc:2376] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5. Re-sending same reply.
I20260709 13:13:25.585556   479 raft_consensus.cc:2376] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6. Re-sending same reply.
I20260709 13:13:25.617575   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.618155   479 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:25.618971   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:25.620136   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:25.555630  2729 raft_consensus.cc:3055] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:25.555719  2763 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:25.616151   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:25.616299   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:25.598740   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.624200   482 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:25.625010   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.585825  2856 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:25.617947   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 70911.3us
I20260709 13:13:25.620657   479 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:25.530169  2700 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 13:13:25.558244  2860 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:25.615787   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:25.625725   597 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:25.709072   447 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:25.709273   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 120816us
I20260709 13:13:25.709885   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:25.625061   632 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:25.709968   597 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:25.716784   633 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:25.633796   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:25.707458   482 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:25.740463   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.741863   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:25.742552   482 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:25.647104   448 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:25.746349   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:25.689251   480 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:25.750660   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:25.620280  2850 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:25.754762   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:25.754498   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:25.758615   476 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.755486   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:25.665077  1173 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 390) took 2088 ms (client timeout 2123 ms). Trace:
I20260709 13:13:25.754864   480 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:25.760386   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:25.760958   631 raft_consensus.cc:2410] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:25.622274  2729 raft_consensus.cc:740] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:25.630214  1170 raft_consensus.cc:1240] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:25.765527   632 raft_consensus.cc:1240] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:25.763504   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 116443us
W20260709 13:13:25.691579  2898 log.cc:927] Time spent T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:13:25.620416  2893 raft_consensus.cc:697] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:25.754520  2856 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.768296   479 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:25.697417   551 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:25.769548   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.711637  2849 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:25.665653  2763 raft_consensus.cc:697] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:25.690917   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:25.758865  2821 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:25.641235  2881 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:25.769035   482 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:25.777904   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.768800  2854 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:25.754468  2621 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:25.781394   480 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:25.636660  2792 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:25.759145  2864 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:25.642051  1168 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 509) took 2204 ms (client timeout 1787 ms). Trace:
W20260709 13:13:25.760108  1173 rpcz_store.cc:269] 0709 13:13:23.576497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.817584 (+241087us) service_pool.cc:224] Handling call
0709 13:13:25.643899 (+1826315us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b5400656b54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:25.665008 (+ 21109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2084065152}
I20260709 13:13:25.707113  2857 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:25.800209   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:25.801031   480 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:25.762493  2465 consensus_queue.cc:1059] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:13:25.803390  2465 raft_consensus.cc:3055] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:25.803725  2465 raft_consensus.cc:740] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:25.787024   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.768529  2850 raft_consensus.cc:697] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:25.788033   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.809280   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.809916   482 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:25.810740   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.811818   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:25.769819  2860 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:25.812443   478 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:25.775949  2890 consensus_queue.cc:260] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:25.788358  1141 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:25.777933  2856 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:25.822685  1141 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:25.804965   479 raft_consensus.cc:2393] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 5: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:25.757776  2827 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:25.846338   555 raft_consensus.cc:1240] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:13:25.757498  2658 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:25.847530  2658 raft_consensus.cc:697] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:25.847764   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1517) took 1343 ms. Trace:
I20260709 13:13:25.848199   555 rpcz_store.cc:276] 0709 13:13:24.506013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.536091 (+1030078us) service_pool.cc:224] Handling call
0709 13:13:25.536434 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:25.846755 (+310321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:25.847521 (+   766us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54002008d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:25.847703 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712081664}
I20260709 13:13:25.848783  2658 consensus_queue.cc:237] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:25.849555   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:25.849933   552 consensus_meta.cc:287] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.551s	user 0.006s	sys 0.002s
I20260709 13:13:25.850176   555 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.850317   552 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
W20260709 13:13:25.786942  2901 log.cc:927] Time spent T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:13:25.778471  2662 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.803782  2729 consensus_queue.cc:260] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:25.788707  1170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 388) took 2227 ms. Trace:
I20260709 13:13:25.807125  2893 consensus_queue.cc:237] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:25.859045  2729 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.861112  1169 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:25.855350  1170 rpcz_store.cc:276] 0709 13:13:23.560832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.585209 (+2024377us) service_pool.cc:224] Handling call
0709 13:13:25.625982 (+ 40773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:25.772433 (+146451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:25.785917 (+ 13484us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:25.869940  2866 consensus_queue.cc:1059] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:25.815915  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:25.818971   480 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:25.876420   480 raft_consensus.cc:1240] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:25.876770  2857 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:25.821818   482 raft_consensus.cc:2410] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:25.803000  2881 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:25.878445   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.878810   482 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:25.879851  2881 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:25.788700   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1527) took 1120 ms. Trace:
I20260709 13:13:25.880009  2850 consensus_queue.cc:237] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:25.880493   551 rpcz_store.cc:276] 0709 13:13:24.667228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.740011 (+ 72783us) service_pool.cc:224] Handling call
0709 13:13:25.786732 (+1046721us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:25.881779   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:25.799687  1168 rpcz_store.cc:269] 0709 13:13:23.437559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.439537 (+  1978us) service_pool.cc:224] Handling call
0709 13:13:25.641818 (+2202281us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b54005f1ed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:25.641946 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86938368}
I20260709 13:13:25.825754  2833 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:25.826323  2764 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:25.827775   479 raft_consensus.cc:1240] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:25.893846   479 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:13:25.833441  2465 consensus_queue.cc:260] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:25.836160   624 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1358) took 2287 ms (client timeout 1640 ms). Trace:
I20260709 13:13:25.838032   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1513) took 1336 ms. Trace:
I20260709 13:13:25.843577  2753 raft_consensus.cc:3055] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:25.844874  2763 consensus_queue.cc:237] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:25.799461  2621 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.850841   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1558) took 1082 ms. Trace:
I20260709 13:13:25.896193   479 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:25.912401   552 rpcz_store.cc:276] 0709 13:13:24.768282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.831119 (+ 62837us) service_pool.cc:224] Handling call
0709 13:13:25.850785 (+1019666us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:25.789481  2854 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:25.858611  2783 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:25.814971  2903 log.cc:927] Time spent T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:13:25.872423   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:25.873178  2662 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:25.874064   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:25.885571   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:25.885951   522 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:25.885954  1139 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:25.790812  2821 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:25.904532   476 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:25.883057   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:25.894708   624 rpcz_store.cc:269] 0709 13:13:23.548880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.550719 (+  1839us) service_pool.cc:224] Handling call
0709 13:13:25.835916 (+2285197us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54001adbd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:25.836081 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404198656}
I20260709 13:13:25.914006   448 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:25.913133   555 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:25.847527  2827 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:25.910207   556 rpcz_store.cc:276] 0709 13:13:24.501955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.664250 (+162295us) service_pool.cc:224] Handling call
0709 13:13:24.716403 (+ 52153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:24.839628 (+123225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:25.837798 (+998170us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54001f27d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:25.837972 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282072960}
W20260709 13:13:25.855074  2906 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:13:25.914304   479 raft_consensus.cc:1240] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:13:25.947808   558 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:25.922967   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 212602us
I20260709 13:13:25.948607   550 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:25.935973   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:25.956017   447 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:25.956363   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:25.951081   551 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:25.951378   379 catalog_manager.cc:5697] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 2 to 3, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 3 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.952867   478 raft_consensus.cc:1240] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:25.928617   483 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:25.956669   557 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:25.959312   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:25.957787   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:25.959818   550 raft_consensus.cc:2393] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 5: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:25.959980   551 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:13:25.960837   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:25.964833   550 raft_consensus.cc:2393] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:25.963898   478 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:25.970693   558 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:25.959606   448 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:25.972327   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:25.973039   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:25.974229   447 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:25.975905   552 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 3.
I20260709 13:13:25.824431  2860 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:25.914759  2621 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:25.933811  2867 consensus_meta.cc:287] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.000s
I20260709 13:13:25.883970  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:26.004256  1166 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:26.005389  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:25.973215  2783 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:25.976794   447 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:26.011039   447 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:25.975217  2646 raft_consensus.cc:2764] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:13:25.958781  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 71170.2us
I20260709 13:13:26.011168  2621 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:26.013962  2792 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:25.911016  2833 raft_consensus.cc:697] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:26.014889  2621 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:25.916347  2890 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:25.979527   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:25.983626   551 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:26.070217   551 raft_consensus.cc:1240] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:13:25.984530   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 98654.9us
I20260709 13:13:25.984736   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1515) took 1482 ms. Trace:
I20260709 13:13:26.072152   553 rpcz_store.cc:276] 0709 13:13:24.502451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.497834 (+995383us) service_pool.cc:224] Handling call
0709 13:13:25.498137 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:25.498400 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:25.770148 (+271748us) log.cc:844] Serialized 14 byte log entry
0709 13:13:25.984425 (+214277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:25.984478 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:25.984520 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:25.984581 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:25.984685 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10860,"prepare.queue_time_us":23847,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":23866,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":8875,"thread_start_us":463552,"threads_started":2}
I20260709 13:13:25.977497   379 catalog_manager.cc:5697] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 2 to 4, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 4 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:25.924296  2854 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.931165   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:26.056077  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:25.918093  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:25.915094  2631 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:25.915649  2764 raft_consensus.cc:697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:25.975909   557 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:25.987299  2757 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:26.015177  2833 consensus_queue.cc:237] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:26.016209   523 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:26.177000   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 160862us
I20260709 13:13:25.978184   483 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:26.017128  2867 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:26.018428   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:25.954165  2881 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.000483   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:26.012667   447 leader_election.cc:400] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5.
I20260709 13:13:26.184286   447 leader_election.cc:403] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:13:26.185150   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 172595us
I20260709 13:13:26.188949   447 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:26.191138   447 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:26.167882  2900 log.cc:927] Time spent T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 13:13:25.961980  2866 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:13:26.022035   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:26.200201   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.011795   556 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:25.925500  2465 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:26.004300  2821 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:26.005391  2605 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.217559  2605 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:26.012552  2646 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:26.070974   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1520) took 1557 ms. Trace:
W20260709 13:13:26.121852   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 49870.7us
I20260709 13:13:26.017192  2864 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:26.000960  2857 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:25.987020  2534 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:25.915659  2753 raft_consensus.cc:740] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:26.169407   555 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:13:26.298642   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1519) took 1785 ms. Trace:
I20260709 13:13:26.298978   555 rpcz_store.cc:276] 0709 13:13:24.513307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.069036 (+1555729us) service_pool.cc:224] Handling call
0709 13:13:26.169034 (+ 99998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.298400 (+129366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.298591 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.061913  2362 raft_consensus.cc:3055] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:26.179651   448 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:26.193076   379 catalog_manager.cc:5697] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 3 to 4, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 4 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.176209  1168 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:26.200817   559 raft_consensus.cc:1240] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:26.366289   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1530) took 4161 ms. Trace:
I20260709 13:13:26.366576   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1526) took 1735 ms. Trace:
I20260709 13:13:26.366740 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:26.220201   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1518) took 1707 ms. Trace:
I20260709 13:13:26.366705   554 rpcz_store.cc:276] 0709 13:13:22.204951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.634635 (+1429684us) service_pool.cc:224] Handling call
0709 13:13:23.731622 (+ 96987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:23.755869 (+ 24247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.365124 (+2609255us) spinlock_profiling.cc:243] Waited 96.6 ms on lock 0x7b5400386b50. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:26.366227 (+  1103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222076288}
I20260709 13:13:26.368755   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1509) took 1256 ms. Trace:
W20260709 13:13:26.369045   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 189490us
I20260709 13:13:26.371762   552 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:26.372586   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1560) took 1558 ms. Trace:
I20260709 13:13:26.372969   552 rpcz_store.cc:276] 0709 13:13:24.814007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.220195 (+1406188us) service_pool.cc:224] Handling call
0709 13:13:26.371506 (+151311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.372297 (+   791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.372520 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.367641   556 rpcz_store.cc:276] 0709 13:13:24.513001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.983965 (+1470964us) service_pool.cc:224] Handling call
0709 13:13:26.011573 (+ 27608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.219940 (+208367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.220134 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.369294   480 rpcz_store.cc:276] 0709 13:13:25.112821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.877055 (+764234us) service_pool.cc:224] Handling call
0709 13:13:25.877286 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:25.877465 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:25.877725 (+   260us) log.cc:844] Serialized 14 byte log entry
0709 13:13:26.367447 (+489722us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:26.368367 (+   920us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:26.368435 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.368522 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:26.368684 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54673,"prepare.queue_time_us":3344,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"thread_start_us":418133,"threads_started":1}
I20260709 13:13:26.376205   480 raft_consensus.cc:1275] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:26.377543   480 raft_consensus.cc:3055] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:26.377911   480 raft_consensus.cc:740] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:26.367043   559 rpcz_store.cc:276] 0709 13:13:24.631491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.200275 (+1568784us) service_pool.cc:224] Handling call
0709 13:13:26.200605 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.366346 (+165741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.366524 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.232247   447 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:26.022653   478 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:26.284040  1139 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:26.383351  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 99438.1us
I20260709 13:13:26.251359   551 rpcz_store.cc:276] 0709 13:13:24.513552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.069506 (+1555954us) service_pool.cc:224] Handling call
0709 13:13:26.069930 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:26.070690 (+   760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.070913 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.019615  2827 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:26.201645  2757 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:26.288082  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:26.176280  2631 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:26.290565  2671 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.409924   379 catalog_manager.cc:5697] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 3 to 4, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 4 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.192771  2849 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:26.195289  2714 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:26.435557   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1561) took 1621 ms. Trace:
I20260709 13:13:26.436247   555 rpcz_store.cc:276] 0709 13:13:24.814332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.299650 (+1485318us) service_pool.cc:224] Handling call
0709 13:13:26.434848 (+135198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.435086 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:26.435121 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:26.435187 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:26.435277 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.435347 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:26.435489 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.390750  1139 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:26.440548   379 catalog_manager.cc:5697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 3 to 4, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 4 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:13:26.198163  2881 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:26.365403  2362 raft_consensus.cc:740] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:26.388229   480 consensus_queue.cc:260] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:26.449493   480 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:26.449697   552 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:26.451246   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1564) took 1635 ms. Trace:
I20260709 13:13:26.451642   552 rpcz_store.cc:276] 0709 13:13:24.815385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.373903 (+1558518us) service_pool.cc:224] Handling call
0709 13:13:26.445097 (+ 71194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.450881 (+  5784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.451152 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.251995  2866 raft_consensus.cc:697] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:26.294864  2864 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:26.411300  2783 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:26.410589  2771 raft_consensus.cc:2764] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:13:26.459759   480 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:26.444218   483 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:13:26.445960  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 61355.8us
I20260709 13:13:26.461637  1139 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:13:26.407717   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 175584us
I20260709 13:13:26.453333   379 catalog_manager.cc:5697] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 2 to 3, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 3 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
W20260709 13:13:26.454607   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.404072  2792 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5.
I20260709 13:13:26.443292   556 raft_consensus.cc:1240] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:26.465449   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1565) took 1648 ms. Trace:
I20260709 13:13:26.465263  2362 consensus_queue.cc:260] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:26.435340  2714 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:26.466029  1166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 392) took 2837 ms. Trace:
I20260709 13:13:26.466320  2714 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:26.453815  2893 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:26.466962  2893 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:26.467367  2893 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:26.467434  2753 consensus_queue.cc:260] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:26.468575  2753 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:26.471678   379 catalog_manager.cc:5697] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 2 to 5, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 5 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:26.473505   379 catalog_manager.cc:5697] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 1 to 3, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 3 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:26.474201  2867 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:26.474481  2714 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:26.475324  2866 consensus_queue.cc:237] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:26.477192  2714 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:26.465818   556 rpcz_store.cc:276] 0709 13:13:24.817176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.374847 (+1557671us) service_pool.cc:224] Handling call
0709 13:13:26.443025 (+ 68178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.465207 (+ 22182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.465394 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.474948   379 catalog_manager.cc:5697] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 2 to 3, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 3 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.479609   551 raft_consensus.cc:1240] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:26.460212   555 raft_consensus.cc:1240] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:26.464740  2783 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.434732  2671 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:26.484826   550 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:26.480973   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1569) took 1600 ms. Trace:
I20260709 13:13:26.486681   555 rpcz_store.cc:276] 0709 13:13:24.880833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.437475 (+1556642us) service_pool.cc:224] Handling call
0709 13:13:26.460037 (+ 22562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.480673 (+ 20636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.480905 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.433926  2646 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:13:26.484293  2763 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.028s	sys 0.052s
I20260709 13:13:26.466473  2362 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:26.295650  2857 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.488930  2783 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:26.466434  1166 rpcz_store.cc:276] 0709 13:13:23.628793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.430959 (+2802166us) service_pool.cc:224] Handling call
0709 13:13:26.465518 (+ 34559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.465704 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:26.465733 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:26.465785 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:26.465818 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.465876 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:26.465978 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.492373  2671 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:26.494204  2729 consensus_meta.cc:287] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.635s	user 0.005s	sys 0.004s
I20260709 13:13:26.504912   555 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:26.609620   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1573) took 1258 ms. Trace:
I20260709 13:13:26.482626   447 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:26.610369   555 rpcz_store.cc:276] 0709 13:13:25.350838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.488338 (+1137500us) service_pool.cc:224] Handling call
0709 13:13:26.504578 (+ 16240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.608933 (+104355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.609541 (+   608us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:26.511381   631 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.007s	sys 0.004s
W20260709 13:13:26.513007  1174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.011s	sys 0.026s
W20260709 13:13:26.614887   631 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.007s	sys 0.004s
W20260709 13:13:26.614980  1174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.012s	sys 0.026s
I20260709 13:13:26.519732   379 catalog_manager.cc:5697] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 2 to 3, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 3 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:26.500801  2763 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.028s	sys 0.052s
I20260709 13:13:26.574092   550 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:26.498880  2844 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:13:26.626880   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:26.614239   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 131894us
I20260709 13:13:26.502365  2890 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:26.504276  2809 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.023s	sys 0.049s
I20260709 13:13:26.634871   447 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:26.504572  2860 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:26.639146   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1497) took 1062 ms. Trace:
W20260709 13:13:26.644963   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.526894  2857 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:26.511106  2646 raft_consensus.cc:697] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:13:26.665619  1141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.003s	sys 0.015s
I20260709 13:13:26.682672   633 rpcz_store.cc:276] 0709 13:13:25.577139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.771365 (+194226us) service_pool.cc:224] Handling call
0709 13:13:25.851548 (+ 80183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:25.851748 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:25.851774 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:25.851821 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:25.851856 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:25.851909 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:26.638904 (+786995us) spinlock_profiling.cc:243] Waited 79.2 ms on lock 0x7b54001adbd0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:26.639070 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182076160}
I20260709 13:13:26.714056   555 raft_consensus.cc:1240] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:26.728804   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1576) took 1209 ms. Trace:
W20260709 13:13:26.729573   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.729203   555 rpcz_store.cc:276] 0709 13:13:25.519132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.614689 (+1095557us) service_pool.cc:224] Handling call
0709 13:13:26.711100 (+ 96411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.728454 (+ 17354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.728733 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:26.724666  1141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.003s	sys 0.015s
W20260709 13:13:26.731156  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.456710  2764 consensus_queue.cc:237] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:26.617106  2768 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:26.511608  2534 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:26.754894   555 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:26.755605   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1577) took 1215 ms. Trace:
W20260709 13:13:26.682596  2809 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.024s	sys 0.049s
I20260709 13:13:26.619766  1168 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:26.755923   555 rpcz_store.cc:276] 0709 13:13:25.540462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.730506 (+1190044us) service_pool.cc:224] Handling call
0709 13:13:26.754597 (+ 24091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.755322 (+   725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.755546 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.639858  2890 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:26.760942   555 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:26.761229  1168 raft_consensus.cc:1240] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:26.761610   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1535) took 1197 ms. Trace:
I20260709 13:13:26.761853  1168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 401) took 2351 ms. Trace:
I20260709 13:13:26.761945   555 rpcz_store.cc:276] 0709 13:13:25.564441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.756935 (+1192494us) service_pool.cc:224] Handling call
0709 13:13:26.760782 (+  3847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.761387 (+   605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.761562 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.762280  1168 rpcz_store.cc:276] 0709 13:13:24.410846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.760781 (+2349935us) service_pool.cc:224] Handling call
0709 13:13:26.761043 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.761606 (+   563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.761801 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.763448   555 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:13:26.763994   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1536) took 1198 ms. Trace:
I20260709 13:13:26.764277   555 rpcz_store.cc:276] 0709 13:13:25.565198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.762890 (+1197692us) service_pool.cc:224] Handling call
0709 13:13:26.763213 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:26.763778 (+   565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.763953 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.765417   555 raft_consensus.cc:1240] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:13:26.758806  2768 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:26.765947   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1537) took 1199 ms. Trace:
I20260709 13:13:26.766276   555 rpcz_store.cc:276] 0709 13:13:25.566288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.764950 (+1198662us) service_pool.cc:224] Handling call
0709 13:13:26.765230 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:26.765739 (+   509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.765905 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.766546   379 catalog_manager.cc:5697] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 3 to 4, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 4 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.768623   379 catalog_manager.cc:5697] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 1 to 2, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 2 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:13:26.779932   555 raft_consensus.cc:1240] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:13:26.780676   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1538) took 1195 ms. Trace:
I20260709 13:13:26.781136  1174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 510) took 3343 ms. Trace:
I20260709 13:13:26.781522  1166 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:26.782356  1166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 400) took 2372 ms. Trace:
I20260709 13:13:26.781530  1174 rpcz_store.cc:276] 0709 13:13:23.437851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.437970 (+   119us) service_pool.cc:224] Handling call
0709 13:13:23.438254 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:23.498665 (+ 60411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:23.498709 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:23.499203 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:13:25.882931 (+2383728us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b1800438820. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb90d1 00007f4b683d4a0f
0709 13:13:26.615379 (+732448us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:26.615427 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.615513 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:26.780841 (+165328us) raft_consensus.cc:1685] finished
0709 13:13:26.780866 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:26.781057 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66006,"raft.queue_time_us":63580,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":84,"spinlock_wait_cycles":6132608,"thread_start_us":732251,"threads_started":1,"wal-append.queue_time_us":3249267}
W20260709 13:13:26.782934  2465 consensus_meta.cc:287] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.000s
I20260709 13:13:26.770328   379 catalog_manager.cc:5697] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.784353  1174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 522) took 1570 ms. Trace:
I20260709 13:13:26.784739  1174 rpcz_store.cc:276] 0709 13:13:25.214554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.783513 (+1568959us) service_pool.cc:224] Handling call
0709 13:13:26.783794 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.783975 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:26.784091 (+   116us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:26.784133 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:26.784163 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.784216 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:26.784305 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.786299  1174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 339) took 1168 ms. Trace:
I20260709 13:13:26.785324   379 catalog_manager.cc:5697] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 2 to 3, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 3 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.786661  1174 rpcz_store.cc:276] 0709 13:13:25.618132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.785591 (+1167459us) service_pool.cc:224] Handling call
0709 13:13:26.785855 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.786023 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:26.786047 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:26.786085 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:26.786121 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.786169 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:26.786252 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.788493  1174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 340) took 1170 ms. Trace:
I20260709 13:13:26.780992   555 rpcz_store.cc:276] 0709 13:13:25.585503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.767103 (+1181600us) service_pool.cc:224] Handling call
0709 13:13:26.779634 (+ 12531us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:26.780414 (+   780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.780625 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.789012  1174 rpcz_store.cc:276] 0709 13:13:25.618401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.787603 (+1169202us) service_pool.cc:224] Handling call
0709 13:13:26.788007 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.788194 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:26.788220 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:26.788255 (+    35us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:26.788294 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.788351 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:26.788442 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.789727   555 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:26.790339   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 211) took 1202 ms. Trace:
I20260709 13:13:26.790513  1174 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:26.790642   555 rpcz_store.cc:276] 0709 13:13:25.587755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.789334 (+1201579us) service_pool.cc:224] Handling call
0709 13:13:26.789575 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.790108 (+   533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.790293 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.798942  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:26.804536  1173 raft_consensus.cc:2393] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:26.804931  1173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 410) took 1048 ms. Trace:
I20260709 13:13:26.805006   475 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:13:26.805279   555 raft_consensus.cc:1240] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:26.805255  1173 rpcz_store.cc:276] 0709 13:13:25.756657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.876171 (+119514us) service_pool.cc:224] Handling call
0709 13:13:26.798787 (+922616us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:26.804876 (+  6089us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31375744}
I20260709 13:13:26.806066   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 214) took 1060 ms. Trace:
I20260709 13:13:26.806665  1173 raft_consensus.cc:1240] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:26.791183  1174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 342) took 1168 ms. Trace:
I20260709 13:13:26.809527  2890 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:26.809696  1174 rpcz_store.cc:276] 0709 13:13:25.623260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.789925 (+1166665us) service_pool.cc:224] Handling call
0709 13:13:26.790198 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.790968 (+   770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.791138 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.801337  2631 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:26.802194  2854 consensus_meta.cc:287] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.638s	user 0.009s	sys 0.000s
I20260709 13:13:26.814649  2854 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:26.816792  2854 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:26.817289   479 raft_consensus.cc:1240] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:26.818832   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1531) took 1427 ms. Trace:
I20260709 13:13:26.709425  2605 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:26.800067  2881 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:26.819154   479 rpcz_store.cc:276] 0709 13:13:25.391680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.958738 (+567058us) service_pool.cc:224] Handling call
0709 13:13:25.997151 (+ 38413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.817796 (+820645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.818588 (+   792us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b540022e054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:26.818758 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1885694720}
W20260709 13:13:26.812137  2879 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:13:26.788074   379 catalog_manager.cc:5697] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 2 to 3, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 3 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:26.822291   553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.010s	sys 0.030s
W20260709 13:13:26.849550   553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.011s	sys 0.030s
I20260709 13:13:26.806419   555 rpcz_store.cc:276] 0709 13:13:25.745477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.804650 (+1059173us) service_pool.cc:224] Handling call
0709 13:13:26.805112 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.805833 (+   721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.806016 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.805373   475 pending_rounds.cc:85] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 3
W20260709 13:13:26.823590  2856 consensus_meta.cc:287] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.942s	user 0.009s	sys 0.000s
I20260709 13:13:26.651724  2844 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:26.852465   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1581) took 1083 ms. Trace:
I20260709 13:13:26.861045   555 rpcz_store.cc:276] 0709 13:13:25.769415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.851024 (+1081609us) service_pool.cc:224] Handling call
0709 13:13:26.851450 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.851863 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:26.851934 (+    71us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:26.851991 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:26.852035 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.852110 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:26.852392 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.821007  2465 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.854349   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:26.851594   475 pending_rounds.cc:107] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 5.4
W20260709 13:13:26.748232  2658 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.075s	sys 0.105s
I20260709 13:13:26.782817  1166 rpcz_store.cc:276] 0709 13:13:24.410329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.709577 (+2299248us) service_pool.cc:224] Handling call
0709 13:13:26.781345 (+ 71768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.782097 (+   752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.782288 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:26.842456  2879 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:26.887181   525 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.018s	sys 0.061s
W20260709 13:13:26.887522   525 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.018s	sys 0.061s
W20260709 13:13:26.887758   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 580024us
W20260709 13:13:26.894450   448 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.021s	sys 0.010s
W20260709 13:13:26.894932   448 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.021s	sys 0.010s
W20260709 13:13:26.895318   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 524457us
W20260709 13:13:26.912360   559 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.014s	sys 0.046s
W20260709 13:13:26.912995   559 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.015s	sys 0.047s
W20260709 13:13:26.886452  2658 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.075s	sys 0.106s
I20260709 13:13:26.864516   555 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:26.824572  2646 consensus_queue.cc:237] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:26.861578  2856 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:26.874179  2465 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:26.882812   475 raft_consensus.cc:2889] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:27.966142   552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.329s	user 0.003s	sys 0.011s
I20260709 13:13:26.929229   479 raft_consensus.cc:3055] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:27.979754   479 raft_consensus.cc:740] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:27.979923   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1495) took 3027 ms. Trace:
W20260709 13:13:27.980206   550 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1534) took 2416 ms (client timeout 2770 ms). Trace:
I20260709 13:13:27.980703   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1415) took 2436 ms. Trace:
I20260709 13:13:27.980500   475 rpcz_store.cc:276] 0709 13:13:24.951998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.992676 (+ 40678us) service_pool.cc:224] Handling call
0709 13:13:26.804483 (+1811807us) spinlock_profiling.cc:243] Waited 5.07 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:26.804682 (+   199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:27.979214 (+1174532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.979736 (+   522us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11669760}
I20260709 13:13:27.981973   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 220) took 1689 ms. Trace:
I20260709 13:13:27.981467   483 rpcz_store.cc:276] 0709 13:13:25.544068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.199094 (+655026us) service_pool.cc:224] Handling call
0709 13:13:26.201916 (+  2822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.460577 (+258661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.980089 (+1519512us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54000d61d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:27.980490 (+   401us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556226432}
I20260709 13:13:27.981606   479 consensus_queue.cc:260] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:27.983304   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:27.984084   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:27.985234   484 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 3.
I20260709 13:13:27.985737   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:27.986610   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:27.977833   476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.922s	user 0.006s	sys 0.014s
W20260709 13:13:27.987860   476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.932s	user 0.007s	sys 0.014s
W20260709 13:13:27.987901   525 leader_election.cc:336] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.782s (SENT)
I20260709 13:13:27.988373   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1567) took 3148 ms. Trace:
W20260709 13:13:27.963529   447 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.247s	user 0.002s	sys 0.013s
W20260709 13:13:27.989765   447 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.273s	user 0.003s	sys 0.014s
I20260709 13:13:27.989019   551 rpcz_store.cc:276] 0709 13:13:24.839969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.389660 (+1549691us) service_pool.cc:224] Handling call
0709 13:13:26.390052 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.480129 (+ 90077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.987791 (+1507662us) spinlock_profiling.cc:243] Waited 89.4 ms on lock 0x7b5400387554. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:27.988136 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205512960}
I20260709 13:13:27.982611   555 rpcz_store.cc:276] 0709 13:13:26.292236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.863927 (+571691us) service_pool.cc:224] Handling call
0709 13:13:26.864284 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:27.981385 (+1117101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.981808 (+   423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:27.977550   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1524) took 3462 ms. Trace:
W20260709 13:13:27.980806   550 rpcz_store.cc:269] 0709 13:13:25.563647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.965611 (+401964us) service_pool.cc:224] Handling call
0709 13:13:27.979766 (+2014155us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b5400387054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:27.979981 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691436800}
W20260709 13:13:27.992394   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 1.35749e+06us
I20260709 13:13:27.974421   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1497) took 3021 ms. Trace:
I20260709 13:13:27.996073   481 rpcz_store.cc:276] 0709 13:13:24.952579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.955603 (+  3024us) service_pool.cc:224] Handling call
0709 13:13:25.230518 (+274915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:25.531055 (+300537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.973714 (+2442659us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54002dd054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:27.974159 (+   445us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":596912512}
I20260709 13:13:27.991784   553 rpcz_store.cc:276] 0709 13:13:24.514503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.074190 (+1559687us) service_pool.cc:224] Handling call
0709 13:13:26.165476 (+ 91286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:26.165947 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:26.194578 (+ 28631us) log.cc:844] Serialized 14 byte log entry
0709 13:13:26.857822 (+663244us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:26.919059 (+ 61237us) log.cc:844] Serialized 26 byte log entry
0709 13:13:26.919350 (+   291us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:26.919402 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.919498 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:27.976645 (+1057147us) raft_consensus.cc:1685] finished
0709 13:13:27.976817 (+   172us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:27.977229 (+   412us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7474,"prepare.queue_time_us":29501,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":71,"raft.queue_time_us":12502,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":22441,"thread_start_us":553073,"threads_started":1,"wal-append.queue_time_us":767973}
I20260709 13:13:27.972993   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:27.998767   477 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
W20260709 13:13:27.058230   556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.001s	sys 0.006s
W20260709 13:13:27.999569   559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.940s	user 0.008s	sys 0.019s
W20260709 13:13:27.059202   557 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.004s	sys 0.035s
I20260709 13:13:28.015784   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1526) took 2772 ms. Trace:
I20260709 13:13:28.016397   476 rpcz_store.cc:276] 0709 13:13:25.243863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.950807 (+706944us) service_pool.cc:224] Handling call
0709 13:13:25.951764 (+   957us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:25.952127 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:25.952160 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:25.952580 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:13:27.988675 (+2036095us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:27.988789 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.988950 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:28.015456 (+ 26506us) raft_consensus.cc:1685] finished
0709 13:13:28.015489 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:28.015718 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":799,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":1932474,"threads_started":1,"wal-append.queue_time_us":2033552}
I20260709 13:13:28.028239  2929 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.029304  2929 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:27.951136   448 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.17.132:39939 timed out after 1.537s (SENT) [suppressed 34 similar messages]
W20260709 13:13:28.048382   552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.411s	user 0.005s	sys 0.017s
W20260709 13:13:28.052173   559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.008s	sys 0.020s
I20260709 13:13:27.995111   447 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:28.054193   557 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.856s	user 0.011s	sys 0.056s
I20260709 13:13:27.983088   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:27.217392   554 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.008s	sys 0.014s
W20260709 13:13:27.058614  1139 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.002s	sys 0.029s
I20260709 13:13:27.335110   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1383) took 1861 ms. Trace:
W20260709 13:13:27.378382  2893 consensus_meta.cc:287] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.910s	user 0.010s	sys 0.000s
W20260709 13:13:27.330029  1169 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 403) took 2513 ms (client timeout 1951 ms). Trace:
I20260709 13:13:28.148948   479 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:27.033818  2850 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.151s	user 0.013s	sys 0.021s
I20260709 13:13:27.348515   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1374) took 2473 ms. Trace:
I20260709 13:13:27.329589  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:27.218079  1171 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 398) took 2809 ms (client timeout 1774 ms). Trace:
W20260709 13:13:27.257915   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:27.624744  1141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.011s	sys 0.027s
I20260709 13:13:27.200897  2534 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:27.216290   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1385) took 1741 ms. Trace:
W20260709 13:13:27.228600   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:27.033607  1140 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.011s	sys 0.020s
W20260709 13:13:28.148461   482 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.395s	user 0.018s	sys 0.039s
W20260709 13:13:27.635905  2866 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.157s	user 0.003s	sys 0.009s
I20260709 13:13:26.930248  2879 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:26.954887  2783 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:27.216957   625 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:28.195559   483 raft_consensus.cc:1240] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:13:27.058764  2833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.007s	sys 0.003s
W20260709 13:13:28.197041   482 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.444s	user 0.023s	sys 0.043s
W20260709 13:13:27.217500  2849 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.003s	sys 0.011s
W20260709 13:13:27.358971  1172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 515) took 3816 ms (client timeout 3208 ms). Trace:
W20260709 13:13:27.596506  2827 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.137s	user 0.012s	sys 0.023s
W20260709 13:13:27.088035  2912 log.cc:927] Time spent T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:13:28.200626   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:27.203469  2920 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 13:13:27.365351  2362 consensus_meta.cc:287] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.843s	user 0.009s	sys 0.002s
I20260709 13:13:28.200542   630 rpcz_store.cc:276] 0709 13:13:25.474621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.477868 (+  3247us) service_pool.cc:224] Handling call
0709 13:13:27.216027 (+1738159us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b54001aefd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:27.216203 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27930880}
W20260709 13:13:27.168584  2864 consensus_meta.cc:287] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.685s	user 0.009s	sys 0.000s
I20260709 13:13:27.072371  2846 raft_consensus.cc:3055] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:13:28.213115   554 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.753s	user 0.008s	sys 0.021s
I20260709 13:13:28.201757   629 rpcz_store.cc:276] 0709 13:13:25.473998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.474146 (+   148us) service_pool.cc:224] Handling call
0709 13:13:25.474403 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:25.517742 (+ 43339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.334767 (+1817025us) spinlock_profiling.cc:243] Waited 42.6 ms on lock 0x7b54002bbbd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:27.335029 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97944320}
W20260709 13:13:28.211385  1139 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.728s	user 0.013s	sys 0.056s
W20260709 13:13:27.330816  1167 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 517) took 2397 ms (client timeout 1506 ms). Trace:
I20260709 13:13:27.346868  2867 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:28.211290   556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.563s	user 0.003s	sys 0.008s
I20260709 13:13:28.217411   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1532) took 3270 ms. Trace:
W20260709 13:13:28.195089  1171 rpcz_store.cc:269] 0709 13:13:24.408983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.870069 (+461086us) service_pool.cc:224] Handling call
0709 13:13:27.217855 (+2347786us) spinlock_profiling.cc:243] Waited 53.4 ms on lock 0x7b54006a0ed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:27.217990 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122888576}
W20260709 13:13:28.221729   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:28.222365   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.223213  2465 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:28.223888   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 287) took 2289 ms. Trace:
W20260709 13:13:28.219020   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 268112us
I20260709 13:13:27.358220  2184 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:28.228004  2933 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.231225  2934 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:28.231853  2934 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:28.231516  2933 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.232321  2934 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:28.234618  2933 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:28.228175  2932 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:28.235037  2850 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.311s	user 0.028s	sys 0.055s
I20260709 13:13:27.099774  2863 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:28.248129  2940 log.cc:927] Time spent T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.180s	user 0.001s	sys 0.001s
I20260709 13:13:28.248446   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1490) took 2674 ms. Trace:
I20260709 13:13:28.219094   552 rpcz_store.cc:276] 0709 13:13:24.947062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.452566 (+1505504us) service_pool.cc:224] Handling call
0709 13:13:26.497597 (+ 45031us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:26.498026 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:26.498064 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:26.498588 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:13:28.193425 (+1694837us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:28.202837 (+  9412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.209011 (+  6174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:28.209052 (+    41us) raft_consensus.cc:1685] finished
0709 13:13:28.209063 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:28.217353 (+  8290us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":12883,"thread_start_us":1416354,"threads_started":1,"wal-append.queue_time_us":1469119}
I20260709 13:13:27.174126  2768 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:27.214211  2662 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:28.248884   625 rpcz_store.cc:276] 0709 13:13:25.573969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.574118 (+   149us) service_pool.cc:224] Handling call
0709 13:13:27.216500 (+1642382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:28.213446 (+996946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.247894 (+ 34448us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54001aefd0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:28.248152 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3776368384}
I20260709 13:13:28.255421   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 283) took 2554 ms. Trace:
W20260709 13:13:28.259006   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 264279us
I20260709 13:13:28.257228   478 rpcz_store.cc:276] 0709 13:13:25.642880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.381989 (+739109us) service_pool.cc:224] Handling call
0709 13:13:26.382353 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:26.405922 (+ 23569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:26.405966 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:26.406573 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 13:13:26.928427 (+521854us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:26.928485 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:26.928581 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:27.200059 (+271478us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b4800002dd8. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6d342aa1 00007f4b6d339b37 00007f4b6d3399ca 00007f4b6d43126f 00007f4b6d430f37 00007f4b6d44555c 00007f4b6d445508 00007f4b6d445488 00007f4b6d445443 00007f4b6d4446ec 00007f4b6c36ea96
0709 13:13:28.023677 (+823618us) raft_consensus.cc:1685] finished
0709 13:13:28.023730 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:28.197233 (+173503us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23116,"raft.queue_time_us":26051,"raft.run_cpu_time_us":3858,"raft.run_wall_time_us":788424,"spinlock_wait_cycles":52070784,"thread_start_us":468653,"threads_started":1,"wal-append.queue_time_us":1576677}
I20260709 13:13:28.259375  2863 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.260264  2863 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.261439   447 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:28.261812  2856 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:28.259016  2945 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:28.262996  2945 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.255504  2534 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:28.264571  2932 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.265046  2534 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.265640  2945 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:28.268388   597 connection.cc:256] RPC call timeout handler was delayed by -1.3642977540000629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260709 13:13:28.251472   599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.004s	sys 0.000s
I20260709 13:13:27.344317  2880 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:28.272393   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1570) took 3189 ms. Trace:
I20260709 13:13:28.272578  2771 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:28.272863   556 rpcz_store.cc:276] 0709 13:13:25.083036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.479641 (+1396605us) service_pool.cc:224] Handling call
0709 13:13:26.493648 (+ 14007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.493866 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:26.494167 (+   301us) log.cc:844] Serialized 14 byte log entry
0709 13:13:28.271798 (+1777631us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:28.271907 (+   109us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:28.272027 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.272111 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:28.272328 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":669,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":1786,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":149,"spinlock_wait_cycles":4497152,"thread_start_us":1729983,"threads_started":1,"wal-append.queue_time_us":1755528}
I20260709 13:13:27.087150  2890 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:28.275409  2866 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.720s	user 0.013s	sys 0.009s
I20260709 13:13:28.275331  2846 raft_consensus.cc:740] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:28.276403  1167 rpcz_store.cc:269] 0709 13:13:24.933053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.034806 (+101753us) service_pool.cc:224] Handling call
0709 13:13:27.330560 (+2295754us) spinlock_profiling.cc:243] Waited 53.5 ms on lock 0x7b54005ed154. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:27.330720 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123049728}
I20260709 13:13:28.277268  2890 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:28.277022  2846 consensus_queue.cc:260] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:28.277665  2827 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.766s	user 0.016s	sys 0.033s
I20260709 13:13:28.274224   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1566) took 3440 ms. Trace:
I20260709 13:13:28.280249  2846 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:28.281991  1170 raft_consensus.cc:2393] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 4: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:28.262907  2863 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:28.226397   480 rpcz_store.cc:276] 0709 13:13:25.934328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.462004 (+527676us) service_pool.cc:224] Handling call
0709 13:13:26.462359 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.462582 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:26.477751 (+ 15169us) log.cc:844] Serialized 14 byte log entry
0709 13:13:28.222968 (+1745217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:28.223093 (+   125us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:28.223263 (+   170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.223381 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:28.223564 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":245987,"prepare.queue_time_us":41186,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":250699,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":346,"thread_start_us":437584,"threads_started":1,"wal-append.queue_time_us":1558234}
W20260709 13:13:28.278403   599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.099s	user 0.005s	sys 0.000s
I20260709 13:13:28.267076  2932 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:28.215102   626 rpcz_store.cc:276] 0709 13:13:24.875567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.058030 (+1182463us) service_pool.cc:224] Handling call
0709 13:13:26.058353 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.826066 (+767713us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:26.870278 (+ 44212us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.033799 (+163521us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:27.033870 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:27.033914 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.348172 (+314258us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b54002bcad4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:27.348244 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:27.348434 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32244,"prepare.queue_time_us":46046,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":110,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":1764853632,"thread_start_us":163078,"threads_started":1,"wal-append.queue_time_us":1186286}
I20260709 13:13:28.268954  2465 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:28.284452  1141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.465s	user 0.011s	sys 0.032s
W20260709 13:13:28.289431  2849 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.602s	user 0.018s	sys 0.039s
I20260709 13:13:28.293342  2658 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:28.270531  2534 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:27.202422  2857 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:28.291525  2833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.730s	user 0.010s	sys 0.019s
I20260709 13:13:28.283079   559 rpcz_store.cc:276] 0709 13:13:24.833626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.380086 (+1546460us) service_pool.cc:224] Handling call
0709 13:13:26.380510 (+   424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:26.913851 (+533341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:26.913901 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:26.914645 (+   744us) log.cc:844] Serialized 52 byte log entry
0709 13:13:28.185186 (+1270541us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:28.185295 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.185453 (+   158us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:28.273919 (+ 88466us) raft_consensus.cc:1685] finished
0709 13:13:28.273947 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:28.274166 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26844,"raft.queue_time_us":78054,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":9936,"thread_start_us":1578333,"threads_started":2,"wal-append.queue_time_us":1157589}
I20260709 13:13:28.301076  2890 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.301429  1168 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:28.299911   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1512) took 3132 ms. Trace:
I20260709 13:13:28.301743  2890 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:28.306541  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.295148  2924 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.307006  2890 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:28.307919  2924 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.310779  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:28.295619  2827 raft_consensus.cc:697] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:28.311650  1171 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:28.291656  1172 rpcz_store.cc:269] 0709 13:13:23.542266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.544133 (+  1867us) service_pool.cc:224] Handling call
0709 13:13:25.491557 (+1947424us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:27.358732 (+1867175us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400652f54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:27.358889 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2583375360}
W20260709 13:13:28.315219   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:28.315879   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:28.316493   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:28.317171   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:28.317725   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:28.318543   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.293481  2465 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.326742  2893 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.328495  1175 raft_consensus.cc:1240] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:28.329792  2893 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:28.327031  2658 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.310997  2924 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:28.235282  1169 rpcz_store.cc:269] 0709 13:13:24.816354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.445400 (+629046us) service_pool.cc:224] Handling call
0709 13:13:27.329807 (+1884407us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b5400600ed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:27.329949 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606862592}
I20260709 13:13:28.342243  1175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 399) took 3932 ms. Trace:
I20260709 13:13:28.342694  1175 rpcz_store.cc:276] 0709 13:13:24.409296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.447434 (+2038138us) service_pool.cc:224] Handling call
0709 13:13:26.458862 (+ 11428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:28.328987 (+1870125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.341956 (+ 12969us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54007201d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:28.342157 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4298586496}
I20260709 13:13:28.344719  1168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 402) took 3912 ms. Trace:
I20260709 13:13:28.345181  1168 rpcz_store.cc:276] 0709 13:13:24.432721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.763215 (+2330494us) service_pool.cc:224] Handling call
0709 13:13:26.779634 (+ 16419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:28.302001 (+1522367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.344419 (+ 42418us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b5400600254. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:28.344653 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3466937728}
I20260709 13:13:28.348364  2783 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:28.348883  1170 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36724 (request call id 345) took 2718 ms (client timeout 1657 ms). Trace:
I20260709 13:13:28.304183   482 rpcz_store.cc:276] 0709 13:13:25.167341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.879517 (+712176us) service_pool.cc:224] Handling call
0709 13:13:25.879765 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:25.879943 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:26.287628 (+407685us) log.cc:844] Serialized 14 byte log entry
0709 13:13:28.224753 (+1937125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:28.251573 (+ 26820us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:28.286866 (+ 35293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.292497 (+  5631us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:28.299852 (+  7355us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1124,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":285608,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":88,"thread_start_us":2295869,"threads_started":3,"wal-append.queue_time_us":661262}
I20260709 13:13:28.291481  2864 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.360196  2827 consensus_queue.cc:237] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:28.367182   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 105902us
I20260709 13:13:28.337857  2534 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:28.364384   599 connection.cc:256] RPC call timeout handler was delayed by -1.2984017119999862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2681s for a response
I20260709 13:13:28.372674   479 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:13:28.373157   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.370893  1167 raft_consensus.cc:1240] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:28.376650   599 connection.cc:256] RPC call timeout handler was delayed by -1.2596540619999814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2256s for a response
I20260709 13:13:28.379452   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:28.383908  2880 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.384835  2880 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.386585  2362 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:13:28.353737  1170 rpcz_store.cc:269] 0709 13:13:25.630822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.868190 (+237368us) service_pool.cc:224] Handling call
0709 13:13:27.329379 (+1461189us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:28.348599 (+1019220us) spinlock_profiling.cc:243] Waited 77.7 ms on lock 0x7b54005d02d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:28.348777 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219179008}
I20260709 13:13:28.387348  2362 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.387737   559 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:28.389635  2362 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:28.390815   482 raft_consensus.cc:3055] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:28.393160   482 raft_consensus.cc:740] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:28.395318  2658 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:28.396019  2857 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:28.392709  2880 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:28.394629   482 consensus_queue.cc:260] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.413456   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 288) took 1681 ms. Trace:
I20260709 13:13:28.413843   479 rpcz_store.cc:276] 0709 13:13:26.732298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.886356 (+154058us) service_pool.cc:224] Handling call
0709 13:13:26.929062 (+ 42706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:28.377949 (+1448887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.413389 (+ 35440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:28.415395   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1562) took 3600 ms. Trace:
I20260709 13:13:28.412492   447 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:28.418473  1171 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:28.420661   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1391) took 2539 ms. Trace:
I20260709 13:13:28.420797  2850 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.421519  2850 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.421170   631 rpcz_store.cc:276] 0709 13:13:25.886204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.887340 (+  1136us) service_pool.cc:224] Handling call
0709 13:13:25.887584 (+   244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:25.912112 (+ 24528us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:26.615335 (+703223us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.059721 (+444386us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:27.060290 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 13:13:28.056891 (+996601us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:28.057008 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.150111 (+ 93103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:28.418164 (+268053us) raft_consensus.cc:1685] finished
0709 13:13:28.418188 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:28.418359 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2593,"prepare.queue_time_us":59763,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":22773,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":11757,"thread_start_us":961551,"threads_started":2,"wal-append.queue_time_us":1642666}
I20260709 13:13:28.406769  2945 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:28.423465  2863 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:28.424088  2945 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.425936   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:28.426620   559 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:28.427209  2945 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:28.427476   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:28.393554  2867 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.429054   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:28.429636  2929 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:28.430037   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:28.430353  2867 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:28.425670  2934 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.376061  2844 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:28.432615  2934 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:28.428274  2465 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:28.433377   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.428493   480 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 4: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:28.429636   478 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:28.417781   554 rpcz_store.cc:276] 0709 13:13:24.814618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.368774 (+1554156us) service_pool.cc:224] Handling call
0709 13:13:26.404626 (+ 35852us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.404840 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:26.442623 (+ 37783us) log.cc:844] Serialized 14 byte log entry
0709 13:13:28.414791 (+1972168us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:28.414919 (+   128us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:28.415044 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.415136 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:28.415330 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":42519,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":46133,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":167,"thread_start_us":1971456,"threads_started":2,"wal-append.queue_time_us":1576915}
I20260709 13:13:28.453634   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:28.461417  2954 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.462313  2954 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.465420  2954 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:28.466012  2954 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.466735  2954 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.469754  2954 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:28.456722   599 leader_election.cc:336] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 2.047s (SENT)
I20260709 13:13:28.476367   599 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:28.481666   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:28.459462   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:28.481287  2863 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:28.485201  2863 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.453330  2534 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.487982   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:28.490254  2534 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:28.495348   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:28.456408  2934 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:28.502555   556 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:28.514117  2957 consensus_queue.cc:1059] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:13:28.515223  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:28.515502  2362 raft_consensus.cc:3055] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:28.515937  2362 raft_consensus.cc:740] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:28.516171  1167 raft_consensus.cc:2393] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:28.452907  2929 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:28.517151  2362 consensus_queue.cc:260] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.518802  2362 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:28.518428  2929 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.520790   624 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:28.571641  2929 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:28.523064   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:28.523507  2863 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:28.572573   629 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:28.524367   632 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:28.524809   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 149724us
I20260709 13:13:28.525000   559 raft_consensus.cc:2410] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:28.575186   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:28.575803   559 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:28.576629   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:28.577181   559 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:28.532238  2864 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:28.537202  2932 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.583958  2932 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.586258  2932 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:28.537810  2866 consensus_queue.cc:1059] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:28.538875   482 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:28.587450  2866 raft_consensus.cc:3055] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:28.587845  2866 raft_consensus.cc:740] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:28.588948  2866 consensus_queue.cc:260] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.590317  2866 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:28.538739  2646 consensus_queue.cc:1059] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:28.591768  2646 raft_consensus.cc:3055] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:13:28.591380  2933 consensus_queue.cc:1175] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" responder_term: 4 status { last_received { term: 3 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:28.592257  2646 raft_consensus.cc:740] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:28.593369  2646 consensus_queue.cc:260] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.594786  2646 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:28.595377   447 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:28.539598   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:28.595569   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1525) took 4011 ms. Trace:
I20260709 13:13:28.596840  2934 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:28.597002   447 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:28.541119  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.458806  2465 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.598601   447 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:28.541235  2184 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.539742  2935 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:13:28.599618  2935 consensus_queue.cc:1243] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 6e6df7e8ed204f1db5c371536b5b0683 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:13:28.599575  2184 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.542943   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:28.542883  2849 consensus_queue.cc:1059] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:28.545132   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:28.546609  2854 consensus_queue.cc:1059] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:28.547899  2550 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:28.548237   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:28.548398   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:28.549238   597 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:28.549455  2893 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.549266   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:28.610357   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:28.550359   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 110340us
I20260709 13:13:28.552100  2850 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:28.554124   552 raft_consensus.cc:2393] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 5: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:28.554550  2956 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:13:28.555310  2926 log.cc:927] Time spent T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:13:28.614925   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:28.615813   554 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 4: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:28.616567   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:28.617574  2184 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:28.617861   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:28.618362   551 raft_consensus.cc:2393] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:28.618453   629 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:28.619349   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:28.619494   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:28.619753  2849 raft_consensus.cc:3055] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:28.620198  2849 raft_consensus.cc:740] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:28.620456   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:28.620543   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:28.620815   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:28.621479   625 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:28.621177  2849 consensus_queue.cc:260] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.621722   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:28.622254   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:28.606163  2935 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:28.558275   523 connection.cc:256] RPC call timeout handler was delayed by -1.5781687979999788s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
I20260709 13:13:28.620208   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:28.623986   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:28.624662   633 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:28.558900  2827 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.561628  2534 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:28.563463   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:28.564188   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 51305.5us
I20260709 13:13:28.565155   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:28.627436   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 78357.4us
I20260709 13:13:28.628298   630 raft_consensus.cc:2410] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:28.628338  2827 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.629338  2864 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:28.548246   550 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:28.539271  2953 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:28.604754  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 167453us
I20260709 13:13:28.607935   559 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:28.633612  2953 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.634487   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:28.609345   556 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:28.627038  2929 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:28.611059   482 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:13:28.635355  2956 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.635826  2929 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.636193  2953 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:28.636729  2954 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.637209  2954 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.608539   558 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:28.637722  2956 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:28.598996  2465 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.638381  2854 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:28.606343  2771 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:13:28.614085   626 raft_consensus.cc:2393] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:28.639822   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:28.614751   447 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:28.615865   632 raft_consensus.cc:2410] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:13:28.622607   629 raft_consensus.cc:2410] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:28.514441   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:28.625479   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:28.560834  1139 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:28.630220  2893 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.627108  2863 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.650103  2863 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.631910  2880 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.651134  2880 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.652064  2783 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.652776  2863 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:28.652642  2783 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.610049  2932 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:28.637526   559 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:28.637830  2929 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:28.613823  2933 raft_consensus.cc:3055] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:28.643386   624 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:28.613306   631 raft_consensus.cc:2393] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:28.622526  2849 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:28.643165   626 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:28.646129   558 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:28.596287   557 rpcz_store.cc:276] 0709 13:13:24.583742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.167838 (+1584096us) service_pool.cc:224] Handling call
0709 13:13:26.168171 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.168424 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:28.147720 (+1979296us) log.cc:844] Serialized 14 byte log entry
0709 13:13:28.448087 (+300367us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:28.455382 (+  7295us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:28.500658 (+ 45276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.507745 (+  7087us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:28.595460 (+ 87715us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39613,"prepare.queue_time_us":48771,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":68631,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":262,"thread_start_us":2148976,"threads_started":3,"wal-append.queue_time_us":147931}
I20260709 13:13:28.646996   555 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:13:28.643363  2850 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:13:28.648801  2465 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:28.659641  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:28.632555  2827 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:28.660619   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 46037.6us
I20260709 13:13:28.660959  2662 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.661712  2662 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:28.655378   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:28.663604   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.664529  2833 raft_consensus.cc:2804] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:28.664955  2833 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.665282  2833 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:28.667593   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:28.668294   632 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:28.653317  2880 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:28.659777  1167 raft_consensus.cc:1240] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:28.673646  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:13:28.651463  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 90804.3us
I20260709 13:13:28.650722  2893 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:28.654260   633 raft_consensus.cc:2410] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:28.643968  2184 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.621495   628 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:28.669662  2771 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:28.657829  2933 raft_consensus.cc:740] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:28.687918  2933 consensus_queue.cc:260] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.689356  2933 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:28.671435  2850 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.691860  2850 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.692319   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:28.674228   554 raft_consensus.cc:1275] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:13:28.693769   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:28.694172  2850 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:28.683575  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:28.694579   633 raft_consensus.cc:2410] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:28.694631  2864 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:28.695474  1169 raft_consensus.cc:2410] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 13:13:28.695606   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.683943  1167 raft_consensus.cc:1240] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:13:28.684373  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:28.696362   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:28.696727  1168 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:28.697118   631 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:28.698004  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:28.698948  1168 raft_consensus.cc:2410] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:13:28.699373  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:28.700043  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:28.700407  1169 raft_consensus.cc:2410] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:13:28.686051  2932 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:28.686414   366 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4e472c1c82c9467a9a5563d6b06e3b53 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6ba2a9c02b534120bbf26e56a1e920ca is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:28.700544  2184 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.693178   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:28.693480  1170 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:28.685017  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:28.707962   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.672688   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:28.682981   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:28.716360   632 raft_consensus.cc:2410] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:28.736181  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:28.737047  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:28.737769  1166 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
W20260709 13:13:28.744946   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.737345  1167 raft_consensus.cc:2410] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:28.763541   624 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
W20260709 13:13:28.765051   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.785192   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:28.786164   483 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
W20260709 13:13:28.786614   599 leader_election.cc:336] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 2.187s (SENT)
I20260709 13:13:28.787216   599 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:28.787707  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:28.788348  1173 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:28.789204  1139 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:28.789395   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:28.701392  2932 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.792469  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:28.793516  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:28.797775   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.793054  1172 raft_consensus.cc:2376] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5. Re-sending same reply.
I20260709 13:13:28.801870  1139 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:28.796334   523 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:28.807471  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.807739   597 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:28.783818  2783 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:28.785243  2662 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:28.814353  2771 consensus_queue.cc:1048] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:28.814976  1174 raft_consensus.cc:1240] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:28.815996  2846 consensus_queue.cc:1059] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:28.816423   483 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:28.816977  2846 raft_consensus.cc:3055] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:28.817369  2846 raft_consensus.cc:740] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:28.818482   523 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:28.818322  2846 consensus_queue.cc:260] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.819991  2534 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:28.820597  2534 raft_consensus.cc:697] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:28.821735  2534 consensus_queue.cc:237] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.823616   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:28.824496   554 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:28.824771   597 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:28.826355  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:28.827843  2867 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:28.828429  2867 raft_consensus.cc:697] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:28.829453  2867 consensus_queue.cc:237] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.831584   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:28.831423  2945 consensus_queue.cc:1059] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:28.819033  2929 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:28.832651  2956 raft_consensus.cc:3055] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:28.832996  2929 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.833213  2956 raft_consensus.cc:740] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:28.833572  2929 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:28.834515   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:28.834298  2956 consensus_queue.cc:260] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.835278   555 raft_consensus.cc:2393] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:28.796263  2362 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:28.836931   479 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:28.812815  1141 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:28.838233  2850 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:28.838658  2850 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:28.839066  2850 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:28.839591  2932 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:28.840772   597 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:28.842440  2951 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:28.842957  2951 raft_consensus.cc:697] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:28.844015   448 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:28.843982  2951 consensus_queue.cc:237] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.810814  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:28.847545  1168 raft_consensus.cc:2393] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:28.847415   522 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:28.848675   522 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:28.849285  2857 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:28.849829  2857 raft_consensus.cc:697] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:28.850955  2959 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:28.850762  2857 consensus_queue.cc:237] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.852231   522 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:28.851012  2856 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:28.853456   551 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:13:28.851524  2959 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.854424  2959 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:28.854483  2362 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.855080  2362 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:28.794843  2864 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:28.861372   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:28.862279  1171 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:13:28.862443  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 60652.6us
I20260709 13:13:28.862998  2930 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:28.863306  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:28.863610  2930 raft_consensus.cc:697] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:28.863930  2764 consensus_queue.cc:1059] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:28.865027  2764 raft_consensus.cc:3055] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:28.864714  2930 consensus_queue.cc:237] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.865422  2764 raft_consensus.cc:740] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:28.866379  2764 consensus_queue.cc:260] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:28.867374  2662 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:28.869005  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:28.870471  2184 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:28.870633   597 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:28.879372  2465 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:28.874711  2954 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:28.879873  2465 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.880617  2465 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:28.879076   599 connection.cc:256] RPC call timeout handler was delayed by -1.4700360510000792s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
I20260709 13:13:28.885694  1173 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:28.826943  1166 raft_consensus.cc:2376] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6. Re-sending same reply.
I20260709 13:13:28.881392   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:28.896960   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:28.896900   480 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:28.904815   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:28.906389   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.907584   484 raft_consensus.cc:2393] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 5: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:28.907955   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:28.909296   522 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:28.907658   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:28.915416   559 raft_consensus.cc:2410] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:28.882881  2764 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:28.918831  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 106084us
I20260709 13:13:28.919664  1141 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:28.920533   478 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:28.896184  2863 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:28.928524   522 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:28.929731   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:28.935676  1174 raft_consensus.cc:1240] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:28.917014  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:28.938275   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:28.927703  2846 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:28.929459  2863 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.946131   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:28.947171   556 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:28.948911   555 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:28.949617   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:28.950313   477 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:28.951771   481 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:28.937294  2957 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:28.935289  2880 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:28.958688   522 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:28.959561  2856 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:28.959833  2827 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:28.960304  2827 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:28.960711  2827 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:28.961052  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:28.961968  1167 raft_consensus.cc:2410] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:13:28.917932  2864 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 13:13:28.956241  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 72238.5us
I20260709 13:13:28.956815   480 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
W20260709 13:13:28.956207   599 leader_election.cc:336] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.736s (SENT)
W20260709 13:13:28.970901   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 44448.1us
I20260709 13:13:28.942546   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:28.973166  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 53584.3us
I20260709 13:13:28.977149   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:28.967634   448 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:28.954468  2863 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:28.986656  1138 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:28.990027  2184 raft_consensus.cc:2804] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:28.990118  2550 consensus_queue.cc:1059] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:28.991298  2550 raft_consensus.cc:3055] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:28.991755  2550 raft_consensus.cc:740] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:28.992724  2550 consensus_queue.cc:260] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:28.994231  2935 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:28.994773  2935 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.995498  2935 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:28.954041  2833 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:29.001453  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:29.001719  2833 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:28.991325   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 59399.8us
I20260709 13:13:29.007161   525 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:28.990528   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 44377.7us
I20260709 13:13:29.009393  2953 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:13:29.011013   599 leader_election.cc:336] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 2.256s (SENT)
W20260709 13:13:29.012164   599 leader_election.cc:336] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 2.681s (SENT)
I20260709 13:13:29.012554   599 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:29.013238   556 raft_consensus.cc:1240] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:29.013749   599 leader_election.cc:336] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 3.240s (SENT)
W20260709 13:13:29.014904   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.012506  1170 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:28.983057  2934 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:28.969698  2646 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:13:28.956610  2867 consensus_queue.cc:1059] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:13:29.047268   476 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:29.218802  2827 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:29.220961  2827 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:28.982844  2362 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:29.265880  2362 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:29.268821  2935 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:29.270843  2935 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:29.280320  2959 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:29.282917  2959 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:29.289366   478 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.301735   478 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:29.319410  2956 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:29.349773  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 371696us
I20260709 13:13:29.350461  2981 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:29.350673  1138 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:29.351859  2362 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:29.362814  2929 consensus_meta.cc:287] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.529s	user 0.006s	sys 0.006s
I20260709 13:13:29.363339  2929 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:29.366057  2929 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:29.371958   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:29.372548   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:29.373399   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.374171   479 raft_consensus.cc:2393] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 5: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:29.372669   478 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:29.376459  2934 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.376986  2934 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:29.380605   476 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:13:29.379145  2934 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:29.382597   478 raft_consensus.cc:2410] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:29.386965  2184 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:29.387471  2184 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.392619   480 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:29.393676   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.396580   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.397156   476 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:29.399400   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.400046   476 raft_consensus.cc:2376] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6. Re-sending same reply.
I20260709 13:13:29.401242   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.402599   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.403170   476 raft_consensus.cc:2376] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7. Re-sending same reply.
I20260709 13:13:29.411049   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:29.411530   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:29.412925   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.411767   477 raft_consensus.cc:2368] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6.
I20260709 13:13:29.414247   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.412154   476 raft_consensus.cc:2376] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4. Re-sending same reply.
I20260709 13:13:29.415282   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.026093  2957 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:29.416973   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:29.417752   479 raft_consensus.cc:2410] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:29.418439   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.415302   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.421988   477 raft_consensus.cc:2393] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 6: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:29.424787   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:29.425719   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.428581   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.426548  2863 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:29.430498  2863 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:29.431538   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:29.436352   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.436286  2935 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:29.436579   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:29.437458   477 raft_consensus.cc:2376] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5. Re-sending same reply.
I20260709 13:13:29.438373   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.439083   477 raft_consensus.cc:2393] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 5: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:29.439863   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:29.440824  2184 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:29.435498   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.441870   479 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:29.442809   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.444087   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:29.444427  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 460360us
I20260709 13:13:29.445106   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.445374  1141 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:29.445746   479 raft_consensus.cc:2393] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 5: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:29.446451   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.441165   477 raft_consensus.cc:2376] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6. Re-sending same reply.
I20260709 13:13:29.447851   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:29.448354   477 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:29.451056  2981 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:29.451715  2981 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:29.452808  1141 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:29.466881  2362 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:29.467314  2362 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.467626  2362 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.488921  2362 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:29.456248   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.462180   477 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:29.442926  2184 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:29.492312   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.492959   479 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:29.493170   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.494160   477 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:29.494297   479 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:29.434852   480 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
W20260709 13:13:29.496239   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:29.496430   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:29.496838   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:29.497299   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.498170   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.498996   478 raft_consensus.cc:2410] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:29.498775   624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:29.499531   624 raft_consensus.cc:606] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:29.500239  2956 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.500728  2956 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:29.501765   475 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:29.503473  2362 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:29.494994  2867 raft_consensus.cc:3055] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:29.509639   632 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:29.521014   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:29.521231   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:29.521862   480 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:29.510272   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:29.510702   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:29.511226   628 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:13:29.524528   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.511552   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:29.512475  2956 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:29.513759  2981 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:29.513985   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:29.516067  1170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:57004
I20260709 13:13:29.534204  1170 raft_consensus.cc:606] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:13:29.015210   599 connection.cc:256] RPC call timeout handler was delayed by -1.04253605100007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2445s for a response
I20260709 13:13:29.534686  1170 raft_consensus.cc:614] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:29.519073  2867 raft_consensus.cc:740] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:29.535897  2867 consensus_queue.cc:260] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:29.525840   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:29.537642   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:29.538691   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:29.537675   479 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:29.539690  2934 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:29.539893   631 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:13:29.540844   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:29.541064   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:29.541641   632 raft_consensus.cc:2410] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:29.542178   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:29.542367   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:29.539729   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:29.543874   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:29.544553   479 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.539217   629 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:29.546032   480 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:29.547634   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:29.036857  2550 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.548655   599 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:29.550349  1138 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:29.551362  2833 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:29.551502   522 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.006s	sys 0.008s
W20260709 13:13:29.551905   522 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.006s	sys 0.008s
W20260709 13:13:29.552174   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 593525us
I20260709 13:13:29.527068   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:29.532812   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:29.553067   522 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:29.553462   477 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.533475   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:29.537092  2867 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:29.554595  2951 raft_consensus.cc:2764] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:13:29.554798   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:29.555120  1166 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:29.555353  2863 consensus_queue.cc:1059] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:29.555908   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:29.556246  2863 raft_consensus.cc:3055] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:29.556589  2863 raft_consensus.cc:740] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:29.556962   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:29.557498   624 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.557410  2863 consensus_queue.cc:260] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:29.558594  2863 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.561669  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:29.576372  1141 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:29.576789   624 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:29.577638  1141 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:29.579456   479 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:29.588040   477 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:29.590334   522 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:29.591820   522 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:29.592948  1141 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:29.595088   624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:29.595855   624 raft_consensus.cc:606] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:29.597563  1141 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:29.589520  2929 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:29.598803   624 raft_consensus.cc:1240] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:29.599735  2929 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:29.593739  2833 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:13:29.600566  2987 raft_consensus.cc:2804] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:29.603266   522 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:29.606361   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 57815.6us
I20260709 13:13:29.607290  2929 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.609097  2929 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.609196  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:29.613220  1170 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:29.594307  2933 raft_consensus.cc:2764] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:13:29.594094  2893 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:29.617084  2893 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.617461  2893 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:29.619451  1174 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:13:29.619812  2979 log.cc:927] Time spent T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.495s	user 0.004s	sys 0.000s
I20260709 13:13:29.594475  2184 raft_consensus.cc:2804] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:29.620760  2184 raft_consensus.cc:697] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:29.624188  1139 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:29.598918  2985 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:13:29.621670  2976 log.cc:927] Time spent T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.501s	user 0.000s	sys 0.004s
I20260709 13:13:29.621601  2929 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:29.634788  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 81419.9us
W20260709 13:13:29.635469   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 102060us
I20260709 13:13:29.621838  2184 consensus_queue.cc:237] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:29.636798   448 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:29.629518  2987 raft_consensus.cc:697] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:29.642123  1139 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:29.636664  2362 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:29.635869  2985 raft_consensus.cc:697] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:29.644521  2933 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:29.644649  2980 log.cc:927] Time spent T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.519s	user 0.003s	sys 0.001s
I20260709 13:13:29.638804  2935 consensus_queue.cc:1059] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:13:29.646781  2952 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:29.649647  2987 consensus_queue.cc:237] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:29.652848  2952 raft_consensus.cc:697] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:29.653800  2952 consensus_queue.cc:237] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:29.654160  2893 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:29.656219  2935 raft_consensus.cc:3055] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:29.656674  2935 raft_consensus.cc:740] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:29.656136  2985 consensus_queue.cc:237] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:29.657511  2935 consensus_queue.cc:260] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:29.658195  2867 consensus_queue.cc:1059] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:29.659492  2951 raft_consensus.cc:3055] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:29.659387  2934 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:29.659919  2951 raft_consensus.cc:740] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:29.639151  2833 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:13:29.660848  2951 consensus_queue.cc:260] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:29.663443  2951 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:29.663726   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:29.664414   482 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:29.670253  2764 consensus_meta.cc:287] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.000s
I20260709 13:13:29.670331  2933 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:29.671175   482 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:13:29.677433  2934 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:29.678653  1141 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:29.678992  2846 consensus_meta.cc:287] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.724s	user 0.004s	sys 0.008s
W20260709 13:13:29.679347   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 661208us
I20260709 13:13:29.679816   626 raft_consensus.cc:2410] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:29.679904  2893 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:29.691108  2986 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:13:29.691336   476 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:29.691452  2880 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:13:29.692137   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:29.692607  1167 pending_rounds.cc:85] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: Aborting all ops after (but not including) 5
I20260709 13:13:29.692915  1167 pending_rounds.cc:107] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:13:29.693251  1167 raft_consensus.cc:2889] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:29.690757  2658 consensus_queue.cc:1059] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:13:29.693434   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:29.694376  2846 raft_consensus.cc:3055] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:29.694815  2846 raft_consensus.cc:740] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:29.695788  2846 consensus_queue.cc:260] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:29.697464  2846 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:29.697759   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.693182   525 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:29.659060  2935 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:29.723645  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 87804.9us
I20260709 13:13:29.711814  2646 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.724967  2863 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:29.720664  2833 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:29.720819  2856 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:13:29.692938  2880 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:13:29.722546  2362 raft_consensus.cc:697] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:29.728014  2764 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:29.745786   628 raft_consensus.cc:1240] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:29.746222  2658 consensus_queue.cc:1059] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:29.746644   525 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:29.746999   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:29.747587  2658 raft_consensus.cc:3055] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:29.747716   628 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:29.748172  2658 raft_consensus.cc:740] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:29.748425   525 leader_election.cc:400] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6.
I20260709 13:13:29.748796   525 leader_election.cc:403] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:13:29.748869   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:29.749521   628 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:29.749858   525 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:29.750000  2991 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:13:29.740700  2863 raft_consensus.cc:697] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:29.776762  2764 raft_consensus.cc:697] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:29.781469   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:29.786144  2987 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.787396  2929 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:29.793831   624 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:13:29.795997  2984 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:13:29.742062  2893 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:13:29.804746   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:29.749193  2658 consensus_queue.cc:260] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:29.812748   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:29.813122  2658 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:29.803930  2550 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.814122   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:29.808135  2880 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.743440  2646 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:29.810055  2827 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:29.811902  2764 consensus_queue.cc:237] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:29.813234  2934 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.808013  2856 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:29.816913  1138 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:29.818568   624 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:29.822464   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:29.823433  2827 raft_consensus.cc:697] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:29.824435   627 raft_consensus.cc:1240] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:29.824371  2827 consensus_queue.cc:237] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:29.829118   624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:29.829770   624 raft_consensus.cc:606] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:29.830225   624 raft_consensus.cc:614] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:29.831398   627 raft_consensus.cc:1275] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:13:29.831965   627 pending_rounds.cc:85] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 2
I20260709 13:13:29.835278   627 pending_rounds.cc:107] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:13:29.835711   627 raft_consensus.cc:2889] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:29.816076  2550 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:29.807016  2987 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:29.839421  2956 consensus_queue.cc:1059] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 13:13:29.895648   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 145875us
I20260709 13:13:29.892077   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:29.896377   550 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:29.896965   627 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:13:29.895500   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:29.898188   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:29.869717  3003 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:29.898788   559 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.896847   525 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:29.897300   627 pending_rounds.cc:85] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 3
I20260709 13:13:29.841776  2934 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:29.901481   627 pending_rounds.cc:107] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:13:29.902551   627 raft_consensus.cc:2889] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:29.831481  2362 consensus_queue.cc:237] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:29.892735  2863 consensus_queue.cc:237] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:29.918926  2977 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.919582  2977 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:29.919981   525 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:29.921053   522 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:29.941762   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.921619  2977 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:29.921811   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:29.959860   556 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:13:29.922221  1139 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:29.923033  2646 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:29.893579  2945 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:13:29.938084   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1593) took 1014 ms. Trace:
I20260709 13:13:29.949410   550 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:29.956224   559 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:29.938000   599 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:29.968811   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:29.969436   627 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:29.970527  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 48388.8us
W20260709 13:13:29.969331   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 49416.1us
I20260709 13:13:29.971442   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:29.972760   525 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:29.974205   525 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:29.962210   558 rpcz_store.cc:276] 0709 13:13:28.923282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.923409 (+   127us) service_pool.cc:224] Handling call
0709 13:13:28.937009 (+ 13600us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:28.986484 (+ 49475us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:29.456780 (+470296us) log.cc:844] Serialized 14 byte log entry
0709 13:13:29.631878 (+175098us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:29.636124 (+  4246us) log.cc:844] Serialized 52 byte log entry
0709 13:13:29.636268 (+   144us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:29.637241 (+   973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:29.637488 (+   247us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:29.937899 (+300411us) raft_consensus.cc:1685] finished
0709 13:13:29.937922 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:29.938030 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":249767,"prepare.queue_time_us":503798,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":39707,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":2768,"thread_start_us":171289,"threads_started":1,"wal-append.queue_time_us":189548}
W20260709 13:13:29.983656   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 81315.9us
I20260709 13:13:29.987371   525 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:29.990744   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.991753  2998 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:29.992672  3000 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:29.993577  2993 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:29.994472  2978 log.cc:927] Time spent T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.874s	user 0.000s	sys 0.004s
I20260709 13:13:29.999795  2934 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:30.000855   599 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:30.004235   628 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:30.012593   556 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:30.013655  2951 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:30.014110  2951 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:13:30.014489   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 93502.2us
I20260709 13:13:30.015072  2945 consensus_queue.cc:1048] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:30.015524  3001 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:30.015897   522 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:30.016776   522 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:30.016987  2998 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:30.017491  2998 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.017830  2998 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:30.019869   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.023777  2924 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.997s
I20260709 13:13:30.020294  1139 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:30.020581  3001 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:29.981536  2856 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:30.021008  3001 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.014513  2951 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:30.021423  2924 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:30.022083  2924 raft_consensus.cc:697] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:30.022226  2987 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:29.986490  2956 raft_consensus.cc:2804] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:30.023591  2956 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:30.023959  2956 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:30.021490  2993 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:30.027794  2993 raft_consensus.cc:697] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:30.029663   628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:30.030361   628 raft_consensus.cc:606] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:30.030752   628 raft_consensus.cc:614] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:13:30.050537   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 48238.3us
W20260709 13:13:30.051542   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:30.019172  2465 consensus_meta.cc:287] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.138s	user 0.011s	sys 0.002s
I20260709 13:13:30.056654   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:30.055564   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:30.057574   550 raft_consensus.cc:2393] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 6: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:30.058005   481 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:29.015403  2864 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:30.059839   630 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:30.061214   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:30.062429   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:30.062841   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 79779.6us
I20260709 13:13:30.063575   525 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:30.021446  3001 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:30.053998  2977 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:30.138352   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:30.145121   631 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:13:30.145543   631 pending_rounds.cc:85] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 3
I20260709 13:13:30.145778   631 pending_rounds.cc:107] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:13:30.145991   631 raft_consensus.cc:2889] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:30.147985   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:30.056756  2880 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6.
W20260709 13:13:30.173341   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 113194us
I20260709 13:13:30.173786  1138 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:30.170781   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 107257us
I20260709 13:13:30.175072   525 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:30.171571   629 raft_consensus.cc:2376] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6. Re-sending same reply.
I20260709 13:13:30.023051  2924 consensus_queue.cc:237] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:30.181398   557 raft_consensus.cc:1240] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:30.184056   525 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:30.128984  2863 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:30.058615  2465 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:30.180327  2953 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:30.202587   630 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:30.182675  2977 raft_consensus.cc:697] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:30.185233  2987 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:30.190026  2929 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.209470   628 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:30.211375   525 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:30.224278   475 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:30.230345   599 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:30.231777   599 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:30.230409   525 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:30.235471   550 raft_consensus.cc:3055] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:30.235832   550 raft_consensus.cc:740] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:13:30.240271   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.204779  2953 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:30.243212   525 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:30.246402   525 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:30.242642   599 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:30.255059   599 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:30.242257   550 consensus_queue.cc:260] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:30.243693  2953 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.257403  2945 raft_consensus.cc:2764] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:13:30.270423   550 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:30.249285  2864 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:30.241108  2880 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:30.254979   412 debug-util.cc:398] Leaking SignalData structure 0x7b0800034700 after lost signal to thread 31817
W20260709 13:13:30.298364   412 debug-util.cc:398] Leaking SignalData structure 0x7b080008b280 after lost signal to thread 415
I20260709 13:13:30.248921  2952 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:30.257902  2856 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:30.248279  2846 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:30.191300  2993 consensus_queue.cc:237] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:30.313352   525 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:30.259202  2658 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:13:30.303042  2864 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:30.308142  2863 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:30.309290  2846 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:30.327255   525 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:30.300153  2951 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:30.332504  2465 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:30.332713   478 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:30.319361  2977 consensus_queue.cc:237] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:30.335970  3009 log.cc:927] Time spent T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:13:30.340899   627 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:30.341641   632 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:30.329883  2952 raft_consensus.cc:2764] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:13:30.325229  2864 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.358119   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:30.358981   480 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:30.360565   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:30.370268   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:30.372175   483 raft_consensus.cc:1240] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:13:30.329015  2827 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:30.328755  2846 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.328290  2863 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:30.377251   629 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:30.341990  2945 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:30.380705   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:30.381989   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 126981us
I20260709 13:13:30.314893  3022 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:13:30.389619   599 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:30.382335   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:30.393110   478 raft_consensus.cc:1275] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:30.396906   550 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:30.391206   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:30.408579   599 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:30.394699  2863 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:30.418843  3006 log.cc:927] Time spent T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.331s	user 0.000s	sys 0.002s
W20260709 13:13:30.419993  3016 log.cc:927] Time spent T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:13:30.425241   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.411635  2465 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:30.410271  2945 raft_consensus.cc:697] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:30.391798  2954 consensus_queue.cc:1059] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:13:30.444200   627 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:30.409895  2952 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:13:30.476523   627 raft_consensus.cc:3055] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:30.477061   627 raft_consensus.cc:740] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:30.435386  2465 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:30.486331  3023 log.cc:927] Time spent T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:13:30.487443  3028 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:30.491328   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.484349   627 consensus_queue.cc:260] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:30.488067  3028 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:30.507536  3028 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:30.507954  3011 log.cc:927] Time spent T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:13:30.510838  2987 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:30.502295  3027 log.cc:927] Time spent T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:13:30.484030  2465 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:30.515664   633 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:30.516520   627 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.481851  2854 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:30.538451   478 raft_consensus.cc:1275] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:13:30.537110   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 237) took 1027 ms. Trace:
I20260709 13:13:30.538275  2934 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.542996  2934 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:30.545192  2934 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:30.545656  2854 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:30.546128  2953 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:30.547958  2854 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:30.555414  2929 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:30.540830   633 rpcz_store.cc:276] 0709 13:13:29.510156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.515005 (+1004849us) service_pool.cc:224] Handling call
0709 13:13:30.515316 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:30.536846 (+ 21530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.537052 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:30.558210   633 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:30.559397  2945 consensus_queue.cc:237] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:30.525926  2998 consensus_meta.cc:287] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.508s	user 0.005s	sys 0.006s
I20260709 13:13:30.611269   478 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:13:30.611750  2864 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:30.614712  2953 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:30.616155   631 raft_consensus.cc:1240] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:30.624147   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 257157us
I20260709 13:13:30.525507  2956 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:30.549846  3001 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:30.609313  2951 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:30.652601  2846 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:30.558224  2465 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:30.659389   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 244132us
I20260709 13:13:30.661801   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:30.671382   481 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:13:30.673520   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:30.674320   482 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.677299   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:30.681882   525 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:30.678786   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:30.685344   480 raft_consensus.cc:2410] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:30.687269   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:30.691478  2934 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.692019  2934 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:30.694164  2934 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:30.697819  3030 log.cc:927] Time spent T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:13:30.699379  3035 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.666205  2864 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:30.703471  3024 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:13:30.705984  2465 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:30.687201   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:30.655159  2846 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:30.720682   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:30.723556   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:30.724611   476 raft_consensus.cc:2410] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:30.728060   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:30.730767   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:30.731325   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:30.731896   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:30.732245   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.735648   480 raft_consensus.cc:1240] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:13:30.608376  2998 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:30.739452   481 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 13:13:30.737303   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:30.742871   625 raft_consensus.cc:1240] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:30.739400   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1509) took 1203 ms. Trace:
I20260709 13:13:30.760237   626 rpcz_store.cc:276] 0709 13:13:29.536405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.543349 (+  6944us) service_pool.cc:224] Handling call
0709 13:13:30.739142 (+1195793us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54000bf9d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:30.739310 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302001920}
I20260709 13:13:30.748402   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:30.752772   412 debug-util.cc:398] Leaking SignalData structure 0x7b080030c240 after lost signal to thread 508
I20260709 13:13:30.657590  2956 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:30.739370   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:30.764279   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:30.764487   626 raft_consensus.cc:3055] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:30.764880   626 raft_consensus.cc:740] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:30.765790   626 consensus_queue.cc:260] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:30.766763   626 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:30.764902   481 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.767979  2985 consensus_queue.cc:1059] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:30.769064  2985 raft_consensus.cc:3055] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:30.769388  2985 raft_consensus.cc:740] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
W20260709 13:13:30.769620   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 1.74277e+06us
I20260709 13:13:30.770201  2985 consensus_queue.cc:260] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:30.771679  2985 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:30.778407   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.781288   599 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:30.783000   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:30.783987   480 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:30.716761  3001 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:30.668762  3025 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
W20260709 13:13:30.819500   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 45917us
I20260709 13:13:30.791083  2465 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:30.824131   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.825196   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:30.825776   633 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:30.827684   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:30.828122   633 raft_consensus.cc:2376] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6. Re-sending same reply.
I20260709 13:13:30.828663   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:30.829399   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:30.829895   633 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.822388  2956 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:30.840831   481 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
W20260709 13:13:30.841774   509 heartbeater.cc:646] Failed to heartbeat to 127.31.17.190:46835 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.31.17.190:46835 timed out after 15.000s (SENT)
I20260709 13:13:30.854316   482 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:30.855777   483 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:30.857931   480 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:30.861681   624 raft_consensus.cc:3055] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:30.862040   624 raft_consensus.cc:740] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:30.826643  2465 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:30.865829  2998 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:30.868117   551 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.904s	user 0.013s	sys 0.018s
I20260709 13:13:30.875036   599 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:30.875926   551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.912s	user 0.013s	sys 0.018s
I20260709 13:13:30.876686   624 consensus_queue.cc:260] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:30.883054  2959 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:13:30.884025  2974 log.cc:927] Time spent T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 1.720s	user 0.000s	sys 0.006s
I20260709 13:13:30.874645  2856 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:30.886745  2856 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:30.886744  2924 raft_consensus.cc:3055] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:30.899938   626 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:13:30.900329   626 pending_rounds.cc:85] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 7
I20260709 13:13:30.900192  2924 raft_consensus.cc:740] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:30.900684   626 pending_rounds.cc:107] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:13:30.900988   626 raft_consensus.cc:2889] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:30.901981   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:30.901537  2924 consensus_queue.cc:260] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:30.903122   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:30.891088   447 leader_election.cc:336] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 2.102s (SENT)
I20260709 13:13:30.912390   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1591) took 2016 ms. Trace:
I20260709 13:13:30.908962   632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1511) took 1372 ms. Trace:
W20260709 13:13:30.916043  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.922549   447 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:30.923168   632 rpcz_store.cc:276] 0709 13:13:29.536974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.543192 (+  6218us) service_pool.cc:224] Handling call
0709 13:13:30.142773 (+599581us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b5800167198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:30.341398 (+198625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:30.342198 (+   800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.908705 (+566507us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54000be5d0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:30.908855 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465753728}
I20260709 13:13:30.920222   525 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:30.926321   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:30.927337   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:30.919206  3042 log.cc:927] Time spent T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 13:13:30.911368  2956 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:30.928726   624 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:30.922705   551 rpcz_store.cc:276] 0709 13:13:28.896120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.896511 (+   391us) service_pool.cc:224] Handling call
0709 13:13:28.919299 (+ 22788us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:28.963655 (+ 44356us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:28.963981 (+   326us) log.cc:844] Serialized 14 byte log entry
0709 13:13:29.993759 (+1029778us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:30.876451 (+882692us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:30.880072 (+  3621us) log.cc:844] Serialized 26 byte log entry
0709 13:13:30.880226 (+   154us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:30.880261 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.880338 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:30.912116 (+ 31778us) raft_consensus.cc:1685] finished
0709 13:13:30.912211 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:30.912334 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48931,"prepare.queue_time_us":698,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":16580,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":1894,"spinlock_wait_cycles":421527424,"thread_start_us":1912057,"threads_started":1,"wal-append.queue_time_us":137376}
W20260709 13:13:30.931838   412 debug-util.cc:398] Leaking SignalData structure 0x7b08003aff20 after lost signal to thread 583
I20260709 13:13:30.934295   632 pending_rounds.cc:85] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 4
I20260709 13:13:30.934705   632 pending_rounds.cc:107] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:13:30.935036   632 raft_consensus.cc:2889] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:30.934821   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:30.903203  2924 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:30.942030  2850 consensus_meta.cc:287] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 2.103s	user 0.011s	sys 0.000s
I20260709 13:13:30.920095  2998 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:13:30.937103  2945 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:30.930508  3022 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:30.939163  2465 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:30.939932  2856 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:30.930733  2981 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:13:30.927124  2854 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:30.936407   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.928890   626 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:30.948652   380 catalog_manager.cc:5697] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:30.950503   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1596) took 2000 ms. Trace:
I20260709 13:13:30.952003  3037 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.952121  3038 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:30.953127  3024 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:30.980036  3037 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:30.955004   624 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:30.955621  3028 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:30.982282  3037 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:30.981719   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1527) took 1434 ms. Trace:
W20260709 13:13:30.960976   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 85999.6us
I20260709 13:13:30.961452   633 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:30.968089  2945 raft_consensus.cc:697] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:30.968369   627 raft_consensus.cc:3055] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:30.987545   627 raft_consensus.cc:740] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:30.966534  2850 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:30.969005  3022 raft_consensus.cc:697] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:30.967047  2993 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:13:30.970252  2550 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:30.975890   557 rpcz_store.cc:276] 0709 13:13:28.950586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.952853 (+  2267us) service_pool.cc:224] Handling call
0709 13:13:28.953215 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:30.181805 (+1228590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.950172 (+768367us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54001ca554. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:30.950424 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2824136448}
W20260709 13:13:30.977658   630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1432) took 1349 ms (client timeout 1603 ms). Trace:
W20260709 13:13:30.994619   630 rpcz_store.cc:269] 0709 13:13:29.628531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.693184 (+ 64653us) service_pool.cc:224] Handling call
0709 13:13:30.977428 (+1284244us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54001ad1d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:30.977581 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840897408}
I20260709 13:13:30.984403   624 rpcz_store.cc:276] 0709 13:13:29.547342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.887344 (+340002us) service_pool.cc:224] Handling call
0709 13:13:29.887742 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:30.861593 (+973851us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b54004676a0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68390dc0 00007f4b6841b1c0 00007f4b6841c231 00007f4b68418d8f 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c
0709 13:13:30.981464 (+119871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.981665 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155499264}
W20260709 13:13:30.988248   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.989327   627 consensus_queue.cc:260] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:30.989915   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 98911.5us
I20260709 13:13:30.983948  3028 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:30.992820   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:30.994083   412 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba940 after lost signal to thread 657
W20260709 13:13:30.998812   412 debug-util.cc:398] Leaking SignalData structure 0x7b0800368de0 after lost signal to thread 658
W20260709 13:13:31.000427   412 debug-util.cc:398] Leaking SignalData structure 0x7b080040a860 after lost signal to thread 1199
W20260709 13:13:31.000795   412 debug-util.cc:398] Leaking SignalData structure 0x7b080040a760 after lost signal to thread 1200
W20260709 13:13:31.001718   412 debug-util.cc:398] Leaking SignalData structure 0x7b080040a740 after lost signal to thread 2925
W20260709 13:13:30.985797   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.014230   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:30.990953  2975 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:13:31.023803   552 raft_consensus.cc:1240] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:13:31.023666   627 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:31.023910   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:31.026918   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.020171   597 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:31.035629  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 78988.5us
I20260709 13:13:31.036350   599 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:13:31.038733   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.040951   447 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:31.042929   599 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:31.057960   628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1528) took 1510 ms. Trace:
I20260709 13:13:31.056631  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:31.058295   628 rpcz_store.cc:276] 0709 13:13:29.547641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.063166 (+515525us) service_pool.cc:224] Handling call
0709 13:13:30.063465 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:30.213978 (+150513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:31.057766 (+843788us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54001aefd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:31.057913 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335028992}
W20260709 13:13:31.039520  2863 consensus_meta.cc:287] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.000s
I20260709 13:13:31.062304   447 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:31.045270  2550 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:31.092308   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 72215.7us
I20260709 13:13:31.080700   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:31.067354  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:31.070225   550 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:31.071959   559 raft_consensus.cc:1240] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 6. Ops: []
I20260709 13:13:31.065559   447 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:31.094264  1175 raft_consensus.cc:2410] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:13:31.100013   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:31.100932   557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:13:31.092561  2534 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:31.067683  2846 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:31.068593  2863 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:31.067157  3000 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.114713   597 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:31.107524   556 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:31.092449  2945 consensus_queue.cc:237] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:31.108472   557 raft_consensus.cc:606] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:31.092274  3022 consensus_queue.cc:237] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:31.067175  2998 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.080816  3035 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:31.075981  2854 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:31.113967  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 51128.8us
I20260709 13:13:31.118717   551 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:31.126112   627 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:31.131040   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:31.134096   558 raft_consensus.cc:2393] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:31.134958   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:31.136001   559 raft_consensus.cc:2410] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:31.111927  2844 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:31.076027  2184 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:13:31.141585   554 raft_consensus.cc:1240] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:31.063638  3041 consensus_queue.cc:1059] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:13:31.124243  2933 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:31.126050  2846 raft_consensus.cc:697] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:31.130142  2864 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:31.155504   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:31.175622   551 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:13:31.176841  2864 raft_consensus.cc:697] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:31.177639  3053 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:13:31.178086  2864 consensus_queue.cc:237] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:31.180501  2534 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:31.153685  1169 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:13:31.133141  2934 consensus_queue.cc:1059] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:13:31.156875  2844 raft_consensus.cc:697] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:13:31.183966  3056 log.cc:927] Time spent T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:13:31.174474  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 48490.9us
I20260709 13:13:31.151906  2550 consensus_queue.cc:1059] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
W20260709 13:13:31.184887   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 142061us
I20260709 13:13:31.185099   597 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:31.140192  2998 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:31.130259  3000 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:31.203699  2856 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:31.175393  3055 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:13:31.184724  2933 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:31.213302  2934 raft_consensus.cc:3055] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:31.221786  3055 consensus_queue.cc:1243] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:13:31.221474  3041 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:31.234449   522 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:13:31.235757   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.239288   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:31.235711   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.241315   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:31.241643   626 raft_consensus.cc:1275] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:31.242780   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:31.243703   633 raft_consensus.cc:2393] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 4: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:31.247367   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:31.248498   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:31.249082   626 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:31.250586  3057 log.cc:927] Time spent T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:13:31.251271  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:13:31.251632  3052 log.cc:927] Time spent T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:13:31.251747  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:31.252177   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:31.252399  1175 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:31.253417   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:31.253821   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:31.254420   628 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:31.255035   632 raft_consensus.cc:1240] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:31.255478  2977 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:31.256613   632 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:31.257171  2863 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:31.257308  2880 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:31.222880  2951 consensus_queue.cc:1059] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:13:31.257925  2880 raft_consensus.cc:697] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:31.254968  2998 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:31.258889  2880 consensus_queue.cc:237] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:31.224511  2934 raft_consensus.cc:740] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:13:31.265897   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 133374us
I20260709 13:13:31.228370  2991 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:13:31.276489   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.277035   522 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:31.284716   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:31.285465   557 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:31.286546   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:31.297295   626 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:31.247885  2924 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:31.308807   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:31.302444  2550 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.311945   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:31.315490  1169 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:31.316860  2863 consensus_queue.cc:1059] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:31.318589  3036 raft_consensus.cc:3055] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:13:31.319890  3058 log.cc:927] Time spent T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:13:31.320365  3000 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:31.318969  3036 raft_consensus.cc:740] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:31.306433  2977 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:31.303074  3041 raft_consensus.cc:697] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:31.327582  2933 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:31.229045  2844 consensus_queue.cc:237] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:31.327968  3041 consensus_queue.cc:237] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:31.329990  2534 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:31.306030  3001 consensus_queue.cc:1048] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:13:31.326895  3059 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.331048   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:31.310019  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:31.331418   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:31.311017  3026 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:13:31.347822   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.355381   557 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:31.308315  2924 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:31.288206  2846 consensus_queue.cc:237] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:31.299072  2991 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:31.350790  3059 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:31.359551   559 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:31.350616  2977 raft_consensus.cc:697] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:31.384634  2991 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:31.388273  2924 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:31.389367   551 raft_consensus.cc:2410] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:13:31.361141   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:31.473807   557 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:31.474987   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:31.389758  1174 raft_consensus.cc:1240] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:31.376156   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.357736  3026 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:31.393190   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:31.393168   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:31.393762   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 126939us
I20260709 13:13:31.324059  2550 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:31.397634   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 134616us
W20260709 13:13:31.478142   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.476928   554 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
W20260709 13:13:31.483309   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 171225us
I20260709 13:13:31.360584  3064 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:31.487458   557 raft_consensus.cc:1240] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:13:31.487705   447 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:31.488511   554 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:31.487437   522 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:31.359030  1167 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:31.491022   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:31.493548   559 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:31.493902  3070 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.494590  3070 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:31.496455  2983 log.cc:927] Time spent T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 2.228s	user 0.010s	sys 0.003s
I20260709 13:13:31.497547  3070 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:31.498170  3001 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:31.498832  3001 raft_consensus.cc:697] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:31.500011  3001 consensus_queue.cc:237] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:31.500993   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1595) took 2550 ms. Trace:
I20260709 13:13:31.501389   555 rpcz_store.cc:276] 0709 13:13:28.950173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.966044 (+ 15871us) service_pool.cc:224] Handling call
0709 13:13:28.983489 (+ 17445us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:29.264866 (+281377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:29.264897 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:29.265524 (+   627us) log.cc:844] Serialized 52 byte log entry
0709 13:13:29.269958 (+  4434us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:29.270001 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:29.270072 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:31.495776 (+2225704us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:31.500671 (+  4895us) raft_consensus.cc:1685] finished
0709 13:13:31.500693 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:31.500930 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":245756,"raft.queue_time_us":249324,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"spinlock_wait_cycles":80676224,"thread_start_us":4070,"threads_started":1,"wal-append.queue_time_us":2264}
I20260709 13:13:31.353626  2933 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.134s
I20260709 13:13:31.525477   557 raft_consensus.cc:1275] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:31.356664  2934 consensus_queue.cc:260] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:31.538918   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:31.534957   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:31.554807   559 raft_consensus.cc:2410] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:31.358135  3067 consensus_queue.cc:1048] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.167s
I20260709 13:13:31.489116  3063 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.533190  2844 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:31.558069  2550 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:31.558662  1168 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:31.393062  3036 consensus_queue.cc:260] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:31.489059  2924 consensus_queue.cc:1059] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:13:31.559423  3026 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:31.560240  2991 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.540288  2998 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:31.487073  3069 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:13:31.562958   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:31.559154  2977 consensus_queue.cc:237] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:31.492347  3064 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:31.566509   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:31.568526   597 connection.cc:256] RPC call timeout handler was delayed by -3.1685358820000147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.277s for a response
W20260709 13:13:31.570961   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.572276   554 raft_consensus.cc:1275] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:31.575196   555 raft_consensus.cc:1275] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:13:31.576076   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:31.591965   626 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
W20260709 13:13:31.589774   597 connection.cc:256] RPC call timeout handler was delayed by -2.395168983999838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
W20260709 13:13:31.592489   597 connection.cc:256] RPC call timeout handler was delayed by -2.3645689840000159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
I20260709 13:13:31.577045   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:31.593255   522 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:31.579011   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:31.585177  3059 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:31.586216  3036 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:31.579263  3074 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:31.587809   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 105204us
I20260709 13:13:31.588286   628 raft_consensus.cc:2410] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:31.603268   447 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:31.569129  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:31.581223  3000 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:31.600086   597 connection.cc:256] RPC call timeout handler was delayed by -2.2583689839998442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19390000000000002s for a response
I20260709 13:13:31.593658   557 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
W20260709 13:13:31.610879   597 connection.cc:256] RPC call timeout handler was delayed by -2.2178689840000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
I20260709 13:13:31.643635   447 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:31.667861   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.593461  3035 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:13:31.693813   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.695859   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:31.608559  2934 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:31.617005  2844 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:13:31.685608  3066 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 13:13:31.590227  2991 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:31.673108  2856 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:31.594198  2998 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:31.758759   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 193331us
I20260709 13:13:31.580164  3063 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:31.763625  3026 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:31.764232  3026 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:31.766664  3026 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:31.705195  2844 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.767472  2844 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:31.703125  2933 consensus_queue.cc:1059] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
W20260709 13:13:31.771853  3071 log.cc:927] Time spent T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:13:31.773779  2933 raft_consensus.cc:3055] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:31.774394  2933 raft_consensus.cc:740] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:31.777678   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:31.778275   554 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:31.758008  2856 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:31.726701  3067 consensus_queue.cc:1059] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:13:31.682363  3000 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:31.705909  3035 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:31.802729   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:31.615319  3074 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:31.787528  3079 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:31.776072  2646 consensus_queue.cc:1059] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
W20260709 13:13:31.807307   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 163786us
I20260709 13:13:31.793890  2856 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:31.809376   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 46272.3us
I20260709 13:13:31.793972  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:31.795073  2933 consensus_queue.cc:260] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:31.816085  3086 log.cc:927] Time spent T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:13:31.818228  3064 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:31.808595  3035 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:31.836663  2933 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:31.841652   597 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:31.856557   553 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:31.865607  3096 consensus_queue.cc:1059] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:31.866917   555 raft_consensus.cc:1275] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:13:31.869110  3074 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:31.869807  3074 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.870263  3074 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:31.870929  2998 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:31.872805   597 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:31.873118  3074 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:31.873672  3064 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:31.871608  3063 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:31.879347   597 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:31.865653   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.881785  3063 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:31.882609  3063 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:31.882998  3063 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:31.883435  3063 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:31.884064   625 raft_consensus.cc:3055] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:31.884485   625 raft_consensus.cc:740] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:31.885277   625 consensus_queue.cc:260] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:31.886432   625 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:31.889631   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.891332   553 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:31.892933   553 raft_consensus.cc:1275] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:31.894502  3036 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.894737  3000 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:31.895097  3036 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:31.897496  3036 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:31.894537  3019 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:31.898591  3019 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:31.899940  2991 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:31.900885  3019 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:31.858788  3067 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:13:31.902015   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1433) took 2273 ms. Trace:
I20260709 13:13:31.902371   631 rpcz_store.cc:276] 0709 13:13:29.629010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.304446 (+675436us) service_pool.cc:224] Handling call
0709 13:13:30.304865 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:30.616729 (+311864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:31.901768 (+1285039us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b5400160dd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:31.901928 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":715304192}
I20260709 13:13:31.903750   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:31.873710  3074 raft_consensus.cc:3055] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:31.905745  3074 raft_consensus.cc:740] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:31.906147  2863 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.906502  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:31.906684  2863 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:31.907203  1170 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:31.906545  3074 consensus_queue.cc:260] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:31.908977   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:31.910205   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:31.910422   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:31.911108   553 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:31.912981   555 raft_consensus.cc:1240] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:31.914527  2844 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:31.920032   551 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:13:31.922114  3035 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.922500  2844 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:31.923909   597 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:31.925318   631 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:31.925832   553 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:31.926505   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:31.927855   558 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
W20260709 13:13:31.931823   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 109771us
I20260709 13:13:31.932235   631 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:31.938917   554 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:31.940116   551 raft_consensus.cc:1275] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:13:31.941812   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.943288   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:31.935005   559 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:31.948621   597 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:31.980111   597 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:13:31.985602   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 53131.7us
I20260709 13:13:31.986692   447 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:31.909052  2863 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:31.992368   447 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:31.992746   597 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:31.997136  3041 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:31.997704  3041 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.998112  3041 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:31.999404  3080 log.cc:927] Time spent T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.180s	user 0.001s	sys 0.006s
I20260709 13:13:32.001277  3077 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:32.001757  3077 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.002164  3077 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:32.003504  3068 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.004112  3068 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:32.006618  3068 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:32.007411  3054 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.805s	user 0.000s	sys 0.019s
I20260709 13:13:31.983418  2956 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:32.015769   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:32.018028   483 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:32.018005   597 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:32.020319   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:32.042342   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:32.042706   480 raft_consensus.cc:1240] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:32.043023   484 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:32.044059   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:32.045790   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:32.046893   480 raft_consensus.cc:2410] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:31.923143  3035 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:32.049839   597 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:32.051995   597 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:32.054472   475 raft_consensus.cc:1240] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:13:32.055155   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:32.023092   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:32.058902   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:31.981701  2880 consensus_queue.cc:1059] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:13:31.989846  3036 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:13:32.090006   523 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:32.017537  2844 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:32.091097   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1429) took 2463 ms. Trace:
I20260709 13:13:32.091553   629 rpcz_store.cc:276] 0709 13:13:29.627619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.205666 (+578047us) service_pool.cc:224] Handling call
0709 13:13:30.221076 (+ 15410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:30.395327 (+174251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:32.090847 (+1695520us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54002bcad4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:32.091037 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351239424}
I20260709 13:13:32.092376  3061 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:32.092940  3061 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:32.094255   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:32.061041   597 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:32.069317  3092 raft_consensus.cc:3055] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:13:32.074894  3076 log.cc:927] Time spent T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.300s	user 0.000s	sys 0.003s
W20260709 13:13:32.082489  3010 log.cc:927] Time spent T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 1.857s	user 0.007s	sys 0.009s
I20260709 13:13:32.086212  2856 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:32.061442  3060 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:13:32.087826  3022 raft_consensus.cc:3055] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:32.056460  3068 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:13:32.099869  3084 log.cc:927] Time spent T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.135s	user 0.000s	sys 0.004s
I20260709 13:13:32.111034   475 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:13:32.157531   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 96553.6us
I20260709 13:13:32.182058   597 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:32.143875  1139 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:32.159117   626 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.004s	sys 0.025s
W20260709 13:13:32.183320   626 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.004s	sys 0.025s
I20260709 13:13:32.047608  3059 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:32.043110  3028 raft_consensus.cc:2764] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:13:32.158151   629 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:32.139216   625 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:32.022446  3093 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:32.195993   480 raft_consensus.cc:1275] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:32.161307   484 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:32.161943   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:32.160828   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:32.095163  3061 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:32.161307   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 71392.7us
I20260709 13:13:32.204640   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:32.056602  2534 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:32.204686   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:32.174252   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.990756  2924 consensus_queue.cc:1059] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
W20260709 13:13:32.212401   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:32.099538  3091 log.cc:927] Time spent T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.135s	user 0.004s	sys 0.000s
W20260709 13:13:32.099721  3085 log.cc:927] Time spent T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.392s	user 0.000s	sys 0.006s
I20260709 13:13:32.216488   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 334) took 1029 ms. Trace:
I20260709 13:13:32.104281  2991 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.218082 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:32.142251  2764 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
W20260709 13:13:32.205703  2465 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:13:32.161861   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:32.198125  3093 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.197458   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:32.141762  2646 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.064865  3064 consensus_queue.cc:1048] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 13:13:32.156731  3092 raft_consensus.cc:740] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:32.205510   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 256) took 1197 ms. Trace:
I20260709 13:13:32.161571  2975 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:32.212726  2959 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.213449   484 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:32.177026  3036 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:32.165575  3022 raft_consensus.cc:740] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:32.141839  3079 raft_consensus.cc:697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:32.158391  2987 consensus_queue.cc:1048] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:13:32.160835  3026 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:13:32.216869   477 rpcz_store.cc:276] 0709 13:13:31.187050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.187195 (+   145us) service_pool.cc:224] Handling call
0709 13:13:31.187543 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:31.223331 (+ 35788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:31.223365 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:31.226498 (+  3133us) log.cc:844] Serialized 52 byte log entry
0709 13:13:31.486140 (+259642us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:31.486176 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:31.486239 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:32.074119 (+587880us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:32.216210 (+142091us) raft_consensus.cc:1685] finished
0709 13:13:32.216229 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:32.216433 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21277,"raft.queue_time_us":114197,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":3061120,"thread_start_us":232353,"threads_started":2,"wal-append.queue_time_us":383916}
W20260709 13:13:32.189319  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 45551.8us
W20260709 13:13:32.223542   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.250253   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:32.161284  2993 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:13:32.226089   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:32.205936  2783 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:32.160920  3063 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:32.217689  2991 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:32.211215  3061 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:32.065088  2956 consensus_queue.cc:1059] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.133s
I20260709 13:13:32.201421  2863 consensus_queue.cc:1059] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:13:32.229360  3093 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:32.242369  2959 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:32.248409   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:32.262176   599 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:32.246268  3078 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.249406   555 raft_consensus.cc:2393] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 8: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:32.231729   475 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:32.215080  3059 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:13:32.232995  3103 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:32.267613   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:32.268116   632 raft_consensus.cc:1240] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:32.268260   484 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:32.237576  2975 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.253525  2783 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.259430   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:32.283002   558 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:32.246345   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:32.236354   630 rpcz_store.cc:276] 0709 13:13:31.008086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.008663 (+   577us) service_pool.cc:224] Handling call
0709 13:13:31.009098 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:31.043980 (+ 34882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:31.044006 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:31.044329 (+   323us) log.cc:844] Serialized 26 byte log entry
0709 13:13:31.188137 (+143808us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:31.204098 (+ 15961us) log.cc:844] Serialized 14 byte log entry
0709 13:13:31.893186 (+689088us) spinlock_profiling.cc:243] Waited 956 us on lock 0x7b18003d8e80. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b65329455 00007f4b68411060 00007f4b68423716 00007f4b68434287 00007f4b68434208
0709 13:13:32.178604 (+285418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:32.178688 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:32.178774 (+    86us) raft_consensus.cc:1685] finished
0709 13:13:32.205298 (+ 26524us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:32.205449 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89918,"prepare.queue_time_us":17001,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":75084,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":9018,"spinlock_wait_cycles":2197760,"thread_start_us":377823,"threads_started":2,"wal-append.queue_time_us":133517}
I20260709 13:13:32.265295   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:32.249869  3001 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.238154  2646 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:32.280671   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:32.256429   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:32.288628   553 raft_consensus.cc:2410] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:32.291153  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:32.294044   477 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:32.288596  3041 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:32.295552   477 raft_consensus.cc:1275] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:32.298230   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:32.284514   599 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:32.298836   477 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 13:13:32.280892   448 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:32.285567   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:32.301100   479 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:32.248335   523 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:32.298416   475 pending_rounds.cc:85] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 2
I20260709 13:13:32.235116  3077 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:32.257041  2985 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:13:32.300284   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:32.302335   475 pending_rounds.cc:107] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:13:32.303789   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:32.282405  2975 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:32.279139  3104 consensus_queue.cc:1059] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:13:32.280469  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:32.281239  3078 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:32.282748  3103 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:32.285652  3022 consensus_queue.cc:260] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:32.284142  3060 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.287436  2934 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:13:32.280757  3092 consensus_queue.cc:260] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:32.341166   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:32.286386  2783 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:32.288009  3061 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:32.307330   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:32.285485  2880 raft_consensus.cc:3055] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:32.335777   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:32.292762  3106 raft_consensus.cc:3055] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:32.335374   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:32.318300  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:32.306447   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 58186.1us
I20260709 13:13:32.356783   627 raft_consensus.cc:2410] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:32.308341   553 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:32.355448   475 raft_consensus.cc:2889] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:32.371152   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 90346.8us
I20260709 13:13:32.371441   523 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:32.371899   448 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:32.363695  3059 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.305467  3064 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:32.366254   483 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:32.297869  3041 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:32.382627   479 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:32.337338  3077 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:32.328526   630 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:32.301632  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:32.376204   627 raft_consensus.cc:1240] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:32.306509   599 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:13:32.388048   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 81735.1us
I20260709 13:13:32.377573   628 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:32.310102  2863 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:32.311214  3063 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:32.322791  2991 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:32.321027  2844 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:32.373469  3106 raft_consensus.cc:740] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:32.306957  2856 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:32.326058  2646 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:32.399415   483 raft_consensus.cc:1275] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:32.390117   599 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:32.367452  2880 raft_consensus.cc:740] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:32.297580  3001 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:32.377091  3073 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:32.380613  3064 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:32.321267  3079 consensus_queue.cc:237] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:32.377051  3102 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:32.399876  2952 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:32.421175  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:32.410094  3061 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:32.425715   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:32.379735  3059 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:32.407998  3022 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:32.430227   483 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:32.375263  3036 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:13:32.431376  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:32.367973  3060 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:32.446079   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:32.457872   628 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:32.426246  3064 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:32.496295  3103 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:32.444579  3108 consensus_queue.cc:1059] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:13:32.428552  3041 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:32.429171  2952 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.420665  2945 consensus_queue.cc:1048] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:13:32.427937  2646 consensus_queue.cc:1059] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:13:32.429121  3061 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.483147  3102 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:32.500135   630 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:32.498139  2959 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:32.499049  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:32.502696  3041 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:32.504334  2952 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:32.563598  3077 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:32.583446  3077 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:32.584936  3072 log.cc:927] Time spent T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 1.009s	user 0.002s	sys 0.000s
I20260709 13:13:32.585150  3059 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:32.585676  3077 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:32.587905  3093 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:32.590121  3093 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:32.591676  1169 raft_consensus.cc:2410] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:32.502516  3106 consensus_queue.cc:260] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:32.593309  3106 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:32.595161  3001 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:32.514415  3061 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:32.596808  3078 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:32.536293  3041 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:32.601193   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.602787   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:32.603564   628 raft_consensus.cc:2393] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:13:32.604596  3112 log.cc:927] Time spent T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
W20260709 13:13:32.613111   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 241690us
W20260709 13:13:32.615119   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 238604us
I20260709 13:13:32.616067   448 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:32.616382   523 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:32.627458   558 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 8. Ops: []
I20260709 13:13:32.628710   631 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:32.627162  2844 consensus_queue.cc:1059] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:13:32.635530   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:32.636569   550 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:32.625782   483 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:32.646037  3060 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:32.616998  3077 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.647266  3077 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:32.647742  2783 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:32.649561  3077 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:32.631683  3064 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:32.611609  2880 consensus_queue.cc:260] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:32.651758  2880 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:32.652143  3064 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:32.655656  3087 log.cc:927] Time spent T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.880s	user 0.001s	sys 0.002s
I20260709 13:13:32.657295  2550 raft_consensus.cc:3055] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:32.657732  2550 raft_consensus.cc:740] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:32.631417  2867 raft_consensus.cc:3055] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:32.658995  2867 raft_consensus.cc:740] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:32.659822  2867 consensus_queue.cc:260] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:32.660758  2867 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:32.616955  3059 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.617779  2945 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:32.636595  3036 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:32.638337  3073 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.701519  3073 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:32.703790  3073 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:32.568430  3102 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:32.667421  3059 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:32.713593   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:32.682277  3109 log.cc:927] Time spent T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.194s	user 0.002s	sys 0.003s
I20260709 13:13:32.689134  2952 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:32.694139   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1598) took 3742 ms. Trace:
I20260709 13:13:32.696544  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:32.696868  3101 log.cc:927] Time spent T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.481s	user 0.005s	sys 0.000s
I20260709 13:13:32.697995  2959 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:32.706409   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:32.649817  2783 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:32.709491   597 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:32.716197   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:32.671015  2945 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:32.719048   624 pending_rounds.cc:85] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 6
I20260709 13:13:32.900439   624 pending_rounds.cc:107] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:13:32.900741   624 raft_consensus.cc:2889] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:32.901814  2945 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:32.901908   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:32.894026   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 278053us
I20260709 13:13:32.903286   627 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:32.816946   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:32.904664   484 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:32.904883  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:32.905550   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:32.775074   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:32.906121  3073 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:32.815873   482 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:32.907018   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:32.906850  3073 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:32.908986  3102 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:32.781656  2981 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.910321  2981 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:32.911392  3073 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:32.911942   448 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:32.853557  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:32.668618  2646 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:32.912896   552 rpcz_store.cc:276] 0709 13:13:28.951264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.953428 (+  2164us) service_pool.cc:224] Handling call
0709 13:13:28.953813 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:31.029117 (+2075304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:32.693835 (+1664718us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b5400151dd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:32.694072 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4759911808}
I20260709 13:13:32.852453   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:32.926369   448 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:32.668478  3000 raft_consensus.cc:3055] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:13:32.917057   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 207652us
I20260709 13:13:32.668785  2844 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:32.937304   475 raft_consensus.cc:2410] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:32.906315  1168 raft_consensus.cc:2393] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 6: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:32.930670   448 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:32.906124   484 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:32.917632   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.876263  3079 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:32.850258  1170 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:13:32.850840  3121 log.cc:927] Time spent T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:13:32.801842  2658 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:32.913132  3093 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:32.730959  3061 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:32.933867  2945 raft_consensus.cc:2804] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:32.951810   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:32.955164  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:32.956110  2658 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:32.959172  3061 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:32.961638  3059 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:32.964607  3069 consensus_queue.cc:1059] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:32.965634  2952 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:32.966272  2945 raft_consensus.cc:697] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:32.967119  3127 log.cc:927] Time spent T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:13:32.949982  3079 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:32.937546  3106 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:32.971494   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.977408   627 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:32.933086  3000 raft_consensus.cc:740] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:32.967952  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:32.939169  3102 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:32.981405   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.022902   552 raft_consensus.cc:2393] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:32.940730  2844 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:32.980613  1175 raft_consensus.cc:2376] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6. Re-sending same reply.
I20260709 13:13:33.025329  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:32.987782   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:33.027978   475 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:32.950194  3019 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:32.952217  3093 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.000880   484 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
W20260709 13:13:33.009028   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.009778  3128 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.015341  3131 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.016363   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 335) took 1827 ms. Trace:
I20260709 13:13:33.018975  3079 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:33.039086   478 rpcz_store.cc:276] 0709 13:13:31.188803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.188981 (+   178us) service_pool.cc:224] Handling call
0709 13:13:31.207101 (+ 18120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:31.227827 (+ 20726us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:31.247275 (+ 19448us) log.cc:844] Serialized 14 byte log entry
0709 13:13:31.353975 (+106700us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:31.354049 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:31.354103 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:32.584429 (+1230326us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:33.016110 (+431681us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b540027c9d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:33.016168 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:33.016299 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18722,"prepare.queue_time_us":19274,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":97,"raft.queue_time_us":51044,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":108,"spinlock_wait_cycles":79023104,"thread_start_us":87563,"threads_started":1,"wal-append.queue_time_us":241903}
I20260709 13:13:33.028447   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:33.028865   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:33.030702  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:33.033529   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:33.037420   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:33.050261   484 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:33.046934   627 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:33.028545  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:32.999454  3106 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.056957   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.048609  3131 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:33.059105  2975 consensus_meta.cc:287] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.690s	user 0.005s	sys 0.005s
I20260709 13:13:33.042224  3128 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.059548  2975 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.061148  3128 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:33.061266  3000 consensus_queue.cc:260] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.062430  3000 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.062655  2844 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:33.064132  3131 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:33.070858   484 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:33.071758   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:33.085361   552 raft_consensus.cc:2376] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6. Re-sending same reply.
I20260709 13:13:33.087054   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.073722   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:33.077395  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:33.089550  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:33.034420  2991 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:33.091569  2991 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:33.092037  2550 consensus_queue.cc:260] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:33.094261  2991 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:33.079838  2945 consensus_queue.cc:237] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:33.099706  2850 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:33.100208  3106 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:33.101847  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:33.104472   559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1568) took 1542 ms (client timeout 1571 ms). Trace:
W20260709 13:13:33.104987   559 rpcz_store.cc:269] 0709 13:13:31.562238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.566281 (+  4043us) service_pool.cc:224] Handling call
0709 13:13:33.104237 (+1537956us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b540034ce54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:33.104392 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618359552}
I20260709 13:13:33.034392  3093 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:33.035090  2981 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:33.027868  1170 raft_consensus.cc:2376] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5. Re-sending same reply.
I20260709 13:13:33.082785  3041 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:33.072916  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:13:33.108156   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 94141.9us
W20260709 13:13:33.110623   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 168553us
I20260709 13:13:33.111374   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.090885  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:33.112727   627 raft_consensus.cc:2410] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:13:33.128214   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1489) took 1101 ms. Trace:
I20260709 13:13:33.134778  1175 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.126530   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:33.134934   480 rpcz_store.cc:276] 0709 13:13:32.026457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.056242 (+ 29785us) service_pool.cc:224] Handling call
0709 13:13:32.056819 (+   577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:32.196405 (+139586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.127859 (+931454us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400132754. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:33.128127 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319264000}
I20260709 13:13:33.136505   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:33.137827   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:33.138433   559 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:33.138654   628 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:33.143340   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.136554   448 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:33.146809   448 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:33.141047   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:33.148790   597 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.17.130:41159 timed out after 1.762s (SENT) [suppressed 39 similar messages]
I20260709 13:13:33.149873   552 raft_consensus.cc:2393] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 5: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:33.152673   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.108398  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:33.157064   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:33.162628   633 raft_consensus.cc:1240] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:33.170461   448 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:33.172433  3114 log.cc:927] Time spent T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.681s	user 0.000s	sys 0.002s
I20260709 13:13:33.172508  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:33.173523  1174 raft_consensus.cc:2368] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6.
I20260709 13:13:33.152570  3061 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:13:33.351137  3115 log.cc:927] Time spent T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.859s	user 0.001s	sys 0.000s
I20260709 13:13:33.313580   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:33.352114   629 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:33.243878   632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1455) took 1355 ms. Trace:
I20260709 13:13:33.354775   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.347730  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:33.355566   557 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:33.355983  3061 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.356694   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:33.321821  2863 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
W20260709 13:13:33.315274   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.236886  3041 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:33.155576  3128 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:33.358234   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:33.340910  3113 log.cc:927] Time spent T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.853s	user 0.004s	sys 0.000s
W20260709 13:13:33.252835   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 82460.3us
I20260709 13:13:33.363348   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:33.147972  2844 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:33.205722  1174 raft_consensus.cc:1275] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:13:33.304768  1138 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:33.364029   448 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:33.240746  1173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 435) took 1704 ms. Trace:
I20260709 13:13:33.354918   632 rpcz_store.cc:276] 0709 13:13:31.888308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.890361 (+  2053us) service_pool.cc:224] Handling call
0709 13:13:31.890686 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:32.280205 (+389519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.243671 (+963466us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b54001e3a54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:33.243824 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":867600640}
I20260709 13:13:33.355589   627 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:33.210454   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.299176  1139 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:33.377929   552 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:33.378765  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:33.376569   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 54187.7us
W20260709 13:13:33.402176  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 103100us
I20260709 13:13:33.377007  1173 rpcz_store.cc:276] 0709 13:13:31.536334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.536501 (+   167us) service_pool.cc:224] Handling call
0709 13:13:31.922429 (+385928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:31.922651 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:13:32.381993 (+459342us) log.cc:844] Serialized 14 byte log entry
0709 13:13:32.719419 (+337426us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:32.719490 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:32.719566 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:32.719654 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:33.240541 (+520887us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b540069e950. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:33.240674 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12673,"prepare.queue_time_us":337554,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":11260,"raft.queue_time_us":17636,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":886850816,"thread_start_us":781895,"threads_started":2,"wal-append.queue_time_us":564104}
W20260709 13:13:33.399858   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 234780us
W20260709 13:13:33.400085  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 95110.3us
I20260709 13:13:33.404891   448 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:33.406198   448 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:33.403687  1139 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:33.405896   597 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:33.414077  1175 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
W20260709 13:13:33.335989  3145 log.cc:927] Time spent T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:13:33.276904  3134 log.cc:927] Time spent T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:13:33.283860  3138 log.cc:927] Time spent T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:13:33.416079   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:33.269367  3035 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:33.434669   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:33.420338   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1482) took 1401 ms. Trace:
I20260709 13:13:33.437474   481 rpcz_store.cc:276] 0709 13:13:32.019044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.019534 (+   490us) service_pool.cc:224] Handling call
0709 13:13:32.042357 (+ 22823us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:32.042773 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:32.042803 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:32.043227 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:13:32.271463 (+228236us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:32.271503 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:32.271568 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:33.340280 (+1068712us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:33.375574 (+ 35294us) raft_consensus.cc:1685] finished
0709 13:13:33.375596 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:33.420261 (+ 44665us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13,"raft.queue_time_us":6059,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5650,"spinlock_wait_cycles":25912192,"thread_start_us":204021,"threads_started":1,"wal-append.queue_time_us":351342}
I20260709 13:13:33.422381   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:33.424273  1139 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:33.440694  1139 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:33.435482   632 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:33.426584   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:33.305335  2662 consensus_queue.cc:1059] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.126s
I20260709 13:13:33.442435   448 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:33.305848  1166 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:33.428185   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:33.206519  3079 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:33.407680  2957 raft_consensus.cc:2749] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:33.244048  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:33.317920  2945 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.413965  2783 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:33.408203  3096 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:33.174769  3077 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.256s
I20260709 13:13:33.323488  2880 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.111s
I20260709 13:13:33.433375  3041 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:33.469831  2783 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.474097   477 raft_consensus.cc:1275] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:33.449618  3143 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:33.436743  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:33.434156  3128 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:33.448045  2985 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:33.467047   597 leader_election.cc:400] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6.
I20260709 13:13:33.451030  3102 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:33.484611   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 47868.6us
I20260709 13:13:33.486601  3041 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:33.489336   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1481) took 1470 ms. Trace:
I20260709 13:13:33.489836   482 rpcz_store.cc:276] 0709 13:13:32.018699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.018944 (+   245us) service_pool.cc:224] Handling call
0709 13:13:32.019293 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:32.907165 (+887872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.489059 (+581894us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b5400184054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:33.489264 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1831411456}
I20260709 13:13:33.490829  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:33.463476  2844 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:33.466889  1170 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:33.497469   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.497900   627 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:13:33.498381   483 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:33.470181  2945 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.500043   559 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:33.471271  2184 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:33.503417   629 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:33.462677  2465 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:33.470544  2981 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:33.508802   629 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:33.479992  2783 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:33.459471  3035 consensus_queue.cc:1059] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:13:33.512889   627 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:33.507123  3061 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:33.517388   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 258) took 1147 ms. Trace:
I20260709 13:13:33.520066   550 rpcz_store.cc:276] 0709 13:13:32.370071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.644982 (+274911us) service_pool.cc:224] Handling call
0709 13:13:32.667081 (+ 22099us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:32.690106 (+ 23025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:32.690142 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:32.690655 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:13:32.969601 (+278946us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:32.969642 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:32.969709 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:33.517217 (+547508us) raft_consensus.cc:1685] finished
0709 13:13:33.517236 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:33.517340 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3774,"raft.queue_time_us":25593,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":278579,"threads_started":1,"wal-append.queue_time_us":415242}
I20260709 13:13:33.500610  2844 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:33.505303  3079 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:33.526072   556 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:33.529165   627 raft_consensus.cc:1275] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:33.537657   556 raft_consensus.cc:1240] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:13:33.528508  2844 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:33.512243  2465 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.541615  2465 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:33.560927  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:33.561977  1167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 439) took 1287 ms. Trace:
I20260709 13:13:33.562340  1167 rpcz_store.cc:276] 0709 13:13:32.274327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.274979 (+   652us) service_pool.cc:224] Handling call
0709 13:13:33.560752 (+1285773us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:33.561896 (+  1144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14240512}
I20260709 13:13:33.564234   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1548) took 1262 ms. Trace:
I20260709 13:13:33.532123  3079 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:33.564643   625 rpcz_store.cc:276] 0709 13:13:32.301401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.378152 (+ 76751us) service_pool.cc:224] Handling call
0709 13:13:32.629399 (+251247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:32.636065 (+  6666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:32.636107 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:32.636553 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:13:32.934949 (+298396us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:33.108033 (+173084us) log.cc:844] Serialized 14 byte log entry
0709 13:13:33.108329 (+   296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.108402 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:33.108445 (+    43us) raft_consensus.cc:1685] finished
0709 13:13:33.108469 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:33.563976 (+455507us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b5400052dd0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:33.564165 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6159,"prepare.queue_time_us":146218,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":11456,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":41187,"spinlock_wait_cycles":558805888,"thread_start_us":372783,"threads_started":2,"wal-append.queue_time_us":369029}
I20260709 13:13:33.567202  3079 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:33.572383   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1551) took 1270 ms. Trace:
I20260709 13:13:33.572751   630 rpcz_store.cc:276] 0709 13:13:32.302128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.386615 (+ 84487us) service_pool.cc:224] Handling call
0709 13:13:32.410739 (+ 24124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:32.514489 (+103750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.572195 (+1057706us) spinlock_profiling.cc:243] Waited 88.9 ms on lock 0x7b54002bb6d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:33.572340 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204496640}
I20260709 13:13:33.571228   447 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:33.576921   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 261) took 1143 ms. Trace:
I20260709 13:13:33.578181   552 rpcz_store.cc:276] 0709 13:13:32.433459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.408141 (+974682us) service_pool.cc:224] Handling call
0709 13:13:33.431808 (+ 23667us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:33.432214 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:33.432253 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:33.450613 (+ 18360us) log.cc:844] Serialized 52 byte log entry
0709 13:13:33.576626 (+126013us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:33.576664 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.576724 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:33.576759 (+    35us) raft_consensus.cc:1685] finished
0709 13:13:33.576771 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:33.576870 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37059,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":126,"thread_start_us":75539,"threads_started":1,"wal-append.queue_time_us":93237}
I20260709 13:13:33.580197  3079 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.582347  3069 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:33.582273  3161 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:33.587518  3079 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.584925  3093 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.620012  3161 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.620682  3069 raft_consensus.cc:697] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:33.663626  3103 raft_consensus.cc:3055] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:33.664114  3103 raft_consensus.cc:740] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:33.664937  3103 consensus_queue.cc:260] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.634099  3079 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:33.669310   559 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:33.656044  3073 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.672065  3103 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:33.694878  1167 raft_consensus.cc:1275] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:33.685196  3161 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:33.678632  1170 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:33.675169  3073 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.711537  1168 raft_consensus.cc:1240] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 13:13:33.704960  3077 consensus_queue.cc:1048] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:13:33.718822 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:33.725879  3077 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.726425  3077 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.734624   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 256) took 1370 ms. Trace:
I20260709 13:13:33.735212   553 rpcz_store.cc:276] 0709 13:13:32.364268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.371260 (+  6992us) service_pool.cc:224] Handling call
0709 13:13:32.382261 (+ 11001us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:32.451097 (+ 68836us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:32.451146 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:32.453567 (+  2421us) log.cc:844] Serialized 26 byte log entry
0709 13:13:32.665721 (+212154us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:32.665763 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.734105 (+1068342us) spinlock_profiling.cc:243] Waited 50 ms on lock 0x7b54000ebd54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:33.734172 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:33.734241 (+    69us) raft_consensus.cc:1685] finished
0709 13:13:33.734263 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:33.734547 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5727,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":25969,"spinlock_wait_cycles":114957568,"thread_start_us":34422,"threads_started":1,"wal-append.queue_time_us":171224}
I20260709 13:13:33.685781  3069 consensus_queue.cc:237] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:33.742333   366 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4e472c1c82c9467a9a5563d6b06e3b53 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6ba2a9c02b534120bbf26e56a1e920ca is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:13:33.745818   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.743317  2844 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.722494  3161 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:33.725890  2975 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:33.750051  3000 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.759464  3000 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.761682  3000 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:33.753407  2952 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.750100  3096 consensus_queue.cc:1059] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:13:33.762462  3096 consensus_queue.cc:1243] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Peer 6ba2a9c02b534120bbf26e56a1e920ca log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:13:33.762351  2952 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.762993  3096 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:33.764400  2952 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:33.754217  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:33.756198   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.765543   550 raft_consensus.cc:2410] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:33.766402  3161 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.769400  3161 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:33.770319  3164 log.cc:927] Time spent T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:13:33.764292  3096 consensus_queue.cc:1059] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:33.775338  3093 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:33.779549   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.780913  2783 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:33.782039  1175 raft_consensus.cc:1240] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:13:33.784600   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:33.785178   550 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:33.785475   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.788676   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.796141   550 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:13:33.796957   554 raft_consensus.cc:1240] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: [4.5-6.6]
I20260709 13:13:33.797947   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.801215   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:33.802269   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.802323  2850 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:33.802922   556 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:33.803483  2850 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.804272   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.805331   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.814815   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:33.816020   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.795027  2783 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:33.804272  2863 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.828253  2863 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.830529  2863 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:33.831660   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:33.832244   556 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.836227  2850 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:33.814224  2952 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.837323  2952 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:33.839946   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:33.841063   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.841560   550 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:33.842274   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.848948   556 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:33.850093   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.851306   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.853041   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:33.858803   553 raft_consensus.cc:1240] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:33.869589   550 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:33.872807   522 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:33.873679   522 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:33.875509   484 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:33.875595   481 raft_consensus.cc:1275] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:13:33.876008   481 pending_rounds.cc:85] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 3
I20260709 13:13:33.876228   481 pending_rounds.cc:107] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:13:33.876443   481 raft_consensus.cc:2889] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:33.876626   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:33.877274   483 raft_consensus.cc:1275] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:33.877370   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:33.878068   555 raft_consensus.cc:1240] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:13:33.878165   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:33.878712  2783 consensus_queue.cc:1059] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:33.880496  3077 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:33.879746  3074 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:33.887462  2959 consensus_queue.cc:1048] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:33.839195  2952 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:33.891916   555 raft_consensus.cc:1275] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:33.892159  3073 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:33.876626   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:33.880125   481 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:33.880234   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:33.893322   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:33.893627   475 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:33.894297   483 raft_consensus.cc:2410] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:33.881629  2783 raft_consensus.cc:3055] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:33.879588   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:33.882242  3000 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:33.882797  3041 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:33.882858  2863 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:33.883430  2998 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:33.884075  2850 consensus_queue.cc:1059] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:13:33.885025   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.805116  2975 consensus_queue.cc:1059] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.140s
I20260709 13:13:33.895035   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:34.234915   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:33.949105   523 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:33.895856   555 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:34.295188   482 raft_consensus.cc:2410] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:13:33.968911   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 224684us
I20260709 13:13:34.287608   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:34.301529   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:34.297710   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 348653us
I20260709 13:13:34.298065   556 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
W20260709 13:13:34.289127   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:34.309571   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.306957   523 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:34.329486   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.943150   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:33.996639   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:33.958425   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:33.970755   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.300107   475 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:34.034209   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:34.344331   552 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:34.347122   550 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:34.332938   553 raft_consensus.cc:2376] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6. Re-sending same reply.
W20260709 13:13:34.019358  3143 consensus_meta.cc:287] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.537s	user 0.007s	sys 0.004s
I20260709 13:13:34.362586   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:34.363438   556 raft_consensus.cc:2376] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7. Re-sending same reply.
I20260709 13:13:34.364650   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:34.365945   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:34.368456   556 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:34.261377  3165 log.cc:927] Time spent T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.562s	user 0.001s	sys 0.000s
I20260709 13:13:34.297851  2783 raft_consensus.cc:740] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:34.356326  3104 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.351325  3041 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:34.360626   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:34.360801   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1576) took 2455 ms. Trace:
I20260709 13:13:34.300799  3000 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.366544   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:34.400590   555 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:34.339015  2952 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:33.894547  2646 raft_consensus.cc:3055] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:34.033881  2935 consensus_queue.cc:1059] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.345s
I20260709 13:13:34.376188  3143 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:34.380883  3041 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:34.382021   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:34.383742   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.401677   559 raft_consensus.cc:1240] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:13:34.403272   484 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:34.374929   551 rpcz_store.cc:276] 0709 13:13:31.905252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.920743 (+ 15491us) service_pool.cc:224] Handling call
0709 13:13:31.939702 (+ 18959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:31.940538 (+   836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:34.360595 (+2420057us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b5400228650. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:34.360743 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42862848}
W20260709 13:13:34.413223   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.417279   559 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:13:33.993750  3108 raft_consensus.cc:3055] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:34.413946  2959 raft_consensus.cc:3055] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:34.404496  3000 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:34.425283   551 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:34.406424  2646 raft_consensus.cc:740] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:13:34.429855  3103 consensus_meta.cc:287] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.744s	user 0.007s	sys 0.000s
I20260709 13:13:34.404201  3104 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:34.432277  3104 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:34.433100  2783 consensus_queue.cc:260] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:34.434414  2783 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:34.435998  2646 consensus_queue.cc:260] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:34.437029  2646 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:34.419042  2959 raft_consensus.cc:740] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:34.440001  2959 consensus_queue.cc:260] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:34.441174  2959 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:34.440001  3041 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.442695  3041 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:34.445758   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1615) took 2197 ms. Trace:
I20260709 13:13:34.446177   558 rpcz_store.cc:276] 0709 13:13:32.248048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.299150 (+ 51102us) service_pool.cc:224] Handling call
0709 13:13:32.308541 (+  9391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:32.627938 (+319397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:34.445535 (+1817597us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54001d7754. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:34.445701 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":733014272}
I20260709 13:13:34.447396  3130 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.447896  3130 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:34.449910  3130 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:34.451195   630 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.000s	sys 0.015s
W20260709 13:13:34.451759   630 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.000s	sys 0.015s
I20260709 13:13:34.480798   484 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:34.422637  3108 raft_consensus.cc:740] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:34.485507  3153 raft_consensus.cc:3055] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:34.485435  3108 consensus_queue.cc:260] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:34.486002  3153 raft_consensus.cc:740] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:34.486490  3108 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:34.486816  3153 consensus_queue.cc:260] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:34.487898  3153 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:34.492857  2184 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.423075  3169 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:34.481715  3131 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:34.499630   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 203947us
I20260709 13:13:34.502568   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1474) took 1095 ms. Trace:
I20260709 13:13:34.503077   624 rpcz_store.cc:276] 0709 13:13:33.407719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.524414 (+116695us) service_pool.cc:224] Handling call
0709 13:13:33.524703 (+   289us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:33.525054 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:33.525079 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:33.531141 (+  6062us) log.cc:844] Serialized 52 byte log entry
0709 13:13:33.631376 (+100235us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:33.631419 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.631487 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:34.502266 (+870779us) raft_consensus.cc:1685] finished
0709 13:13:34.502294 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:34.502492 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":822,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":3922,"thread_start_us":92725,"threads_started":1,"wal-append.queue_time_us":137349}
I20260709 13:13:34.501981   597 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:34.453109  2935 consensus_queue.cc:1243] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:13:34.509991   597 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:34.493431  2184 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:34.512897  2975 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:34.501791  3131 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:34.537195   556 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
W20260709 13:13:34.520197  3160 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.057s	sys 0.101s
I20260709 13:13:34.502099  3169 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:34.541532  3160 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.058s	sys 0.101s
W20260709 13:13:34.555399   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:34.556066   525 connection.cc:256] RPC call timeout handler was delayed by -1.4568914200001473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
W20260709 13:13:34.558439   525 connection.cc:256] RPC call timeout handler was delayed by -1.2310834920001525s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
W20260709 13:13:34.559406   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 49497.6us
I20260709 13:13:34.561923   597 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:34.557729   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 250855us
I20260709 13:13:34.566082  1141 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:34.562625  2863 raft_consensus.cc:697] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:34.568545   523 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:34.555284  3041 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:34.569422  1141 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:34.557928  2975 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:34.566504   597 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:34.560359   525 connection.cc:256] RPC call timeout handler was delayed by -1.0991835030001766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
W20260709 13:13:34.564172   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 229951us
W20260709 13:13:34.572781   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 67545us
I20260709 13:13:34.578126  3041 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:34.580178  3041 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.580643  3041 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:34.582739  3041 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:34.583154  2981 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:34.579487  2863 consensus_queue.cc:237] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:34.574059  2975 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.584517  2975 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:34.596596   525 connection.cc:256] RPC call timeout handler was delayed by -1.0905752369999391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
W20260709 13:13:34.597296   525 connection.cc:256] RPC call timeout handler was delayed by -1.0181835030000457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
I20260709 13:13:34.576412   597 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:34.584215  2850 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:34.600450  3159 log.cc:927] Time spent T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 1.062s	user 0.000s	sys 0.014s
I20260709 13:13:34.571033  3183 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:34.608388   523 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:34.608562  3102 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.610579  2844 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:34.611021   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 260) took 2234 ms. Trace:
I20260709 13:13:34.612448   557 rpcz_store.cc:276] 0709 13:13:32.376409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.375109 (+998700us) service_pool.cc:224] Handling call
0709 13:13:33.375460 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:33.375785 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:33.375827 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:33.414381 (+ 38554us) log.cc:844] Serialized 26 byte log entry
0709 13:13:33.522181 (+107800us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:33.522235 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.522320 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:34.599899 (+1077579us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:34.607613 (+  7714us) raft_consensus.cc:1685] finished
0709 13:13:34.607633 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:34.610958 (+  3325us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":44218,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":3185,"spinlock_wait_cycles":12417920,"thread_start_us":58112,"threads_started":1,"wal-append.queue_time_us":103947}
I20260709 13:13:34.570665  3187 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:34.607788  3041 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:34.575554  2998 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:34.608572   597 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:34.601788  2977 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:34.620558  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 51209.7us
I20260709 13:13:34.625932   552 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:34.629194   448 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:34.627442  3187 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:34.618487  3041 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.637418  3192 consensus_queue.cc:1059] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:34.640971   448 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:34.645686  2844 consensus_queue.cc:1059] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:34.646631  2844 raft_consensus.cc:3055] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:34.646950  2844 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:34.647830  2844 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:34.649058  2844 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:34.651001  3000 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:34.651686  2646 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:34.652204  2646 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:34.653178  3000 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:34.654222  2646 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:34.655367   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.657406  3169 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:34.658308  2783 consensus_queue.cc:1059] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:34.670994   448 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:34.619580  3102 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:34.659412  3041 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:34.639024  3108 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:34.629061  2977 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:34.659616  2998 raft_consensus.cc:697] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:13:34.701949  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 61893.5us
I20260709 13:13:34.668917  3169 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:34.708684   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:34.713729   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:34.715765   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:34.675156  3143 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:34.718235   556 raft_consensus.cc:2393] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:34.717599   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:34.718854   555 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:34.708684  3169 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:34.704023  3130 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:34.725666  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:34.726051  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:34.726649  1174 raft_consensus.cc:2410] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:13:34.711139  2863 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:34.726822  1172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 440) took 2452 ms (client timeout 2235 ms). Trace:
W20260709 13:13:34.728384   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 91043.3us
W20260709 13:13:34.731949  1172 rpcz_store.cc:269] 0709 13:13:32.274810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.274946 (+   136us) service_pool.cc:224] Handling call
0709 13:13:34.725915 (+2450969us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:34.726746 (+   831us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14001536}
I20260709 13:13:34.729413  3193 consensus_queue.cc:1048] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:34.729954  3187 raft_consensus.cc:697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:34.734321  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:34.749428   448 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:34.734786  3130 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:34.735697  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:34.736384  2998 consensus_queue.cc:237] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:34.738335  2977 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:34.739457   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:34.724931  3143 raft_consensus.cc:697] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:34.740396  2863 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:34.766450   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.631203  3179 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:34.744316   552 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:34.747080   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:34.747848  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:34.767540   555 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:34.670965  3170 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:13:34.724311  3169 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:34.741255   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 114606us
I20260709 13:13:34.766714   597 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:34.768131   448 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:34.811295   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.834654  2646 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:34.835515   525 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:34.842365   525 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:34.730731  2975 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:34.760067  3104 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:34.839396   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 267) took 2134 ms. Trace:
I20260709 13:13:34.843139   631 rpcz_store.cc:276] 0709 13:13:32.705374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.895045 (+189671us) service_pool.cc:224] Handling call
0709 13:13:32.895395 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:32.902988 (+  7593us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:32.980373 (+ 77385us) log.cc:844] Serialized 14 byte log entry
0709 13:13:33.112604 (+132231us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:33.112659 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:33.112701 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:34.839168 (+1726467us) spinlock_profiling.cc:243] Waited 7.1 ms on lock 0x7b54002bd9d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:34.839210 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:34.839345 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":177966,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":13967,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":2805,"spinlock_wait_cycles":16319872,"thread_start_us":208465,"threads_started":2,"wal-append.queue_time_us":168233,"wal-append.run_cpu_time_us":1366,"wal-append.run_wall_time_us":1087651}
I20260709 13:13:34.798254  3192 raft_consensus.cc:3055] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:34.850798  3130 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:34.864988  3131 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:34.851164  2975 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:34.845973  3104 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.812155   448 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:34.869623   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 57571.2us
I20260709 13:13:34.854574   525 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:34.846189  3179 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:34.867976  3196 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:34.874218   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:34.875051  3200 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:34.910349   551 raft_consensus.cc:2393] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:34.910284  3200 raft_consensus.cc:697] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:34.911147   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:34.911530  3102 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:34.911226  3200 consensus_queue.cc:237] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:34.912514   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:34.869110  3104 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:34.913589  3143 consensus_queue.cc:237] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:34.917085   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:34.917609   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.875569  2863 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:34.886096  2850 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:34.894994   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1502) took 1021 ms. Trace:
W20260709 13:13:34.919878   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.888229   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1583) took 1099 ms. Trace:
I20260709 13:13:34.834937  3187 consensus_queue.cc:237] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:34.889896  2945 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:34.890003   558 raft_consensus.cc:1275] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:13:34.928117   558 pending_rounds.cc:85] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 2
I20260709 13:13:34.928357   558 pending_rounds.cc:107] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:13:34.928591   558 raft_consensus.cc:2889] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:34.857029  3192 raft_consensus.cc:740] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:34.856622  2646 raft_consensus.cc:697] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:34.896293   479 raft_consensus.cc:3055] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:34.941975   479 raft_consensus.cc:740] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:13:34.943186   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 88706.5us
I20260709 13:13:34.944592   525 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:34.946345   525 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:34.908293  3130 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:34.868916  3194 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:13:34.924311   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.923931   554 rpcz_store.cc:276] 0709 13:13:33.788857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.789332 (+   475us) service_pool.cc:224] Handling call
0709 13:13:33.796734 (+  7402us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:33.797289 (+   555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:34.888028 (+1090739us) spinlock_profiling.cc:243] Waited 7.08 ms on lock 0x7b54000eb350. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:34.888172 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16283008}
I20260709 13:13:34.919399   484 rpcz_store.cc:276] 0709 13:13:33.873776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.876398 (+  2622us) service_pool.cc:224] Handling call
0709 13:13:34.894834 (+1018436us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b54002de454. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:34.894936 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1173009280}
I20260709 13:13:34.893712  3077 raft_consensus.cc:3055] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:13:34.898563   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.950465  3077 raft_consensus.cc:740] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:34.868995  3193 consensus_queue.cc:1059] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 13:13:34.952630  2646 consensus_queue.cc:237] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:34.953540  3191 log.cc:927] Time spent T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:13:34.953171  3077 consensus_queue.cc:260] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:34.950300  3182 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:34.954445  3194 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:34.948397  3130 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:34.955308  3130 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:34.954715  3077 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:34.955622  3192 consensus_queue.cc:260] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:34.956642  3192 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:34.950476  3196 consensus_queue.cc:1059] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:13:34.958475  3196 raft_consensus.cc:3055] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:34.958794  3196 raft_consensus.cc:740] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:34.918926  2658 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:34.953068  3193 raft_consensus.cc:3055] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:34.869555  2844 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:13:34.989902   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:35.065659   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 119409us
I20260709 13:13:35.067034   525 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:35.014873   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:35.047511   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:35.054071   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 248092us
I20260709 13:13:34.949396  2863 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:13:35.107151   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.106993   479 consensus_queue.cc:260] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:35.108850   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.894990  3041 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:35.085529   597 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:35.115024  1171 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:35.115778  1171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 550) took 2218 ms. Trace:
I20260709 13:13:35.116261  1171 rpcz_store.cc:276] 0709 13:13:32.897773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:35.114568 (+2216795us) service_pool.cc:224] Handling call
0709 13:13:35.114850 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:35.115541 (+   691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.115727 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:35.077407  2184 consensus_meta.cc:287] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.003s
I20260709 13:13:34.994167  3193 raft_consensus.cc:740] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:35.127215   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:35.053653  3108 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:35.129731   628 raft_consensus.cc:1240] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:35.075124  3179 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:35.053996  3131 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:13:35.132922   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 65983.2us
I20260709 13:13:35.102612  3170 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:35.134835  2959 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:35.135319  3201 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:35.148324   632 raft_consensus.cc:1240] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:35.149003   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:35.149639   629 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:35.145589  2658 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:35.137009   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:35.139011   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:35.155782   627 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:35.139714   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 337) took 2356 ms. Trace:
I20260709 13:13:35.156308   478 rpcz_store.cc:276] 0709 13:13:32.783523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.147823 (+364300us) service_pool.cc:224] Handling call
0709 13:13:33.161286 (+ 13463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:33.359105 (+197819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:33.359131 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:33.359599 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:13:33.473385 (+113786us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:33.473422 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.118052 (+1644630us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400370ad4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:35.118110 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:35.118163 (+    53us) raft_consensus.cc:1685] finished
0709 13:13:35.118174 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:35.139634 (+ 21460us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":454083840,"thread_start_us":113433,"threads_started":1,"wal-append.queue_time_us":158604,"wal-append.run_cpu_time_us":1740,"wal-append.run_wall_time_us":1041544}
I20260709 13:13:34.733616 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:35.133615   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:35.144332   525 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:35.130306   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:35.160374   631 raft_consensus.cc:2393] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:35.118558  3153 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:35.103638  2935 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:13:35.146250   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 60850.1us
I20260709 13:13:35.090572  3182 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:13:35.150360   380 catalog_manager.cc:5697] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 1 to 3, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 3 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:35.136813   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:35.090741  2844 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:35.161202  2658 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:35.165937   626 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:35.171922   525 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:35.186914   629 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:35.134311  2184 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:35.205783  2184 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:34.959568  3196 consensus_queue.cc:260] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:35.192080   627 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:13:35.182575  3179 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:35.207551   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 338) took 2423 ms. Trace:
I20260709 13:13:35.196681   525 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:35.168231  3201 raft_consensus.cc:697] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:35.150245  3108 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:35.149008  3131 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:35.182875  2863 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:35.154260  2959 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:35.192593  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 138902us
I20260709 13:13:35.185864  2935 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:35.210233   525 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:35.212167  3035 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:35.291370  3179 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:13:35.291829  3206 log.cc:927] Time spent T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:13:35.200928  3180 consensus_queue.cc:1048] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:13:35.216078  3202 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:13:35.219668  3196 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:35.272277   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 107668us
I20260709 13:13:35.170049  3153 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:35.195158  3198 consensus_queue.cc:1048] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:13:35.198357  2977 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:13:35.190809  3204 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:35.208102   477 rpcz_store.cc:276] 0709 13:13:32.783846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.341737 (+557891us) service_pool.cc:224] Handling call
0709 13:13:33.342157 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:33.474816 (+132659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.207266 (+1732450us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540022d154. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:35.207478 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302653824}
I20260709 13:13:35.150800  3170 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:35.273353  3102 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.285480  1175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 554) took 1783 ms. Trace:
I20260709 13:13:35.305038  1175 rpcz_store.cc:276] 0709 13:13:33.502158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.502384 (+   226us) service_pool.cc:224] Handling call
0709 13:13:33.502648 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:33.782397 (+279749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.285130 (+1502733us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54004583d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:35.285402 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642054016}
W20260709 13:13:35.308221   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.397327  3153 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:35.398398  2935 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:35.403963  1168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 555) took 1828 ms. Trace:
I20260709 13:13:35.404603  1168 rpcz_store.cc:276] 0709 13:13:33.575282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.576114 (+   832us) service_pool.cc:224] Handling call
0709 13:13:33.704256 (+128142us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:33.712032 (+  7776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.403643 (+1691611us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54005ed150. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:35.403874 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237823360}
I20260709 13:13:35.290971  2658 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:35.415267  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:35.419569  2959 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:35.188678  3193 consensus_queue.cc:260] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:35.300436  3194 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:35.284862  2844 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:35.425658  2844 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:35.426389  2844 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:35.429342  2844 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:35.432770  3201 consensus_queue.cc:237] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:35.279426  3210 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:35.434562  3210 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:35.437256  3210 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:35.440167  2550 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:35.289512   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 168430us
W20260709 13:13:35.290614   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 80435.8us
I20260709 13:13:35.444236   525 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:35.444540   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:35.290954  3205 log.cc:927] Time spent T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:13:35.291396  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:35.228941  2952 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:35.414599  3130 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:35.296454   597 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:35.454696   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 158306us
I20260709 13:13:35.455461   597 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:35.304164  3204 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.285974  2849 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:35.292480   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:35.461613   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.460649   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:35.462958   553 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:35.462011   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:35.461537   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:35.464207   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.465787   477 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:13:35.466133   477 pending_rounds.cc:85] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 2
I20260709 13:13:35.466353   477 pending_rounds.cc:107] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:13:35.466569   477 raft_consensus.cc:2889] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:35.467924   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:35.468297   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.468503   475 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:35.471190   475 raft_consensus.cc:1240] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: [4.2-5.3]
I20260709 13:13:35.471019   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:35.452581  3181 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:35.485512   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:35.475755   525 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:35.488611   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:35.474781   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:35.448554  3102 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:35.459563  3194 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:35.469914  3019 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.461648  3077 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:35.493626   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:35.459775  3204 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:35.496155   478 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:35.467185  2783 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:13:35.495390  3192 consensus_meta.cc:287] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.002s
I20260709 13:13:35.472930  3041 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:35.474713  3181 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.467613  3143 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:35.493436  2959 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:35.463088  2849 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:35.461596  2975 consensus_queue.cc:1059] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:13:35.508471  3208 log.cc:927] Time spent T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:13:35.509130  3170 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:35.518811   553 raft_consensus.cc:2410] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:35.558562   475 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:35.501865  3019 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:35.495502  3108 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:35.534722   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.529680  3181 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:35.493633  2952 consensus_queue.cc:1059] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:13:35.493687  3153 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
W20260709 13:13:35.552781  3169 consensus_meta.cc:287] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.000s
I20260709 13:13:35.544831  2957 raft_consensus.cc:3055] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:13:35.573500   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.545399  2959 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.529647  3194 raft_consensus.cc:697] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:35.544533  3077 raft_consensus.cc:697] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:35.504045  3202 consensus_queue.cc:1059] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
W20260709 13:13:35.600060   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:35.600994   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 131887us
I20260709 13:13:35.505196  2783 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:35.579321  2975 raft_consensus.cc:3055] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:35.580032  2959 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:35.575877  2849 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:35.576354  2957 raft_consensus.cc:740] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:35.552570  3143 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:35.599797  3199 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:35.619408   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 274) took 2562 ms. Trace:
I20260709 13:13:35.620337   553 raft_consensus.cc:1240] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:13:35.613847  3202 consensus_queue.cc:1243] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer 6e6df7e8ed204f1db5c371536b5b0683 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:13:35.610365  2975 raft_consensus.cc:740] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:35.621495   633 rpcz_store.cc:276] 0709 13:13:33.057240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.494846 (+437606us) service_pool.cc:224] Handling call
0709 13:13:33.495161 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:33.496597 (+  1436us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:13:33.500944 (+  4347us) log.cc:844] Serialized 14 byte log entry
0709 13:13:35.443056 (+1942112us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b1800080a40. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb923a 00007f4b68423a2a
0709 13:13:35.599554 (+156498us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:35.599606 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:35.599651 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.599833 (+   182us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:35.619350 (+ 19517us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3709,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":5779,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":11606,"spinlock_wait_cycles":10371328,"thread_start_us":151969,"threads_started":1,"wal-append.queue_time_us":2110730}
W20260709 13:13:35.634153  3104 consensus_meta.cc:287] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.721s	user 0.007s	sys 0.001s
I20260709 13:13:35.634610  3104 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:35.635489  2957 consensus_queue.cc:260] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:35.625501  3199 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:35.579242  3169 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:35.677594   480 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:13:35.678802   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:35.694444   551 raft_consensus.cc:2393] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 8: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:35.678289   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:35.703408  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:35.707085   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:35.707974   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.708235   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:35.712730   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:35.713822   551 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:35.714568   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:35.715289   551 raft_consensus.cc:2410] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:13:35.716945  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 255981us
I20260709 13:13:35.713164  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:35.731961  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:35.733052   448 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:35.733739   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:35.731442  1175 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:35.734529   555 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:35.734476   448 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:35.741508   551 raft_consensus.cc:1240] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 6. Ops: []
I20260709 13:13:35.742519   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:35.744343   599 connection.cc:256] RPC call timeout handler was delayed by -1.6984452069998497s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
I20260709 13:13:35.705840  3103 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.747931   478 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:35.750277   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:35.753453  1139 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:35.754315   448 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:35.708971  3202 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:35.756629   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:35.758152   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:35.762329   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:35.736227  3215 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.736650  2957 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:35.630286  3077 consensus_queue.cc:237] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:35.773535   448 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:35.780373   478 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:35.777987   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:35.752112  3228 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.628221  3194 consensus_queue.cc:237] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:35.746984  3192 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:35.747221  3108 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:35.762085  3170 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:35.941107  3170 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.941642  3170 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:35.803983   482 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:35.922358  3104 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:35.941431  3204 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:35.952466  3239 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.953042  3239 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:35.761947  3190 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:35.954228  3190 raft_consensus.cc:697] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:35.861841   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1645) took 1151 ms. Trace:
W20260709 13:13:35.866158   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.859930   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1646) took 1148 ms. Trace:
I20260709 13:13:35.919304   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1648) took 1204 ms. Trace:
I20260709 13:13:35.756336  3079 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:35.837996  3213 log.cc:927] Time spent T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:13:35.957587   556 rpcz_store.cc:276] 0709 13:13:34.711444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.713488 (+  2044us) service_pool.cc:224] Handling call
0709 13:13:35.859736 (+1146248us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b540034ce54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:35.859867 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8622976}
I20260709 13:13:35.958252   558 rpcz_store.cc:276] 0709 13:13:34.715085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.715210 (+   125us) service_pool.cc:224] Handling call
0709 13:13:34.715479 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:34.929010 (+213531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.919004 (+989994us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b540002a8d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:35.919217 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":400550272}
W20260709 13:13:35.959434   599 connection.cc:256] RPC call timeout handler was delayed by -1.4561117529999592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 13:13:35.966405   599 connection.cc:256] RPC call timeout handler was delayed by -1.1532625639997605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
I20260709 13:13:35.861531  2977 raft_consensus.cc:3055] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:35.958534  3228 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:35.980173   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:35.868530  3196 consensus_meta.cc:287] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.000s
I20260709 13:13:35.762501  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:35.984808   551 raft_consensus.cc:2410] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:13:35.779390  3067 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:35.985375  3067 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:35.867202  3143 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:35.805585  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:35.870757  3130 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:35.865198  3131 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:35.819386  3019 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:35.908432   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:35.970265   599 connection.cc:256] RPC call timeout handler was delayed by -1.0841515170000093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
W20260709 13:13:36.016440   599 connection.cc:256] RPC call timeout handler was delayed by -1.0690786170000592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
I20260709 13:13:35.972867   478 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
W20260709 13:13:35.871932  3227 log.cc:927] Time spent T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:13:35.959497  3192 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:35.763826  3202 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.023577   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:35.955289   557 rpcz_store.cc:276] 0709 13:13:34.710638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.711285 (+   647us) service_pool.cc:224] Handling call
0709 13:13:34.711684 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:34.722530 (+ 10846us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:34.722551 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:34.722865 (+   314us) log.cc:844] Serialized 26 byte log entry
0709 13:13:35.645492 (+922627us) spinlock_profiling.cc:243] Waited 6.28 ms on lock 0x7b18002b9000. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb90d1 00007f4b683d4a0f
0709 13:13:35.731351 (+ 85859us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:35.731393 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.731462 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:35.861564 (+130102us) raft_consensus.cc:1685] finished
0709 13:13:35.861584 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:35.861786 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9841,"raft.queue_time_us":11825,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":4613,"spinlock_wait_cycles":14434176,"thread_start_us":72471,"threads_started":1,"wal-append.queue_time_us":1066572}
I20260709 13:13:35.865420  2783 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:35.846488  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:35.866168  3169 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.036748   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.037293   484 raft_consensus.cc:2393] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:35.760962  3103 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.018746  3108 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.985807  3067 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:35.802109  3220 consensus_queue.cc:1059] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.238s
I20260709 13:13:35.975461  2977 raft_consensus.cc:740] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:36.020671   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.075552   478 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:36.040737   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.041100   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.036316  3019 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:13:35.994174  3204 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:35.808040  3215 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.059978  3128 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.021761  2550 raft_consensus.cc:2764] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:13:36.079461   628 raft_consensus.cc:2410] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:36.072427  3108 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.080838   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.081458   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.081694  2977 consensus_queue.cc:260] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.073000   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:36.073108  1169 raft_consensus.cc:2410] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:13:36.083796  3239 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:36.090584   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.079613  2959 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.086539  3202 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:36.101022   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.128048   631 raft_consensus.cc:2393] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:36.121583   484 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:36.122604   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:36.124176   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.126103   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:36.128885   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.127169   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.129914   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.129443   482 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:36.129375   628 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:36.130275   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.130486   631 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:36.049639  3190 consensus_queue.cc:237] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.131351   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.131633   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:36.160027   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.160400   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.160697   631 raft_consensus.cc:2393] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:36.111544  3128 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.164685   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.166877   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.170833   484 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:36.171808   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.174629  3128 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.162232  2783 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:36.175498  2783 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.175918   626 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:36.177266   626 raft_consensus.cc:1275] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:36.177301  2783 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.159608  2977 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:36.180109   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:36.180480   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.180663   478 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:36.184592   628 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:36.190464   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.191802   484 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:36.194036   484 raft_consensus.cc:1275] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:36.195403  1141 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.124928  3229 consensus_queue.cc:1048] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 13:13:36.185228  3181 consensus_meta.cc:287] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.002s
I20260709 13:13:36.208127   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.209384   478 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:36.209264   627 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:36.212702   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.213841   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.214865   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:36.215855  3252 log.cc:927] Time spent T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:13:36.216234   627 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:36.217237   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.218492  2658 raft_consensus.cc:3055] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:36.218973  2658 raft_consensus.cc:740] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:36.220088  2658 consensus_queue.cc:260] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.223315  3181 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.225473  3181 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.226282   559 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 6: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:36.205837  2783 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:36.238075  3108 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.189677  3092 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:36.241914   480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 345) took 3291 ms (client timeout 2237 ms). Trace:
W20260709 13:13:36.242321   480 rpcz_store.cc:269] 0709 13:13:32.950576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.136230 (+185654us) service_pool.cc:224] Handling call
0709 13:13:36.241727 (+3105497us) spinlock_profiling.cc:243] Waited 2.54 s on lock 0x7b540022d654. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:36.241827 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5839660288}
I20260709 13:13:36.243880  3228 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:36.244724  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:36.246582  2959 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.247344  3192 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:36.184026  3245 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.190073  3128 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.238864   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.257103   599 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:36.203835  3253 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:36.266043   627 raft_consensus.cc:2393] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 7: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:36.266881  3249 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:36.269483  3249 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:36.269884  3249 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:36.271489  2975 consensus_queue.cc:260] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.272921  2975 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:36.281348  3249 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.287818   597 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.284185   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.289674   632 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:36.290122  3077 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:36.290515   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.291211   632 raft_consensus.cc:2393] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:36.292100   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:36.293310   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.294292   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:36.294524  3249 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:36.295964   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.294492   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.297819   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.298727   633 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:36.299683   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:36.300666   632 raft_consensus.cc:2393] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:36.300922   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.301293   599 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.302215   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.306140   632 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:13:36.303592   633 raft_consensus.cc:2410] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:13:36.318926   599 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.321877   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.323838   629 raft_consensus.cc:1240] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:36.327875   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:36.296737  3253 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.331403  3253 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.331920  3253 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:36.332396  3253 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.334430  3253 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.335574   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:36.338551   480 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:13:36.344197  3170 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.346303  3170 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.347510  3067 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.349555  3067 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:36.265245  3128 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.351715  3128 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.353906   480 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:36.339653   380 catalog_manager.cc:5697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:36.354596  3103 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:36.356411   476 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:36.328568  3249 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:36.357187   478 raft_consensus.cc:1240] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:36.258459  3192 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:13:36.262301  3245 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.359632   482 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:13:36.360355  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 150196us
I20260709 13:13:36.367192   599 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.371354   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.372262   447 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.363036  3073 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.372532   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.372977  3073 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.362429  3228 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:36.374207   482 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
I20260709 13:13:36.375869  3245 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.375103   447 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.378710   447 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.380702  3103 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:36.381402  3103 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.382254   447 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.381850  3103 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:36.374178  2945 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:36.386816   447 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.392338  1141 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:36.376771  3092 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:36.394357   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 321421us
W20260709 13:13:36.397330   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.398124   447 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:36.409308   523 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:36.408497  3253 raft_consensus.cc:2804] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:36.390601  3228 raft_consensus.cc:697] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:36.391968  3128 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:36.411203   447 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:36.412238   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.417357   525 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:36.417356   447 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:36.432147   447 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:36.433415   447 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:36.434533   447 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.410951  2977 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.442410  2977 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.444335  2998 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:36.444550  2977 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:36.445194  2977 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:36.444903  2998 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.445648  2977 raft_consensus.cc:697] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:36.446767  2646 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:36.410770  3253 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:36.447940  3253 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:36.449045  2977 consensus_queue.cc:237] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.450451  2783 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:36.431857  3170 consensus_queue.cc:1059] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:13:36.452014  3170 raft_consensus.cc:3055] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:36.452365  3170 raft_consensus.cc:740] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:36.452540  3220 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:36.412083  3067 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:36.453091  3170 consensus_queue.cc:260] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.453723   447 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.447227  3019 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:36.455094   447 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.408808  3210 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:36.467641   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 48665.1us
I20260709 13:13:36.451112  3092 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:36.468333  3170 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:36.478428   447 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:36.415897  3181 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:13:36.487461   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 86644.9us
I20260709 13:13:36.491760   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.492658   633 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:36.498677   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.499759   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:36.499895   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.468693  2646 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:36.500794   633 raft_consensus.cc:2376] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6. Re-sending same reply.
I20260709 13:13:36.483625  3067 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:36.504129   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.476897  3180 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:36.505451   525 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:36.490195  2850 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.506104   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.501916  3019 consensus_queue.cc:1059] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:13:36.498294  3198 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.507186  3253 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.508104   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:36.533171   627 raft_consensus.cc:2393] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:36.508608   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1611) took 1046 ms. Trace:
I20260709 13:13:36.533545   559 rpcz_store.cc:276] 0709 13:13:35.462103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:35.462239 (+   136us) service_pool.cc:224] Handling call
0709 13:13:36.508429 (+1046190us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b54001ca054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:36.508550 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1221186304}
I20260709 13:13:36.483852  3092 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:36.431077  3108 consensus_queue.cc:1048] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:13:36.509837   481 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:36.511612   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:36.536582   633 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:36.531672  2998 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:36.537683   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1657) took 1611 ms. Trace:
I20260709 13:13:36.537839  2998 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:36.538431  2998 raft_consensus.cc:697] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:36.490037  3128 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:36.540755  3128 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:36.541158  3128 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:36.519420   476 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1586) took 4288 ms (client timeout 1743 ms). Trace:
W20260709 13:13:36.544111   476 rpcz_store.cc:269] 0709 13:13:32.221152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.239571 (+ 18419us) service_pool.cc:224] Handling call
0709 13:13:36.509407 (+4269836us) spinlock_profiling.cc:243] Waited 4.09 s on lock 0x7b5400370fd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:36.509514 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9417148800}
I20260709 13:13:36.519973   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.546700  3102 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.520911   447 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:36.490150  3169 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:36.529704   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:36.547876   632 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:36.502068  3074 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:13:36.500098  3181 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.548430  2998 consensus_queue.cc:237] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.530241  3228 consensus_queue.cc:237] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.535179  3198 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.554364  3215 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:36.532150   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.538105   552 rpcz_store.cc:276] 0709 13:13:34.925828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.926021 (+   193us) service_pool.cc:224] Handling call
0709 13:13:34.949082 (+ 23061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:34.959992 (+ 10910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:34.960028 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:34.960068 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:34.960103 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:36.537444 (+1577341us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b540034d354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:36.537494 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:36.537625 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24607616}
I20260709 13:13:36.529420  2934 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:36.565238   633 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:36.565814   447 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.567006   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:36.567829   552 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:36.568439   447 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.536206  3092 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:36.581993   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.585494   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:36.578293   559 raft_consensus.cc:1240] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: [4.5-6.6]
W20260709 13:13:36.590756   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 181506us
W20260709 13:13:36.590698   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 85329.6us
I20260709 13:13:36.531410  2850 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.595441   552 raft_consensus.cc:2410] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:36.594367  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:36.596580  1174 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:36.589591   447 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:36.569308  2783 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.599812   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:36.603266   552 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:36.607636  2850 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.594393  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:36.598249   523 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:36.571098  3169 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:36.588052  3251 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.622969  3203 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:36.623145  3251 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.623551  3203 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.624047  2658 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:36.626039  3203 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:36.600718   447 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:36.627841  3108 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:36.628487  3108 raft_consensus.cc:697] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:36.629582  3108 consensus_queue.cc:237] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.569459  3271 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:36.631840  3271 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.633999  3271 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:36.604159   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:36.635031  3277 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.635509   558 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:36.635870  3277 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.638520  3277 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.597822  3215 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:36.605937  3253 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.605978   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:36.603507  2646 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:36.592464  3210 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:36.600885   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:36.612928   552 raft_consensus.cc:1275] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:36.613539  3181 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.614034   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:36.616262   556 raft_consensus.cc:1240] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:13:36.614648  3198 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:36.640563   555 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:36.611205   597 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:36.647261   476 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:36.643152  2646 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.604352  2783 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:36.649178   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 51000.2us
I20260709 13:13:36.653129   597 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:36.618378  3169 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.656733  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:36.657334  1174 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:36.658740   523 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:36.659632  3277 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:36.660168  3277 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:36.660413  2783 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.660817  3277 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:36.661263  1173 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:13:36.662243   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.663426   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:36.664135  3266 log.cc:927] Time spent T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.192s	user 0.003s	sys 0.000s
I20260709 13:13:36.664258   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1517) took 1194 ms. Trace:
I20260709 13:13:36.664459   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.651011  2646 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:36.665478   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.664646   477 rpcz_store.cc:276] 0709 13:13:35.470192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:35.486210 (+ 16018us) service_pool.cc:224] Handling call
0709 13:13:35.486586 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:35.494063 (+  7477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:35.494097 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:35.494537 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:13:35.596863 (+102326us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:36.663544 (+1066681us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b18000776e0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b67fc14bc 00007f4b6530f48b 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b65329455 00007f4b6be113c7 00007f4b684239a7 00007f4b684330bf
0709 13:13:36.663678 (+   134us) log.cc:844] Serialized 14 byte log entry
0709 13:13:36.663901 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:36.663968 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:36.664007 (+    39us) raft_consensus.cc:1685] finished
0709 13:13:36.664108 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:36.664210 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20019,"prepare.queue_time_us":52215,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":7947,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":6506,"spinlock_wait_cycles":3108224,"thread_start_us":123158,"threads_started":2,"wal-append.queue_time_us":127198}
I20260709 13:13:36.666489   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.667382  3200 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:36.667783  3200 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.668130  3200 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:36.668771  3067 raft_consensus.cc:3055] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:36.669214  3067 raft_consensus.cc:740] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:36.670035  3067 consensus_queue.cc:260] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.677192  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:36.678813   476 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:36.679802   599 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:36.680150  1141 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:36.680658   599 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:36.682034   599 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.684263   525 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:36.639959  3251 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:36.691004  1172 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:13:36.667014   480 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:36.693698   597 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:36.650836  3203 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:36.696609   556 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:36.701141   599 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.702422   599 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.702800  2975 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:36.703387   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1487) took 1574 ms. Trace:
I20260709 13:13:36.697463   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:36.704155  3251 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:36.704656  3251 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:36.704603  3092 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.705168  3251 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:36.705734   626 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:36.706760  3092 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.675639  3102 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:36.707485  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:36.710264  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:36.649107  3274 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:36.650353  2880 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:36.700531   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.698621   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.711024  1168 raft_consensus.cc:2393] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 7: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:36.676107  3169 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:36.674978  3277 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.663174  3073 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.703740   630 rpcz_store.cc:276] 0709 13:13:35.128969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:35.402645 (+273676us) service_pool.cc:224] Handling call
0709 13:13:35.403207 (+   562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:35.451895 (+ 48688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:35.451925 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:35.459112 (+  7187us) log.cc:844] Serialized 26 byte log entry
0709 13:13:36.702865 (+1243753us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b54001b8620. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68383090 00007f4b683906b8 00007f4b6841992b 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c
0709 13:13:36.702921 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:36.702973 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:36.703034 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:36.703073 (+    39us) raft_consensus.cc:1685] finished
0709 13:13:36.703087 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:36.703331 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7271,"raft.queue_time_us":10064,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":5100,"spinlock_wait_cycles":9523584,"thread_start_us":135252,"threads_started":1,"wal-append.queue_time_us":88091,"wal-append.run_cpu_time_us":2014,"wal-append.run_wall_time_us":1068594}
I20260709 13:13:36.715394   599 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.726541   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:36.727221   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.755851   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:36.671187  3067 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:36.645690  3215 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.694180  2945 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:36.764518   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.701257  2783 raft_consensus.cc:2804] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:36.701391  3203 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.764814   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.701496  3249 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:36.766562  3128 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.767750  3277 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:36.762524   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 47220.3us
I20260709 13:13:36.696524  3210 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.766794   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.707504  3187 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:36.784742  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:36.794606  1172 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:36.783784   477 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:36.713979  3198 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:36.758656  2880 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.787272  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:36.787038   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:36.722283  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:36.789290   599 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.774856  2945 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:36.796501   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:36.800283   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:36.785638  3203 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:36.800539   480 raft_consensus.cc:1240] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:36.795300  3249 raft_consensus.cc:697] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:36.803176   476 raft_consensus.cc:2410] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:36.721370  3077 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:36.802289   552 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:36.801954  2945 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:36.786665  1168 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:13:36.787077  3181 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.808753  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:36.811527   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.814597  1169 raft_consensus.cc:2393] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:36.811452  3077 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.811225  3187 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:36.762228  3274 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.797348  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:36.791900  2783 raft_consensus.cc:697] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:36.820655   476 raft_consensus.cc:1240] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:13:36.785784  3103 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.806818  2975 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:36.711046  3192 consensus_queue.cc:1048] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:13:36.871903   480 raft_consensus.cc:1240] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:13:36.871615   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 178016us
I20260709 13:13:36.842868  1172 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:36.862244  3160 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:36.864517  3200 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.832993   483 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:36.871275   559 raft_consensus.cc:1240] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:36.798672  2880 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:36.835861  3077 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:36.800033  3210 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.876371  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:36.879753   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:36.880404   556 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:36.868582  3228 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:36.883785   480 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:13:36.885182  3128 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:36.885731  3200 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:36.887396  3103 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.879312  3187 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:36.837795  3251 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.839385  3249 consensus_queue.cc:237] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.896585  2880 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.900666  3274 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:36.880833  3160 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:36.912912   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.839435  3181 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.835204  3215 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:36.891220   597 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:36.919492  2945 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:36.920665   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 131475us
I20260709 13:13:36.922394  2783 consensus_queue.cc:237] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.880997  2975 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:36.934588  2975 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.935977  3251 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:36.936576  2975 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:36.937077  3199 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:36.927060  3187 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:36.937768   483 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:36.938881   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.939150  3187 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:36.939496  3279 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.106s	user 0.000s	sys 0.003s
I20260709 13:13:36.939519   483 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:13:36.940766  1141 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:36.929747   597 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:36.929992   599 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.930537  3215 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:36.933149  3160 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:36.934080  2880 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:36.941337   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:36.945221   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:36.946362   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:36.947299   599 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.987577  3187 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:36.989094  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:36.883278  2646 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:36.994532   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:36.991532   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 44344.2us
I20260709 13:13:36.990279   557 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:36.992437  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:36.941042  3181 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.995025   554 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:36.995571   599 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:36.991340  3240 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:36.934583  3210 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:36.994704  3279 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:13:36.989979  3199 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:37.002089  3199 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.002529  3199 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:37.002923   599 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:37.003822  3241 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:37.004261  3241 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:37.004649  3241 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:37.000646   483 raft_consensus.cc:1275] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:37.007696  3249 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:37.009554   599 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:37.010797  3249 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:36.999366  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:36.988597  2975 consensus_queue.cc:1048] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:13:37.012715  2646 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:36.995755  3215 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:36.998755  3240 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:36.995394  3187 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:37.021108   554 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:37.025866  2945 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:37.026636  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:37.039201   599 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:37.047345   599 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:37.048861   599 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:37.042378  3187 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:37.027093  3077 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.054031  3077 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:37.056775  3169 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.057564  3199 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.058895  3169 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:37.072471   599 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:37.044983  3215 raft_consensus.cc:697] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:37.060278  3199 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:37.063757   477 raft_consensus.cc:2410] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:37.040761  3240 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:37.065312   483 raft_consensus.cc:1240] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 7. Current term is 8. Ops: []
W20260709 13:13:37.065412  3281 log.cc:927] Time spent T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:13:37.066512  3203 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:37.082911   475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1518) took 1608 ms (client timeout 1791 ms). Trace:
I20260709 13:13:37.072263  3249 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:37.086923   475 rpcz_store.cc:269] 0709 13:13:35.471821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:35.485269 (+ 13448us) service_pool.cc:224] Handling call
0709 13:13:37.079612 (+1594343us) spinlock_profiling.cc:243] Waited 72.2 ms on lock 0x7b540022d154. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:37.079780 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166132992}
I20260709 13:13:37.078434  2658 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:37.053422  3287 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:37.082103  3192 raft_consensus.cc:2749] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:37.099291   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:37.115185   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:37.100179   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:37.116807   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:37.117347   626 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:37.117421   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:37.117532   633 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:37.118520   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:37.118791   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:37.119378   631 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.120298   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:37.121045   632 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:37.123394   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:37.123934   476 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.086900  1167 raft_consensus.cc:1240] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:37.125135   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:37.081437  3228 consensus_queue.cc:1059] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:13:37.126540   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:37.127182   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:37.132418   626 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:37.133527   447 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:37.136157   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:37.089435  3249 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:37.136722   630 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:37.143352   483 raft_consensus.cc:1240] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:13:37.123971  2975 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:37.089483  2783 consensus_queue.cc:1059] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:13:37.089114  3077 consensus_queue.cc:1059] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:13:37.136686  2646 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:37.135457  2934 consensus_queue.cc:1059] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:13:37.091387  3199 consensus_queue.cc:1059] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:13:37.149682   631 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:37.139938  3249 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.155663   476 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:37.158685   630 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:13:37.157516   447 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:37.148532  3192 raft_consensus.cc:3055] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:37.162103   447 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:37.166446  3073 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:37.166951  3073 raft_consensus.cc:697] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:37.168308  3073 consensus_queue.cc:237] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.167500   479 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:37.143206  3241 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.177304   479 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:37.179621   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1585) took 4977 ms. Trace:
I20260709 13:13:37.159704  2646 raft_consensus.cc:697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:37.191947  2646 consensus_queue.cc:237] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.145120  3215 consensus_queue.cc:237] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.160899  3074 raft_consensus.cc:3055] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:37.160800  3251 raft_consensus.cc:3055] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:37.181352   477 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:37.180157   479 rpcz_store.cc:276] 0709 13:13:32.200925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.383380 (+182455us) service_pool.cc:224] Handling call
0709 13:13:32.411804 (+ 28424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:34.896190 (+2484386us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400198aa0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68390dc0 00007f4b6841b1c0 00007f4b6841c231 00007f4b68418d8f 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c
0709 13:13:37.163131 (+2266941us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b58007700d0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b683750aa 00007f4b683f7447 00007f4b6840ffe7 00007f4b684117de 00007f4b6841bb49 00007f4b6841c416 00007f4b68418d8f 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4
0709 13:13:37.177673 (+ 14542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.177844 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7291828352}
I20260709 13:13:37.157437  2975 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.179672  3170 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.175108  2934 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:37.188081  3203 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:37.188663  3241 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:37.189298   625 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:37.189471   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:37.235946   476 raft_consensus.cc:2368] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9.
I20260709 13:13:37.205250  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:37.175623  3192 raft_consensus.cc:740] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:37.227957   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:37.238530  1175 raft_consensus.cc:2393] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 7: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:37.217832  3074 raft_consensus.cc:740] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:37.220296  3169 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.220582  3251 raft_consensus.cc:740] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:37.232762  3195 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.247344  3195 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.249468  3195 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:37.250419  2975 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:37.250183  3192 consensus_queue.cc:260] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.240463  2934 raft_consensus.cc:697] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:37.251339  3192 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:37.252076  2934 consensus_queue.cc:237] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.258106   632 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
W20260709 13:13:37.261269   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:37.264915   625 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:13:37.267858   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1504) took 3393 ms. Trace:
I20260709 13:13:37.268296   481 rpcz_store.cc:276] 0709 13:13:33.874279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.940502 (+ 66223us) service_pool.cc:224] Handling call
0709 13:13:36.509534 (+2569032us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:36.536123 (+ 26589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.267652 (+731529us) spinlock_profiling.cc:243] Waited 2.57 s on lock 0x7b5400370fd0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:37.267796 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5907366144}
I20260709 13:13:37.234688  3170 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.273392   633 raft_consensus.cc:1240] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:37.273953   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:37.274184   626 raft_consensus.cc:1240] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:37.275674   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:37.276466   628 raft_consensus.cc:2393] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 7: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:37.276512   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:37.277490   626 raft_consensus.cc:2410] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:13:37.280788   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:37.282874   628 raft_consensus.cc:2410] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:37.232082  3187 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.275910   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:37.271140  3203 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.281586   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:37.286139   633 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:37.286958   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:37.245223  3169 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.284232  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:37.296262   632 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:37.275141  2945 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:37.292280  2854 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:13:37.300520  1138 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:37.313381  3193 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.291505  3160 consensus_queue.cc:1059] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:13:37.290373  3203 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.343585  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:37.344141  3203 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:37.344291   525 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:37.345117  1166 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:37.303061  3187 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:37.346632   631 raft_consensus.cc:2393] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:37.320771  3169 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:37.346748   525 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:37.348910  3274 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:37.349396  3274 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.351470  3181 raft_consensus.cc:2764] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:13:37.351497   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:37.286918  3074 consensus_queue.cc:260] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.290730  3251 consensus_queue.cc:260] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.329411  3160 raft_consensus.cc:3055] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:37.296514  3260 consensus_queue.cc:1059] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:13:37.299032  2945 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.334616  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:37.336710   479 raft_consensus.cc:1240] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:37.336768   481 raft_consensus.cc:1275] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:37.364928  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:37.352257   380 catalog_manager.cc:5697] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 3 to 4, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132), no longer has a pending config: VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130), VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131), VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 4 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.360427  3074 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:37.338021   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:37.338810  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:37.339623  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:37.339720  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:37.367125   476 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:37.340772  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:37.341063   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 512876us
I20260709 13:13:37.341279  3276 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:37.341495  3232 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:37.316517  3253 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:37.341709  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:37.342219  3246 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:37.325338  3240 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:37.361122   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:37.369673  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:37.373029   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1615) took 1907 ms. Trace:
I20260709 13:13:37.373584   553 rpcz_store.cc:276] 0709 13:13:35.466076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:35.626310 (+160234us) service_pool.cc:224] Handling call
0709 13:13:35.626606 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:35.626800 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:35.650266 (+ 23466us) log.cc:844] Serialized 14 byte log entry
0709 13:13:37.032169 (+1381903us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b18004136e0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb923a 00007f4b68423a2a
0709 13:13:37.372610 (+340441us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:37.372679 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:37.372738 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.372826 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:37.372963 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":246815,"prepare.queue_time_us":49431,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"spinlock_wait_cycles":35654912,"thread_start_us":93324,"threads_started":1,"wal-append.queue_time_us":1465711}
I20260709 13:13:37.376734   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:37.377008   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:37.371181  1171 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:37.377902   626 raft_consensus.cc:2410] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:13:37.360582  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:37.375835   597 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:37.378633   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:37.357712  3274 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:37.358810  3160 raft_consensus.cc:740] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:37.384595   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1666) took 1643 ms. Trace:
I20260709 13:13:37.379284   597 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:37.385033   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:37.384963   551 rpcz_store.cc:276] 0709 13:13:35.741582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:35.742284 (+   702us) service_pool.cc:224] Handling call
0709 13:13:37.384425 (+1642141us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54002003d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:37.384542 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555318144}
I20260709 13:13:37.385686  3200 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:37.386225  3200 raft_consensus.cc:697] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:37.387033  3200 consensus_queue.cc:237] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.385098  3160 consensus_queue.cc:260] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.390527  3160 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:37.379619   448 connection.cc:256] RPC call timeout handler was delayed by -1.1668374079999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2061s for a response
I20260709 13:13:37.380730   626 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:13:37.380679   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:37.366734  3251 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.380154   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:37.393186   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:37.381327   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:37.372412  3253 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:37.394934  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:37.395529   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:37.396250   633 raft_consensus.cc:2393] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:37.396471   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:37.394743   448 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:37.365693  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:37.392354   626 pending_rounds.cc:85] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 5
I20260709 13:13:37.385777   629 raft_consensus.cc:2393] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:37.402235   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:37.406653   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:37.407816  1175 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:37.414862   630 raft_consensus.cc:2393] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:37.404865   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:37.415578   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:37.416616   626 pending_rounds.cc:107] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:13:37.416893   626 raft_consensus.cc:2889] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:37.361402  3187 consensus_queue.cc:1059] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:13:37.377652  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:37.421716   448 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:37.394062  3199 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:37.401901  3295 log.cc:927] Time spent T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.256s	user 0.003s	sys 0.000s
I20260709 13:13:37.392331  3181 raft_consensus.cc:2804] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:37.432413   629 raft_consensus.cc:1240] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:37.403509  3102 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:37.403640  3253 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:37.437105  3271 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:37.406023  3287 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.403644  3240 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:37.443212   448 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:37.372923  3232 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.421078  3196 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.408867  1168 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:37.448858   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:37.456228   553 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:37.449489   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:37.450006   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:37.450068   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:37.456970   552 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:37.457301   554 raft_consensus.cc:2393] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 8: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:37.453826   557 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:37.454201   448 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:37.433808  3187 consensus_queue.cc:1243] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer 6e6df7e8ed204f1db5c371536b5b0683 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:13:37.432775  3199 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:37.462400   550 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:37.418498  3249 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.435191  3181 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:37.469544   552 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:37.444312  2854 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:37.383430  3246 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.474651   555 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:13:37.472780   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:37.476452   552 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:37.477588   447 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:37.478499   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:37.479574   480 raft_consensus.cc:1240] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:13:37.482894   553 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:37.427600  2646 consensus_queue.cc:1059] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:13:37.451975  3153 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.452086  3067 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:37.486936  2945 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:37.491926   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:37.492811   555 raft_consensus.cc:2393] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:37.493718   476 raft_consensus.cc:1240] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:13:37.488490   552 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:37.485581   599 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:37.495905   624 raft_consensus.cc:2393] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:37.464673  3199 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.464046  3128 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:37.456389  3287 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.464887  2880 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:37.472651  3181 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.496399   599 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:37.503620   597 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:37.504805   597 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:37.505060   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 129480us
I20260709 13:13:37.464742  2934 consensus_queue.cc:1048] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:13:37.502143   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:37.484925  3215 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:37.510815  3291 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:37.507529  3225 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:37.512483  3225 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:37.512929  3225 raft_consensus.cc:697] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:37.513754  3225 consensus_queue.cc:237] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.464857  3196 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.516809  3196 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:37.490821  3077 consensus_queue.cc:1048] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:13:37.506537  2658 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:13:37.500363  2945 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:37.506752  2880 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.522962   380 catalog_manager.cc:5697] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 2 to 4, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 4 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.524072  2880 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:37.524758   380 catalog_manager.cc:5697] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 2 to 3, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 3 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:37.525535  3228 raft_consensus.cc:3055] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:37.525678  3232 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:37.525951  3228 raft_consensus.cc:740] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:37.490649  3204 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:13:37.527374  3246 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:37.527678  3241 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:37.526124   380 catalog_manager.cc:5697] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 2 to 5, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 5 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.528731  3249 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:37.530247   599 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:37.529129  3108 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:37.535137   599 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:37.490327  3203 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:13:37.539537   599 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:37.546438   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:37.496780  3153 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.549893  3108 raft_consensus.cc:697] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:37.557638  3108 consensus_queue.cc:237] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.550138  2975 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:37.559821  3153 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:37.536856  3305 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:37.560663  3305 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.526778  3228 consensus_queue.cc:260] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.563738  3228 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:37.562672  3199 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.537068  3249 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:37.567754   599 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:37.554260  3187 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:37.531955  3215 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.576928   599 leader_election.cc:400] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9.
I20260709 13:13:37.575925  3251 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:13:37.580616   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:37.577453  3203 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:37.575549  3291 raft_consensus.cc:697] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:37.564898  3305 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:37.583192  3291 consensus_queue.cc:237] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.571499  2975 consensus_queue.cc:1059] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:13:37.580061   599 leader_election.cc:403] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:13:37.596930   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 136607us
W20260709 13:13:37.603199   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 97487.3us
I20260709 13:13:37.604301   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:37.605540   556 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:37.606549   552 raft_consensus.cc:2393] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 7: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:37.605664   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:37.607131   553 raft_consensus.cc:2393] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 6: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:37.611074   597 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:37.611567   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 132986us
I20260709 13:13:37.611658   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:37.633244  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 68809.5us
I20260709 13:13:37.614666   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:37.812745   552 raft_consensus.cc:2368] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7.
I20260709 13:13:37.616376   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:37.615631   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:37.813827   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:37.813977   557 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
I20260709 13:13:37.814805   552 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:37.815454   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:37.814378   558 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 6: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:37.694471   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:37.637414   625 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:13:37.812745   553 raft_consensus.cc:2368] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6.
I20260709 13:13:37.819743   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:37.820809   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:37.821585   553 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:37.822355   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:37.815864   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:37.823782   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:37.727512   366 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 227b93e1b31e4b058d5ec1fc69bd6849 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6e6df7e8ed204f1db5c371536b5b0683 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:37.828989   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:37.756426   380 catalog_manager.cc:5697] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:37.829402   366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 101944us
I20260709 13:13:37.836112   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:37.826948   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:37.837576   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:37.839365   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:37.841738   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:37.843292   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 232286us
I20260709 13:13:37.844058   557 raft_consensus.cc:2393] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:37.840188   475 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
W20260709 13:13:37.847987   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:37.824267   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:37.769023   522 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:37.596855  3187 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9.
I20260709 13:13:37.746948  2985 raft_consensus.cc:3055] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:13:37.699107  3297 log.cc:927] Time spent T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.556s	user 0.002s	sys 0.000s
W20260709 13:13:37.669306  3318 log.cc:927] Time spent T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:13:37.860285  3253 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.861171  2985 raft_consensus.cc:740] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:37.862425  3253 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:37.862128  2985 consensus_queue.cc:260] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.863197  1174 raft_consensus.cc:2393] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 7: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:37.863552   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:37.864168   554 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:37.865052   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:37.866477   554 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:13:37.747464  3192 raft_consensus.cc:3055] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:37.882792   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 356) took 2169 ms. Trace:
I20260709 13:13:37.883385   478 rpcz_store.cc:276] 0709 13:13:35.713397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.210374 (+496977us) service_pool.cc:224] Handling call
0709 13:13:36.210992 (+   618us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:36.364518 (+153526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.882488 (+1517970us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54000f0fd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:37.882714 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335804800}
I20260709 13:13:37.830930   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:37.852924   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 84096.8us
I20260709 13:13:37.748327  3215 leader_election.cc:290] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:37.888334   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:37.854156   477 raft_consensus.cc:1275] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:13:37.889523   629 raft_consensus.cc:2410] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:13:37.846532  3079 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.828191  3241 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:37.855949   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:37.890810  3241 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.892910  3241 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:37.856994  3201 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:37.857400  3130 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:37.893752   523 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:37.893836  3130 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.856518   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:37.895893  3130 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:37.896572  3079 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.898671  3079 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:37.613565  3305 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.851281   481 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:37.838451  3200 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.858940   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:37.613018  3307 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.881011   599 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:37.885443   555 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:37.746948  3199 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:37.886432   522 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:37.886543   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:37.907648   478 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:37.868935  3287 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:37.849514   552 raft_consensus.cc:2393] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:37.863205  2985 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:37.890295  2934 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.891158   483 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:37.882560  3192 raft_consensus.cc:740] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:37.933175  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:37.926949   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:37.702148  3170 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:37.901842   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:37.903055   448 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:37.750253  3181 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.904101  3201 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:37.906833   522 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:37.887311   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:37.920446   599 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:37.922220   447 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:37.928542  3241 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:37.948799  3241 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:37.949195  3241 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.949546  3241 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:37.944275  3079 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:37.935890  2934 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.952962   476 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:37.957298  3170 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:37.957911  3170 raft_consensus.cc:697] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:37.959712  3210 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.960327  3210 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.962185   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:37.962584  3210 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:37.869447  3314 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:37.964180  3314 raft_consensus.cc:697] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:37.824923   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:37.931082   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:37.965348  3248 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.965811  3314 consensus_queue.cc:237] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.966013  3248 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.904100  2977 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:13:37.910382  3000 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:37.958786  3170 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.969386  3000 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:37.969985  3000 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:37.937301   477 raft_consensus.cc:2410] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:13:37.972859  3192 consensus_queue.cc:260] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:37.937963   478 raft_consensus.cc:1240] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:13:37.974066  3192 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:37.977519   478 raft_consensus.cc:1275] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:37.981240   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:37.981820   629 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:37.984941  3248 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:37.940333   448 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:37.635809  3291 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.264s
I20260709 13:13:37.941915   556 raft_consensus.cc:1240] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:37.912217  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:37.965442   550 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:37.934841   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:37.987607   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 47339.5us
I20260709 13:13:37.987865   552 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:37.988580  3079 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:37.910614  3305 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:38.038053   629 raft_consensus.cc:1240] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:38.035125   633 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:38.039207   558 raft_consensus.cc:2410] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:13:37.912065  3200 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:38.041152  3200 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:37.991816   525 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:38.041867   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 50123.1us
I20260709 13:13:37.992319  2998 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.920043  3307 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:37.989645   448 leader_election.cc:400] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6.
I20260709 13:13:38.061316   448 leader_election.cc:403] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:13:38.062254   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 72767.3us
W20260709 13:13:38.062724   379 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46008 (request call id 260) took 22726 ms (client timeout 15000 ms). Trace:
I20260709 13:13:38.063128   448 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:37.995227  3000 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:38.066596  3000 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:37.997196   552 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:13:37.986717   447 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:13:38.067845   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 81349.6us
I20260709 13:13:38.064409   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:38.000208   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:37.999869  3241 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:38.008062  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:38.009032   380 catalog_manager.cc:5697] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:38.011643   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 367) took 1642 ms. Trace:
I20260709 13:13:38.014240  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:37.936456 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:38.019125   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.021924  3271 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.029036  2184 raft_consensus.cc:3055] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:38.033390   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:38.041872   629 raft_consensus.cc:1240] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:38.043684   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:38.097680   631 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:38.096848  2184 raft_consensus.cc:740] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:38.060568   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:38.045374   483 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:38.001433  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:38.099159  2184 consensus_queue.cc:260] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:38.108413  2184 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:38.088184   380 catalog_manager.cc:5697] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:38.083791   482 rpcz_store.cc:276] 0709 13:13:36.369242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.376881 (+  7639us) service_pool.cc:224] Handling call
0709 13:13:37.079778 (+702897us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:37.080727 (+   949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:37.080770 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:37.081288 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:13:37.160217 (+ 78929us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:37.238566 (+ 78349us) log.cc:844] Serialized 14 byte log entry
0709 13:13:37.241560 (+  2994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.241639 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:37.297465 (+ 55826us) raft_consensus.cc:1685] finished
0709 13:13:37.297483 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:38.011444 (+713961us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b540022d150. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:38.011575 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8289,"prepare.queue_time_us":65353,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":4820,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":1984,"spinlock_wait_cycles":1610365952,"thread_start_us":79140,"threads_started":2,"wal-append.queue_time_us":153480}
I20260709 13:13:38.101595   599 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:38.101794   478 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:13:38.097545   627 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:38.110519  3312 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:38.122048   483 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:13:38.060098  3153 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:38.111691   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 47377.7us
I20260709 13:13:38.127770   448 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:38.063283   379 rpcz_store.cc:269] 0709 13:13:15.336225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.343309 (+  7084us) service_pool.cc:224] Handling call
0709 13:13:38.062488 (+22719179us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:28.067688 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:28.225684 (+157996us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:28.239610 (+ 13926us) write_op.cc:435] Acquired schema lock
0709 13:13:28.254083 (+ 14473us) tablet.cc:662] Decoding operations
0709 13:13:28.329570 (+ 75487us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:28.329699 (+   129us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:28.329733 (+    34us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:13:28.439698 (+109965us) tablet.cc:701] Row locks acquired
0709 13:13:28.446082 (+  6384us) write_op.cc:260] PREPARE: finished
0709 13:13:28.458888 (+ 12806us) write_op.cc:270] Start()
0709 13:13:28.479412 (+ 20524us) write_op.cc:276] Timestamp: P: 1783602808455101 usec, L: 0
0709 13:13:28.479465 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 13:13:28.480469 (+  1004us) log.cc:844] Serialized 5919 byte log entry
0709 13:13:28.956262 (+475793us) op_driver.cc:464] REPLICATION: finished
0709 13:13:29.127964 (+171702us) write_op.cc:301] APPLY: starting
0709 13:13:29.128061 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:29.128431 (+   370us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:29.128591 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:29.133030 (+  4439us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:29.133376 (+   346us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:13:29.133427 (+    51us) write_op.cc:312] APPLY: finished
0709 13:13:29.133972 (+   545us) log.cc:844] Serialized 107 byte log entry
0709 13:13:29.134186 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:29.134356 (+   170us) write_op.cc:454] Released schema lock
0709 13:13:29.134421 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:29.134811 (+   390us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:29.134837 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1400972,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":154562,"apply.run_cpu_time_us":4595,"apply.run_wall_time_us":6819,"num_ops":15,"prepare.queue_time_us":92429,"prepare.run_cpu_time_us":104592,"prepare.run_wall_time_us":570058,"raft.queue_time_us":268587,"raft.run_cpu_time_us":5874,"raft.run_wall_time_us":222319,"replication_time_us":447999,"thread_start_us":479081,"threads_started":4,"wal-append.queue_time_us":151699,"wal-append.run_cpu_time_us":43522,"wal-append.run_wall_time_us":2177099}]]}
I20260709 13:13:38.122534   483 pending_rounds.cc:85] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 4
I20260709 13:13:38.111521   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:38.068516   555 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:38.089725  3310 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:38.089485  3210 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:13:38.161994  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.179939  3210 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.067973  3079 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6.
I20260709 13:13:38.164404   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:38.250456  3210 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:38.136287   631 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:13:38.071139  3286 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.131100   448 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:38.173398  3241 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:38.111877  3271 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:38.175367  1170 raft_consensus.cc:2410] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:13:38.163203  2854 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:38.176003   523 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:38.177997   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1623) took 1577 ms. Trace:
I20260709 13:13:38.178810   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:38.255715   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 79801.2us
I20260709 13:13:38.225055  3228 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:38.260530  3228 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:38.262841  3228 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:38.123770  3251 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:38.243359   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:38.263850   556 raft_consensus.cc:2393] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 6: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:38.059916  3248 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 13:13:38.097903  3108 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:13:38.067647  2998 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:38.127113  3153 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:38.170800  3276 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:38.249697  3312 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:38.171095  3310 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.170027  3130 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 13:13:38.252351  3079 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:38.253829  3286 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:38.260001  3309 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:38.297907  3079 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.298344  3079 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:38.304402  1174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 564) took 1604 ms (client timeout 1725 ms). Trace:
W20260709 13:13:38.304942  1174 rpcz_store.cc:269] 0709 13:13:36.699560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.699693 (+   133us) service_pool.cc:224] Handling call
0709 13:13:37.339587 (+639894us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:38.304153 (+964566us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b540069e954. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:38.304318 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1142330496}
I20260709 13:13:38.305581   632 raft_consensus.cc:1240] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:38.309185  3128 raft_consensus.cc:3055] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:38.309710  3128 raft_consensus.cc:740] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:38.280558  3251 raft_consensus.cc:697] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:38.312399  3251 consensus_queue.cc:237] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:38.280253  3271 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:38.296451  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.318193   625 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:38.291790  3153 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:38.315594  3310 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:38.310791  3128 consensus_queue.cc:260] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:38.316394  3312 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:38.329685  3253 consensus_queue.cc:1048] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:13:38.346246  3286 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:38.352140  3307 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:38.356912  3312 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:38.251881   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 120857us
I20260709 13:13:38.407218   448 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:38.232999   475 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:13:38.421625   477 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:38.423615   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:38.425057   475 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:13:38.427662   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:38.429651   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:38.429558   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 522648us
I20260709 13:13:38.430210   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:38.256023   482 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:13:38.432196   554 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.006s	sys 0.029s
I20260709 13:13:38.431128   522 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:38.432842   554 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.006s	sys 0.029s
I20260709 13:13:38.266736   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:38.434736   556 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:38.162204   483 pending_rounds.cc:107] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:13:38.435701   483 raft_consensus.cc:2889] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:38.292447   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:38.437305   555 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:38.223284   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:38.431133   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:38.439770   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 387730us
I20260709 13:13:38.440995   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:38.441843   557 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:38.255321   559 rpcz_store.cc:276] 0709 13:13:36.600928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.601316 (+   388us) service_pool.cc:224] Handling call
0709 13:13:36.602533 (+  1217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:36.878990 (+276457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:38.177775 (+1298785us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b540034ce54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:38.177938 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617551104}
I20260709 13:13:38.446393   559 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:38.447366   483 raft_consensus.cc:1275] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:38.426775   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:38.453820   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.443073   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:38.327718  1141 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:38.462054  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 134297us
I20260709 13:13:38.465019   557 raft_consensus.cc:2410] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:38.468196   557 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:38.466142   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:38.460945   559 raft_consensus.cc:1240] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:38.474006   631 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:38.474332  2184 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:38.476706  2646 consensus_queue.cc:1059] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:38.477368  2184 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:38.477536   556 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:38.477841  2184 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:38.482071  2646 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:38.483392   559 raft_consensus.cc:3055] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:38.483826   559 raft_consensus.cc:740] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:38.485131   559 consensus_queue.cc:260] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:38.486420   559 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:38.487941  2646 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.488767   557 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:38.488241   482 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:38.500082   555 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:38.414911   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:38.503355   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.335795  3201 raft_consensus.cc:697] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:38.505313  3201 consensus_queue.cc:237] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:38.512902  2998 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:38.513283  3260 consensus_queue.cc:1059] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:38.515158  3130 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.516036  3130 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:38.517436  3271 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:38.518538  3271 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:38.519569  3130 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:38.519884  3276 consensus_queue.cc:1048] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:38.520921  2854 raft_consensus.cc:3055] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:38.521483  2854 raft_consensus.cc:740] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:38.522961  2854 consensus_queue.cc:260] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:38.547946  2854 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:38.548291  3130 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:38.550007  3130 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:38.550661  3130 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:38.580699   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 136155us
W20260709 13:13:38.584041   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 142746us
I20260709 13:13:38.585045   525 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:38.524313  3215 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:13:38.523741  3308 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:13:38.523011  3276 consensus_queue.cc:1059] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 13:13:38.603264   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 55639us
I20260709 13:13:38.604476   630 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:38.605099  3203 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:38.605886  3203 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:38.545164  3271 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:38.612112  3241 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:38.612805  3241 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:38.613404  3271 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:38.558354  2646 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:38.525878  3291 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
W20260709 13:13:38.623401   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 208766us
I20260709 13:13:38.659296  3305 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:38.664731  3276 consensus_queue.cc:1243] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:13:38.615213  3241 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:38.655884   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 71017.8us
W20260709 13:13:38.648948   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 67469.2us
I20260709 13:13:38.656260  3332 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:38.628566  3130 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:38.678562   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.639457   597 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:38.670410  2184 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:38.637166  2985 consensus_meta.cc:287] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.706s	user 0.007s	sys 0.007s
I20260709 13:13:38.648406   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 277) took 1012 ms. Trace:
W20260709 13:13:38.647660  3343 log.cc:927] Time spent T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.068s	user 0.004s	sys 0.000s
W20260709 13:13:38.637907  3351 log.cc:927] Time spent T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
I20260709 13:13:38.623615  2646 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:38.688896  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 224788us
I20260709 13:13:38.631593  3128 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:38.639001  3203 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:38.653733  3181 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:38.682446  3190 raft_consensus.cc:3055] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:38.703222  1141 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:38.704861  3153 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:38.708470  2985 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:38.708914  2985 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.709285  2985 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:38.712391  3346 log.cc:927] Time spent T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.134s	user 0.002s	sys 0.000s
I20260709 13:13:38.714313  2934 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:38.714417   552 raft_consensus.cc:3055] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:38.714901   552 raft_consensus.cc:740] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:38.717327  1138 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:38.718137  3341 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.115s	user 0.004s	sys 0.000s
I20260709 13:13:38.714929  3153 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:38.719105  1138 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:38.716012   552 consensus_queue.cc:260] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:38.721035  3253 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:38.721472  3253 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:38.721920  3253 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:38.721482  3311 consensus_queue.cc:1059] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:38.633160  3228 consensus_queue.cc:1048] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.107s
I20260709 13:13:38.698602  3190 raft_consensus.cc:740] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:38.734588  3260 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:38.684326   554 rpcz_store.cc:276] 0709 13:13:37.635572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:37.867276 (+231704us) service_pool.cc:224] Handling call
0709 13:13:37.867538 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:37.867720 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:13:38.433546 (+565826us) log.cc:844] Serialized 14 byte log entry
0709 13:13:38.580267 (+146721us) log.cc:844] Serialized 14 byte log entry
0709 13:13:38.646722 (+ 66455us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:38.647812 (+  1090us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:38.647888 (+    76us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:38.648000 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:38.648133 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:38.648317 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67261,"prepare.queue_time_us":66167,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":86,"raft.queue_time_us":68099,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":138,"spinlock_wait_cycles":69635968,"thread_start_us":711032,"threads_started":2,"wal-append.queue_time_us":144851}
I20260709 13:13:38.741110  3203 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:13:38.770116   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 80982.5us
I20260709 13:13:38.773108   522 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:38.775122  3347 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:13:38.777623  3192 consensus_meta.cc:287] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.803s	user 0.013s	sys 0.004s
I20260709 13:13:38.779815   627 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:13:38.780061   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 140959us
I20260709 13:13:38.780997  3079 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:38.782490   480 raft_consensus.cc:2368] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 7. Current term is 8.
I20260709 13:13:38.779856  3000 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:13:38.785921   628 raft_consensus.cc:1275] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:38.768103  3203 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.787384   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:38.787987  3203 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:38.789047  3248 raft_consensus.cc:3055] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:38.789587  3248 raft_consensus.cc:740] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:38.792310   629 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:38.756989  3260 raft_consensus.cc:697] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:38.793546  3260 consensus_queue.cc:237] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:38.800390  3310 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:38.803725   631 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:13:38.805114  3210 consensus_meta.cc:287] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.003s
I20260709 13:13:38.805505  2184 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:38.805557  3210 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:38.809528  3130 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:38.811102   599 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:38.833387   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:38.837731   626 raft_consensus.cc:2410] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 8 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:38.832649  3314 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.842533   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:38.846182   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 71160.4us
I20260709 13:13:38.831199  3310 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:38.848250   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:38.852681  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 121200us
W20260709 13:13:38.858209  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 137042us
I20260709 13:13:38.770733  3190 consensus_queue.cc:260] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:38.867494   522 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:38.856611   525 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:38.790882  3248 consensus_queue.cc:260] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:38.856613  3079 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:38.856657  3210 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:38.874377   628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 301) took 1173 ms. Trace:
I20260709 13:13:38.877586   631 raft_consensus.cc:2410] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:38.877620   628 rpcz_store.cc:276] 0709 13:13:37.700679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.646217 (+945538us) service_pool.cc:224] Handling call
0709 13:13:38.646695 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:38.786300 (+139605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:38.873282 (+ 86982us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54001bba54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:38.874303 (+  1021us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319026432}
I20260709 13:13:38.877225  3181 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:38.891507  3249 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.892220  3249 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:38.893258  3362 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:38.893975  3362 consensus_queue.cc:1243] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:13:38.894363  3249 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:38.895596   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 57451.1us
I20260709 13:13:38.898523  3347 consensus_queue.cc:1059] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:38.899380   599 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:38.899792  3248 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:38.883417   597 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:38.874734  3000 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:38.874964  3192 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:38.922458   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:38.923331   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 60417.2us
W20260709 13:13:38.924021   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 51413us
I20260709 13:13:38.926594   522 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:38.927673   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:38.928651   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 370834us
I20260709 13:13:38.929503   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:38.930212   477 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:38.876012  3169 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:13:38.932070  3286 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:38.932492  3286 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.932824  3286 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:38.934629   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.931689   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:38.869867  2934 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:13:38.932498   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:38.877986  2646 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:13:38.980271   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:38.983312  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 112496us
W20260709 13:13:38.983210   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:38.967896   448 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.17.130:41159 timed out after 1.553s (SENT) [suppressed 22 similar messages]
I20260709 13:13:38.985033   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:38.989734   627 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:38.980098  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 70596.2us
I20260709 13:13:38.991279   552 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:38.993444   476 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:38.995126   478 raft_consensus.cc:2393] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 6: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:38.995735   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:38.903028  3314 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:38.975270  3192 raft_consensus.cc:697] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:39.012749  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:39.028321   479 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:38.923350  3312 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.128s
I20260709 13:13:39.039402   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:39.044450   555 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:39.045459   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:39.036589  3181 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:39.066627   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.070690   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:39.071574   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:39.072243   555 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:39.075140   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 148656us
I20260709 13:13:39.076901   552 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:39.077766   559 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:39.082515   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:39.099951   552 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:39.084103  3276 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:13:39.077360  3215 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:39.107667   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:39.108944   482 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:39.111744   559 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:39.084735  3287 raft_consensus.cc:2749] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:39.109819   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:39.106978  3291 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.127282   525 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:39.158878   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 50399.1us
I20260709 13:13:39.163497   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:39.171990   559 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
W20260709 13:13:39.173543  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 120056us
W20260709 13:13:39.204276   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 94029.2us
I20260709 13:13:39.203536  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:39.208518   553 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:39.208961  1171 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:39.209548  2975 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.209636   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:39.210171   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:39.210233  2975 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:39.166188  3215 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:39.133402  3192 consensus_queue.cc:237] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:39.213443  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:39.213867  3215 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:39.210870   559 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:39.210906   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:39.214111  1173 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
W20260709 13:13:39.221925  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.212627  2975 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:39.251655   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 81853.8us
I20260709 13:13:39.279834  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:39.133615  3253 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:39.281853  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:39.168530  3203 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:39.244567  3000 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:39.165079  2985 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:39.339433   555 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:13:39.340270   553 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:13:39.340440   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.343116  1173 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:39.345294   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:39.345739  3363 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:39.347716  3366 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
W20260709 13:13:39.348577  3354 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 13:13:39.351402  3372 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:39.313769   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 402314us
I20260709 13:13:39.356101   551 raft_consensus.cc:2410] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:39.208880  3291 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:39.355275   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 255870us
W20260709 13:13:39.359418   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 244351us
W20260709 13:13:39.345335  3357 log.cc:927] Time spent T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.264s	user 0.000s	sys 0.002s
I20260709 13:13:39.342319  3000 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.371833   559 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:39.380282   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:39.366598   597 leader_election.cc:304] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:39.392118  3372 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:39.393786   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:39.394603   555 raft_consensus.cc:2410] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:39.375751  3000 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:39.392838   553 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:13:39.397310  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:39.397974   553 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:39.364147  3363 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:39.400025  3352 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:13:39.404211  1168 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:39.366938  3314 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:39.409477  1169 raft_consensus.cc:1240] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:39.410022   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:39.410873   629 raft_consensus.cc:2393] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:39.417222  1166 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:39.425527   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.427160   552 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
W20260709 13:13:39.429410   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 73787.2us
I20260709 13:13:39.429785  3372 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:39.425262  3079 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:39.430781  3079 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:39.431486  3249 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:39.432968  3079 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:39.434136   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:39.429544  3199 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.435876  3199 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:39.438246  3305 raft_consensus.cc:3055] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:39.438449  3199 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:39.438680  3305 raft_consensus.cc:740] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:39.439795  3305 consensus_queue.cc:260] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:39.444012  3169 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.452812  3376 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:39.443612  3128 consensus_meta.cc:287] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.745s	user 0.011s	sys 0.002s
W20260709 13:13:39.454339   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.455644  1173 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:39.444166  3305 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:39.444952  3253 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:39.445133   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1694) took 1013 ms. Trace:
I20260709 13:13:39.446199  3203 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:39.442000   448 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:39.410938  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:39.449263  3372 consensus_queue.cc:1048] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:39.449894   553 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:13:39.451710  2934 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:13:39.448992  3286 consensus_meta.cc:287] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.001s
I20260709 13:13:39.462538   522 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:39.458645   558 rpcz_store.cc:276] 0709 13:13:38.431191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.636336 (+205145us) service_pool.cc:224] Handling call
0709 13:13:38.636794 (+   458us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:38.646386 (+  9592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:38.646420 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:38.647188 (+   768us) log.cc:844] Serialized 52 byte log entry
0709 13:13:38.839184 (+191996us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:38.846930 (+  7746us) log.cc:844] Serialized 14 byte log entry
0709 13:13:38.852108 (+  5178us) log.cc:844] Serialized 14 byte log entry
0709 13:13:38.852359 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:38.852450 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:38.898138 (+ 45688us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b480021c258. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6d342aa1 00007f4b6d339b37 00007f4b6d3399ca 00007f4b6d43126f 00007f4b6d430f37 00007f4b6d44555c 00007f4b6d445508 00007f4b6d445488 00007f4b6d445443 00007f4b6d4446ec 00007f4b6c36ea96
0709 13:13:39.444741 (+546603us) raft_consensus.cc:1685] finished
0709 13:13:39.444774 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:39.444933 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6790,"prepare.queue_time_us":39836,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":78,"raft.queue_time_us":14817,"raft.run_cpu_time_us":3714,"raft.run_wall_time_us":52921,"spinlock_wait_cycles":11571584,"thread_start_us":191545,"threads_started":1,"wal-append.queue_time_us":234796}
I20260709 13:13:39.464361   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:39.464753   448 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:39.466250  3248 consensus_meta.cc:287] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.000s
I20260709 13:13:39.477448   597 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:39.491063   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:39.478767  3079 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:39.469300  1169 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:39.503515  3241 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:39.452831  3169 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:39.498317   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.494555   632 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:39.507596  3241 raft_consensus.cc:697] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:39.486596  3181 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:39.453426  3376 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:39.508562  1138 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:39.511763  3241 consensus_queue.cc:237] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:39.470647  2934 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:39.490584  3128 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:39.550907  3128 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:39.552102   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:39.553051  3128 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:39.517663   627 consensus_meta.cc:287] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.515s	user 0.001s	sys 0.009s
I20260709 13:13:39.553660  3201 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.554383  3201 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:39.518023   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 47872.7us
I20260709 13:13:39.521445  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:39.521880  3363 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:39.522485   628 pending_rounds.cc:85] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 5
I20260709 13:13:39.522658   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:39.472826  3286 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:39.524022  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:39.522835  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 310957us
I20260709 13:13:39.557950   478 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 4.
W20260709 13:13:39.535688   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 71035.8us
I20260709 13:13:39.509994  2646 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:39.537835  3291 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:39.546147  3377 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:39.547547   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:39.552306  2934 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:39.553810   627 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:39.520975   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:39.516661  3169 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:39.558491  1171 raft_consensus.cc:2393] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 6: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
W20260709 13:13:39.531121  3365 log.cc:927] Time spent T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 13:13:39.557652   628 pending_rounds.cc:107] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:13:39.581418   628 raft_consensus.cc:2889] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:39.510775  2985 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:39.580377   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:39.600719   475 consensus_meta.cc:287] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.570s	user 0.008s	sys 0.004s
I20260709 13:13:39.601312   475 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:39.565138  3377 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.602377   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:39.602802   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 175633us
W20260709 13:13:39.622555   477 consensus_meta.cc:287] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.692s	user 0.013s	sys 0.000s
I20260709 13:13:39.634869   477 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:39.601383   483 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:39.615398   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 386) took 1172 ms. Trace:
I20260709 13:13:39.620393   633 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:39.637722   522 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:39.638800  3332 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:39.639585   522 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:39.640643  3332 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:39.641556  3332 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:39.641798   522 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:39.643083  3332 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:39.643481   522 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:39.645794   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:39.636420   480 rpcz_store.cc:276] 0709 13:13:38.417806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.430812 (+ 13006us) service_pool.cc:224] Handling call
0709 13:13:39.586447 (+1155635us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b5400132254. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:39.589545 (+  3098us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":787405568}
I20260709 13:13:39.633718  1167 raft_consensus.cc:2393] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 8: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:39.672358   478 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:39.669663   523 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:39.677289  1141 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:39.678174   633 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:39.636960  3377 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:39.682701  1138 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:39.685540   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:39.685699   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 68300.7us
I20260709 13:13:39.687083  1173 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:39.687628  1171 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:39.688931  2184 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:39.678294  3181 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:39.694113  2184 raft_consensus.cc:697] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:39.698447   475 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:13:39.703195  3368 log.cc:927] Time spent T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.502s	user 0.000s	sys 0.002s
I20260709 13:13:39.704962   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1687) took 1812 ms. Trace:
I20260709 13:13:39.707379  3386 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:39.705652   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:39.707995  3386 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.708187  3190 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:39.708281   480 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
W20260709 13:13:39.708575  3379 log.cc:927] Time spent T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.228s	user 0.002s	sys 0.000s
I20260709 13:13:39.705284   556 rpcz_store.cc:276] 0709 13:13:37.892513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.478362 (+585849us) service_pool.cc:224] Handling call
0709 13:13:38.478850 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:38.589290 (+110440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:38.589319 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:38.605654 (+ 16335us) log.cc:844] Serialized 26 byte log entry
0709 13:13:38.805520 (+199866us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b18003c0040. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb90d1 00007f4b683d4a0f
0709 13:13:38.876566 (+ 71046us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:38.968048 (+ 91482us) log.cc:844] Serialized 14 byte log entry
0709 13:13:38.968741 (+   693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:38.968847 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:39.553313 (+584466us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:39.704753 (+151440us) raft_consensus.cc:1685] finished
0709 13:13:39.704773 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:39.704888 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8770,"prepare.queue_time_us":8542,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":124496,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":66736,"spinlock_wait_cycles":15884800,"thread_start_us":257978,"threads_started":3,"wal-append.queue_time_us":430159}
W20260709 13:13:39.720888  3381 log.cc:927] Time spent T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:13:39.721357  3394 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:13:39.722252  3378 log.cc:927] Time spent T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:13:39.719588  1141 leader_election.cc:400] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 7. Current term is 8.
I20260709 13:13:39.723814   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1654) took 1677 ms. Trace:
I20260709 13:13:39.731616  1141 leader_election.cc:403] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:13:39.725066  3000 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:39.725988   597 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:39.727305  3201 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:39.690415  3332 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:39.720208  3400 consensus_queue.cc:1059] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:39.701617  2184 consensus_queue.cc:237] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:39.740651   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 44851us
I20260709 13:13:39.708385  3386 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:39.744484  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.752406   480 raft_consensus.cc:1240] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:39.755124  1139 leader_election.cc:336] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Timed out: RequestConsensusVote RPC to 127.31.17.130:41159 timed out after 1.668s (SENT)
W20260709 13:13:39.754431   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 111085us
I20260709 13:13:39.757772   632 raft_consensus.cc:1240] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:39.759416  1139 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:39.762076   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:39.742177  3332 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.765084   448 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:39.774317  3225 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:39.758698  3286 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:39.780884  3332 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:39.788429   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 68159.8us
I20260709 13:13:39.789865   597 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:39.748101  2985 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 7. Current term is 8.
W20260709 13:13:39.806675  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 57890.8us
I20260709 13:13:39.809052  3363 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:39.796619   476 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:39.731676   550 rpcz_store.cc:276] 0709 13:13:38.020054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.620391 (+600337us) service_pool.cc:224] Handling call
0709 13:13:38.620801 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:38.656281 (+ 35480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:38.656322 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:38.656983 (+   661us) log.cc:844] Serialized 26 byte log entry
0709 13:13:38.866715 (+209732us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:38.866763 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:38.866852 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:39.530467 (+663615us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:39.692640 (+162173us) raft_consensus.cc:1685] finished
0709 13:13:39.692674 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:39.697624 (+  4950us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34663,"raft.queue_time_us":34945,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":134,"spinlock_wait_cycles":340999936,"thread_start_us":209307,"threads_started":1,"wal-append.queue_time_us":428188}
W20260709 13:13:39.812757   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 97721.2us
I20260709 13:13:39.818790   597 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:39.821098   597 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:39.813300  3169 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:39.815728  3291 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:39.827885  1168 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:39.826967  3385 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:39.828737  3204 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:39.823117  3376 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:39.836306   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 85152.1us
I20260709 13:13:39.825985  3192 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:13:39.827396  1170 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:13:39.839111   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.819856  3286 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 13:13:39.834003  3260 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.025s	sys 0.034s
I20260709 13:13:39.823637  3225 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:13:39.845903   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:39.848281  3169 consensus_queue.cc:1059] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:39.848698  2934 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:39.848928  3128 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:39.849413  3169 raft_consensus.cc:3055] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:39.849900  3169 raft_consensus.cc:740] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:39.849344   448 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:39.851898  3079 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:39.852342  3079 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:39.852718  3079 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:39.855847  3000 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:39.845927   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:39.857849  3130 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:39.850720  3169 consensus_queue.cc:260] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:39.859416   448 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:39.861343   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:39.861446   448 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:39.862635   550 raft_consensus.cc:2393] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 8: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
W20260709 13:13:39.841265  3260 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.026s	sys 0.034s
I20260709 13:13:39.862392  3128 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:39.866269   554 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:39.868974   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:39.867132  3128 raft_consensus.cc:697] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:39.864821  3130 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:39.883442   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:39.883579   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:39.884068  1139 leader_election.cc:336] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Timed out: RequestConsensusVote RPC to 127.31.17.130:41159 timed out after 1.869s (SENT)
I20260709 13:13:39.870537   553 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:39.885155  3377 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:39.887933  3361 log.cc:927] Time spent T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.670s	user 0.001s	sys 0.001s
I20260709 13:13:39.896351  1174 raft_consensus.cc:1240] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:39.863754  3403 consensus_queue.cc:1059] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:13:39.891036   483 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:39.891443   552 raft_consensus.cc:1275] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:39.895234   484 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:39.895291  1139 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:39.900736   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:39.901335   557 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:39.888664  3169 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:39.899405  3287 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.905584   555 raft_consensus.cc:2393] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:39.905619   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:39.906251  3287 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:39.909981  3128 consensus_queue.cc:237] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:39.911360  3287 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:39.912205  3305 raft_consensus.cc:3055] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:39.912604  3305 raft_consensus.cc:740] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:39.913472  3305 consensus_queue.cc:260] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:39.907480  3079 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:39.916026  3377 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:39.907270  3260 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:39.917738  3079 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:39.922070   483 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:39.920462   525 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:39.932111   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 65725.6us
I20260709 13:13:39.933111   448 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:39.891693  3310 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:13:39.935137   481 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:39.936733   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:39.935949   448 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:39.944325   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:39.945050   448 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:39.949182   525 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:39.935318  3079 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:39.937631  3130 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:39.935472  3312 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:13:39.958209  3375 log.cc:927] Time spent T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.618s	user 0.000s	sys 0.003s
I20260709 13:13:39.962764   558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:13:39.976150   558 raft_consensus.cc:606] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Received request to transfer leadership to TS 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:39.976545   558 raft_consensus.cc:614] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:39.948155  3225 consensus_queue.cc:1059] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:13:39.946800  2934 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:39.965174  3128 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:39.967203   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:39.970959   484 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
W20260709 13:13:39.971290   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.948905  3403 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:39.966723  3229 raft_consensus.cc:3055] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:39.977283  3079 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:39.978423  3130 raft_consensus.cc:697] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:39.982108  3344 raft_consensus.cc:2804] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:39.982903   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:39.994989   483 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:13:39.983453  3312 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:39.972380  3310 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:39.991678  3229 raft_consensus.cc:740] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:39.994072  3287 raft_consensus.cc:3055] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:13:39.997011   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 44469.8us
I20260709 13:13:39.997573  3229 consensus_queue.cc:260] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:39.998637  3229 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:39.998682  3344 raft_consensus.cc:697] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:39.994454  2646 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:39.999780  2646 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:39.999807  3344 consensus_queue.cc:237] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:40.000722  3079 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:39.994094  3403 raft_consensus.cc:697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:40.002045  2646 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:40.002666  3310 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:40.002885  3403 consensus_queue.cc:237] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:40.004448  3312 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:40.004859  3310 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:39.996038  3225 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:40.006665   597 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:40.006915  3225 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.007431  3204 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.007483  3225 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:40.008095  3204 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:40.009457  3000 raft_consensus.cc:3055] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:40.009729  3225 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:40.009868  3000 raft_consensus.cc:740] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:40.010360  3225 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:39.997098  3287 raft_consensus.cc:740] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:40.010526  3204 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:40.002686   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:40.016552   483 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:40.017264   597 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:39.977232  3332 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:40.020089  3332 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:40.023790   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:40.025278   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:40.011456  3241 consensus_queue.cc:1048] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
W20260709 13:13:40.028327  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.011456  3286 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:40.022142  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:40.029794  1169 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:40.001866  3130 consensus_queue.cc:237] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:40.016896   558 raft_consensus.cc:2376] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8. Re-sending same reply.
I20260709 13:13:40.029172  3286 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.038286  3286 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:40.038573   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:40.039810   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:40.029166  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.010864  3000 consensus_queue.cc:260] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:40.036545  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:39.993510  3363 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:40.012008  3402 log.cc:927] Time spent T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:13:40.045452  1168 raft_consensus.cc:2393] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 6: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:39.994731  3128 raft_consensus.cc:697] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:13:40.056624  1139 leader_election.cc:336] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Timed out: RequestConsensusVote RPC to 127.31.17.130:41159 timed out after 2.099s (SENT)
I20260709 13:13:40.057267  1139 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:40.052150   448 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:40.058221   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 112420us
I20260709 13:13:40.059553   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:40.055387  3367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.000s	sys 0.013s
I20260709 13:13:40.061295  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:40.062340  3128 consensus_queue.cc:237] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:40.047966  3204 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:40.068732   448 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:40.071571  3386 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:40.068269  3367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.000s	sys 0.014s
I20260709 13:13:40.079777   559 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:40.077673  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:40.078974   525 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:40.082020  1168 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:40.086016  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:40.086747  1171 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
W20260709 13:13:40.087917  3404 log.cc:927] Time spent T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:13:40.089399  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:40.090770  3411 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:40.077723  3204 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.092034  3204 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:40.072643  2934 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.094097  2934 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:40.096194  2934 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:40.098124  1139 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:40.077860  3310 raft_consensus.cc:2764] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:13:40.098470  1169 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:40.101606   525 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:40.104192  3201 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:40.104727  3201 raft_consensus.cc:697] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:40.105654  3201 consensus_queue.cc:237] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:40.107379  3347 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:40.107880  3347 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:40.108453  3414 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:40.109110  3414 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:40.109933  3347 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:40.115911   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:40.116245   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:40.117087   553 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:40.150285   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:40.154168   555 raft_consensus.cc:2368] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7.
I20260709 13:13:40.154175   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:40.073154  3403 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 13:13:40.162501   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 93846.5us
I20260709 13:13:40.116287  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:40.118304  2934 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:40.168342   448 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:40.168680  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 70679.6us
I20260709 13:13:40.151818  3362 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:40.171521  3386 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:40.156584  3355 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:40.172940  3355 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:40.175135   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1646) took 1137 ms. Trace:
I20260709 13:13:40.175411  3310 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:40.175505   631 rpcz_store.cc:276] 0709 13:13:39.037402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.037552 (+   150us) service_pool.cc:224] Handling call
0709 13:13:39.052305 (+ 14753us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:39.458335 (+406030us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:39.613958 (+155623us) log.cc:844] Serialized 14 byte log entry
0709 13:13:39.689217 (+ 75259us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:39.696714 (+  7497us) log.cc:844] Serialized 52 byte log entry
0709 13:13:39.696878 (+   164us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:39.696910 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:39.696998 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:40.174883 (+477885us) raft_consensus.cc:1685] finished
0709 13:13:40.174907 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.175050 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58848,"prepare.queue_time_us":228410,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":109086,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":27128,"thread_start_us":413787,"threads_started":3,"wal-append.queue_time_us":178082}
I20260709 13:13:40.177346   448 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:40.177834   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1644) took 1275 ms. Trace:
I20260709 13:13:40.180025  1168 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:40.155165  3153 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.183065  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:40.185684  1168 raft_consensus.cc:2393] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:40.163681  3000 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:40.188776   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:40.163518  3332 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:40.193450   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:40.178370   626 rpcz_store.cc:276] 0709 13:13:38.902409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.902554 (+   145us) service_pool.cc:224] Handling call
0709 13:13:38.908364 (+  5810us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:38.979053 (+ 70689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:38.979082 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:40.062410 (+1083328us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b2c00072b18. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b66d12a11 00007f4b66d22372 00007f4b68454a01 00007f4b6841943a 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2
0709 13:13:40.062846 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:13:40.159869 (+ 97023us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:40.159908 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.159985 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:40.161477 (+  1492us) raft_consensus.cc:1685] finished
0709 13:13:40.161500 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.177774 (+ 16274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36669,"raft.queue_time_us":44130,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":19779,"spinlock_wait_cycles":7938816,"thread_start_us":96570,"threads_started":1,"wal-append.queue_time_us":96982}
I20260709 13:13:40.190465  3411 consensus_queue.cc:1059] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:13:40.196694  3411 raft_consensus.cc:3055] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:40.197065  3411 raft_consensus.cc:740] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:40.197990  3411 consensus_queue.cc:260] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:40.185570  3310 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:40.222860   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:40.223665   555 raft_consensus.cc:2393] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:40.225458   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:40.227653   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 50402.6us
I20260709 13:13:40.183266  2646 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:13:40.226419  3411 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:40.188503  3153 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:40.234755  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.221575  3400 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.177803  3287 consensus_queue.cc:260] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:40.240399   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 56707.7us
I20260709 13:13:40.234668   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:40.216467  3332 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:40.237560   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:40.245215   559 raft_consensus.cc:2393] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:40.229259  3410 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:40.248472  3204 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:40.250684  3153 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:40.258944  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:40.265813   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:40.266475   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:40.269942   553 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:40.271551   626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:40.272117   626 raft_consensus.cc:606] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:40.272419   626 raft_consensus.cc:614] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:40.231417  3286 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:40.273721  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:40.281410  1168 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
W20260709 13:13:40.274410   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.275717  3416 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:40.275863   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:40.275978   631 raft_consensus.cc:1275] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:13:40.276736  3204 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:40.271426  3241 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:13:40.278898  3414 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:40.282135   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.274698   559 pending_rounds.cc:85] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 4
I20260709 13:13:40.284104   631 pending_rounds.cc:85] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 3
I20260709 13:13:40.292492   559 pending_rounds.cc:107] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:13:40.292621   631 pending_rounds.cc:107] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:13:40.293027   559 raft_consensus.cc:2889] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:40.293131   631 raft_consensus.cc:2889] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:40.280190  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:40.303481   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:40.313010   624 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:40.315867   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:40.283819  3287 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:40.328989   626 raft_consensus.cc:2393] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:40.260133  3400 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:40.341410  3400 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:40.339363  3421 log.cc:927] Time spent T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:13:40.350895   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.356196   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:40.357288  3423 log.cc:927] Time spent T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:13:40.361225  3310 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:40.369860   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:40.374380   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:40.328318  3363 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.384008   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:40.384614   557 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:13:40.291596  3416 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:40.400981   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:40.402549   631 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:40.404155   597 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:40.415496  3241 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:40.415939  3241 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.416266  3241 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:40.420138  3286 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:40.410300  3225 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:13:40.390767  3363 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:40.426674  3363 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:40.427043  3332 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:40.428673   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:40.432940   597 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:40.434118   597 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:40.435563  3386 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:40.436239  3386 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:40.436672  3386 raft_consensus.cc:697] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:40.436468   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:40.437640   625 raft_consensus.cc:2393] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:40.437613  3386 consensus_queue.cc:237] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:40.439927   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.440119   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:40.441002   624 raft_consensus.cc:2368] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 6. Current term is 7.
I20260709 13:13:40.444280   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:40.444490  3416 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:40.444881   484 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:40.435174   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:40.465543  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:40.466398  1172 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:40.475572   525 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:40.475955  3390 log.cc:927] Time spent T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.831s	user 0.006s	sys 0.008s
I20260709 13:13:40.476390  3416 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:40.476771  3416 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:40.477156  3416 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:40.477254   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1648) took 1439 ms. Trace:
I20260709 13:13:40.477643   630 rpcz_store.cc:276] 0709 13:13:39.038008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.038123 (+   115us) service_pool.cc:224] Handling call
0709 13:13:39.038454 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:39.038981 (+   527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:39.039021 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:39.058677 (+ 19656us) log.cc:844] Serialized 26 byte log entry
0709 13:13:39.467038 (+408361us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:39.467090 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:39.467163 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:40.475645 (+1008482us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b24001de058. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b651b29c4 00007f4b651b0acb 00007f4b6536bdc9 00007f4b6536ba55 00007f4b6536b09d 00007f4b67f9d10e 00007f4b67fb488c 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221
0709 13:13:40.476955 (+  1310us) raft_consensus.cc:1685] finished
0709 13:13:40.476974 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.477193 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":530,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":5126,"spinlock_wait_cycles":36689280,"thread_start_us":373045,"threads_started":1,"wal-append.queue_time_us":491339}
I20260709 13:13:40.479421   632 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:40.481716  1168 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:40.482870  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:40.488286  3305 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:40.490633  3416 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:40.494531  3422 log.cc:927] Time spent T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.234s	user 0.000s	sys 0.002s
I20260709 13:13:40.496336  3410 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:40.496779  3410 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:40.503326  1172 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
W20260709 13:13:40.504281   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.506548   557 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:40.507802   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:40.537698   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:40.538478   597 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:40.519817  1172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 475) took 1292 ms (client timeout 1565 ms). Trace:
I20260709 13:13:40.540609   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:40.541308   557 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:13:40.542992   626 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 7. Current term is 8. Ops: [7.3-7.3]
W20260709 13:13:40.539721  1172 rpcz_store.cc:269] 0709 13:13:39.211113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.328025 (+116912us) service_pool.cc:224] Handling call
0709 13:13:40.465220 (+1137195us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:40.503897 (+ 38677us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15112064}
I20260709 13:13:40.546800   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:40.546965   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:40.546564   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:40.543675   624 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:40.497539  3286 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:40.547650   481 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:40.511278  3363 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.557188   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:40.560983   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:40.553061  3204 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:40.567746   480 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:40.572445   523 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:40.576267   556 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:40.559700  3201 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:13:40.562420  3363 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:40.579694   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:40.580339   523 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:40.575747  3204 raft_consensus.cc:697] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:40.594269  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.601949   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:40.607221   557 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:40.608863   597 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:40.604720   480 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:40.610852   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:40.610131   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:40.612308   626 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:40.615584   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:40.617667   523 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:40.614307   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:40.620512   625 raft_consensus.cc:2393] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:40.601351  3364 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.622143   480 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:40.621112   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:40.624747   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:40.625384   557 raft_consensus.cc:2393] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:40.632105  3200 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:40.631978  3204 consensus_queue.cc:237] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:40.635632  3427 log.cc:927] Time spent T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
W20260709 13:13:40.636622  3428 log.cc:927] Time spent T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:13:40.642125  3416 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:40.642388   558 raft_consensus.cc:2410] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:13:40.643399  3414 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:40.643312  3417 consensus_queue.cc:1059] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:13:40.651832   631 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:40.652944   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:40.653777   477 raft_consensus.cc:2410] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:13:40.601842  3000 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:40.668593   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:40.668673  3241 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:40.669919   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:40.670573   551 raft_consensus.cc:2368] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 7. Current term is 8.
I20260709 13:13:40.671379   522 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:40.673192  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:40.673769  1172 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:40.616771  3332 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:40.682018   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:40.685740   551 raft_consensus.cc:2368] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 7. Current term is 8.
I20260709 13:13:40.683135   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:40.686304   633 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:40.687973   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:40.701313   557 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:13:40.703872  1172 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:40.708702   597 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:40.711527   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:40.712095   480 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:40.713344   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:40.715415   557 raft_consensus.cc:1275] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:13:40.718495   557 raft_consensus.cc:1240] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:40.716972   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:40.710799   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:40.720463   479 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:40.671028  3241 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:40.722935   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 105338us
I20260709 13:13:40.666380  3200 raft_consensus.cc:697] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:40.735960   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 68361.5us
I20260709 13:13:40.731300   633 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:40.713124  3417 consensus_queue.cc:1243] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer 6e6df7e8ed204f1db5c371536b5b0683 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:13:40.743904   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:40.695631  3000 raft_consensus.cc:697] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:40.719900  3204 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:40.666246  3364 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:40.765663   551 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:40.774860  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.776082   522 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:40.779850  3437 log.cc:927] Time spent T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:13:40.780741  3332 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:40.782104  3332 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:40.717852  3192 consensus_queue.cc:1059] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:13:40.746237  3276 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:40.769027   633 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:13:40.789255   599 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:40.792590   522 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:40.735193  3410 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:40.782982  3241 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:40.884584   626 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
W20260709 13:13:40.843869   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 54699.5us
I20260709 13:13:40.904491   479 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:40.790395  3287 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.858320   554 raft_consensus.cc:3055] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:40.793008  3204 raft_consensus.cc:697] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:40.912990   554 raft_consensus.cc:740] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:40.843401   480 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:40.879843   551 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:40.829389  3436 log.cc:927] Time spent T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:13:40.916839  3204 consensus_queue.cc:237] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:40.917268  3287 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:40.845952  3241 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:40.855922  3438 log.cc:927] Time spent T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:13:40.852527  3432 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 13:13:40.852063  3439 log.cc:927] Time spent T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:13:40.859256  3386 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:40.857388  3410 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:40.885703  3355 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:40.935354   554 consensus_queue.cc:260] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:40.939007  3386 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:40.942250  3386 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:40.945744   554 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:40.927393  3352 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:13:40.938910  1167 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:13:40.935495  3315 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:40.851318  3000 consensus_queue.cc:237] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:40.949770  3364 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:40.951735  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 147104us
I20260709 13:13:40.852113  3200 consensus_queue.cc:237] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:40.962008   599 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:40.963341   599 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:40.968106  3192 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:40.968811  3192 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:40.969339  3192 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:40.969353  1138 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:40.974581  3260 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:40.976830  3362 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:40.981002  3192 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:40.996713  3225 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:40.997485  3225 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:41.000851  3225 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:40.964869  3286 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:40.958961  3315 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:41.039598  3386 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:41.042815  3287 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:41.006122   599 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:41.052132  3287 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:41.052783  3315 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:41.053138   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 47233.4us
I20260709 13:13:41.059888  3315 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:13:41.062072  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.074527   599 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:41.162446   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:41.171213   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:41.175046   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:41.176735   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:41.179330   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:41.179802  3260 raft_consensus.cc:697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:41.180781  3260 consensus_queue.cc:237] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:41.186425   630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:41.187069   630 raft_consensus.cc:606] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:41.187460   630 raft_consensus.cc:614] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:41.193886   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:41.161518  3287 raft_consensus.cc:2749] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:41.199944   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:41.201233   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:41.205186   630 raft_consensus.cc:2368] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6.
I20260709 13:13:41.199591  3386 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.222456   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1685) took 1213 ms. Trace:
I20260709 13:13:41.223016   556 rpcz_store.cc:276] 0709 13:13:40.006955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.025002 (+ 18047us) service_pool.cc:224] Handling call
0709 13:13:41.219851 (+1194849us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b5400200dd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:41.219984 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1265609088}
I20260709 13:13:41.226209   632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:41.226897   632 raft_consensus.cc:606] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:13:41.225921  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 251807us
I20260709 13:13:41.227481   632 raft_consensus.cc:614] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:41.239168  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:41.239919  1172 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:41.246165  1167 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:13:41.247951  1166 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:13:41.244462  3203 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:13:41.249581  3203 consensus_queue.cc:1243] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer 6e6df7e8ed204f1db5c371536b5b0683 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:13:41.249806   632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:41.250428   632 raft_consensus.cc:606] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:41.255489  3241 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:41.225865  3386 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:41.264112  3386 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:41.242789  3461 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:41.244633  3286 consensus_queue.cc:1059] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:13:41.272495  3461 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:41.281378   632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:13:41.282142   632 raft_consensus.cc:606] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Received request to transfer leadership to TS 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:41.286782   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 44534.6us
I20260709 13:13:41.290042   597 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:41.291317 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:41.291828  1167 pending_rounds.cc:85] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: Aborting all ops after (but not including) 5
I20260709 13:13:41.292234  1167 pending_rounds.cc:107] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:13:41.292500  1167 raft_consensus.cc:2889] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:41.297247  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:41.298092  1172 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:41.308311  3459 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:41.308758   597 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:41.309785  3385 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:41.310268  3204 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:41.310698  3204 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.312487  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:41.311023  3204 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:41.299044  3286 raft_consensus.cc:3055] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:41.313573  3225 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:13:41.324580  3440 log.cc:927] Time spent T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.527s	user 0.008s	sys 0.014s
I20260709 13:13:41.326419   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1684) took 1319 ms. Trace:
I20260709 13:13:41.326779   552 rpcz_store.cc:276] 0709 13:13:40.006691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.047834 (+ 41143us) service_pool.cc:224] Handling call
0709 13:13:40.061519 (+ 13685us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.072661 (+ 11142us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:13:40.081158 (+  8497us) log.cc:844] Serialized 14 byte log entry
0709 13:13:40.491957 (+410799us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b180023da60. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb923a 00007f4b68423a2a
0709 13:13:40.709932 (+217975us) log.cc:844] Serialized 14 byte log entry
0709 13:13:40.720939 (+ 11007us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:40.734358 (+ 13419us) log.cc:844] Serialized 26 byte log entry
0709 13:13:40.734519 (+   161us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:40.734551 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.734611 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:41.049421 (+314810us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b180023da60. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6532c522 00007f4b6532e7c1 00007f4b6532e779 00007f4b6532e709 00007f4b6532e6d1 00007f4b6532d9cd 000000000038f354 000000000038f199 00007f4b6530f83a
0709 13:13:41.324025 (+274604us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:41.326191 (+  2166us) raft_consensus.cc:1685] finished
0709 13:13:41.326218 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.326356 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71331,"prepare.queue_time_us":36599,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":78,"raft.queue_time_us":27311,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":17696,"spinlock_wait_cycles":96750848,"thread_start_us":181688,"threads_started":2,"wal-append.queue_time_us":622675}
W20260709 13:13:41.336678   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 794472us
I20260709 13:13:41.320484  3286 raft_consensus.cc:740] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:41.321455  3225 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:41.378571   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:41.382165  3187 raft_consensus.cc:3055] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:41.345798  3461 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:41.382552   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:41.440549  3169 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:41.490396   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 697814us
I20260709 13:13:41.504765   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1704) took 1470 ms. Trace:
I20260709 13:13:41.906874  3305 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.915987  3305 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:41.916996   522 leader_election.cc:400] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 6. Current term is 7.
I20260709 13:13:41.917313   522 leader_election.cc:403] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:41.916663  3169 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:41.917857  3000 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 6. Current term is 7.
I20260709 13:13:41.918308  3305 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:41.908708   554 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:41.479077 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:41.600273  3286 consensus_queue.cc:260] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:41.504354  3347 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:13:41.909852   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:41.496711  3355 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:41.539106  1141 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:41.930130  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 391125us
W20260709 13:13:41.416005   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 85439.6us
I20260709 13:13:41.911377   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:41.750176  3363 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:41.932453   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:41.933756   448 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:41.404063  2646 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:13:41.389389  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.440318   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:41.942821   481 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:13:41.490453  3467 log.cc:927] Time spent T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:13:41.361256  3225 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:41.461983  3469 log.cc:927] Time spent T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:13:41.602387  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.951936   522 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:41.691720  3308 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:41.914139   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.920320   558 rpcz_store.cc:276] 0709 13:13:40.034401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.039559 (+  5158us) service_pool.cc:224] Handling call
0709 13:13:41.504571 (+1465012us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b5400386b54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:41.504706 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1383886080}
I20260709 13:13:41.953691  3169 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:41.927603  3128 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:41.939548  3312 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:41.949187  3463 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:41.954357  3416 consensus_queue.cc:1059] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:13:41.960074  3128 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:41.960599  3416 raft_consensus.cc:3055] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:41.960944  3416 raft_consensus.cc:740] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:41.495857  3444 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:41.961733  3416 consensus_queue.cc:260] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:41.961894  3444 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:41.964146  3444 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:41.382793  3187 raft_consensus.cc:740] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:41.965207  3187 consensus_queue.cc:260] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:41.966144  3187 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:41.490657  3276 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:41.954824   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:41.968091   556 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:41.417258  2934 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:41.969116  2934 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:41.967330   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.963011  3416 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:41.970888  3200 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:41.949872  2646 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:41.971426  3200 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:41.415771  3310 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:41.972903  3310 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:41.973551   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.974575  3462 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:41.975145  3462 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:41.976864   481 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:41.977171  3462 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:41.977584  3472 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:41.977876   559 raft_consensus.cc:2393] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:41.978117  3472 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:41.980451  3443 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:41.981006  3443 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:41.980218  2934 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:41.981626  3225 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:41.977846   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:41.988411   481 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:41.962271  3128 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:41.981333  3472 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:41.805975  3201 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:13:41.985848   482 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.005s	sys 0.008s
W20260709 13:13:41.994643   482 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.005s	sys 0.009s
W20260709 13:13:41.992908   483 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.000s	sys 0.016s
I20260709 13:13:41.985149  3169 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:41.996321   483 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.000s	sys 0.016s
I20260709 13:13:41.997076   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:41.993039   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:41.999428   484 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:41.975078  3310 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:42.009450   481 raft_consensus.cc:1275] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:42.012759   597 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:13:42.002008   447 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.013s	sys 0.014s
W20260709 13:13:42.028990   447 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.013s	sys 0.015s
I20260709 13:13:42.002170   556 raft_consensus.cc:1275] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:41.992309  3276 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:41.983157  3443 leader_election.cc:290] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:42.035408   556 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:13:41.998261  3000 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.001303  3347 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.039780   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:41.993598  3308 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:42.041393   556 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:41.992563  3355 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:42.034853  3461 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:42.047188  3310 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:42.049120   554 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:13:42.069429   480 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:42.032547  3315 consensus_queue.cc:1059] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:13:42.074841   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:42.076653   558 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:13:42.039927  3459 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:42.039741  3443 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:42.033805  3312 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.000449  3201 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.082201   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:42.082360   480 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:13:42.051906  3305 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.085737   554 raft_consensus.cc:1275] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:42.085846   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:42.086580   481 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:42.073506  3461 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.041653  3000 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.092379  3000 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:42.082370  3225 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:42.085144  3443 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.093144   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:42.079877  3310 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:42.095460  3443 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:42.095808  3310 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:42.096423  3310 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:42.046906  3347 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:42.096916  3310 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.098680  3347 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:42.099869  3169 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:42.100414  3169 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:42.101847  3355 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:42.102415  3169 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:42.086724  3459 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.083225  2646 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:42.104333   475 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 4.
I20260709 13:13:42.070318  3181 consensus_queue.cc:1059] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:13:42.104202  3461 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:42.167730   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:42.178709   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 245020us
I20260709 13:13:42.182046   481 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:42.089103  3305 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.191223   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:42.191880   481 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:13:42.192209  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:42.188037  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 236078us
I20260709 13:13:42.169682  3443 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:42.189998   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:42.089893  3200 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:42.193075   448 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:42.198194  1172 raft_consensus.cc:1275] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:42.185420  3347 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:13:42.203410   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 114009us
I20260709 13:13:42.201907  1141 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:42.183614  3481 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:42.213114   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:42.213861   481 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:42.253010  1141 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:42.265697  1174 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:13:42.204151  3443 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:42.204576  3308 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:42.268529  2646 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:13:42.317390   380 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41332 (request call id 155) took 23629 ms (client timeout 15000 ms). Trace:
I20260709 13:13:42.291895  3312 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:42.296535  3491 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:42.271714  3347 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:42.326011  3480 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
W20260709 13:13:42.333384  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 80467.5us
I20260709 13:13:42.289466  3315 consensus_queue.cc:1048] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:13:42.254052  3481 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.311610  3352 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:42.329347   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 116728us
I20260709 13:13:42.315353  3364 raft_consensus.cc:2764] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:13:42.327456  3411 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:42.325644  3128 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:42.319303  2646 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.362442  1141 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:42.371268  3459 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:42.344866  3496 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:42.349505  3153 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:42.348419  3497 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:42.354565  3201 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:42.397758   475 raft_consensus.cc:1275] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:13:42.374109  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 157780us
W20260709 13:13:42.379400   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 175433us
W20260709 13:13:42.317889   380 rpcz_store.cc:269] 0709 13:13:18.477706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.490056 (+ 12350us) service_pool.cc:224] Handling call
0709 13:13:19.864541 (+1374485us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b54000fbed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68383090 00007f4b68421f3a 00007f4b6e1d81cc 00007f4b6e2d637e 00007f4b6c7972a4 00007f4b6c797232 00007f4b6c797161 00007f4b6c7970dc 00007f4b6c796392 00007f4b6675448c 00007f4b667538c6
0709 13:13:42.106691 (+22242150us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:38.580078 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:38.580788 (+   710us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:38.580840 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:13:38.580873 (+    33us) tablet.cc:662] Decoding operations
0709 13:13:38.582079 (+  1206us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:38.582199 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:38.582224 (+    25us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:13:38.647892 (+ 65668us) tablet.cc:701] Row locks acquired
0709 13:13:38.647948 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:13:38.648159 (+   211us) write_op.cc:270] Start()
0709 13:13:38.648342 (+   183us) write_op.cc:276] Timestamp: P: 1783602818648085 usec, L: 0
0709 13:13:38.648397 (+    55us) op_driver.cc:348] REPLICATION: starting
0709 13:13:38.649278 (+   881us) log.cc:844] Serialized 4043 byte log entry
0709 13:13:39.211865 (+562587us) op_driver.cc:464] REPLICATION: finished
0709 13:13:39.528850 (+316985us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b6530f0ac 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b6be4fef0
0709 13:13:39.719932 (+191082us) write_op.cc:301] APPLY: starting
0709 13:13:39.733114 (+ 13182us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:39.733368 (+   254us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:39.733403 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:39.736096 (+  2693us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:39.736437 (+   341us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:13:39.736491 (+    54us) write_op.cc:312] APPLY: finished
0709 13:13:39.736900 (+   409us) log.cc:844] Serialized 77 byte log entry
0709 13:13:39.737126 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:39.737260 (+   134us) write_op.cc:454] Released schema lock
0709 13:13:39.737328 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:39.737735 (+   407us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:39.737762 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6917326,"reported_tablets":23,"spinlock_wait_cycles":3153280,"child_traces":[["op",{"apply.queue_time_us":507748,"apply.run_cpu_time_us":3776,"apply.run_wall_time_us":17786,"num_ops":10,"prepare.queue_time_us":180574,"prepare.run_cpu_time_us":12059,"prepare.run_wall_time_us":271773,"raft.queue_time_us":309565,"raft.run_cpu_time_us":20257,"raft.run_wall_time_us":433596,"replication_time_us":563277,"spinlock_wait_cycles":326529280,"thread_start_us":892340,"threads_started":4,"wal-append.queue_time_us":250028,"wal-append.run_cpu_time_us":15373,"wal-append.run_wall_time_us":1840492}]]}
I20260709 13:13:42.337462  3491 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.348568  3352 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.399546   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:42.408937   479 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:42.409435   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1692) took 1033 ms. Trace:
I20260709 13:13:42.399996   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:42.343411  3200 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:13:42.402856   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1581) took 2161 ms. Trace:
I20260709 13:13:42.380591  3411 raft_consensus.cc:697] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:42.382982  3305 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:42.386461  3363 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:42.416452   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:42.413177   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1696) took 1035 ms. Trace:
I20260709 13:13:42.397861  3153 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.409716   479 rpcz_store.cc:276] 0709 13:13:41.376471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.379734 (+  3263us) service_pool.cc:224] Handling call
0709 13:13:42.398164 (+1018430us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:42.409382 (+ 11218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7307136}
I20260709 13:13:42.386998  3493 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:42.384788  3128 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.418995   478 rpcz_store.cc:276] 0709 13:13:41.377669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.462283 (+ 84614us) service_pool.cc:224] Handling call
0709 13:13:42.399556 (+937273us) spinlock_profiling.cc:243] Waited 981 us on lock 0x7b5800002798. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:42.413090 (+ 13534us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2256640}
I20260709 13:13:42.410605   482 rpcz_store.cc:276] 0709 13:13:40.241873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.244334 (+  2461us) service_pool.cc:224] Handling call
0709 13:13:40.265917 (+ 21583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:41.330743 (+1064826us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:41.330773 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:41.331923 (+  1150us) log.cc:844] Serialized 26 byte log entry
0709 13:13:41.994988 (+663065us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:41.995026 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.995087 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:42.402596 (+407509us) raft_consensus.cc:1685] finished
0709 13:13:42.402618 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.402775 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1064452,"raft.queue_time_us":1069968,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":615936,"threads_started":1,"wal-append.queue_time_us":644704}
I20260709 13:13:42.433817   475 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:13:42.434717  3479 log.cc:927] Time spent T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.361s	user 0.000s	sys 0.002s
I20260709 13:13:42.416841  3363 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.437005   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1682) took 1869 ms. Trace:
I20260709 13:13:42.456244  3363 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:42.456871   630 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:42.459937  1174 consensus_queue.cc:237] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:42.461763  3487 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.463357  3364 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:42.464006  3411 consensus_queue.cc:237] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:42.468626   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 472794us
I20260709 13:13:42.452654   476 rpcz_store.cc:276] 0709 13:13:40.560045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.560204 (+   159us) service_pool.cc:224] Handling call
0709 13:13:40.570236 (+ 10032us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:41.357485 (+787249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:41.357529 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:41.940569 (+583040us) log.cc:844] Serialized 26 byte log entry
0709 13:13:42.216754 (+276185us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:42.216807 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.216900 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:42.428587 (+211687us) raft_consensus.cc:1685] finished
0709 13:13:42.428619 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.429752 (+  1133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":801653,"raft.queue_time_us":797797,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":253635,"threads_started":1,"wal-append.queue_time_us":462976}
I20260709 13:13:42.429442  3486 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:42.470067  3204 consensus_meta.cc:287] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.150s	user 0.014s	sys 0.002s
I20260709 13:13:42.462386  3487 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:42.484326  3505 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:13:42.487810   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:42.509984   478 raft_consensus.cc:1275] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:42.510512   630 raft_consensus.cc:2410] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:13:42.516191   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:42.517501   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:42.518266   478 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:42.473266  3443 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:42.524029   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:42.534794  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:42.547526   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 141736us
I20260709 13:13:42.398999  3496 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:42.548664   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:42.548029   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 168745us
I20260709 13:13:42.558213   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:42.508574  3305 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:42.560482   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1678) took 2060 ms. Trace:
I20260709 13:13:42.475533  3503 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:13:42.563767   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:42.560860   483 rpcz_store.cc:276] 0709 13:13:40.500360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.500470 (+   110us) service_pool.cc:224] Handling call
0709 13:13:40.539206 (+ 38736us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:41.346590 (+807384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:41.346636 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:41.359092 (+ 12456us) log.cc:844] Serialized 26 byte log entry
0709 13:13:42.000788 (+641696us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:42.000860 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.000976 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:42.434045 (+433069us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:42.546363 (+112318us) raft_consensus.cc:1685] finished
0709 13:13:42.546383 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.560422 (+ 14039us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":790764,"raft.queue_time_us":811761,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":5517,"spinlock_wait_cycles":6996352,"thread_start_us":531908,"threads_started":1,"wal-append.queue_time_us":650352}
I20260709 13:13:42.559110  3497 raft_consensus.cc:697] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:42.520974  3417 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:42.521529  3201 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:42.522943  3347 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:42.547169  3276 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.546979  3400 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.576380   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:42.576437   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:42.549275  3308 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:42.438966  3493 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:42.577069   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:42.585116   479 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:42.583575   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:42.590091   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:42.569042  3497 consensus_queue.cc:237] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.516451  3204 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:42.596755   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:42.598855   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 48378.7us
I20260709 13:13:42.603209   556 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:13:42.603354   448 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:42.573575  3510 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.486397  3486 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:42.616797  3513 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:42.619920   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1693) took 1243 ms. Trace:
I20260709 13:13:42.571451  3305 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.625185  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:42.624110  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:42.620316   477 rpcz_store.cc:276] 0709 13:13:41.376832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.379849 (+  3017us) service_pool.cc:224] Handling call
0709 13:13:41.931913 (+552064us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:42.176253 (+244340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:42.176287 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:42.193675 (+ 17388us) log.cc:844] Serialized 52 byte log entry
0709 13:13:42.323785 (+130110us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:42.323846 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.323942 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:42.619688 (+295746us) raft_consensus.cc:1685] finished
0709 13:13:42.619711 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.619855 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52647,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":99,"spinlock_wait_cycles":11136,"thread_start_us":283782,"threads_started":2,"wal-append.queue_time_us":109137}
I20260709 13:13:42.585551  3201 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:42.640014   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.640091  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:42.644333   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 87037.5us
I20260709 13:13:42.586686  3400 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.619814  2646 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:42.591531  3308 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.654773   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:42.655542   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:42.657681   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:42.586871  3276 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:42.663128  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:42.663472   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:42.660286   628 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:42.579021  3417 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.668422   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:42.669238   630 raft_consensus.cc:2410] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:13:42.661092   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:42.661648   447 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:42.634151  3352 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:42.648880  3416 consensus_meta.cc:287] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.678s	user 0.012s	sys 0.000s
I20260709 13:13:42.664482   554 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:42.665548   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:42.670483   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:42.676327   628 raft_consensus.cc:2410] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:42.674594   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:42.675094   447 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:42.677840   627 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:13:42.679621   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:42.679733   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:42.679872   447 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:42.681535   556 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:42.681823   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:42.683095   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:42.684021   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:42.684181  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:42.684832   629 raft_consensus.cc:2410] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:13:42.685246   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:42.685508   447 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:42.686851   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:42.661654  3200 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.682634   632 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:42.696126   447 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:42.695941   630 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:42.697516   447 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:42.698449  3130 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:42.698663   447 leader_election.cc:400] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6.
I20260709 13:13:42.699146  3130 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:42.699383  3513 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:42.692870  3484 log.cc:927] Time spent T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:13:42.703639   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:42.704427   629 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:42.706174   629 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:42.708666   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:42.710872   522 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:42.711676  3416 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:42.713424   522 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:42.665325  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:42.715679   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:42.672600  3153 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:42.720058   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:42.730252   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:42.729336   522 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:42.610019  3510 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:42.743691  3506 log.cc:927] Time spent T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:13:42.679056  3515 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:42.691620  3516 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:42.736313  3310 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:42.738327  3519 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:42.724895  3513 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:42.745118   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:42.733536  3517 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:13:42.746747   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:42.748962   558 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:42.755488   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:42.771850   550 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:42.744825  3153 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:42.726636  3416 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:42.755062   522 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:42.726444  3521 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:42.731185  3286 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:42.765813  3508 log.cc:927] Time spent T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:13:42.805243  3481 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:42.737499  3496 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:42.735178  3363 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:42.807082  1172 raft_consensus.cc:2393] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 8: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:42.808048  3363 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:42.765301  3347 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:42.779764   522 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:42.785157  3493 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:42.786931  3486 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:42.789180  3201 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:42.789845  3487 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:42.793767  3461 consensus_meta.cc:287] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.608s	user 0.004s	sys 0.006s
I20260709 13:13:42.794827  3305 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:42.796089  3521 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.797197  3204 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:42.777016  3513 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:42.771073  3511 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:13:42.799268  3519 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:42.719497  3200 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.809026  3347 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:42.814996   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:42.815014   556 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:42.846827   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:42.839368   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:42.846870   483 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:42.838719  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:42.810065  3461 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:42.862584  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:42.863420  1166 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:42.864868   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 85156.4us
I20260709 13:13:42.893054  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:42.866201   522 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:42.897401   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.897835   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:42.900996   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:42.901087   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:42.901633   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:42.902854   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:42.835891  3443 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.910507  3204 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:42.835664  3519 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:42.894735  3200 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:42.896813  3493 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:42.915325   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:42.918440   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:42.827075  3496 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:42.924501  1166 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:42.925593   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:43.171367   448 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.046s	sys 0.055s
I20260709 13:13:43.112169   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:43.169281   483 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:42.826498  3525 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:42.997385   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:43.296039   448 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.055s	sys 0.067s
W20260709 13:13:43.262502   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 363893us
I20260709 13:13:43.308054  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:43.300285  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:43.143376  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.312611  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:43.312932  3528 log.cc:927] Time spent T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.420s	user 0.001s	sys 0.000s
I20260709 13:13:43.228286   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:43.333195   631 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
W20260709 13:13:43.334187  3286 consensus_meta.cc:287] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.000s
I20260709 13:13:43.339445  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:43.340327  1168 raft_consensus.cc:2410] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:13:43.341017   554 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:43.342684   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:43.343954   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:43.344457   554 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:13:43.345810  1139 connection.cc:256] RPC call timeout handler was delayed by -1.3347959119998904s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2717s for a response
I20260709 13:13:43.346263   377 catalog_manager.cc:5697] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 1 to 5, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 5 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:43.296757  3493 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.919828  3417 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:43.319224  3128 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:43.320233  3540 log.cc:927] Time spent T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:13:43.328176  3538 log.cc:927] Time spent T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:13:43.329481  3539 log.cc:927] Time spent T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:13:42.920821  3153 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.393s
I20260709 13:13:42.917227  3472 raft_consensus.cc:3055] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:43.332202  3521 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:43.332244   627 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:13:43.306991   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 676486us
I20260709 13:13:43.312729  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:43.473469   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1710) took 1475 ms. Trace:
I20260709 13:13:43.474056  1167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 414) took 1273 ms. Trace:
I20260709 13:13:43.000039  3443 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:43.474514  3459 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.355829   597 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:43.475100  3459 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:43.476042   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 120381us
I20260709 13:13:43.476202  3443 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:43.476806  3443 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:43.477229  3443 raft_consensus.cc:697] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:43.477443  3459 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:42.919996  3461 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:43.478053  3459 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:43.478149  3443 consensus_queue.cc:237] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:43.349926   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:43.479976  3347 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:43.307379   630 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:43.308635   624 raft_consensus.cc:2393] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 8: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:43.357059   554 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:13:43.369779   625 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:42.920245  3000 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.485s
I20260709 13:13:43.473367  3472 raft_consensus.cc:740] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:43.477126   597 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:43.348397   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:43.375701   626 raft_consensus.cc:1240] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:43.411092   557 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 13:13:43.384843   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:43.428087   550 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.001s	sys 0.012s
I20260709 13:13:42.911754  3444 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:43.475008  3355 raft_consensus.cc:3055] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:43.411468   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:43.384812   478 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:43.387147   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:43.577724   477 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:43.504786  3519 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:43.534621   483 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:43.474128   559 rpcz_store.cc:276] 0709 13:13:41.998879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.002456 (+  3577us) service_pool.cc:224] Handling call
0709 13:13:42.035312 (+ 32856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.084438 (+ 49126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:42.084467 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:42.084530 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:42.084563 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.473181 (+1388618us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b54000eb854. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:43.473229 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.473406 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112579968}
I20260709 13:13:42.918630  3513 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:43.565857   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 88792.4us
I20260709 13:13:43.622713   597 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:43.623320   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1701) took 1997 ms. Trace:
I20260709 13:13:43.054456  3305 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:43.177273  3510 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:43.406553  3493 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:43.623895   484 rpcz_store.cc:276] 0709 13:13:41.626160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.040588 (+414428us) service_pool.cc:224] Handling call
0709 13:13:42.067627 (+ 27039us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.195739 (+128112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:42.195767 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:42.195816 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:42.195866 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.622958 (+1427092us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540020e9d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:43.623027 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.623222 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293553408}
I20260709 13:13:43.632894   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:43.405542   377 catalog_manager.cc:5697] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 3 to 4, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 4 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:43.517757  3315 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.620083   525 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:43.634472   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:43.310606  3496 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:43.405916  3286 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.217s
I20260709 13:13:43.695533   377 catalog_manager.cc:5697] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:43.622059  3511 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:43.699839   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 79947.2us
I20260709 13:13:43.566715  3444 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:43.366801  3204 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:43.858899   377 catalog_manager.cc:5697] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 2 to 5, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 5 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:13:43.836781   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 214128us
I20260709 13:13:43.835999   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:43.744319   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:43.830130  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 483331us
W20260709 13:13:43.869866  1139 connection.cc:256] RPC call timeout handler was delayed by -1.2053890759998467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
I20260709 13:13:43.869993   597 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:43.870249  1139 connection.cc:256] RPC call timeout handler was delayed by -1.1846890759998132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
I20260709 13:13:43.576555  3462 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:43.715083  3537 log.cc:927] Time spent T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:13:43.575026  3355 raft_consensus.cc:740] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:43.852970   525 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:43.889359  1172 raft_consensus.cc:2410] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:13:43.706666  3524 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:43.698828  3315 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:43.899515   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:43.900871   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:43.869415   480 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:43.474545  1167 rpcz_store.cc:276] 0709 13:13:42.200627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.312393 (+1111766us) service_pool.cc:224] Handling call
0709 13:13:43.473489 (+161096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.473731 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.473755 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:43.473799 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:43.473836 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.473897 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.474005 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:43.735317  3547 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:43.886830  3511 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:43.887172   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:43.889844   525 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:43.872467   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:43.910842   631 raft_consensus.cc:2410] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:13:43.910874   478 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 4.
I20260709 13:13:43.902091   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:43.886835   377 catalog_manager.cc:5697] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 4 to 7, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 7 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:43.911856   480 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:43.862900  3444 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:43.905512   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:43.915117   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:43.915279  3496 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:43.916769  3204 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:43.917903  3308 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:43.873569  3287 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:43.918731   377 catalog_manager.cc:5697] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 4 to 6, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 6 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:43.899649  3347 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:43.923846   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:43.928035  1139 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:43.938233   480 raft_consensus.cc:2393] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:43.938858   484 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:43.945046   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:43.944656   377 catalog_manager.cc:5697] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 4 to 7, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 7 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:43.910223  3547 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:43.933207  3524 raft_consensus.cc:2804] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:13:43.965217   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 93840.6us
I20260709 13:13:43.862747  3472 consensus_queue.cc:260] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:43.967453   377 catalog_manager.cc:5697] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:43.968429   597 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:43.858180  3305 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:43.988689  3443 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:43.990082 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:43.991214  3443 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:43.992424   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1727) took 1251 ms. Trace:
I20260709 13:13:43.993752  3443 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:43.992806   551 rpcz_store.cc:276] 0709 13:13:42.740989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.741101 (+   112us) service_pool.cc:224] Handling call
0709 13:13:42.741416 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.791656 (+ 50240us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:42.792062 (+   406us) log.cc:844] Serialized 14 byte log entry
0709 13:13:43.068533 (+276471us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:43.068609 (+    76us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:43.068682 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.992183 (+923501us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b54001d6d54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:43.992231 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.992366 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41364,"prepare.queue_time_us":21133,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":5128,"raft.queue_time_us":41515,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":6010,"spinlock_wait_cycles":114583936,"thread_start_us":234545,"threads_started":1,"wal-append.queue_time_us":613302}
I20260709 13:13:43.996007   597 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:43.996850  3443 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:43.997014   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 413) took 1519 ms. Trace:
I20260709 13:13:43.997292  3443 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:43.997762  3443 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:43.997519   476 rpcz_store.cc:276] 0709 13:13:42.477623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.478748 (+  1125us) service_pool.cc:224] Handling call
0709 13:13:42.479019 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.479202 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:42.521611 (+ 42409us) log.cc:844] Serialized 14 byte log entry
0709 13:13:43.109038 (+587427us) log.cc:844] Serialized 14 byte log entry
0709 13:13:43.996636 (+887598us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:43.996693 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:43.996751 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.996820 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.996941 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1013218,"prepare.queue_time_us":151318,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":2388,"raft.queue_time_us":944323,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":20170,"spinlock_wait_cycles":42409344,"thread_start_us":475861,"threads_started":1}
I20260709 13:13:43.999989  3310 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:44.000597  3310 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:44.001834  3519 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:44.002311  3519 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.002806  3310 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:43.955343  3347 raft_consensus.cc:697] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:44.013518   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:44.014652   377 catalog_manager.cc:5697] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 3 to 4, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 4 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:43.997107   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1717) took 1410 ms. Trace:
I20260709 13:13:43.959569  3547 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:44.016604   479 rpcz_store.cc:276] 0709 13:13:42.586245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.587383 (+  1138us) service_pool.cc:224] Handling call
0709 13:13:42.602271 (+ 14888us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:42.621798 (+ 19527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:42.621833 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:42.636717 (+ 14884us) log.cc:844] Serialized 52 byte log entry
0709 13:13:42.922993 (+286276us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:43.108575 (+185582us) log.cc:844] Serialized 14 byte log entry
0709 13:13:43.996399 (+887824us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b180009c820. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b652a6c0a 00007f4b6e9e6219 00007f4b6532ea40 00007f4b653294e4 00007f4b65329455 00007f4b68411060 00007f4b68423716 00007f4b68434287 00007f4b68434208
0709 13:13:43.996595 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.996675 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:43.996720 (+    45us) raft_consensus.cc:1685] finished
0709 13:13:43.996825 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.996958 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31718,"prepare.queue_time_us":185635,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":903189,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":194,"spinlock_wait_cycles":9665408,"thread_start_us":236191,"threads_started":1,"wal-append.queue_time_us":568906}
I20260709 13:13:43.967417  3524 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:44.042080   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:44.043927   599 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:44.047680   377 catalog_manager.cc:5697] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 2 to 7, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 7 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:44.004309  3519 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:43.955701  3548 consensus_queue.cc:1048] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:13:44.012959  3287 raft_consensus.cc:2804] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:44.013201  3472 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.057946   523 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:43.971276  3459 consensus_queue.cc:1048] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:13:44.062381  3128 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:44.066560  3128 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.068684  3128 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:44.069446   556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1726) took 1328 ms (client timeout 1647 ms). Trace:
W20260709 13:13:44.069933   556 rpcz_store.cc:269] 0709 13:13:42.740695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.744889 (+  4194us) service_pool.cc:224] Handling call
0709 13:13:44.069287 (+1324398us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b5400105754. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:44.069386 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100840704}
I20260709 13:13:44.046368  3524 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.070205  3000 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.054124   377 catalog_manager.cc:5697] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 3 to 5, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 5 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:44.051330  3491 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:44.084201   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 148574us
I20260709 13:13:44.052227  3497 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:44.051770  3512 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:13:44.088668   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 44855.5us
I20260709 13:13:44.062574  3417 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.070173  3287 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:44.086494  3000 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.115417  3561 consensus_queue.cc:1048] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:44.115437  3417 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.116256  3525 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:44.116379   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1536) took 1464 ms. Trace:
I20260709 13:13:44.117355  3363 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:44.094323   599 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:44.118333  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.118508  3305 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:44.093555  3545 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:44.120126  3347 consensus_queue.cc:237] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.121410  3510 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:44.122517  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 110620us
I20260709 13:13:44.092803  3491 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:44.155555  3491 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.157503  3491 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.158059  3563 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.158528  3563 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.160615  3563 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.163321  3200 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:44.136626  3509 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:44.165217  3000 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.084774  3500 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.165975  3500 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.168013  3500 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.149915  3461 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:44.169021  3461 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:44.128337  3512 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.169417  3355 consensus_queue.cc:260] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.171545  3512 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.173312  3417 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.174261  3276 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:44.120549   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1722) took 1282 ms. Trace:
I20260709 13:13:44.137511   599 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:44.134122   625 rpcz_store.cc:276] 0709 13:13:42.652351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.655307 (+  2956us) service_pool.cc:224] Handling call
0709 13:13:44.116175 (+1460868us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b5400161cd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:44.116298 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1552826752}
I20260709 13:13:44.149353   377 catalog_manager.cc:5697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 3 to 4, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 4 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:44.128250  3362 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:44.149441  3363 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:44.165062  3509 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.130375   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1709) took 2129 ms. Trace:
I20260709 13:13:44.189072   377 catalog_manager.cc:5697] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 3 to 4, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 4 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:44.128018  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 208366us
I20260709 13:13:44.191512  1139 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:44.129907  3287 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:44.124969  3407 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:13:44.182547   448 connection.cc:256] RPC call timeout handler was delayed by -1.0007310050002616s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
I20260709 13:13:44.150785  3545 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:44.169397  3461 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.186575  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:44.208376   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 119614us
I20260709 13:13:44.147944  3463 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.193789  3363 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.181061  3510 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:44.195724  3554 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:13:44.195214   377 catalog_manager.cc:5697] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 3 to 4, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 4 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:44.199400  3549 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:44.200093   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 62645.8us
I20260709 13:13:44.214375   599 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:44.200588  3225 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:44.188977   552 rpcz_store.cc:276] 0709 13:13:41.995454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.995564 (+   110us) service_pool.cc:224] Handling call
0709 13:13:41.995840 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.105764 (+109924us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:42.295829 (+190065us) log.cc:844] Serialized 14 byte log entry
0709 13:13:42.362075 (+ 66246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:42.362149 (+    74us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:42.362218 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.124258 (+1762040us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54001ca054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:44.124315 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.124459 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":211998,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":3288,"raft.queue_time_us":1311,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"spinlock_wait_cycles":252246272,"thread_start_us":195847,"threads_started":2,"wal-append.queue_time_us":182690,"wal-append.run_cpu_time_us":2216,"wal-append.run_wall_time_us":1255816}
I20260709 13:13:44.203990   448 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:44.095494  3497 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.182242   550 rpcz_store.cc:276] 0709 13:13:42.837876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.838454 (+   578us) service_pool.cc:224] Handling call
0709 13:13:42.897075 (+ 58621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.912533 (+ 15458us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:13:42.912826 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 13:13:43.619287 (+706461us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:43.619338 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:43.619382 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.114179 (+494797us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b18003d7c20. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6532c3f3 00007f4b6532e7c1 00007f4b6532e779 00007f4b6532e709 00007f4b6532e6d1 00007f4b6532d9cd 000000000038f354 000000000038f199 00007f4b6530f83a
0709 13:13:44.120345 (+  6166us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b5400387f54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:44.120392 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.120498 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54459,"prepare.queue_time_us":8872,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":54666,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":11097,"spinlock_wait_cycles":41906432,"thread_start_us":641926,"threads_started":1,"wal-append.queue_time_us":1085565}
I20260709 13:13:44.171151  3355 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:44.208796  1174 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:44.217391   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:44.218526   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:44.210925  3362 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:44.227370   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:44.227982   554 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:44.228214  3502 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:44.228631  3502 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:44.229017  3502 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.205582  3312 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:44.231599  3312 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.233897  3312 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.221522  3500 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:44.221632  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:44.222568  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:44.223284  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:44.223536  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:44.224191  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:44.224380   448 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:44.280750   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 56751.5us
I20260709 13:13:44.236974   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:44.239826   556 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:44.239861   525 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:44.241072   599 leader_election.cc:304] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:44.274720  1139 leader_election.cc:400] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 7. Current term is 8.
I20260709 13:13:44.275446   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:44.279104  1175 raft_consensus.cc:2376] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9. Re-sending same reply.
W20260709 13:13:44.283140   447 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 1.568s (SENT) [suppressed 11 similar messages]
I20260709 13:13:44.283625   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:44.284794   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:44.285404   555 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:44.276540  1174 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:13:44.277051   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:44.208470  3545 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:44.206403  3512 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:13:44.283645   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 43854.7us
I20260709 13:13:44.274636   377 catalog_manager.cc:5697] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 4 to 5, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 5 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:44.282748   551 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:44.294044   525 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:44.287510   557 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 4.
W20260709 13:13:44.288122   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 51237.4us
W20260709 13:13:44.289458   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 48450.2us
I20260709 13:13:44.216941  3562 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.291136   556 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:13:44.297289   599 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:44.292692   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:44.299386  1173 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:13:44.302732   599 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:44.302732   448 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:44.217163  3463 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:44.299993   377 catalog_manager.cc:5697] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:44.318041   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:44.318615   551 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.319646   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:44.291038  3352 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:44.312409  3562 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:44.291433  3181 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:44.314720  3510 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:44.311709  3541 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:44.325563   377 catalog_manager.cc:5697] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 1 to 5, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 5 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:44.328430   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.288182  3312 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:44.404091   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:44.405347   556 raft_consensus.cc:2410] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:44.406373   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:44.407341   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:44.302022  3225 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:44.407104   559 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
W20260709 13:13:44.409145   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 115214us
I20260709 13:13:44.388998   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:44.415606   525 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:44.210601  3407 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.412559   377 catalog_manager.cc:5697] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 5 to 6, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 6 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:13:44.417905   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.288492  1170 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:44.315984  3462 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:44.422600   555 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:44.322532  3308 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.434415   377 catalog_manager.cc:5697] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:44.439011   597 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:44.435204   525 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:44.439883   377 catalog_manager.cc:5697] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 5 to 6, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 6 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:44.443591   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:44.447692  3308 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:44.449707   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 166570us
I20260709 13:13:44.389789  3181 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:44.451689  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 136012us
I20260709 13:13:44.454066   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:44.389058  3519 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:44.421288   448 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:44.456532   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 153861us
I20260709 13:13:44.457351   599 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:44.239711  3549 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.404014  3312 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:44.419262  3525 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:44.419816  3225 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.462051   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:44.463294   525 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:44.471266   525 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:44.460564  3493 consensus_meta.cc:287] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.761s	user 0.009s	sys 0.003s
I20260709 13:13:44.464468   599 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:44.475265  1139 leader_election.cc:400] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 7. Current term is 8.
I20260709 13:13:44.305538  3512 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:44.414906  3511 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.432858  3488 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:44.459585  3541 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:44.467631  3312 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:44.516839   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:44.453197  3548 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:44.458333  3181 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.474192   525 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:44.463441   448 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:44.522491   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 59121.6us
I20260709 13:13:44.510005   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:44.470804  3462 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:44.462381  3563 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.462247  3310 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:44.469528  3305 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:44.512910   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 48510.2us
I20260709 13:13:44.466464  2646 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:13:44.417616  3200 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:44.467425  3525 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:44.472443  2934 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:44.511843  3541 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:44.596004  3541 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.595788  2934 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:44.514467  3560 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.248s
W20260709 13:13:44.598055  3567 log.cc:927] Time spent T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:13:44.528203  3565 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:44.598728  3565 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:44.599126  3565 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.523265   448 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:44.537765  3524 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:44.539026  3443 consensus_meta.cc:287] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.541s	user 0.014s	sys 0.000s
I20260709 13:13:44.605728   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:44.544876  3549 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:44.550516  3547 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.552889   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:44.553637   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:44.610881   478 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
W20260709 13:13:44.555205  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 82250.7us
W20260709 13:13:44.505527  3558 log.cc:927] Time spent T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
W20260709 13:13:44.504309  3559 log.cc:927] Time spent T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
W20260709 13:13:44.504734  3532 log.cc:927] Time spent T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 13:13:44.619079  1139 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:44.471710  3225 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:44.476698  3000 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:13:44.567350  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.504868  3494 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:44.506623  3417 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:44.523861   476 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:44.510501  3488 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:44.659476  3488 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.465862  3519 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.520159  3352 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:44.527315   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 53197.5us
I20260709 13:13:44.476198  3510 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.110s
I20260709 13:13:44.507776  3493 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.582144  3462 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:44.568521  3310 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:44.603070  3525 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.627640  1141 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:44.608063  3128 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:44.639914  3461 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.641515   555 raft_consensus.cc:2410] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:13:44.650002  3443 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.589525  3563 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:44.688650  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 61129.6us
I20260709 13:13:44.602741  3200 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:44.655858  3516 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:44.656200  3417 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:44.648105  3494 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:44.684827  3310 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:44.678094  3462 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:44.673978   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 88702.5us
I20260709 13:13:44.645308  3503 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:44.630394  3000 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:44.614938  3308 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.692837   558 raft_consensus.cc:2393] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 9: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:44.716524   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1537) took 2063 ms. Trace:
I20260709 13:13:44.664426   551 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:44.707547   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:44.673331   476 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:13:44.708134  3562 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:44.712402  3547 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:44.754221  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 79714.8us
I20260709 13:13:44.663005  3287 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:44.724233  3509 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.705256  2934 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:44.720116  3494 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:44.717267  3417 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:44.738708  3502 consensus_meta.cc:287] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.001s
I20260709 13:13:44.718326  3464 raft_consensus.cc:2804] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:44.775671  3464 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.775569  3502 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:44.776141  3464 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.777678  3502 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:44.685930  3128 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:44.686643  3305 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:44.752092  3580 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.780005  3305 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:44.780478  3444 consensus_meta.cc:287] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.843s	user 0.010s	sys 0.001s
I20260709 13:13:44.780366  3580 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.780929  3444 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.782080  3305 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:44.720180  3548 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.782753  3548 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.783942  3461 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:44.785259  3551 log.cc:927] Time spent T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.780s	user 0.004s	sys 0.004s
I20260709 13:13:44.785339  3548 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.782639  3580 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:44.779541   482 raft_consensus.cc:2393] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:44.782954  3444 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:44.788280  3472 consensus_meta.cc:287] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.000s
I20260709 13:13:44.791046  3521 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.716873  3512 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:44.713378  3524 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:44.714511  3563 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.715905  3443 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:44.791626  3521 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:44.701267  3516 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:44.792490  3516 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.782083  3225 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:44.793790  3521 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:44.794308  3225 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:44.746193   633 rpcz_store.cc:276] 0709 13:13:42.652602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.655951 (+  3349us) service_pool.cc:224] Handling call
0709 13:13:42.667695 (+ 11744us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:42.676153 (+  8458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:42.676197 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:42.676723 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:13:42.925057 (+248334us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:43.112107 (+187050us) log.cc:844] Serialized 14 byte log entry
0709 13:13:43.356847 (+244740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.356917 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:44.716333 (+1359416us) raft_consensus.cc:1685] finished
0709 13:13:44.716351 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.716469 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":204960,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":6772,"raft.queue_time_us":197358,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":7483,"thread_start_us":435191,"threads_started":2,"wal-append.queue_time_us":1189767}
I20260709 13:13:44.697100  3497 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.743185  3503 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.796322  3503 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:44.715554  3407 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.800257  3200 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:44.801258  3315 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:44.684935  3347 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:13:44.802779  3564 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:44.744588  3000 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.765297  3204 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:44.751084  3463 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.721968  3488 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.768018  3493 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.767791  3312 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.768196  3519 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.773177  3287 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:44.719780  3541 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.779533  3128 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.776083  3181 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:44.878074  3181 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:44.704631  3545 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:44.882102  3525 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.805401  3416 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:44.883945  3545 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:44.883652  3416 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:44.801895  3565 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.884624  3312 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.885846  3488 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.886408  3416 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:44.887136   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 295282us
I20260709 13:13:44.803385  3347 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:44.888845   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:44.899865   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:44.900110   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:44.900481   479 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:13:44.900839   484 raft_consensus.cc:2410] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:44.902729   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:44.903404   479 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:44.906113   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:44.908198   553 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:44.908083   597 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:44.909550   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:44.910140   484 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:44.803334  3564 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:44.959759   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:44.945595   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:44.937394   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:44.969477   551 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:44.926137   557 raft_consensus.cc:1240] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:44.974313   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 220486us
I20260709 13:13:44.976640   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:44.980118   484 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:44.886432  3565 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:44.992969   525 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:44.997118   479 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:45.000099   525 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:45.003543   525 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:45.007674   552 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:44.947899  3400 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:45.001690   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:44.874020  3204 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:45.013258  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:45.014642  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:45.036652  1172 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:45.036983   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:45.014854   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.038376   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:44.976755   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:45.015661   551 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
W20260709 13:13:45.020359   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 497131us
I20260709 13:13:45.040369   448 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:45.020789   626 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:13:45.022729   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:44.887398  3310 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:44.993125  3574 log.cc:927] Time spent T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:13:45.026846   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:45.027565   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:45.018770   553 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:45.016248   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.039016   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:45.041718   597 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:45.041945   631 raft_consensus.cc:2393] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:45.038967   625 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:44.898514  3347 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:45.046984   633 raft_consensus.cc:1240] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:45.072732   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.042919   556 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:45.079919   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:45.071681   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 58229.3us
I20260709 13:13:45.047020   624 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:13:45.076934   482 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:45.076771   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.083133   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.083868   626 raft_consensus.cc:2410] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:13:45.084643   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:44.998759  3472 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.011601  3565 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:45.077842   483 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:45.012778  3416 raft_consensus.cc:2764] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:13:45.086627  3464 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:45.088121  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:45.088552  3549 consensus_queue.cc:1059] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:45.117527  3464 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:45.120388  1141 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:45.121673  1141 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:45.122705  3496 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:45.124199  3510 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:45.123169  3496 raft_consensus.cc:697] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:45.128974  3496 consensus_queue.cc:237] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:45.089440  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:45.089926   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.132108  3310 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:45.132725  3310 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.133119   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.133358   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.133876   633 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:45.090597  1172 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:45.071614  3516 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:45.092449  3580 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:45.139981   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:45.094162  3347 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:45.095755   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 55473us
I20260709 13:13:45.140599   475 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:45.097438   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 55792.3us
I20260709 13:13:45.097960   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.098590   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:45.047678   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.077229   557 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:45.045867   484 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:45.143253   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:44.936312  3579 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:45.103549   552 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:13:45.026801  3545 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:45.102662   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:45.106040  3534 log.cc:927] Time spent T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 1.472s	user 0.000s	sys 0.011s
I20260709 13:13:45.103778   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.108914   525 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:45.109731  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 465590us
I20260709 13:13:45.027405  3524 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:45.110845   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:45.115491   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:45.115867  3417 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:45.116593   558 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1726) took 2254 ms (client timeout 2841 ms). Trace:
I20260709 13:13:45.046782  3513 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:45.155879   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:45.196458   476 raft_consensus.cc:2410] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:13:45.196700   478 raft_consensus.cc:2393] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:45.198068   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.199213  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:45.201840   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:45.202467   479 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:45.100593  3585 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:45.205255   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:45.209252   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:45.103052  3565 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:45.213176   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.213137   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:45.213806  1138 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:45.213825   632 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:45.177762   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:45.162009   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 203227us
I20260709 13:13:45.178566   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:45.187634   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:45.216428  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:45.216802   559 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:45.191892   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 86644.6us
I20260709 13:13:45.203456   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:45.203900   633 raft_consensus.cc:2393] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:45.204358   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.206954  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:45.137470  3541 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:45.240573   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:45.102509  3472 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:45.203521   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.204360  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:45.246855   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:45.188277  3488 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.215958   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:45.193534   558 rpcz_store.cc:269] 0709 13:13:42.861781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.900744 (+ 38963us) service_pool.cc:224] Handling call
0709 13:13:45.116396 (+2215652us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54001f27d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:45.116516 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3204529920}
I20260709 13:13:45.210362   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:45.221007  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:45.243714   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.245553   479 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:45.197204  3524 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.254350   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:45.282871   482 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:45.253512   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:45.139772  3310 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:45.202207  3287 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:45.285537   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.212318  3363 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:13:45.251772   625 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:45.177235  3312 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:13:45.195909  3581 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:45.208461  3585 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:45.197461  3169 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:13:45.248657  3490 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:45.309711   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:45.333683   484 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
W20260709 13:13:45.310997   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 120977us
I20260709 13:13:45.312645   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.335929   625 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:45.312774   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:45.313575   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.195344  3416 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:45.218255  3565 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:45.280735   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:45.354315   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:45.354693   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.285983  3524 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:45.314504   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 172705us
I20260709 13:13:45.317497   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:45.318055   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.196413  3545 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:45.291954   522 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:45.206745  3513 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:45.334278   482 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:13:45.338398   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.253451  3579 raft_consensus.cc:697] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:45.239485  3464 consensus_queue.cc:1059] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:13:45.345314   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.290463  3488 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:45.703266   625 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:45.572693   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:45.285888  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:45.239609  3503 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:45.361565   475 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:45.404965   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.674183   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:45.435922   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:45.389528   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:45.504765   523 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:45.362859   559 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:45.380970   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:45.714934   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:45.715075   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.715719   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:45.317169  3362 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:45.362135   476 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:45.709437  3312 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:13:45.716967  3462 consensus_meta.cc:287] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.968s	user 0.011s	sys 0.000s
W20260709 13:13:45.707960   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 279336us
I20260709 13:13:45.476891   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:45.743731   481 raft_consensus.cc:2410] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:45.715961   632 raft_consensus.cc:2393] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 8: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:13:45.390328   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 54425.5us
I20260709 13:13:45.743866   448 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:45.671813  3604 log.cc:927] Time spent T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
W20260709 13:13:45.412936  3000 consensus_meta.cc:287] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.609s	user 0.005s	sys 0.004s
I20260709 13:13:45.720322   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:45.746254   633 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:45.621644  3516 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:45.388496  3580 raft_consensus.cc:697] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:45.457928  3564 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:45.725947   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 434050us
W20260709 13:13:45.726289   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 221647us
I20260709 13:13:45.729614   479 raft_consensus.cc:1240] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:45.329519  3585 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:45.471885  3597 log.cc:927] Time spent T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:13:45.327545  3581 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:45.388720  3555 log.cc:927] Time spent T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 1.187s	user 0.002s	sys 0.010s
I20260709 13:13:45.345916  3416 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:45.482923  3494 consensus_meta.cc:287] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.710s	user 0.007s	sys 0.003s
I20260709 13:13:45.725466   555 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:45.716779   557 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:45.731850   447 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:45.520761  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 306996us
W20260709 13:13:45.469506  3128 consensus_meta.cc:287] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.574s	user 0.004s	sys 0.004s
W20260709 13:13:45.468930  3586 log.cc:927] Time spent T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 13:13:45.426833   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:45.738070   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:45.478983  3417 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:45.312182  3287 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:45.560091  3510 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:45.741601   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.327154  3515 consensus_queue.cc:1059] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.405s
I20260709 13:13:45.716900   552 raft_consensus.cc:2393] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:45.745397   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:45.477861  3472 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:45.353852  3490 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:45.795045  1139 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.029s	sys 0.033s
W20260709 13:13:45.841655  1139 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.032s	sys 0.056s
I20260709 13:13:45.783859   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.750577   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.788018   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:45.747126   448 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:45.844254   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 112486us
I20260709 13:13:45.845196   447 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:45.846109   552 raft_consensus.cc:1240] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:13:45.846589   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 101262us
I20260709 13:13:45.846902   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:45.848316   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:45.850108   632 raft_consensus.cc:2393] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 8: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:45.850558   479 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:13:45.852694   597 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:45.855047  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:45.852582   633 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:13:45.737919  3400 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:45.737350  3305 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:13:45.757297  3496 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.020s	sys 0.012s
I20260709 13:13:45.862857   482 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:45.866439  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:45.864585  1172 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:45.865257   479 raft_consensus.cc:1240] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:45.778770  3310 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:45.794683  3549 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.762894  3575 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:45.869277   624 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:45.851274  3416 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:45.870289  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:45.870693  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:45.865963  3496 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.038s	sys 0.035s
I20260709 13:13:45.879999   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:45.857681  3519 raft_consensus.cc:2804] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:45.853643  3352 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:45.876718   555 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:45.748792  3312 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:45.879293   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 414) took 1371 ms. Trace:
I20260709 13:13:45.873250   553 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:45.856794  3363 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:45.764062  3514 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 13:13:45.882010   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.851847  3128 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:45.763736  3520 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 13:13:45.885841   477 rpcz_store.cc:276] 0709 13:13:44.507409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.507566 (+   157us) service_pool.cc:224] Handling call
0709 13:13:44.554435 (+ 46869us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:44.679884 (+125449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:44.679914 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:44.688585 (+  8671us) log.cc:844] Serialized 26 byte log entry
0709 13:13:45.021154 (+332569us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:45.021210 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.021290 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:45.879060 (+857770us) raft_consensus.cc:1685] finished
0709 13:13:45.879081 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:45.879215 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":72214,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":16470,"thread_start_us":440178,"threads_started":2,"wal-append.queue_time_us":393639}
W20260709 13:13:45.886443   598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.019s	sys 0.026s
I20260709 13:13:45.764668  3462 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:45.863940  3305 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:45.762346  3000 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:45.876942  3565 consensus_meta.cc:287] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 13:13:45.889667   555 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:45.880317   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:45.892161  1175 raft_consensus.cc:1240] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:13:45.894830   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.856413  3494 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:45.859668  3564 consensus_queue.cc:1059] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:13:45.896643   598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.019s	sys 0.027s
I20260709 13:13:45.896660   557 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:13:45.905370   483 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:45.905539  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:45.906329  1168 raft_consensus.cc:2410] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:13:45.874404  3608 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:45.909587   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:45.884548  3519 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:45.874038  3579 consensus_queue.cc:237] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:45.908748   627 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:13:45.891017  3602 log.cc:927] Time spent T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 13:13:45.893234  3352 raft_consensus.cc:697] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:45.901469  3305 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:45.917337   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.917934  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:45.878038  3549 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:45.918641   556 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:45.924543  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:45.911556  3603 log.cc:927] Time spent T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:13:45.926064   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.926709   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.892791  3363 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:45.909322  3286 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:45.909993  3608 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.915921  3519 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:45.933351   630 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:45.934142   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.916882  3525 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:45.939790   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:45.944249   626 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:45.945549   626 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:45.938647  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:45.942206   627 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:45.904825  3565 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:45.947309  1175 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:45.926039  3488 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:45.931394  3545 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:45.960563   633 raft_consensus.cc:1275] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:45.967850   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1636) took 1039 ms. Trace:
I20260709 13:13:45.932265  3347 raft_consensus.cc:3055] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:45.988257   476 raft_consensus.cc:1240] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:45.969491   597 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:45.968454   478 rpcz_store.cc:276] 0709 13:13:44.928070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.725831 (+797761us) service_pool.cc:224] Handling call
0709 13:13:45.758151 (+ 32320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:45.899394 (+141243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:45.899425 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:45.899463 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:45.899494 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.967538 (+ 68044us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400131354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:45.967607 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:45.967763 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324216704}
I20260709 13:13:45.979116   624 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:45.935892  3503 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:45.903900  3580 consensus_queue.cc:237] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:46.014523   599 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:46.018153   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:46.014667   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:46.025068   629 raft_consensus.cc:1240] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:45.936399  3286 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:13:46.029578   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 60222.7us
I20260709 13:13:45.942512  3608 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:46.031762   559 raft_consensus.cc:1240] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:46.031690   599 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:46.032511   627 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:46.028728  3615 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:13:46.046550   554 raft_consensus.cc:1240] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:45.988683  3347 raft_consensus.cc:740] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:46.056492  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:13:46.056754   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 213748us
I20260709 13:13:46.028371  3286 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:46.062043  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 219781us
I20260709 13:13:46.033840  3609 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:46.041671  3541 raft_consensus.cc:2749] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:46.063882   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 220933us
I20260709 13:13:46.049955  3490 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:46.077241   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 232118us
I20260709 13:13:46.049571  3287 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:46.061661  3204 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:46.072206  3494 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:46.087116   522 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:46.038802  3352 consensus_queue.cc:237] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:46.084750   523 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:46.091421  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:46.072693  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:46.089155   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 57539.1us
I20260709 13:13:46.117542   599 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:46.085211   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 338162us
I20260709 13:13:46.086766   447 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:46.104895  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 250088us
I20260709 13:13:46.092653  3312 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:46.093071  3589 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:46.088068  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:46.123066   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:46.121362   447 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:46.106541  3462 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:46.111771  3000 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:46.129396   599 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:46.113144  3128 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:46.115903  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:46.132036  3613 log.cc:927] Time spent T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:13:46.142444   447 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:46.126062  3525 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.125547  3520 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:46.160534   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 54903.5us
W20260709 13:13:46.162011   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 44642.8us
I20260709 13:13:46.164577   523 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:46.096961  3347 consensus_queue.cc:260] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:46.135076  3494 raft_consensus.cc:2804] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:46.166949   522 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:46.168269   599 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:46.172405   523 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:46.174897   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 51856.6us
I20260709 13:13:46.140208  3589 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:46.134999  3503 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.137351  3607 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:46.182256   447 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:13:46.186394  3400 consensus_queue.cc:1175] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6e6df7e8ed204f1db5c371536b5b0683" responder_term: 8 status { last_received { term: 4 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:46.194316  3607 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:46.157567  1167 raft_consensus.cc:2393] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:46.179736  3629 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:46.187493   448 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:46.188287   599 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:46.161628  3549 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:46.179602  3312 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:46.177106  3315 raft_consensus.cc:3055] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:46.176669  3363 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:46.178870  3618 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:46.212384   447 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:46.182451  3169 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:13:46.222316   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 55774.4us
I20260709 13:13:46.183467  3565 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:46.167688  3525 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:46.185760  3575 raft_consensus.cc:2749] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:46.221495   448 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:46.189574  3347 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:46.185271  3619 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:46.204141  3462 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:46.225366   522 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:46.228528  3637 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:46.226838  3633 consensus_queue.cc:1059] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:13:46.251699  3618 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:46.226096   628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1560) took 1200 ms. Trace:
I20260709 13:13:46.218808  3315 raft_consensus.cc:740] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:46.217862  1170 raft_consensus.cc:2410] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:13:46.204722  3494 raft_consensus.cc:697] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:46.264673   522 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:46.283390   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1755) took 1286 ms. Trace:
I20260709 13:13:46.213299  3312 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:46.214444  3605 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:13:46.285666   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 113322us
I20260709 13:13:46.276489   628 rpcz_store.cc:276] 0709 13:13:45.025914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.101440 (+ 75526us) service_pool.cc:224] Handling call
0709 13:13:45.101707 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:45.310842 (+209135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:45.310868 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:45.330115 (+ 19247us) log.cc:844] Serialized 26 byte log entry
0709 13:13:45.740643 (+410528us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:45.740683 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.972372 (+231689us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400051ed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:45.972437 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:46.220425 (+247988us) raft_consensus.cc:1685] finished
0709 13:13:46.220446 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:46.226017 (+  5571us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81794,"raft.queue_time_us":17267,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":10072,"spinlock_wait_cycles":444169472,"thread_start_us":311480,"threads_started":1,"wal-append.queue_time_us":538874}
I20260709 13:13:46.279476  3462 raft_consensus.cc:697] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:46.289111  3632 log.cc:927] Time spent T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:13:46.289875  3462 consensus_queue.cc:237] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:46.256536  3000 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:46.220021  3629 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:46.206856  3503 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:46.287628  3633 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:46.287856  3312 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:46.276453  3618 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:46.288268  3565 raft_consensus.cc:3055] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:46.271427   599 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:46.292407   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1757) took 1148 ms. Trace:
I20260709 13:13:46.293628   522 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:46.304550   559 rpcz_store.cc:276] 0709 13:13:45.143699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.732501 (+588802us) service_pool.cc:224] Handling call
0709 13:13:45.732866 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:46.036740 (+303874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.292180 (+255440us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b5400228654. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:46.292351 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":686949632}
I20260709 13:13:46.305485   522 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:46.234951  3541 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:13:46.284030   551 rpcz_store.cc:276] 0709 13:13:44.996877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.129414 (+132537us) service_pool.cc:224] Handling call
0709 13:13:45.129691 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:45.129864 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:45.908869 (+779005us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b18002640a0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b67fc14bc 00007f4b6530f48b 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b65329455 00007f4b6be113c7 00007f4b684239a7 00007f4b684330bf
0709 13:13:45.912224 (+  3355us) log.cc:844] Serialized 14 byte log entry
0709 13:13:46.268081 (+355857us) log.cc:844] Serialized 14 byte log entry
0709 13:13:46.268248 (+   167us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:46.283016 (+ 14768us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:46.283066 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.283136 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:46.283330 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12195,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":5027,"raft.queue_time_us":17538,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":5149,"spinlock_wait_cycles":11432832,"thread_start_us":469776,"threads_started":4,"wal-append.queue_time_us":310715}
I20260709 13:13:46.306878  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:46.286618  3607 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:46.223666  3549 consensus_queue.cc:1059] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:13:46.284226  3204 consensus_queue.cc:1059] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:13:46.316323  3541 raft_consensus.cc:3055] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:46.316700  3541 raft_consensus.cc:740] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:46.317492  3636 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:46.317459  3541 consensus_queue.cc:260] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:46.318763  3541 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:46.297685  3629 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.320937  3629 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:46.322466  3585 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:46.298452  3619 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:46.323411  3619 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:46.323817  3619 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:46.326406  3524 consensus_meta.cc:287] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.607s	user 0.003s	sys 0.006s
I20260709 13:13:46.310606  3605 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:46.329919  3605 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.330565  3605 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:46.334692   597 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:46.329960  3315 consensus_queue.cc:260] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:46.309363  3565 raft_consensus.cc:740] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:46.339372  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:46.342445  1169 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:13:46.342994  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:46.343740  3549 raft_consensus.cc:3055] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:13:46.344069   624 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1575) took 1189 ms (client timeout 1511 ms). Trace:
I20260709 13:13:46.344266  3494 consensus_queue.cc:237] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:46.345597   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1728) took 1246 ms. Trace:
I20260709 13:13:46.360656   476 rpcz_store.cc:276] 0709 13:13:45.098969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.734105 (+635136us) service_pool.cc:224] Handling call
0709 13:13:45.988082 (+253977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:45.988788 (+   706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.345401 (+356613us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54002dd550. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:46.345539 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":583253376}
I20260709 13:13:46.346243  3525 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:46.349856  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:46.349936   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:46.362589   554 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:46.350221   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:46.315116   522 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:46.363883   554 raft_consensus.cc:1240] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:46.364472   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 49437.6us
I20260709 13:13:46.365477  3525 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:46.365628  3633 consensus_queue.cc:1059] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:46.366482   625 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:46.367100  3637 raft_consensus.cc:3055] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:46.367489  3637 raft_consensus.cc:740] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:46.364494  3503 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:46.351616   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:46.353518   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:46.368285  3000 consensus_queue.cc:1048] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:46.370908   480 raft_consensus.cc:1240] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:46.372807  3585 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:46.375952  3608 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:46.377156   626 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:46.359939  3549 raft_consensus.cc:740] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:46.355070  3416 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:46.387077  3619 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:46.388510  3416 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:46.389199  3619 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:46.389410   558 raft_consensus.cc:2368] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9.
I20260709 13:13:46.351140  3639 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:46.392572  3639 raft_consensus.cc:697] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:46.393725  3582 raft_consensus.cc:3055] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:46.393534  3639 consensus_queue.cc:237] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:46.394107  3582 raft_consensus.cc:740] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:46.308957  3618 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:46.326834  3524 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:46.354784   597 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:46.377688   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:46.359093   624 rpcz_store.cc:269] 0709 13:13:45.154778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.188592 (+ 33814us) service_pool.cc:224] Handling call
0709 13:13:46.343887 (+1155295us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54000523d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:46.344009 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1506881664}
I20260709 13:13:46.381345  3315 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:46.385134  3565 consensus_queue.cc:260] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:46.359093  3614 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:46.368290  3637 consensus_queue.cc:260] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:46.356038  3286 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:46.418120   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:46.434701   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 80009.7us
I20260709 13:13:46.441759   551 raft_consensus.cc:2393] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 6: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:46.444554   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:46.420770  3605 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:46.445923   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:46.447507   550 raft_consensus.cc:2368] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8.
I20260709 13:13:46.447604  3605 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:46.435782   597 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:46.422520  3617 log.cc:927] Time spent T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:13:46.452607   633 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:46.452996   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:46.453389  3547 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:46.453876  3513 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:46.453832  3547 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:46.454556  3547 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:46.457152  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:46.410308  3549 consensus_queue.cc:260] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:46.460070  3549 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:46.463423  3637 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:46.406193  3582 consensus_queue.cc:260] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:46.469457  3582 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:46.469659   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1754) took 1271 ms. Trace:
I20260709 13:13:46.470072   553 rpcz_store.cc:276] 0709 13:13:45.215828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.887005 (+671177us) service_pool.cc:224] Handling call
0709 13:13:45.898188 (+ 11183us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:45.898440 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:45.898457 (+    17us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:45.902386 (+  3929us) log.cc:844] Serialized 52 byte log entry
0709 13:13:46.046322 (+143936us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:46.046382 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.046475 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:46.421845 (+375370us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:46.465283 (+ 43438us) raft_consensus.cc:1685] finished
0709 13:13:46.465304 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:46.469600 (+  4296us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":3364,"spinlock_wait_cycles":41467136,"thread_start_us":120639,"threads_started":1,"wal-append.queue_time_us":266590}
I20260709 13:13:46.471336  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:46.472724  3581 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:46.450243  3519 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:46.475593  3524 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:46.478852   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1680) took 1371 ms. Trace:
I20260709 13:13:46.492341   626 rpcz_store.cc:276] 0709 13:13:45.107221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.952632 (+845411us) service_pool.cc:224] Handling call
0709 13:13:45.952964 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:46.381997 (+429033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.478620 (+ 96623us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b54002bcad4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:46.478794 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975046016}
I20260709 13:13:46.450631  3629 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:46.480965  3286 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:46.482839   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1749) took 1575 ms. Trace:
I20260709 13:13:46.419060  3541 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.491570  1166 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:46.495973   556 rpcz_store.cc:276] 0709 13:13:44.907132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.086796 (+179664us) service_pool.cc:224] Handling call
0709 13:13:45.087056 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:45.926679 (+839623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.482590 (+555911us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54001d6854. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:46.482779 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1911990016}
I20260709 13:13:46.467972   597 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:46.445505  3580 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:46.391566  3305 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:46.497466   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 130026us
I20260709 13:13:46.451723  3614 raft_consensus.cc:697] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:46.486802  3312 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:46.501272   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:46.493844  3565 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:46.449035  3503 consensus_queue.cc:1059] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:13:46.463460  3547 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:46.505810   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:46.506695   554 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:13:46.508948   552 raft_consensus.cc:1240] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:46.509052   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:46.510042   553 raft_consensus.cc:2410] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:13:46.511756   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:46.498209  3352 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:46.515455   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:46.521813   551 raft_consensus.cc:1240] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:46.502918  3580 raft_consensus.cc:697] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:46.525518   553 raft_consensus.cc:1240] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:46.527874  3312 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:46.531525  3286 consensus_queue.cc:1059] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:46.532560  3629 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:46.541957   550 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1750) took 1616 ms (client timeout 1817 ms). Trace:
I20260709 13:13:46.499250  3541 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:46.552390   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:46.553228   555 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:46.542603   550 rpcz_store.cc:269] 0709 13:13:44.925637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.977539 (+ 51902us) service_pool.cc:224] Handling call
0709 13:13:46.541684 (+1564145us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400388454. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:46.541874 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3261350784}
I20260709 13:13:46.550230   597 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:46.555820   551 raft_consensus.cc:1240] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:46.535084  3519 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:46.561192   553 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:13:46.569126   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:46.573137  1139 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:46.580257  1139 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:46.582727   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:46.583933   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.576732   522 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:46.576896   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:46.566077   624 raft_consensus.cc:2393] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:46.574239   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:46.585228  1139 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:46.588793  1139 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:46.590891  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:46.592365  1139 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:46.593652   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:46.594213   630 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:46.595530   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:46.596575   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:46.564884  3286 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:46.597227   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:46.599699   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:46.617937   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:46.619170   626 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:46.604462   555 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
I20260709 13:13:46.621178  1139 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:46.609695   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:46.622008  3496 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:46.536542  3614 consensus_queue.cc:237] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:46.625751   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:46.628415   626 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:13:46.583060  3494 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:46.628633   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:46.587308  3503 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:46.647496   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.630118   626 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:13:46.609305  3608 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:46.633225   597 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:46.625025  3286 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.660410  3494 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:46.587977  3639 consensus_queue.cc:1059] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:13:46.568174  3472 consensus_queue.cc:1059] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:13:46.599850  3363 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:46.595875  3610 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:46.590917  3627 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:46.592840  3362 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:13:46.629146  3643 log.cc:927] Time spent T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:13:46.690287  3362 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.690757  3362 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:46.694985   554 raft_consensus.cc:2410] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:13:46.617844  3611 consensus_queue.cc:1059] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:13:46.700246  3611 raft_consensus.cc:3055] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:46.700609  3611 raft_consensus.cc:740] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:46.583582  3287 consensus_queue.cc:1059] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 13:13:46.596587  3463 consensus_queue.cc:1059] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:13:46.627897  3496 raft_consensus.cc:697] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:46.627503  3636 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:13:46.682881  3648 log.cc:927] Time spent T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:13:46.683794  3646 log.cc:927] Time spent T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:13:46.687709  3647 log.cc:927] Time spent T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:13:46.721096  1175 raft_consensus.cc:2410] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:13:46.675276  3204 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:46.675135  3286 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:46.743501   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1746) took 1553 ms. Trace:
I20260709 13:13:46.745744  3516 raft_consensus.cc:3055] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:46.746162  3516 raft_consensus.cc:740] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:46.722930   629 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:13:46.748327   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 364) took 1466 ms. Trace:
I20260709 13:13:46.748699   633 rpcz_store.cc:276] 0709 13:13:45.281760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.962407 (+680647us) service_pool.cc:224] Handling call
0709 13:13:45.962669 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:46.452999 (+490330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.748083 (+295084us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b5400023354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:46.748267 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1126300928}
I20260709 13:13:46.749784   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1683) took 1641 ms. Trace:
I20260709 13:13:46.750490   630 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:46.751332  3496 consensus_queue.cc:237] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:46.756912   559 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:46.743938   552 rpcz_store.cc:276] 0709 13:13:45.189851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.847054 (+657203us) service_pool.cc:224] Handling call
0709 13:13:45.847377 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:46.509490 (+662113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.743213 (+233723us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b54001c9b54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:46.743426 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521073920}
I20260709 13:13:46.622953  3621 consensus_queue.cc:1059] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.127s
I20260709 13:13:46.737332  3305 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:46.750172   625 rpcz_store.cc:276] 0709 13:13:45.108573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.960222 (+851649us) service_pool.cc:224] Handling call
0709 13:13:45.960591 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:46.366856 (+406265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.749571 (+382715us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54002e77d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:46.749728 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":933046016}
I20260709 13:13:46.658049  3580 consensus_queue.cc:237] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:46.735993  3636 raft_consensus.cc:697] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:13:46.765475  3630 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.515s	user 0.000s	sys 0.003s
I20260709 13:13:46.760351  3547 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:46.746986  3516 consensus_queue.cc:260] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:46.803678  3649 log.cc:927] Time spent T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:13:46.804416   523 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:46.848697   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 179610us
I20260709 13:13:46.803059  3362 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:46.854647  3362 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:46.858381  3564 raft_consensus.cc:3055] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:46.858827  3564 raft_consensus.cc:740] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:13:46.859007  1166 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 502) took 1643 ms (client timeout 1618 ms). Trace:
W20260709 13:13:46.859436  1166 rpcz_store.cc:269] 0709 13:13:45.215608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.216166 (+   558us) service_pool.cc:224] Handling call
0709 13:13:46.858824 (+1642658us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400600254. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:46.858936 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2893603072}
I20260709 13:13:46.863704  1174 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:46.844524  3633 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:46.851373  3516 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:46.845041  3286 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:46.878824   558 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1760) took 1560 ms (client timeout 1840 ms). Trace:
W20260709 13:13:46.881134   558 rpcz_store.cc:269] 0709 13:13:45.318844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.716768 (+397924us) service_pool.cc:224] Handling call
0709 13:13:46.878667 (+1161899us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b540031abd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:46.878775 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1260158848}
I20260709 13:13:46.881500  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:46.868510  3541 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:46.885890   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1729) took 1784 ms. Trace:
I20260709 13:13:46.886299   481 rpcz_store.cc:276] 0709 13:13:45.101702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.749498 (+647796us) service_pool.cc:224] Handling call
0709 13:13:45.749923 (+   425us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:45.776010 (+ 26087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:45.776058 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:45.804064 (+ 28006us) log.cc:844] Serialized 52 byte log entry
0709 13:13:46.103041 (+298977us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:46.103079 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.103144 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:46.764835 (+661691us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:46.880286 (+115451us) raft_consensus.cc:1685] finished
0709 13:13:46.880312 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:46.885814 (+  5502us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5663,"raft.queue_time_us":6000,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":15047,"spinlock_wait_cycles":37586304,"thread_start_us":236921,"threads_started":1,"wal-append.queue_time_us":396171}
I20260709 13:13:46.865329  3549 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:13:46.899048  3286 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:46.899612  3286 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:46.900058  3286 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:46.902050  3286 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:46.902801   628 raft_consensus.cc:2393] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 8: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:46.903658   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:46.903834  3621 consensus_queue.cc:1059] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:46.904726  3464 raft_consensus.cc:3055] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:46.904897   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:46.905113  3464 raft_consensus.cc:740] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:46.905695  1169 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:13:46.905983  3464 consensus_queue.cc:260] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:46.907477  3464 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:46.891966  3655 raft_consensus.cc:3055] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:46.892930  3618 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:46.908342  3655 raft_consensus.cc:740] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:46.909511  3655 consensus_queue.cc:260] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:46.910205  3618 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:46.911331   555 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:46.876765  3636 consensus_queue.cc:237] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:46.915052   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.895612  3494 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:46.926002   625 raft_consensus.cc:1240] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:46.923846   554 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:13:46.925359   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 429) took 1356 ms. Trace:
I20260709 13:13:46.911002  3655 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:46.940364   476 raft_consensus.cc:1240] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:46.928212   554 pending_rounds.cc:85] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 7
I20260709 13:13:46.940860   554 pending_rounds.cc:107] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:13:46.941111   554 raft_consensus.cc:2889] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:46.928288   480 rpcz_store.cc:276] 0709 13:13:45.569164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.897841 (+328677us) service_pool.cc:224] Handling call
0709 13:13:45.898082 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:46.371352 (+473270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.925157 (+553805us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54000d75d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:46.925306 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1086998272}
I20260709 13:13:46.929558   559 raft_consensus.cc:1275] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:46.931193   552 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:46.942956   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:46.944144   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:46.945515   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:46.946305   483 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:46.931380  3520 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:46.932242   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1741) took 1645 ms. Trace:
I20260709 13:13:46.957017   482 rpcz_store.cc:276] 0709 13:13:45.286884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.867619 (+580735us) service_pool.cc:224] Handling call
0709 13:13:45.867862 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:45.868045 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:46.096273 (+228228us) log.cc:844] Serialized 14 byte log entry
0709 13:13:46.216107 (+119834us) log.cc:844] Serialized 14 byte log entry
0709 13:13:46.931908 (+715801us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:46.931957 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:46.932004 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.932084 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:46.932189 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1466633,"prepare.queue_time_us":292083,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":90,"raft.queue_time_us":718741,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":4928,"thread_start_us":301134,"threads_started":2,"wal-append.queue_time_us":180271}
W20260709 13:13:46.932917   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 720584us
I20260709 13:13:46.959859   447 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:46.933597  3515 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:46.934139  3310 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:46.935938  3564 consensus_queue.cc:260] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:46.963413  3564 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:46.854589  3611 consensus_queue.cc:260] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:46.937777  3621 consensus_queue.cc:1059] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:46.968051  3621 raft_consensus.cc:3055] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:46.968421  3621 raft_consensus.cc:740] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
W20260709 13:13:46.939394   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 717896us
I20260709 13:13:46.969424  3621 consensus_queue.cc:260] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:46.970696  3621 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:46.977540   556 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:46.978680   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:46.979589   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:46.979697   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:46.980930   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:46.981374   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:46.982344   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:46.982547   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:46.983076   554 raft_consensus.cc:2393] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 5: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:46.983348   550 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:46.951488   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:46.985052   479 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:46.984999   556 raft_consensus.cc:2393] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 8: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:46.937672   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:46.952389   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:46.991353   447 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:46.993645   483 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:46.996469   551 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:46.997491   477 raft_consensus.cc:1275] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:46.998878  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:46.999570  1166 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:13:47.000981  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:47.001677  1173 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:47.003747   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:47.005363   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:47.005656   448 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:47.005654   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:47.007422   482 raft_consensus.cc:1240] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:47.010761  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:47.011721  1166 raft_consensus.cc:2393] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 7: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:47.012633   447 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:47.015864  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:47.016455   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:47.017381   553 raft_consensus.cc:2393] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 8: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:47.017467  1172 raft_consensus.cc:1240] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:13:47.020840   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:46.962436  3575 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:47.025274  1171 raft_consensus.cc:1240] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:13:47.025679  3516 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:47.026360   477 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:13:47.027647   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:47.031410   557 raft_consensus.cc:1240] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 13:13:47.037214   479 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:47.034783   447 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:47.031793  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:13:47.037703   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 156462us
I20260709 13:13:47.010054  3483 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:47.015882  3519 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:47.017951  3515 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:47.052440   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:47.056084  1141 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:47.025774  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:47.066001   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:47.067458   478 raft_consensus.cc:1240] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:47.068320   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:47.020305  3520 consensus_queue.cc:1059] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:13:47.073730  1168 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:47.074229   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:47.076067   556 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.075381   597 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:47.076336  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 116643us
I20260709 13:13:47.057297  3515 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:47.078843   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:47.082329   479 raft_consensus.cc:3055] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:47.040684  3362 consensus_queue.cc:1059] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:13:47.082679   479 raft_consensus.cc:740] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:13:47.079177   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 44494.5us
I20260709 13:13:47.040460  3496 consensus_queue.cc:1059] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:13:47.084585   597 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:47.114266   557 raft_consensus.cc:1240] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:47.117641   447 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:47.084466   551 raft_consensus.cc:1240] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
W20260709 13:13:47.119141   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 46955us
I20260709 13:13:47.076295  3614 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:47.116868   479 consensus_queue.cc:260] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.126456   448 leader_election.cc:400] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9.
I20260709 13:13:47.126920   448 leader_election.cc:403] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:13:47.126952   479 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:47.130501   550 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:47.113596  3204 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:13:47.119654  3588 consensus_queue.cc:1048] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:13:47.138831  3352 raft_consensus.cc:3055] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:47.139303  3352 raft_consensus.cc:740] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:47.139549  3659 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:13:47.130453  3516 consensus_queue.cc:1175] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" responder_term: 9 status { last_received { term: 8 index: 5 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:47.140185  3659 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.142800  3659 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:47.133335   447 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:47.079981  3549 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:47.145767  3549 raft_consensus.cc:697] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:47.145676  3664 consensus_queue.cc:1059] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:13:47.146173   631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1570) took 2046 ms (client timeout 1555 ms). Trace:
W20260709 13:13:47.146625   631 rpcz_store.cc:269] 0709 13:13:45.099790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.099969 (+   179us) service_pool.cc:224] Handling call
0709 13:13:47.145965 (+2045996us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54001ae5d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:47.146101 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3188278656}
I20260709 13:13:47.146934  3549 consensus_queue.cc:237] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.147356  3128 consensus_queue.cc:1059] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:47.131512  3130 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:13:47.121758  3541 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:47.160176   599 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:47.161489  3611 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:47.163877   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:47.087047  3515 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.172688   556 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:47.080824  3488 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:47.168247   448 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:47.168711   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:47.071520  3519 consensus_queue.cc:1059] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:13:47.176780   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:47.177500   556 raft_consensus.cc:2368] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8.
I20260709 13:13:47.176170   599 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:47.177735   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 44505.5us
I20260709 13:13:47.180369   479 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:47.181124   447 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:47.181417   599 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:47.182755   599 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:47.183686   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:47.080623  3668 consensus_queue.cc:1059] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 13:13:47.184407   484 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.187008   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:47.184268  3286 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:47.188838  3516 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:47.140192  3352 consensus_queue.cc:260] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.189464  3607 raft_consensus.cc:3055] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:47.189558  3352 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:47.190006  3607 raft_consensus.cc:740] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:47.190956  3607 consensus_queue.cc:260] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:47.191416  3585 raft_consensus.cc:3055] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:47.191860  3585 raft_consensus.cc:740] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:47.192679  3585 consensus_queue.cc:260] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.194072  3585 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:47.195788  3668 raft_consensus.cc:3055] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:47.196223  3668 raft_consensus.cc:740] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:47.196949  3668 consensus_queue.cc:260] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.198132  3668 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:47.199544  3513 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:47.200958   448 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:47.184486   599 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:47.186720   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:47.202757   448 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:47.205574   448 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:47.206954   447 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:47.207878  1139 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:47.208408   481 raft_consensus.cc:1240] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:47.142946  3472 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:13:47.174386  3620 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:47.174649  3605 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:47.216007   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:47.216403   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.222651  1141 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:47.224242   522 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:47.217114   625 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:47.240581   447 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:47.241628   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:47.242623   556 raft_consensus.cc:2393] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 9: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:47.246121   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:47.246747   627 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:47.179744  3312 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:47.183503  3614 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:47.257401   629 raft_consensus.cc:1240] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:47.185166  3588 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:47.220834  3362 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:47.262281   476 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:47.202517  3629 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:47.265975   632 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:47.275652   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:47.256712  3130 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:47.266829  3547 consensus_queue.cc:1059] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:13:47.271740   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 47564us
I20260709 13:13:47.284601   522 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:47.272312  3636 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:47.219810  3513 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:47.276808   628 raft_consensus.cc:1240] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:13:47.234601  3581 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:47.295359   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:47.276739   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:47.204612  3128 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:47.280450   625 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:47.310134   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:47.282307   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:47.312016   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:47.313382   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:47.314704   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:47.283113   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:47.283370   480 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:47.315639   477 raft_consensus.cc:2393] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 5: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:47.316022   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:47.317106   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:47.285235   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:47.318660   482 raft_consensus.cc:2376] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7. Re-sending same reply.
I20260709 13:13:47.319482   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:47.306725   522 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:47.320395   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:47.285730   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:47.321372   630 raft_consensus.cc:2368] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9.
I20260709 13:13:47.234767  3514 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:47.220604  3463 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:47.239527  3472 consensus_queue.cc:1243] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer 6e6df7e8ed204f1db5c371536b5b0683 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:13:47.232290  3575 raft_consensus.cc:3055] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:47.337519  3575 raft_consensus.cc:740] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:47.338675  3575 consensus_queue.cc:260] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.279407   525 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:47.339655   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:47.340744   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 61410.5us
I20260709 13:13:47.296769   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:47.344498   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:47.345146   631 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:47.347596  3547 raft_consensus.cc:3055] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:47.348088  3547 raft_consensus.cc:740] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:47.349093  3547 consensus_queue.cc:260] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.350698  3547 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:47.351480   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 60724.3us
I20260709 13:13:47.352712  3618 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:47.355657  3570 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:47.359372  3581 raft_consensus.cc:697] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:47.360497  3581 consensus_queue.cc:237] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.304546   484 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:47.187304  3661 consensus_queue.cc:1048] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:13:47.317562   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:47.318061   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 84029.8us
I20260709 13:13:47.379283   628 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:47.323859   482 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:47.381155   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:47.324834   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:47.326699   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:47.286968  3621 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:47.278847  3204 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:13:47.391098  1174 pending_rounds.cc:85] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: Aborting all ops after (but not including) 6
I20260709 13:13:47.391624  1174 pending_rounds.cc:107] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:13:47.391947  1174 raft_consensus.cc:2889] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:47.392055  3672 log.cc:927] Time spent T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:13:47.262910  3169 consensus_queue.cc:1059] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:13:47.308915  3128 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:47.329314   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:47.323913  3639 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:47.295917  3620 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:47.330349   627 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
W20260709 13:13:47.306396  3628 log.cc:927] Time spent T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 1.138s	user 0.000s	sys 0.005s
I20260709 13:13:47.334095   447 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:47.334359  3514 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:47.369374   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:47.448120   484 raft_consensus.cc:2376] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7. Re-sending same reply.
I20260709 13:13:47.370934   631 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:47.377241   626 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:47.247493  3496 consensus_queue.cc:1059] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
W20260709 13:13:47.451638   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.383005   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:47.452514   477 raft_consensus.cc:2393] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 8: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:47.384260   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:47.452739   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 118741us
I20260709 13:13:47.385380   482 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 5: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:47.386745   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:47.389067   556 raft_consensus.cc:1240] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:47.383657  3621 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:47.395869   625 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:47.441603   624 raft_consensus.cc:1240] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:47.456723   480 raft_consensus.cc:2393] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
W20260709 13:13:47.445031  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 222433us
I20260709 13:13:47.294061  3564 consensus_queue.cc:1059] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:13:47.446282   597 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:47.466562   597 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:47.467003   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.379024  3000 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:47.369702  3513 raft_consensus.cc:697] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:47.378763  3488 raft_consensus.cc:2764] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:13:47.439301  3128 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:47.325054  3305 consensus_queue.cc:1059] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 13:13:47.481422   477 raft_consensus.cc:3055] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:47.465219   447 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:47.552142   477 raft_consensus.cc:740] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:13:47.552772   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 87674.8us
W20260709 13:13:47.493332   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:47.495615  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.444360  3620 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:47.558746  3620 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.454734  3514 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:47.583557  3305 raft_consensus.cc:3055] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:47.584197  3305 raft_consensus.cc:740] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:47.585253  3305 consensus_queue.cc:260] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.586812  3305 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.599730  3513 consensus_queue.cc:237] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:47.612942   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.537387  3608 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:47.448335  3639 raft_consensus.cc:697] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:47.552959   477 consensus_queue.cc:260] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:47.625509   477 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:47.633044  3630 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:13:47.633948  3582 raft_consensus.cc:3055] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:47.634406  3582 raft_consensus.cc:740] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
W20260709 13:13:47.635317  3676 log.cc:927] Time spent T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:13:47.635421  3582 consensus_queue.cc:260] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:47.636896  3582 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:47.636924   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1637) took 2708 ms. Trace:
W20260709 13:13:47.643749  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 47635.1us
I20260709 13:13:47.550267  3000 raft_consensus.cc:697] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:47.640551   475 rpcz_store.cc:276] 0709 13:13:44.928348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.726560 (+798212us) service_pool.cc:224] Handling call
0709 13:13:45.751110 (+ 24550us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:45.775228 (+ 24118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:45.775296 (+    68us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:45.792236 (+ 16940us) log.cc:844] Serialized 52 byte log entry
0709 13:13:46.020982 (+228746us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:46.144036 (+123054us) log.cc:844] Serialized 14 byte log entry
0709 13:13:46.180491 (+ 36455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.180568 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:46.320217 (+139649us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b4800002dd8. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6d342aa1 00007f4b6d339b37 00007f4b6d3399ca 00007f4b6d43126f 00007f4b6d430f37 00007f4b6d44555c 00007f4b6d445508 00007f4b6d445488 00007f4b6d445443 00007f4b6d4446ec 00007f4b6c36ea96
0709 13:13:46.930961 (+610744us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b1800357220. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b652a6c0a 00007f4b6e9e6219 00007f4b6c2ed58f 00007f4b6532c571 00007f4b6532e7c1 00007f4b6532e779 00007f4b6532e709 00007f4b6532e6d1 00007f4b6532d9cd
0709 13:13:47.084704 (+153743us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:47.636648 (+551944us) raft_consensus.cc:1685] finished
0709 13:13:47.636688 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:47.636856 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":690053,"prepare.queue_time_us":185461,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":52188,"raft.run_cpu_time_us":3683,"raft.run_wall_time_us":550474,"spinlock_wait_cycles":48194432,"thread_start_us":257903,"threads_started":2,"wal-append.queue_time_us":276721}
W20260709 13:13:47.659530   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 338200us
I20260709 13:13:47.660878   522 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:13:47.664345   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 458833us
W20260709 13:13:47.665329   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 323318us
I20260709 13:13:47.618175  3605 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 13:13:47.549692   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 76185.5us
I20260709 13:13:47.465165  3621 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:47.456487  3629 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:47.555219   447 leader_election.cc:400] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9.
W20260709 13:13:47.676316   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 122723us
I20260709 13:13:47.554837  3310 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:47.616350   599 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:47.475100  3549 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:47.399782  3580 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:13:47.672699   448 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:47.704896   448 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:47.671876  3564 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:47.707712  3564 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:47.708154  3564 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:47.709641  3519 raft_consensus.cc:3055] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:47.710204  3519 raft_consensus.cc:740] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:47.660828  3516 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:47.673933  3611 consensus_meta.cc:287] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
W20260709 13:13:47.752733   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 136488us
W20260709 13:13:47.736245  3677 log.cc:927] Time spent T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:13:47.733506  3352 consensus_meta.cc:287] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.543s	user 0.005s	sys 0.005s
I20260709 13:13:47.716349  3564 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:47.807483   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 59898.3us
W20260709 13:13:47.735630  3675 log.cc:927] Time spent T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:13:47.817207  3516 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:47.816992   447 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:47.819114  1173 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:13:47.712894  3633 raft_consensus.cc:3055] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:47.760843  3579 raft_consensus.cc:3055] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:47.819639  1173 pending_rounds.cc:85] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683: Aborting all ops after (but not including) 4
I20260709 13:13:47.678252  3169 consensus_queue.cc:1059] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:13:47.829149  3169 raft_consensus.cc:3055] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:47.829487  3169 raft_consensus.cc:740] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:47.818252  3629 consensus_queue.cc:1059] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:13:47.830562  3629 raft_consensus.cc:3055] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:47.830256  3169 consensus_queue.cc:260] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:47.830906  3629 raft_consensus.cc:740] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:13:47.822479  1175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36724 (request call id 433) took 1751 ms (client timeout 2223 ms). Trace:
W20260709 13:13:47.831437  1175 rpcz_store.cc:269] 0709 13:13:46.071317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.071440 (+   123us) service_pool.cc:224] Handling call
0709 13:13:46.456978 (+385538us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:47.818543 (+1361565us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54004439d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:47.822385 (+  3842us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":607477760}
I20260709 13:13:47.832705  3169 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:47.837019  3564 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:47.838397   484 raft_consensus.cc:1240] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:47.826280   447 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:47.750667  3520 raft_consensus.cc:2749] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:47.825238  1173 pending_rounds.cc:107] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:13:47.840276  1173 raft_consensus.cc:2917] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:13:47.840703  1173 raft_consensus.cc:2889] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:47.840413  3629 consensus_queue.cc:260] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.841296  1173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:50818 (request call id 8) took 5386 ms. Trace:
W20260709 13:13:47.842599  3668 consensus_meta.cc:287] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.644s	user 0.008s	sys 0.003s
I20260709 13:13:47.841606  1173 rpcz_store.cc:276] 0709 13:13:42.455266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.455391 (+   125us) service_pool.cc:224] Handling call
0709 13:13:42.785500 (+330109us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b4c003c8a00. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b666e5a20 00007f4b666f6a29 00007f4b666bc644 00007f4b666e3f2d 00007f4b666e3b93 00007f4b683721af 00007f4b68371f3e 00007f4b683f7888 00007f4b6841475c 00007f4b6841576a 00007f4b6841491b
0709 13:13:42.827648 (+ 42148us) log.cc:844] Serialized 501 byte log entry
0709 13:13:44.113261 (+1285613us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b18003d69c0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b652a6c0a 00007f4b6e9e6219 00007f4b6532ea40 00007f4b653294e4 00007f4b65329455 00007f4b68372b0b 00007f4b683f7b63 00007f4b6841f752 00007f4b684179fa
0709 13:13:47.841216 (+3727955us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":779990,"raft.queue_time_us":819306,"raft.run_cpu_time_us":2170,"raft.run_wall_time_us":31315,"spinlock_wait_cycles":127002880,"thread_start_us":380871,"threads_started":1,"wal-append.queue_time_us":874142,"wal-append.run_cpu_time_us":2136,"wal-append.run_wall_time_us":1003448}
I20260709 13:13:47.828356  3516 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:47.844288  3516 raft_consensus.cc:697] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:47.841773  3629 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:47.845187  3516 consensus_queue.cc:237] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.850981   625 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:13:47.851471  3668 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:47.736364  3639 consensus_queue.cc:237] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.852694  3681 consensus_queue.cc:1059] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:47.852490  3668 raft_consensus.cc:697] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:47.854610  3668 consensus_queue.cc:237] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.803424  3286 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:47.711212  3519 consensus_queue.cc:260] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.825109  3579 raft_consensus.cc:740] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:47.855688  3286 raft_consensus.cc:697] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:47.856323  3579 consensus_queue.cc:260] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.856547  3286 consensus_queue.cc:237] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.857440  3579 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:47.859582  3519 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:47.819278  3683 consensus_queue.cc:1059] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:13:47.864874  3589 raft_consensus.cc:3055] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:47.865185  3683 consensus_queue.cc:1243] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:13:47.865291  3589 raft_consensus.cc:740] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:47.865866  3683 raft_consensus.cc:3055] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:47.866225  3589 consensus_queue.cc:260] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.866680  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:47.867336  1168 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.731647  3000 consensus_queue.cc:237] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.867219  3589 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:47.866250  3683 raft_consensus.cc:740] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:47.875694  3683 consensus_queue.cc:260] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.876914  3683 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:47.878785  3654 raft_consensus.cc:3055] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:47.879187  3654 raft_consensus.cc:740] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:47.880033  3654 consensus_queue.cc:260] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:47.881151  3654 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:47.882794  3585 consensus_meta.cc:287] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.688s	user 0.011s	sys 0.000s
I20260709 13:13:47.883597   481 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:13:47.885285   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 182375us
I20260709 13:13:47.886642   525 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:47.887535  1168 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:47.887990   525 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:47.890940   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 186092us
W20260709 13:13:47.894007   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:47.894377   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:47.894824   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.823999  3633 raft_consensus.cc:740] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:13:47.899971   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.897553   525 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:47.903683   525 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:47.891554  3564 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:47.898662  3682 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:47.906999   477 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:13:47.912473   477 pending_rounds.cc:85] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 7
I20260709 13:13:47.912897   477 pending_rounds.cc:107] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:13:47.913341   477 raft_consensus.cc:2889] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:47.909744   525 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:47.915439   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 242392us
I20260709 13:13:47.917906   525 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:47.919627   525 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:47.922448   448 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:47.912793  3312 consensus_meta.cc:287] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.647s	user 0.010s	sys 0.000s
W20260709 13:13:47.917333  3515 consensus_meta.cc:287] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.739s	user 0.005s	sys 0.006s
W20260709 13:13:47.931478  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.935094  3690 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:47.926390  3312 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9.
I20260709 13:13:47.921694  3682 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:47.918874  3503 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:13:47.919450  3564 raft_consensus.cc:2804] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:47.935843  3690 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:47.899835  3620 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:47.925935   366 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4e472c1c82c9467a9a5563d6b06e3b53 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
W20260709 13:13:47.935850  3547 consensus_meta.cc:287] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.585s	user 0.011s	sys 0.001s
I20260709 13:13:47.969656   632 raft_consensus.cc:2410] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:13:47.955628   366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 69245us
I20260709 13:13:47.929216  3689 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:47.919616  3514 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:47.975517   484 raft_consensus.cc:1240] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
W20260709 13:13:47.976253   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 58677.1us
W20260709 13:13:47.977790   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 58249.6us
I20260709 13:13:47.944224  3483 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:47.981192   448 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:47.982857   476 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:13:47.982993   522 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:47.978783   525 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:47.930358  3515 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:47.986395   448 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:47.955595  3564 raft_consensus.cc:697] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:47.988832   479 raft_consensus.cc:1240] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:47.988408   525 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:47.991655  3514 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:47.993284  3515 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:48.000627  3564 consensus_queue.cc:237] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.001487   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:48.002889   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:47.981631  3621 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.003715   633 raft_consensus.cc:2393] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 8: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:48.004523  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:47.926052  3633 consensus_queue.cc:260] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.005137  1167 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:48.005501  3621 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:48.005625  1167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 636) took 1125 ms. Trace:
I20260709 13:13:48.005751  3633 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:48.009920   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.011786   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:48.006104  1167 rpcz_store.cc:276] 0709 13:13:46.880376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.880830 (+   454us) service_pool.cc:224] Handling call
0709 13:13:48.004387 (+1123557us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:48.005575 (+  1188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40249216}
I20260709 13:13:48.011482   448 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:48.012523   633 raft_consensus.cc:2393] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:48.014509   525 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:48.016394   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:48.017046   551 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:48.016932   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:48.018275   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:48.019111  3607 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:48.023307   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:48.025453   525 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:47.987200  3690 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:13:47.989380  3629 raft_consensus.cc:2804] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:48.054797  3629 raft_consensus.cc:697] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:47.990270  3689 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:48.017434  3483 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:48.055720  3629 consensus_queue.cc:237] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.056686   551 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:13:48.053866  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:48.027638   550 raft_consensus.cc:2393] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
W20260709 13:13:48.065594   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.070319   448 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:48.019933  3305 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:48.022557  3682 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:48.063493  3515 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:48.091418   553 raft_consensus.cc:1240] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:48.064181  3700 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:48.064818  3699 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:48.067739  3689 raft_consensus.cc:697] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:48.108764   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:48.077667  3312 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:48.114974  3620 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:48.116248  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:48.116354   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:48.120098  3128 consensus_meta.cc:287] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.000s
I20260709 13:13:48.121244  3689 consensus_queue.cc:237] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.098735  3305 raft_consensus.cc:697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:48.139991  1139 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:48.147746  1139 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:48.142395   633 raft_consensus.cc:1275] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:48.099277  3564 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:48.106616  3515 raft_consensus.cc:697] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:48.145006  3128 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:48.157052   448 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:48.171284   477 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:13:48.141904  3639 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.155046  3490 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:48.157388  3503 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:48.152109  3620 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:48.171665  3312 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:48.176568  3204 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:48.248400   633 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:13:48.233129  3483 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:48.124336  3699 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.246642  3503 raft_consensus.cc:697] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:48.277598  3655 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.180655  3639 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:48.238287  3620 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:48.155356  3682 consensus_queue.cc:1048] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:13:48.290302  3655 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.290436  3660 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:48.335692  3687 log.cc:927] Time spent T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:13:48.260634  3305 consensus_queue.cc:237] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:48.276367  3515 consensus_queue.cc:237] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.259155  3204 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:48.345021  3654 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.392881   632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1720) took 1111 ms. Trace:
I20260709 13:13:48.393471   632 rpcz_store.cc:276] 0709 13:13:47.281244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.317053 (+ 35809us) service_pool.cc:224] Handling call
0709 13:13:48.392468 (+1075415us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b54001e5354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:48.392753 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1186873216}
W20260709 13:13:48.397156   377 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41332 (request call id 156) took 12546 ms (client timeout 15000 ms). Trace:
I20260709 13:13:47.651072 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:48.401036   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 729905us
I20260709 13:13:48.401875   597 leader_election.cc:400] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8.
I20260709 13:13:48.402884  3614 consensus_queue.cc:1059] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:48.403941  3614 raft_consensus.cc:3055] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:48.405318  3614 raft_consensus.cc:740] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:48.406181  3614 consensus_queue.cc:260] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.408006  3614 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:48.410981   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1653) took 1125 ms. Trace:
I20260709 13:13:48.411442   476 rpcz_store.cc:276] 0709 13:13:47.285201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.329035 (+ 43834us) service_pool.cc:224] Handling call
0709 13:13:48.410817 (+1081782us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54000d4dd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:48.410926 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1146900352}
I20260709 13:13:48.402977   597 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:48.414870  3580 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:13:48.418915   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.435436   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1772) took 1153 ms. Trace:
I20260709 13:13:48.430255  1141 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:48.436105   481 rpcz_store.cc:276] 0709 13:13:47.282458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.283670 (+  1212us) service_pool.cc:224] Handling call
0709 13:13:47.283919 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:47.883937 (+600018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.435094 (+551157us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54000d6bd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:48.435352 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1378359040}
I20260709 13:13:48.364840  3660 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:48.380331  3128 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:48.388541  3582 consensus_meta.cc:287] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.751s	user 0.013s	sys 0.001s
I20260709 13:13:48.377952  3629 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:13:48.397650   377 rpcz_store.cc:269] 0709 13:13:35.872594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:35.920826 (+ 48232us) service_pool.cc:224] Handling call
0709 13:13:37.085918 (+1165092us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b54000fbd28. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e60b331 00007f4b6e6063fc 00007f4b6e1d81b4 00007f4b6e2d637e 00007f4b6c7972a4 00007f4b6c797232 00007f4b6c797161 00007f4b6c7970dc 00007f4b6c796392 00007f4b6675448c 00007f4b667538c6
0709 13:13:48.397047 (+11311129us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:44.995723 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:45.213553 (+217830us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:45.217754 (+  4201us) write_op.cc:435] Acquired schema lock
0709 13:13:45.239080 (+ 21326us) tablet.cc:662] Decoding operations
0709 13:13:45.636203 (+397123us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:45.636263 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:45.636300 (+    37us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:13:45.638288 (+  1988us) tablet.cc:701] Row locks acquired
0709 13:13:45.638310 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:13:45.638525 (+   215us) write_op.cc:270] Start()
0709 13:13:45.638674 (+   149us) write_op.cc:276] Timestamp: P: 1783602825638461 usec, L: 0
0709 13:13:45.638709 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:13:45.857294 (+218585us) log.cc:844] Serialized 7810 byte log entry
0709 13:13:46.533459 (+676165us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b18001271e0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6532c3f3 00007f4b6532e7c1 00007f4b6532e779 00007f4b6532e709 00007f4b6532e6d1 00007f4b6532d9cd 000000000038f354 000000000038f199 00007f4b6530f83a
0709 13:13:46.533796 (+   337us) op_driver.cc:464] REPLICATION: finished
0709 13:13:46.685505 (+151709us) write_op.cc:301] APPLY: starting
0709 13:13:46.685604 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:46.686011 (+   407us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:46.686033 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:46.688114 (+  2081us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:46.688400 (+   286us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 13:13:46.688446 (+    46us) write_op.cc:312] APPLY: finished
0709 13:13:46.688823 (+   377us) log.cc:844] Serialized 139 byte log entry
0709 13:13:46.722185 (+ 33362us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:46.737111 (+ 14926us) write_op.cc:454] Released schema lock
0709 13:13:46.757374 (+ 20263us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:46.819755 (+ 62381us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:46.841217 (+ 21462us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":226842,"reported_tablets":27,"spinlock_wait_cycles":27895168,"child_traces":[["op",{"apply.queue_time_us":151454,"apply.run_cpu_time_us":4362,"apply.run_wall_time_us":97796,"num_ops":20,"prepare.queue_time_us":261950,"prepare.run_cpu_time_us":24429,"prepare.run_wall_time_us":1137344,"raft.queue_time_us":135301,"raft.run_cpu_time_us":38161,"raft.run_wall_time_us":85462,"replication_time_us":894923,"spinlock_wait_cycles":31643904,"thread_start_us":618093,"threads_started":4,"wal-append.queue_time_us":370900,"wal-append.run_cpu_time_us":15238,"wal-append.run_wall_time_us":1442870}]]}
W20260709 13:13:48.437291  3589 consensus_meta.cc:287] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.002s
I20260709 13:13:48.376925  3654 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:48.475033   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 449593us
W20260709 13:13:48.448455  3704 log.cc:927] Time spent T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.373s	user 0.001s	sys 0.000s
W20260709 13:13:48.481371   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.480247  3582 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:48.511897   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:48.504575  3683 consensus_meta.cc:287] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.617s	user 0.011s	sys 0.003s
I20260709 13:13:48.512589   632 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:48.372563  3503 consensus_queue.cc:237] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.492760  3000 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:48.517035  3582 raft_consensus.cc:697] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:48.508621  3690 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:48.475524  3629 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.505990  3639 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:48.512034  3711 log.cc:927] Time spent T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
W20260709 13:13:48.536587  3708 log.cc:927] Time spent T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:13:48.541354  3575 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:48.508435  3705 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:48.552875   551 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:48.553773   559 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:13:48.521718  3712 log.cc:927] Time spent T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 13:13:48.627557  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 197383us
I20260709 13:13:48.627051   550 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:48.630614  3614 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.631341   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:48.632479  3589 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.631316  3614 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:48.633145  3589 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.634922  3614 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:48.534684  3000 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.642717  3000 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:48.559285  3636 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:48.672741  3636 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:48.674845  3636 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:48.628677  3703 log.cc:927] Time spent T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:13:48.635494  3589 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:48.636456  3616 raft_consensus.cc:3055] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:48.625974  3639 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:48.636214  3362 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:48.560482  3690 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:48.675346  3633 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:48.685985  1173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 639) took 1627 ms. Trace:
I20260709 13:13:48.701089  1173 rpcz_store.cc:276] 0709 13:13:47.059069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.059290 (+   221us) service_pool.cc:224] Handling call
0709 13:13:47.818680 (+759390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:47.843871 (+ 25191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.685688 (+841817us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b54004439d0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:48.685870 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1745440640}
I20260709 13:13:48.670061  3204 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:48.664085  3689 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.636804  3705 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:48.705256  3689 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:48.688074  3699 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:48.691751  3616 raft_consensus.cc:740] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:48.720969  3616 consensus_queue.cc:260] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:48.722039  3616 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:48.723925  3629 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:48.725747  3690 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:48.701813  3639 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:48.730492  3700 consensus_meta.cc:287] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
I20260709 13:13:48.730918  3700 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:48.732338  3463 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.732844  3463 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.734803  3463 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:48.728487  3639 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:48.687469  3582 consensus_queue.cc:237] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.704420  3362 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:48.717728  3707 log.cc:927] Time spent T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:13:48.718457  3689 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:48.756758  3362 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:48.719043  3716 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.757476  3716 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.719588  3654 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:48.759677  3716 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:48.707938  3633 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.761721  3633 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:48.715423  3660 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:48.719715  3705 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:48.751281  3463 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:48.762672  3463 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:48.754462  3607 consensus_meta.cc:287] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.696s	user 0.004s	sys 0.007s
I20260709 13:13:48.764783  3463 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:48.841903   559 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:48.843499  3664 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.810545   483 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:13:48.848042   483 pending_rounds.cc:85] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 4
I20260709 13:13:48.848572   483 pending_rounds.cc:107] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:13:48.849086   483 raft_consensus.cc:2889] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:48.851477  3463 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:48.852443  3717 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.852653  3463 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.853477  3717 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:48.827209  3483 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:48.855852  3483 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:48.765242  3655 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:48.810966   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1776) took 1182 ms. Trace:
W20260709 13:13:48.809104   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.894511   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1659) took 1605 ms. Trace:
I20260709 13:13:48.894662   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:48.895167   483 rpcz_store.cc:276] 0709 13:13:47.289377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.393703 (+104326us) service_pool.cc:224] Handling call
0709 13:13:47.393967 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:48.850071 (+1456104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.894118 (+ 44047us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54000aafd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:48.894433 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3254589312}
I20260709 13:13:48.896004   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:48.867604   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:48.896673   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:48.897454   552 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:13:48.851891  3700 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:48.900079  3700 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.868105   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:48.904794   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:48.884325   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1763) took 1821 ms. Trace:
I20260709 13:13:48.885924  3581 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.888952  3655 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:48.906854   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:48.907444  3581 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:48.891319   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:48.906301   478 rpcz_store.cc:276] 0709 13:13:47.062924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.086861 (+ 23937us) service_pool.cc:224] Handling call
0709 13:13:47.130881 (+ 44020us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:47.883622 (+752741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:47.883651 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:47.883690 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:47.883724 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.883711 (+999987us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b54000d57d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:48.883810 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:48.884119 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1730675456}
I20260709 13:13:48.872689   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1774) took 1262 ms. Trace:
I20260709 13:13:48.908975   559 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:48.894359  3503 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:48.909361   479 rpcz_store.cc:276] 0709 13:13:47.609947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.610088 (+   141us) service_pool.cc:224] Handling call
0709 13:13:47.610442 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:47.989253 (+378811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.872043 (+882790us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b5400187c54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:48.872456 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":869771648}
I20260709 13:13:48.910053  3503 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.897580   554 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:48.851815  3664 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.915364  3620 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:48.915798   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1778) took 1247 ms. Trace:
I20260709 13:13:48.916345   484 rpcz_store.cc:276] 0709 13:13:47.628722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.839105 (+210383us) service_pool.cc:224] Handling call
0709 13:13:47.839369 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:47.975967 (+136598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.870686 (+894719us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54001c9154. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:48.875944 (+  5258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312680704}
I20260709 13:13:48.907534  3655 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.920877  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:48.926636  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:48.926844   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:48.927807  1174 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
W20260709 13:13:48.926841  3685 log.cc:927] Time spent T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 1.193s	user 0.000s	sys 0.009s
I20260709 13:13:48.929801  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:48.930645  1167 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:48.932128  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:48.933214  1173 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:48.936568  3717 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:48.860611   475 rpcz_store.cc:276] 0709 13:13:47.628100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.652977 (+ 24877us) service_pool.cc:224] Handling call
0709 13:13:47.666854 (+ 13877us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:47.809220 (+142366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:47.809267 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:47.815635 (+  6368us) log.cc:844] Serialized 26 byte log entry
0709 13:13:48.428238 (+612603us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b180028d7a0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb90d1 00007f4b683d4a0f
0709 13:13:48.549576 (+121338us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:48.549632 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.549729 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:48.810009 (+260280us) raft_consensus.cc:1685] finished
0709 13:13:48.810088 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:48.810647 (+   559us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141857,"raft.queue_time_us":144783,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":3827,"spinlock_wait_cycles":9442048,"thread_start_us":121104,"threads_started":1,"wal-append.queue_time_us":833367}
I20260709 13:13:48.898793   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:48.906303   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:48.928453  3710 log.cc:927] Time spent T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.616s	user 0.003s	sys 0.000s
I20260709 13:13:48.940814  3463 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:48.960518   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:48.963738   552 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:13:48.956609   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:48.962304  1139 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:48.964747   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:48.971678   554 raft_consensus.cc:1240] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:13:48.974876  3564 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:48.975494  3705 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.975759  3639 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:48.976387  3705 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:48.976794  3639 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:48.965704  3483 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:48.982822   556 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:48.964389  3700 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:48.992179  3611 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:48.987493   481 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:13:48.995260   483 raft_consensus.cc:2393] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 8: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:48.992769  3611 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.012703  3611 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:49.017463   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.016000  3700 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.027091  3483 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.025187  3503 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:49.028441  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 66452us
I20260709 13:13:49.041898  3620 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:49.042304  3700 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:49.042968  3620 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:49.045068   555 raft_consensus.cc:1240] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:49.047672   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:49.049134  3581 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:49.050942   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.053272  3483 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:49.030678  3564 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:49.052157  3513 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.195s	user 0.023s	sys 0.015s
I20260709 13:13:49.059525  3616 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:49.060315  3616 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:49.061115  3483 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.062186  3639 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:49.063254  3664 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:49.062840  3616 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.062852  1141 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:49.064023  3607 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.064767  3700 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:49.064874  3607 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:49.065918  3735 log.cc:927] Time spent T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.143s	user 0.002s	sys 0.000s
I20260709 13:13:49.066607  3564 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:49.068229  3705 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.069433  1139 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:49.070469  3582 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:49.070923  3582 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.071396  3582 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:49.075608  3621 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:49.076062  3621 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.076398  3621 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:49.076655  3620 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.079211   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.079962   555 raft_consensus.cc:1275] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:49.080227   554 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:49.079155   552 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:13:49.081646   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.082077   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.082410   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.070494  1139 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:49.083175  3664 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.084017  1139 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:49.083904  3664 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:49.085234  3510 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:49.085311  3655 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.085682   523 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:49.086129  3655 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:49.086443  3664 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:49.087172  3664 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:49.087813  3664 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:49.088380  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:49.089067  1167 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:49.090169  3730 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:49.090927  3730 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:49.093580  3730 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:49.094314  3700 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:49.095299  3664 leader_election.cc:290] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:49.095770  3683 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:49.096499  3683 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:49.098850  3683 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.099972  3683 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.100524  3607 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:49.100629  3683 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:49.101776  3616 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.102394  3616 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:49.095403  3700 raft_consensus.cc:697] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:49.151187   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.158416   479 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:49.150067   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:49.156221   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:49.158753  3700 consensus_queue.cc:237] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:49.159494   632 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:13:49.160878   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.160787   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:49.115871   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:49.104895  3616 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:49.129771   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.141628  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:49.116151   447 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:49.163744  1167 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
W20260709 13:13:49.141860   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 447370us
I20260709 13:13:49.100561   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 328) took 1087 ms. Trace:
W20260709 13:13:49.058597  3513 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.310s	user 0.023s	sys 0.016s
I20260709 13:13:49.164614   553 rpcz_store.cc:276] 0709 13:13:48.012645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.012761 (+   116us) service_pool.cc:224] Handling call
0709 13:13:48.013013 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:48.091978 (+ 78965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:49.100042 (+1008064us) spinlock_profiling.cc:243] Waited 78.1 ms on lock 0x7b54000ebd54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:49.100364 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179680640}
I20260709 13:13:49.165858  3513 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.139818  3684 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.150617   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:49.166640  3513 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:49.103828  3483 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:49.167909  3684 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:49.127115   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:49.108479  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.111574  3130 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:49.170567  3684 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.114737  3629 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.171795  3655 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.172659  3655 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:49.173241  3490 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:49.173979  3490 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:49.105482  3620 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:49.168673  3483 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:49.171490   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:49.183126  3664 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:13:49.187907   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.182471  3730 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:13:49.145962   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.139815  3564 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:13:49.170158  3130 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:49.196507  3616 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:49.172190  3629 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:49.146965  1174 raft_consensus.cc:1275] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:13:49.183430   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.161757   479 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:49.138178  1139 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:49.197530   482 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:49.198626   475 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:49.187431   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:49.208449  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 70435us
I20260709 13:13:49.203372   483 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:49.175060  3655 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.211113  1139 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:49.206029   556 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:49.208688  1141 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:49.103335  3683 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.216576   523 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:49.210665  3510 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:49.207187  3130 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.176209  3490 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.236534   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:49.238163   482 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:49.233539   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.175544  3620 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:49.243739   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.244714   553 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:49.246920   559 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:13:49.247303  3496 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.247608  1167 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:49.247992  3496 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:49.234678  3607 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:49.249315  3607 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:49.250741  3496 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.224988  3510 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:49.251677  3510 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:49.252647  3204 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:49.255038   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.222666  3463 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:49.255769  3463 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:49.256259  3463 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:49.264989   479 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:49.229187  3683 raft_consensus.cc:2804] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:49.255765   478 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:13:49.271023  1141 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:49.271528  3564 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:49.271970   480 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:49.272380  3496 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:49.272010  3564 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:13:49.272668   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 94345.8us
I20260709 13:13:49.272843  3496 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.273029  3564 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:49.273278  3496 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:49.273944   522 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:49.275015  3619 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:49.275293   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.275493  3619 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.275902   559 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:13:49.275919  3619 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:49.269613  3683 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.277212  3683 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:49.227033  3655 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:49.275938   553 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:13:49.278337  3655 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.278728  3655 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:49.279393  3607 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.280048   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.280921   480 raft_consensus.cc:2393] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 10: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:49.292390  3620 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.293254  3629 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.294351  3621 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:49.258260   597 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:49.282950   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:49.295428   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:49.295701   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 179827us
I20260709 13:13:49.303090  3629 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.303781  3629 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:49.318332   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 61291.3us
I20260709 13:13:49.318887  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:49.307510  3483 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.330523   482 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:49.295133  3582 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:49.339891  1139 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:49.342104   484 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:13:49.311200  3664 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
W20260709 13:13:49.344395   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.348560   480 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:13:49.349289  3490 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:49.349788  3490 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.349792  3503 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:49.350346  3490 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:49.350189  3364 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:49.338994  3639 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:49.351442  1139 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:49.352413  3503 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:49.352850  3503 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:49.353303  3503 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:49.351854  3639 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:49.346666   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:49.335412  3204 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:49.334923  3620 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:49.363989  3639 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.356235  3204 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.375950   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.379638  3581 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.379354   482 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:49.343532  3616 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:13:49.380439  3582 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:49.380424  3581 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:49.388581   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 115024us
I20260709 13:13:49.394938   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.397307  3488 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:49.398025  3488 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:49.400259  3742 log.cc:927] Time spent T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:13:49.400578  3488 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.380810  3204 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:49.365567  3607 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:13:49.411288   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.413563   482 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:49.397331  3581 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:49.428848   556 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:13:49.440372  3621 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.444628  3727 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:49.445624  3727 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:49.448889   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:49.452145  3564 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:49.454686  3715 consensus_queue.cc:1059] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:49.457582  3629 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.458540  3513 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:49.466799   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.422398   523 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:49.472307   556 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:49.450827  3490 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:49.483593   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 93986.2us
I20260709 13:13:49.402976  3620 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:49.495639   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:49.494935   380 catalog_manager.cc:5697] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 3 to 8, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 8 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:49.504621   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.505452   557 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:49.505957   484 raft_consensus.cc:1275] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:49.505774  3619 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:49.506479  3620 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.507942  3639 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:49.508415  3639 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:49.508852  3639 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:49.496248   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 45579us
I20260709 13:13:49.511817   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.512257   476 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:13:49.512439   480 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:49.513221   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.513340   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.513835   476 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:49.514395   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:49.476225  3611 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:49.515627   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.516144   477 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:49.516311   625 raft_consensus.cc:2393] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:49.517141  3611 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:49.517745  3490 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:49.504725   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.518705   556 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:49.515755   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.519439  1173 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:49.519673   479 raft_consensus.cc:2393] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 8: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:49.520226   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:49.522027   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:49.522817   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.523569   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:49.522857   624 raft_consensus.cc:2393] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:49.525712   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:49.526377   633 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:49.527949   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:49.528174  3727 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:49.529395   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.530529  3581 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:49.523523   475 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:13:49.514942   480 raft_consensus.cc:2376] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9. Re-sending same reply.
W20260709 13:13:49.538239   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:49.543146  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 179755us
W20260709 13:13:49.539149  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 164296us
I20260709 13:13:49.546216  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:49.549800   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.550928   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:49.551421   553 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:49.552593  1168 raft_consensus.cc:1240] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:13:49.553889   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:49.554605   475 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:49.547863   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:49.548530  1167 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:49.548264   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:49.565640   555 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:49.514770  3463 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:49.568734   480 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:49.530767  3664 consensus_queue.cc:1059] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:49.570686   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:49.572516   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.575479   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.577754  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:49.592077   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.598439   632 raft_consensus.cc:2393] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 8: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:49.599586   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:49.600299   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.574921  3620 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.601442   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.602113   557 raft_consensus.cc:2393] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 10: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:49.602662   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:49.603904   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:49.605273   476 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:13:49.605553   476 pending_rounds.cc:85] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 7
I20260709 13:13:49.605509   448 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:49.605913  3575 consensus_queue.cc:1048] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:49.607409  3575 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:49.607770  3575 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:49.608117  3575 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:49.601222  3620 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:49.612875  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:49.605945   476 pending_rounds.cc:107] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:13:49.602843   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.615139   476 raft_consensus.cc:2889] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:49.606842   448 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:49.613530   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.616941   553 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:49.531190  3581 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:49.625350   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 50511.4us
I20260709 13:13:49.626422   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:49.627305   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.629424   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:49.630897  1167 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:49.597465  3564 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:49.627023   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.632055   480 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:49.629614   484 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:49.628238  1139 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:49.636986   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.609726   380 catalog_manager.cc:5697] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 5 to 6, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 6 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:49.647482  1139 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:49.649533   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.568004  3496 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:49.650564   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.570112  3510 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:49.660697   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 53928us
I20260709 13:13:49.663062   475 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:13:49.659564   479 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:49.646340  3483 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:49.663656  1141 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:49.672448   557 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:49.657243   380 catalog_manager.cc:5697] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 1 to 6, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 6 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:13:49.655027  3607 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:49.682577  1173 raft_consensus.cc:2393] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 9: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:49.683280   556 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:13:49.684758  3753 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:49.659832  3629 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.615850  3130 consensus_queue.cc:1059] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:13:49.692808   625 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:13:49.687597   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.696935   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:49.696653  1166 raft_consensus.cc:1275] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:13:49.711113   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.711987   557 pending_rounds.cc:85] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 4
I20260709 13:13:49.712363   557 pending_rounds.cc:107] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:13:49.712666   557 raft_consensus.cc:2889] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:49.715153  1141 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:49.657083  3700 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:13:49.688393  3619 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.709753   380 catalog_manager.cc:5697] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 7 to 8, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 8 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:49.659170  3683 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:49.739393   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.696702  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:49.710661  3463 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.710724  3689 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:49.750949   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 96693.3us
I20260709 13:13:49.748152   380 catalog_manager.cc:5697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 4 to 8, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 8 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:49.760070   380 catalog_manager.cc:5697] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 3 to 6, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 6 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:49.771543   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.733606  3727 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:13:49.748849  3513 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.757318  3607 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:13:49.784061   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 56723us
I20260709 13:13:49.785257   625 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:49.807818   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:49.780017   380 catalog_manager.cc:5697] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 2 to 6, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 6 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:13:49.812469   523 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:49.740110  3629 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:49.820411   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 65964us
I20260709 13:13:49.848416  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:49.807453  3513 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:49.794094  1169 raft_consensus.cc:2393] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:49.780718  3664 raft_consensus.cc:3055] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:49.860013   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:49.860579  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:49.849392  3766 consensus_queue.cc:1059] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:13:49.866954  1172 raft_consensus.cc:2393] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 8: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:49.864209   599 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:49.819898   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:49.870622   477 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:49.783329  3748 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:13:49.873903   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.769639  3689 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:49.884801   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:49.805050  3515 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:49.901235  3655 consensus_meta.cc:287] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.005s
I20260709 13:13:49.858968  3607 raft_consensus.cc:697] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
W20260709 13:13:49.927259   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 114862us
I20260709 13:13:49.928938   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:49.868165  3664 raft_consensus.cc:740] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:49.935257   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:49.931689   525 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:49.936076   632 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:49.939144   380 catalog_manager.cc:5697] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 6 to 7, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 7 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:49.949571  1173 raft_consensus.cc:1240] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:49.949571  1175 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:13:49.947415   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 272657us
I20260709 13:13:49.926493  3748 raft_consensus.cc:697] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:49.951953  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:49.914005  3766 consensus_queue.cc:1243] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer 6e6df7e8ed204f1db5c371536b5b0683 log is divergent from this leader: its last log entry 6.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:13:49.949896   380 catalog_manager.cc:5697] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 1 to 6, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 6 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
W20260709 13:13:49.975811   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 61453.5us
I20260709 13:13:49.950802  3510 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:49.950996  3581 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:49.955018  3700 raft_consensus.cc:2804] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:49.982837   599 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:49.932355  3655 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:49.991665   380 catalog_manager.cc:5697] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 1 to 6, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 6 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
W20260709 13:13:50.000311  3750 log.cc:927] Time spent T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
W20260709 13:13:50.001253  3756 log.cc:927] Time spent T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:13:50.001878   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:50.022845   380 catalog_manager.cc:5697] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 3 to 9, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 9 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.025233  3689 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:50.028648  3772 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.029471  1169 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:13:50.150151  3503 consensus_meta.cc:287] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.796s	user 0.012s	sys 0.001s
I20260709 13:13:49.961712  3620 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:49.999841   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 318936us
I20260709 13:13:50.135393   552 raft_consensus.cc:1275] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:13:49.984328  3747 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.978081  3766 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:50.150616   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:50.141189  3683 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:50.143610  3130 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.011550  3607 consensus_queue.cc:237] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:50.143543   477 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:13:50.146493   632 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:50.145386   597 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:49.971112  3515 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:49.986604  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:50.169664   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 187112us
I20260709 13:13:50.171096  1174 raft_consensus.cc:2393] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 6: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
W20260709 13:13:50.198104   555 consensus_meta.cc:287] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.631s	user 0.004s	sys 0.006s
I20260709 13:13:50.198518   555 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:13:50.182668   550 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 8: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:49.999794  3759 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:50.143841  3564 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:13:50.170557  3760 log.cc:927] Time spent T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.244s	user 0.000s	sys 0.010s
I20260709 13:13:50.181550  3689 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:50.195279   380 catalog_manager.cc:5697] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:13:50.197170  1141 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:50.177178  3700 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.179445  3582 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.032513  3664 consensus_queue.cc:260] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:50.177098  3779 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:50.167676  3503 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:50.202059  3759 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.204579  1170 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:50.187225  3772 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:50.229341   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:50.230185   631 raft_consensus.cc:2393] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:50.230345  3772 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:50.230590  3575 consensus_meta.cc:287] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.622s	user 0.001s	sys 0.007s
I20260709 13:13:50.230958  3689 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:50.231827   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 198954us
I20260709 13:13:50.240338   525 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:50.242457  1168 raft_consensus.cc:2393] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 8: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
W20260709 13:13:50.216145  3684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.019s	sys 0.018s
I20260709 13:13:50.213191  3779 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.231325  3773 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:50.213095  3364 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:50.211709  3700 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:50.236281   380 catalog_manager.cc:5697] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 4 to 5, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 5 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:50.257421   448 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:50.197690  3747 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:50.201612  3130 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:50.270174  3779 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:50.280665  3763 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:13:50.282104  3515 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:50.212785  3564 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:50.282754   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:50.272962  3773 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.284245  3564 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:50.284413  3773 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:50.231082  3575 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:50.286537  3575 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:50.288749  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:50.290175   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 49964.8us
I20260709 13:13:50.235046  3759 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:50.270973   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:50.297029   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:50.289595  3655 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:50.254349  3629 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:50.305702   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.298074   631 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:50.260612  3684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.020s	sys 0.019s
I20260709 13:13:50.261257  3488 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.226997  3582 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:50.308075   632 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:50.313699   380 catalog_manager.cc:5697] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 2 to 7, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 7 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:13:50.323870   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:50.255527  3772 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:13:50.326797  3130 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:50.332715   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:50.333571  3496 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:50.334489  3778 log.cc:927] Time spent T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:13:50.343338   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:50.343940   627 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:50.345646  3204 consensus_meta.cc:287] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.887s	user 0.010s	sys 0.000s
I20260709 13:13:50.346171  3204 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:50.335347  3689 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:50.309983  3364 raft_consensus.cc:697] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:50.351511   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:50.352246   632 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:13:50.352109  3364 consensus_queue.cc:237] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:50.343968  3503 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:50.359315   525 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:50.363075   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:50.366027  3204 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:50.365809  3779 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:50.367125   624 raft_consensus.cc:2368] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9.
I20260709 13:13:50.207162  3748 consensus_queue.cc:237] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:50.366999  3757 log.cc:927] Time spent T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.617s	user 0.000s	sys 0.001s
I20260709 13:13:50.370338   631 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:50.377705   380 catalog_manager.cc:5697] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:13:50.374684   525 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:50.381925   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 142415us
W20260709 13:13:50.383859   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 170089us
W20260709 13:13:50.384531   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 148183us
I20260709 13:13:50.386677   380 catalog_manager.cc:5697] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.389237   599 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:50.323966  3488 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:50.382042  3689 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:50.410188  3633 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:50.436343  1167 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:50.410914   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:50.455119   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:50.475036   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 85883.3us
W20260709 13:13:50.445192   522 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 1.640s (SENT) [suppressed 30 similar messages]
I20260709 13:13:50.475801   599 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:50.444353  1139 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:50.405571  3639 consensus_meta.cc:287] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.896s	user 0.009s	sys 0.005s
I20260709 13:13:50.436828  3488 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:50.360680  3564 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:13:50.450529   627 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:13:50.392866  3766 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:13:50.391498   448 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:50.479003   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 87534.3us
I20260709 13:13:50.371556  3763 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:13:50.482314  1173 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:13:50.410610  3777 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:50.431995  3747 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:50.484658  3705 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:50.405877   380 catalog_manager.cc:5697] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:13:50.487185   380 catalog_manager.cc:5697] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 1 to 6, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 6 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:50.489289   380 catalog_manager.cc:5697] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 1 to 6, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 6 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:50.411729  3774 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:13:50.410162  3776 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:50.492467  3776 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:50.492967  3776 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:50.412467  3784 consensus_queue.cc:1048] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:13:50.474731  3689 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.495057   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:50.495419   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:50.474920  3633 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.507658   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:50.508039   553 raft_consensus.cc:1240] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:50.511554  3791 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:13:50.511885  3755 log.cc:927] Time spent T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.703s	user 0.002s	sys 0.000s
I20260709 13:13:50.512089  3791 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.512519  3791 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:50.512465   525 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:50.511575  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:50.479454  3496 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:50.496506  3488 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:50.510421   625 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:50.516963   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:50.517969   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:50.498124  3689 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:50.476838  3639 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:50.517764   552 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:13:50.497282  3773 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:50.496369   380 catalog_manager.cc:5697] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 2 to 5, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 5 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:13:50.521829   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:50.498329  3777 raft_consensus.cc:697] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:50.509788  3633 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:50.529978   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 54243.4us
I20260709 13:13:50.531993  3788 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:50.528330  3496 raft_consensus.cc:697] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:50.497400  3130 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:13:50.519012  3488 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.517745  3772 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:50.536791   599 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:50.579936  3515 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.580504  3496 consensus_queue.cc:237] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:50.593786   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:50.588366  3575 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:50.538853  3788 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:50.600095  3748 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.582547   525 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:50.587718  3772 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:50.583652  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:50.607904  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:50.585690   558 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:50.586936   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:50.504387  3629 consensus_queue.cc:1048] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:13:50.590384   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 52688.5us
W20260709 13:13:50.591182   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 54527us
I20260709 13:13:50.623853  3792 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:50.624584  3792 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.624974  3792 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:50.587996  3488 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:50.627569   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:50.629001   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:50.631011  3639 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:50.632179   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:50.635082   628 raft_consensus.cc:1240] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:50.616794  3784 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:50.637357  3784 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.597222  3581 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:13:50.613312   525 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:50.583177  3801 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.639482  3801 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:50.605875  3515 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:50.637764  3784 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:50.597546  3620 consensus_queue.cc:1059] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:13:50.582165  3777 consensus_queue.cc:237] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:50.586689   380 catalog_manager.cc:5697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 2 to 5, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 5 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:13:50.605835  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:50.585670  3564 consensus_queue.cc:1059] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:13:50.594321  3683 consensus_queue.cc:1059] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:13:50.608800  3788 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:50.616883  3772 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:50.721637  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:50.603044  3575 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:50.709952  3766 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:50.737700  3754 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:50.738474  3754 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:50.743881  3639 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:50.746292  3515 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:50.746695  3754 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:50.746524  3792 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:50.747148  3515 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:50.747622  1175 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:50.747993  3515 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:50.748932   523 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:50.750532  3515 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:50.753436  3792 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:50.754057  3801 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:50.756230   380 catalog_manager.cc:5697] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 2 to 5, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 5 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
W20260709 13:13:50.761955   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 316751us
I20260709 13:13:50.615659  3759 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:50.807399   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 218812us
I20260709 13:13:50.751109  3515 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:50.808324   480 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:50.755005  3792 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:50.811309   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:50.817409   380 catalog_manager.cc:5697] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:13:50.676828  3748 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:50.756940  3766 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:50.812247   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:50.808311   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 136694us
W20260709 13:13:50.820328   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 80303.1us
W20260709 13:13:50.822429   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 112643us
I20260709 13:13:50.824205   626 raft_consensus.cc:2393] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:50.831856   478 raft_consensus.cc:2393] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 6: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:50.754012  3488 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:50.827533   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:50.841341   478 raft_consensus.cc:1240] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:50.822919  3766 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:50.849552   482 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:13:50.851583  3758 raft_consensus.cc:3055] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:50.851806  3804 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:50.852116  3758 raft_consensus.cc:740] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:50.852476  3804 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:50.852061  3705 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:50.853199  3758 consensus_queue.cc:260] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:50.853852  3705 raft_consensus.cc:697] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:50.854393  3758 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:50.854811  3705 consensus_queue.cc:237] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:50.854780  3804 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:50.819628  3792 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:50.849381  3700 consensus_meta.cc:287] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.004s
I20260709 13:13:50.819895  3515 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:50.859385  3773 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:50.915832  1174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 650) took 1579 ms. Trace:
I20260709 13:13:50.877192   380 catalog_manager.cc:5697] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 2 to 6, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 6 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:13:50.917567  1174 rpcz_store.cc:276] 0709 13:13:49.298229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.298375 (+   146us) service_pool.cc:224] Handling call
0709 13:13:50.877399 (+1579024us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b54003a3ed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:50.877536 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1951474048}
I20260709 13:13:50.847007  3788 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:50.930154   380 catalog_manager.cc:5697] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:50.966912   380 catalog_manager.cc:5697] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.875384  3689 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:50.875157  3700 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:51.075682   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:51.079831   478 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:51.001312  3773 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:51.005219  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:51.239866   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 407934us
I20260709 13:13:51.261656   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:51.264834  3812 log.cc:927] Time spent T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
I20260709 13:13:51.262423   476 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:51.042852  3130 consensus_queue.cc:1059] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.247s
I20260709 13:13:51.311609  3814 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.312304  3814 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:51.314711  3814 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:51.327952   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:51.328758   476 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:13:51.332468   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:51.263731  3773 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:51.316479  3515 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:51.306604  3759 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:51.381361   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:51.382164   523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.004s	sys 0.017s
W20260709 13:13:51.383342   523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.004s	sys 0.017s
W20260709 13:13:51.383893   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 525031us
W20260709 13:13:51.390298   553 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.005s	sys 0.002s
W20260709 13:13:51.391326   553 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.006s	sys 0.002s
W20260709 13:13:51.393944   552 consensus_meta.cc:287] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.807s	user 0.009s	sys 0.000s
I20260709 13:13:51.394479   552 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
W20260709 13:13:51.395030   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 126322us
I20260709 13:13:51.399892   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:51.400885   552 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:51.388111  3776 consensus_meta.cc:287] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.895s	user 0.004s	sys 0.009s
I20260709 13:13:51.385793  3620 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:51.415772   525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.004s	sys 0.024s
I20260709 13:13:51.412123  3748 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:51.427103  3766 consensus_meta.cc:287] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.000s
I20260709 13:13:51.428869  3766 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:51.431022  3766 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:51.431842   525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.004s	sys 0.024s
W20260709 13:13:51.432193   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 610358us
I20260709 13:13:51.432969   552 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:13:51.433751   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:51.434428   552 raft_consensus.cc:2393] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:51.435074   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:51.439589  3815 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:51.440199  3815 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:51.442390  3815 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:51.447889  3804 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:51.448427  3804 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:51.450357  3804 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:51.451776  3748 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.452262  3748 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:51.454188  3748 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:51.455137  3817 log.cc:927] Time spent T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 13:13:51.457454  3761 log.cc:927] Time spent T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 1.639s	user 0.047s	sys 0.083s
I20260709 13:13:51.457801  3616 raft_consensus.cc:3055] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:51.415436  3620 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:51.458384  3616 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:51.459499  3616 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:51.460897  3805 log.cc:927] Time spent T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.389s	user 0.000s	sys 0.001s
I20260709 13:13:51.463303  3788 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:51.463877  3788 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:51.464306  3788 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:51.466290  3788 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:51.467494  3620 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:51.468014  3620 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:51.468321  3779 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:51.468495  3620 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:51.469355  3619 raft_consensus.cc:3055] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:51.469911  3619 raft_consensus.cc:740] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:51.450991  3804 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:51.405764  3792 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:51.470986  3619 consensus_queue.cc:260] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:51.415654  3515 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:51.482533  3515 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:51.484616  3515 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:51.486505   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 58294.1us
I20260709 13:13:51.487911   522 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:51.489105   522 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:51.491917  3766 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:51.492555  3766 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:51.493171   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 60348.5us
I20260709 13:13:51.460916  3616 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:51.471350  3804 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:51.474697  3811 log.cc:927] Time spent T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.515s	user 0.001s	sys 0.000s
W20260709 13:13:51.512575   596 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.036s	sys 0.048s
I20260709 13:13:51.420433  3808 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:51.503101   476 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
W20260709 13:13:51.521484   596 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.037s	sys 0.048s
W20260709 13:13:51.522964   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.476215  3689 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:51.412524  3776 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:51.471014  3620 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:51.521963  3633 consensus_meta.cc:287] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.924s	user 0.007s	sys 0.003s
I20260709 13:13:51.533682  3831 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:51.577682  3633 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:51.578980   555 raft_consensus.cc:2368] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8.
I20260709 13:13:51.591677   559 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 6: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:51.536135  3619 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:51.624033   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1800) took 1121 ms. Trace:
I20260709 13:13:51.529978  3808 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:51.624447   557 rpcz_store.cc:276] 0709 13:13:50.502445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.503791 (+  1346us) service_pool.cc:224] Handling call
0709 13:13:50.511913 (+  8122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:50.512306 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:50.512333 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:50.512852 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:13:50.819422 (+306570us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:50.819471 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:50.819546 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:51.623809 (+804263us) raft_consensus.cc:1685] finished
0709 13:13:51.623830 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.623970 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1053,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6732,"thread_start_us":305876,"threads_started":1,"wal-append.queue_time_us":337550}
I20260709 13:13:51.614519  3830 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.682031   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:51.630410  3773 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:51.686744   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:51.687551   632 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:13:51.690163   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:51.642125  3804 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:51.591308  3831 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:51.642398  3829 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:51.715656  3829 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:51.713999   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1834) took 1195 ms. Trace:
I20260709 13:13:51.767208   553 rpcz_store.cc:276] 0709 13:13:50.518094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.633381 (+115287us) service_pool.cc:224] Handling call
0709 13:13:50.633784 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.634088 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:50.634437 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 13:13:51.708848 (+1074411us) log.cc:844] Serialized 14 byte log entry
0709 13:13:51.709359 (+   511us) log.cc:844] Serialized 14 byte log entry
0709 13:13:51.713512 (+  4153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:51.713583 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:51.713646 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.713765 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.713923 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3897,"prepare.queue_time_us":170,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":289610,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":84015,"spinlock_wait_cycles":4036480,"thread_start_us":1067674,"threads_started":3,"wal-append.queue_time_us":214513}
W20260709 13:13:51.723544   597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.005s	sys 0.020s
W20260709 13:13:51.770439   597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.005s	sys 0.020s
W20260709 13:13:51.770792   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 938736us
W20260709 13:13:51.749300   599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.007s	sys 0.026s
W20260709 13:13:51.719218   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 189688us
I20260709 13:13:51.771793   522 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:51.772547   599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.007s	sys 0.026s
W20260709 13:13:51.773053   478 consensus_meta.cc:287] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.000s
I20260709 13:13:51.773491   478 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
W20260709 13:13:51.714294  1138 connection.cc:256] RPC call timeout handler was delayed by -1.1696137430001272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
I20260709 13:13:51.717255  3684 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:13:51.781075  1138 connection.cc:256] RPC call timeout handler was delayed by -1.1579137430001083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 13:13:51.783408  1138 connection.cc:256] RPC call timeout handler was delayed by -1.0904137429999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
I20260709 13:13:51.665849  3830 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:51.782080   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1633) took 1632 ms. Trace:
W20260709 13:13:51.789541   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.792815   522 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:51.784898   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:51.794658   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:51.795226   629 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:51.796445  3831 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:51.785403  3843 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:51.797600  3843 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:51.799734  3843 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:51.780967  3783 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.803196   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1807) took 1282 ms. Trace:
I20260709 13:13:51.803342  3496 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:51.803606  3783 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:51.803925  3496 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:51.804629   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54754 (request call id 398) took 1494 ms. Trace:
I20260709 13:13:51.805004   626 rpcz_store.cc:276] 0709 13:13:50.310754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.310950 (+   196us) service_pool.cc:224] Handling call
0709 13:13:51.804435 (+1493485us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b5400010c54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:51.804550 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1143227776}
I20260709 13:13:51.805737  3783 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:51.790441  3804 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:51.806526   626 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:13:51.806834  3804 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:51.806078  3496 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:51.815205  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:51.815852  1173 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:51.817044   629 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:51.803629   555 rpcz_store.cc:276] 0709 13:13:50.520636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.628729 (+108093us) service_pool.cc:224] Handling call
0709 13:13:51.802977 (+1174248us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b540031a6d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:51.803115 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2183087360}
W20260709 13:13:51.821777   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:51.789494  3784 consensus_meta.cc:287] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 1.061s	user 0.011s	sys 0.001s
I20260709 13:13:51.785755  3689 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:51.830029  3772 consensus_meta.cc:287] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 1.074s	user 0.007s	sys 0.002s
I20260709 13:13:51.831830   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:51.846568   555 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:51.846791  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:51.784265   633 rpcz_store.cc:276] 0709 13:13:50.142984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.143151 (+   167us) service_pool.cc:224] Handling call
0709 13:13:50.150556 (+  7405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.187219 (+ 36663us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:50.323225 (+136006us) log.cc:844] Serialized 14 byte log entry
0709 13:13:51.498500 (+1175275us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b180032ae80. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b652a6c0a 00007f4b6e9e6219 00007f4b6532ea40 00007f4b653294e4 00007f4b65329455 00007f4b6be113c7 00007f4b684239a7 00007f4b684330bf 00007f4b68433038
0709 13:13:51.498714 (+   214us) log.cc:844] Serialized 14 byte log entry
0709 13:13:51.771066 (+272352us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:51.771122 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:51.775390 (+  4268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.775493 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.775654 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79932,"prepare.queue_time_us":1140018,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":7781,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":32898,"spinlock_wait_cycles":157671808,"thread_start_us":433807,"threads_started":3,"wal-append.queue_time_us":67010,"wal-append.run_cpu_time_us":1337,"wal-append.run_wall_time_us":1027372}
W20260709 13:13:51.832367  3791 consensus_meta.cc:287] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.319s	user 0.012s	sys 0.001s
I20260709 13:13:51.834023  3804 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:51.847265   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:51.862957  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:51.834375  3758 consensus_meta.cc:287] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.980s	user 0.005s	sys 0.005s
I20260709 13:13:51.835930   632 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:13:51.836503  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:51.838590   522 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:51.824575   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:51.873193   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:51.874485   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:51.823321  3633 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:51.872611  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:51.875890  1166 raft_consensus.cc:2393] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 6: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:51.874102   597 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:51.878922   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 355) took 1072 ms. Trace:
I20260709 13:13:51.879307   557 rpcz_store.cc:276] 0709 13:13:50.806779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.642034 (+835255us) service_pool.cc:224] Handling call
0709 13:13:51.685221 (+ 43187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:51.685496 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:13:51.836526 (+151030us) log.cc:844] Serialized 14 byte log entry
0709 13:13:51.878580 (+ 42054us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:51.878643 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:51.878692 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.878761 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.878864 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":192403,"threads_started":2}
I20260709 13:13:51.878400  3804 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.882580  3804 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:51.884822  3804 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:51.885375   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:51.885560   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:51.886147   557 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:13:51.887409   557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:13:51.888134   557 raft_consensus.cc:606] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:51.875208   626 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:51.890141   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1808) took 1362 ms. Trace:
I20260709 13:13:51.914919  1138 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:51.818631  3684 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:51.890524   552 rpcz_store.cc:276] 0709 13:13:50.527732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.435906 (+908174us) service_pool.cc:224] Handling call
0709 13:13:51.436192 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:51.436527 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:51.436551 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:51.437017 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:13:51.626365 (+189348us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:51.626425 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.626520 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:51.889943 (+263423us) raft_consensus.cc:1685] finished
0709 13:13:51.889963 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.890080 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":188896,"threads_started":1,"wal-append.queue_time_us":353547}
I20260709 13:13:51.867637  3831 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:51.918934   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:51.868548  3844 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:51.930889   476 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:51.894341  3758 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:51.943874  3758 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.944267  3758 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:51.944351  3754 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:51.947837  3813 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:51.847533  3784 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:51.950428   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:51.951289   633 raft_consensus.cc:2410] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:13:51.951560  3776 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:51.936093  3835 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:51.936532  3828 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:13:51.943404  3829 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:51.948027  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:51.953672   555 raft_consensus.cc:2410] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:13:51.954183   557 raft_consensus.cc:1240] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:13:51.957888  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:51.960119   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1812) took 1133 ms. Trace:
I20260709 13:13:51.960599   557 rpcz_store.cc:276] 0709 13:13:50.827114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.917209 (+1090095us) service_pool.cc:224] Handling call
0709 13:13:51.934006 (+ 16797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:51.959798 (+ 25792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.960056 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:51.937875  3830 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:51.868355  3772 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:51.873070  3766 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:13:51.956123  3727 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:51.962936  3754 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.873535  3773 consensus_queue.cc:1059] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:13:51.979982   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:51.980711   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 142221us
I20260709 13:13:52.002286   476 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:51.868996  3791 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:51.989039   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:51.917322  3783 consensus_queue.cc:1059] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:13:52.003551   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.005925   522 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:51.956578  3784 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:52.011693   633 raft_consensus.cc:2368] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11.
I20260709 13:13:51.932085  3831 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:52.015903   629 raft_consensus.cc:2368] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8.
I20260709 13:13:52.017490   522 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:52.018712   522 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:52.000713  3727 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:52.019655   557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:13:52.020375   557 raft_consensus.cc:606] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:52.020736  3791 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:52.020929   557 raft_consensus.cc:614] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:52.021978   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.022007  3727 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:52.030047   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:52.034236   624 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1621) took 2509 ms (client timeout 2415 ms). Trace:
W20260709 13:13:52.034678   624 rpcz_store.cc:269] 0709 13:13:49.524947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.527718 (+  2771us) service_pool.cc:224] Handling call
0709 13:13:52.033927 (+2506209us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54001e3054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:52.034113 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1908307840}
I20260709 13:13:52.038192  3803 raft_consensus.cc:3055] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:52.038667  3803 raft_consensus.cc:740] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:52.004078  3754 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:52.039455  3803 consensus_queue.cc:260] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:52.041621  3754 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:52.016268  3633 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:52.044732  3831 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:52.045684  3767 log.cc:927] Time spent T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 1.899s	user 0.004s	sys 0.024s
I20260709 13:13:52.046090   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:52.048834  3806 log.cc:927] Time spent T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 1.130s	user 0.001s	sys 0.000s
I20260709 13:13:52.048916  3808 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:52.005476  3829 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:52.049548   478 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:13:52.013025  3813 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:13:52.049958  3829 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:52.051795  3488 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:52.052786   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1823) took 2523 ms. Trace:
I20260709 13:13:52.051877  3843 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:52.053233   554 rpcz_store.cc:276] 0709 13:13:49.529264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.529383 (+   119us) service_pool.cc:224] Handling call
0709 13:13:49.529768 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:49.530231 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:49.530263 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:49.530795 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:13:49.757025 (+226230us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:49.757080 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:49.757168 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:52.044978 (+2287810us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:52.052480 (+  7502us) raft_consensus.cc:1685] finished
0709 13:13:52.052501 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.052709 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":331,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":71,"spinlock_wait_cycles":45359360,"thread_start_us":225806,"threads_started":1,"wal-append.queue_time_us":477879}
I20260709 13:13:52.054498  3843 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:52.054927  3843 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:52.057662   554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:13:52.058261   554 raft_consensus.cc:606] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:52.058600   554 raft_consensus.cc:614] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:52.059827  3772 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:52.060079  3582 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:52.069940  3830 raft_consensus.cc:3055] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:52.070441  3830 raft_consensus.cc:740] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:52.071522  1169 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:57004
I20260709 13:13:52.072106  1169 raft_consensus.cc:606] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:52.072420  1169 raft_consensus.cc:614] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:52.077152   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.077893   631 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 8: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:52.077701   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.078064   554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82382f158074497a857b03f9f87f9e86"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:13:52.078615   554 raft_consensus.cc:606] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:52.079654   633 raft_consensus.cc:1275] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:52.080951   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.081883   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.082154   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.082491   624 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:13:52.082708   633 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:52.083369   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.083595   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.084874   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.085762   478 raft_consensus.cc:2410] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:13:52.091748   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:52.092563   481 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:52.100092   554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:13:52.100961   554 raft_consensus.cc:606] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:52.101377   554 raft_consensus.cc:614] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:52.101261   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.102277   630 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:52.103788 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:52.105984 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:52.105822   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.108139   625 raft_consensus.cc:2393] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 7: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:52.086952   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.115777   478 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:52.116884   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:52.117504   478 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:52.124729   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.132189   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.133809   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:52.134917   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:52.015723  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 105380us
I20260709 13:13:52.137600   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.139322   633 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:52.143421   476 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:13:52.144881  1138 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:13:52.144354   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 125738us
I20260709 13:13:52.153877   522 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:52.157179   522 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:52.158257   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.160501   476 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:52.170929   478 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:52.174356   481 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:52.176601   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:52.177224   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.152974  3619 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:52.181488  1167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 653) took 2519 ms. Trace:
I20260709 13:13:52.206190  3619 raft_consensus.cc:697] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:52.206120  1167 rpcz_store.cc:276] 0709 13:13:49.662161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.665017 (+  2856us) service_pool.cc:224] Handling call
0709 13:13:50.436163 (+771146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.474997 (+ 38834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.181276 (+1706279us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54004d3350. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:52.181406 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1712625024}
I20260709 13:13:52.206709   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.207350  3619 consensus_queue.cc:237] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:52.211248  1138 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:52.185448   522 leader_election.cc:400] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9.
I20260709 13:13:52.186666   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.216033   522 leader_election.cc:403] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:52.216286   625 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:13:52.216414   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.188447   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:52.217306   483 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:52.198002  3825 log.cc:927] Time spent T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.575s	user 0.000s	sys 0.002s
I20260709 13:13:52.203045   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1829) took 1698 ms. Trace:
I20260709 13:13:52.204486  3844 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:52.172585  3582 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:52.152948  3830 consensus_queue.cc:260] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:52.211723  3575 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:52.174072  3828 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:52.218353  1138 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:52.221065  3503 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:13:52.221483   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 47271.7us
I20260709 13:13:52.221551  3633 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9.
I20260709 13:13:52.225795  3689 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:52.263859   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.172384  3766 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:52.217260  3813 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:52.229136   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.284160   481 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:52.228154   550 rpcz_store.cc:276] 0709 13:13:50.504982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.507316 (+  2334us) service_pool.cc:224] Handling call
0709 13:13:52.202141 (+1694825us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b5800116198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3f2fc0 00007f4b6d3dd929 00007f4b6d3dd3d2 00007f4b66954bd4
0709 13:13:52.202358 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.202588 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.202617 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:52.202680 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:52.202711 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.202801 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.202954 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5234432}
I20260709 13:13:52.226466  3803 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:52.231992   483 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
W20260709 13:13:52.230185   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 195753us
I20260709 13:13:52.240345   447 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:52.287974   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.288597   627 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
W20260709 13:13:52.288681   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 56035.8us
I20260709 13:13:52.242681  1138 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:52.244418   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:52.289724  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 47196.3us
I20260709 13:13:52.257802   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.293596   478 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:52.283010   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:52.245041   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:52.294772   630 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:52.296506   554 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:13:52.268352  3759 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.020s	sys 0.020s
I20260709 13:13:52.300365   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:52.257243  3204 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:52.228236  3758 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:52.313354   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1809) took 1487 ms. Trace:
I20260709 13:13:52.313819   553 rpcz_store.cc:276] 0709 13:13:50.826242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.786827 (+960585us) service_pool.cc:224] Handling call
0709 13:13:51.820065 (+ 33238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:51.871421 (+ 51356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:51.871471 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:51.921615 (+ 50144us) log.cc:844] Serialized 26 byte log entry
0709 13:13:52.138430 (+216815us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:52.138483 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.156820 (+ 18337us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:52.313123 (+156303us) raft_consensus.cc:1685] finished
0709 13:13:52.313148 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.313292 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31124,"raft.queue_time_us":38505,"thread_start_us":172817,"threads_started":1,"wal-append.queue_time_us":375745}
I20260709 13:13:52.315541  3765 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.316128  3765 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:52.318085   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.301690  3510 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:52.319509   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.320101   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.302122  3808 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:13:52.320845   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:52.321002   556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1828) took 1816 ms (client timeout 2207 ms). Trace:
W20260709 13:13:52.301318  3759 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.020s	sys 0.020s
I20260709 13:13:52.324555   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1797) took 1511 ms. Trace:
I20260709 13:13:52.325074  3758 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:52.324970   482 rpcz_store.cc:276] 0709 13:13:50.813129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.813246 (+   117us) service_pool.cc:224] Handling call
0709 13:13:50.813519 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:50.849981 (+ 36462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.324315 (+1474334us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b54000d6bd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:52.324493 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82278272}
I20260709 13:13:52.299537  3813 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:52.301506  3130 consensus_queue.cc:1048] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:13:52.333422   629 raft_consensus.cc:2368] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9.
I20260709 13:13:52.267410   599 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:52.335181   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 67882.9us
W20260709 13:13:52.321421   556 rpcz_store.cc:269] 0709 13:13:50.504655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.504796 (+   141us) service_pool.cc:224] Handling call
0709 13:13:52.319953 (+1815157us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b5800116198. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:52.320942 (+   989us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7977344}
I20260709 13:13:52.336149   599 leader_election.cc:304] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:52.264813   626 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:13:52.308243   597 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:52.338445   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.341526   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.343019   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.257438  3564 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.349726   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.350504   481 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:52.346436   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.346771   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:52.352177  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:52.352715   627 raft_consensus.cc:2393] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 8: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:52.260818  3754 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:52.347864   482 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:13:52.355825  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:52.347985   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.344246   556 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:13:52.354564   557 raft_consensus.cc:1275] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:52.355165   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.355345  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:52.307142  3575 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:52.355064  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:52.355695  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:52.363142  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:52.351763   554 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:52.357122   550 raft_consensus.cc:2410] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:13:52.233078  3818 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 13:13:52.363869   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.346442  3758 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:52.367586  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:52.376178  1175 raft_consensus.cc:2410] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:13:52.369047   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1798) took 1555 ms. Trace:
W20260709 13:13:52.367442  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 135195us
I20260709 13:13:52.298004  3843 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:52.319053  3765 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:52.361651   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:52.371820   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:52.349609  3808 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:52.376003   599 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:52.377178   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.384578   550 raft_consensus.cc:2393] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 8: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:52.338204  3766 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.373149   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:52.380211   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.337459  3204 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:52.381076   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:52.381356   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.387220  3765 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:52.389952   552 raft_consensus.cc:2410] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:13:52.381021   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.390388   477 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:52.391536   448 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:52.429730   448 leader_election.cc:400] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8.
I20260709 13:13:52.430032   448 leader_election.cc:403] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:13:52.389524   599 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:52.432128  3575 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:52.432403  3831 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:52.433049  3831 raft_consensus.cc:697] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:52.433987  3831 consensus_queue.cc:237] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:52.436666   477 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:52.404731   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.436478  3616 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:52.438380   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.405023   626 raft_consensus.cc:2393] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:52.440032   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:52.431097   599 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:52.441217   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:52.441375  3513 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:52.441802   599 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:52.392493  3766 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:52.442296   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.443146  3758 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:52.442947   626 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:13:52.444723  3730 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:52.445138  3730 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:52.445538  3730 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:52.448222  1138 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:52.448637   626 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:52.439057  3616 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8.
I20260709 13:13:52.442971   599 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:52.370857  3791 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:52.418473  3582 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:52.404606  3488 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:52.420596   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:52.421587  3838 consensus_queue.cc:1048] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:13:52.376969   479 rpcz_store.cc:276] 0709 13:13:50.813404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.813503 (+    99us) service_pool.cc:224] Handling call
0709 13:13:50.821751 (+  8248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:50.920471 (+ 98720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:50.920503 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:50.963822 (+ 43319us) log.cc:844] Serialized 26 byte log entry
0709 13:13:51.381690 (+417868us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:51.381725 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.197187 (+815462us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:52.368765 (+171578us) spinlock_profiling.cc:243] Waited 96.6 ms on lock 0x7b54002dcb54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:52.368817 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:52.368857 (+    40us) raft_consensus.cc:1685] finished
0709 13:13:52.368869 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.368990 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252671104,"thread_start_us":288145,"threads_started":1,"wal-append.queue_time_us":480450}
I20260709 13:13:52.358863  3564 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:52.394207  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:52.436913   448 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:52.449817  3857 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:52.383702  3808 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:13:52.451908   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:52.460685   558 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1819) took 2969 ms (client timeout 2623 ms). Trace:
I20260709 13:13:52.461701   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.477121   448 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:52.491072   554 raft_consensus.cc:2410] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:13:52.397719   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.453714   482 raft_consensus.cc:2393] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 8: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:52.411799  3204 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:52.458909  1172 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:52.451536   476 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:52.374186  3781 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:13:52.463984   483 raft_consensus.cc:1240] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:52.492803   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.461236   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:52.493495   626 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:52.503054   550 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:52.496296   479 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 7. Current term is 8. Ops: [5.8-7.9]
I20260709 13:13:52.496456  3813 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:52.496537   551 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:13:52.497025  3770 raft_consensus.cc:3055] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:13:52.490530   558 rpcz_store.cc:269] 0709 13:13:49.483903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.496199 (+ 12296us) service_pool.cc:224] Handling call
0709 13:13:52.453462 (+2957263us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000eb354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:52.453579 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2459108096}
I20260709 13:13:52.506314   553 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:52.508647   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.510165   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:52.460705  3765 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.511319   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:52.518218   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.453035  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:52.520040   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:52.525982   551 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:52.526173   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.475093  3130 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:52.474975  3857 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:52.527288   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:52.499655  3843 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:52.492030  3826 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.528080   630 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:13:52.522017   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.546020   479 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:52.491668  3808 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:52.534300   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.508929  3791 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:52.515400  3818 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:52.560166  3818 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.560684  3818 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:52.561722  3781 raft_consensus.cc:3055] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:52.562150  3781 raft_consensus.cc:740] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:52.532986  3857 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:52.562989  3781 consensus_queue.cc:260] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:52.563768  3754 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:52.564312  3781 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:52.561758   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.528544  3765 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:52.566576   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.568722  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:52.507422  3770 raft_consensus.cc:740] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:52.576416  3770 consensus_queue.cc:260] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:52.577824  3770 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:52.578050  1172 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:52.579355  3826 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:52.579959   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:52.580464   557 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:52.580727   479 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:52.581609  3826 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:52.586727   628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 403) took 2245 ms. Trace:
I20260709 13:13:52.587189   628 rpcz_store.cc:276] 0709 13:13:50.341212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.362338 (+ 21126us) service_pool.cc:224] Handling call
0709 13:13:50.362676 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.635697 (+273021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.586428 (+1950731us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54001ae0d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:52.586631 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512616832}
W20260709 13:13:52.590435   559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43548 (request call id 357) took 1774 ms (client timeout 1784 ms). Trace:
I20260709 13:13:52.549615   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:52.531133  3130 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:52.551093  3771 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:52.590903   559 rpcz_store.cc:269] 0709 13:13:50.816304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.381085 (+564781us) service_pool.cc:224] Handling call
0709 13:13:52.590211 (+1209126us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54000eb854. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:52.590371 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468735360}
I20260709 13:13:52.598681   554 raft_consensus.cc:2393] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 8: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:52.551731   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:52.553596  3863 log.cc:927] Time spent T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:13:52.555133  3829 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:52.505587  3575 consensus_queue.cc:1059] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:13:52.558511  3766 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:52.604773   630 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:13:52.605496  3766 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:52.592777   448 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:52.593670   556 raft_consensus.cc:1240] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:52.597364   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.524621  3758 raft_consensus.cc:697] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:52.551524  1171 raft_consensus.cc:1240] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:13:52.600903   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.600281  3754 consensus_queue.cc:1059] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:13:52.600024  3771 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:52.602447   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.600127  3130 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:52.612886   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:52.620330  3747 raft_consensus.cc:3055] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:52.620596  3564 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:52.599144  3616 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:13:52.631170   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 188249us
I20260709 13:13:52.644425   551 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:13:52.655431   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.660027   599 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:52.664214   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.665737   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:52.665858   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.666425   554 raft_consensus.cc:2376] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8. Re-sending same reply.
I20260709 13:13:52.671561   551 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:52.674293   599 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:52.682554   599 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:52.685491   557 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:52.688364  3616 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:52.688903   557 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:52.690727   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:52.691706   557 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 6: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:52.692826   557 raft_consensus.cc:1240] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:52.693897  3774 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:52.695113  1139 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:52.695963   599 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:52.696815   599 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:52.697539  1139 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:52.697885   599 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:52.698134  3791 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:52.699222  3834 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:52.699335  3791 raft_consensus.cc:697] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:52.699868  3834 raft_consensus.cc:697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:52.700886  3834 consensus_queue.cc:237] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:52.701826  3859 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:52.702641  3859 consensus_queue.cc:1243] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer 6ba2a9c02b534120bbf26e56a1e920ca log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:13:52.703408  3774 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:52.704116  3859 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:52.706142  3859 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:52.706203   599 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:52.707682   599 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:52.658363  3747 raft_consensus.cc:740] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:52.720855   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.719254  3774 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:13:52.717334   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.727741   550 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:52.707058  3859 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:52.729382  3859 raft_consensus.cc:697] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:52.730492  3859 consensus_queue.cc:237] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:52.734268   479 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:52.700700  3791 consensus_queue.cc:237] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:52.711448  3803 raft_consensus.cc:3055] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:52.697933  3589 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:52.740788  3771 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:52.679013  3874 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:52.747638   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:52.747867  3871 log.cc:927] Time spent T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:13:52.752489   522 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:52.670924  3808 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:52.722350  3774 raft_consensus.cc:697] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:52.751087  3803 raft_consensus.cc:740] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:52.768788   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:52.759471  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:52.753633  3589 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:52.775228   525 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:52.783864   627 raft_consensus.cc:2393] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 7: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:13:52.759450   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 303425us
I20260709 13:13:52.785972   525 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:52.800699   525 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:52.754256  3758 consensus_queue.cc:237] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:52.776790  3683 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.019s	user 0.027s	sys 0.028s
W20260709 13:13:52.813565  3683 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.058s	user 0.028s	sys 0.028s
W20260709 13:13:52.815742   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 49079.5us
I20260709 13:13:52.816591   522 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:52.817504   597 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:52.821012   597 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:52.824695  3876 consensus_queue.cc:1059] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:52.825364  3582 raft_consensus.cc:3055] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:52.825139  3774 consensus_queue.cc:237] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:52.825773  3582 raft_consensus.cc:740] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:52.833953   552 raft_consensus.cc:1240] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:52.825621  3876 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:52.834772   522 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:52.835460   525 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:52.797947  3589 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:52.808612  3843 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:52.812835  3633 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:52.846557   525 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:52.756758  3747 consensus_queue.cc:260] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:52.851950   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.852614  3818 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:52.826778  3582 consensus_queue.cc:260] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:52.855772  3582 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:52.857360   479 raft_consensus.cc:2368] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10.
W20260709 13:13:52.864303   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.841511  3781 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:52.840911  3564 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:52.855147  3818 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:52.866961  3705 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:52.843564  3826 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:52.876133   552 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:13:52.840593  3730 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:52.873562   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 280884us
I20260709 13:13:52.869334  3747 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:52.910490   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:52.828064  3803 consensus_queue.cc:260] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:52.873860  3770 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:13:52.897972   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 63277.6us
W20260709 13:13:52.909698   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 131057us
I20260709 13:13:52.912922   475 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:13:52.884745  3564 raft_consensus.cc:697] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:52.910121  3633 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:52.929478   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:52.932556   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.943760   522 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:52.946782   479 raft_consensus.cc:2410] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:13:52.934502   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.948081   477 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:13:52.949103   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.949841   477 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:52.950766   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.935863  1138 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:52.927249   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.942030   599 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:52.954990   627 raft_consensus.cc:2393] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:52.962805   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:52.961900  1139 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:52.963783   556 pending_rounds.cc:85] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 8
I20260709 13:13:53.005206   556 pending_rounds.cc:107] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:13:53.005568   556 raft_consensus.cc:2889] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:52.969426   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.970289   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:52.928056  3808 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:52.957437  3513 consensus_queue.cc:1059] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:13:52.979985  3765 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:52.993672   481 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:52.939508  3781 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.914476  3857 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:52.996598   475 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:52.954656  3759 consensus_queue.cc:1059] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:13:52.954691  3766 consensus_queue.cc:1059] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:13:52.999770   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:52.972162  3639 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
W20260709 13:13:52.923269   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 99385.6us
W20260709 13:13:53.045008   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.075924   627 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:53.034444   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:53.076866   632 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:13:52.963965   447 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:52.939519  3818 consensus_queue.cc:1059] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
W20260709 13:13:53.030304   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.958990   477 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:52.967154  3705 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:53.035681   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:52.962620  3717 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:13:53.011831  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 50032.7us
I20260709 13:13:53.084739   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:53.075825   597 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:52.958518  3748 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:53.079694   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 115863us
I20260709 13:13:53.088709   447 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:53.081512   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:53.085551   477 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
W20260709 13:13:53.060128  3894 log.cc:927] Time spent T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:13:53.095047   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:53.030084  3792 raft_consensus.cc:3055] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:53.104666   477 raft_consensus.cc:1275] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 13:13:53.064332  3842 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:53.023382  3582 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:53.104079   479 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:53.106144   477 pending_rounds.cc:85] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 7
I20260709 13:13:53.117633   477 pending_rounds.cc:107] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:13:53.117717   630 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:13:53.118013   477 raft_consensus.cc:2889] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:53.084197  3488 raft_consensus.cc:2764] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:13:53.106473   447 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:53.120232   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:53.091953  3717 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:13:53.125068  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.097970  3705 raft_consensus.cc:697] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:53.133852   447 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:53.106732  3515 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:53.105610  3808 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:53.137122   481 raft_consensus.cc:2410] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:13:53.119168  3513 raft_consensus.cc:3055] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:53.105857  3792 raft_consensus.cc:740] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:53.082697  3781 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:53.149420  3705 consensus_queue.cc:237] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:53.129740  3763 consensus_queue.cc:1059] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:13:53.151796  3130 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:53.152245  3876 raft_consensus.cc:3055] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:53.153720  3876 raft_consensus.cc:740] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:53.154191  3130 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:53.154670  3876 consensus_queue.cc:260] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:53.155113   475 raft_consensus.cc:1240] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:53.155963  3876 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:53.158407  3589 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:53.062731  3564 consensus_queue.cc:237] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:53.160526  1175 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:13:53.161336  3589 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:53.162617  3130 consensus_queue.cc:1059] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:13:53.143972  3891 log.cc:927] Time spent T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:13:53.140404  3513 raft_consensus.cc:740] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:53.163816  3700 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:53.139041   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:53.148891  3792 consensus_queue.cc:260] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:53.162762  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:53.151381  3781 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:53.141135   447 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:53.167078   479 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:53.106674  3759 consensus_queue.cc:1059] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:13:53.136070  3717 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:53.138592  3818 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:53.132287  3730 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:53.121567  3859 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:13:53.141072  3515 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.191885   479 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:53.192615   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:53.173799  3488 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:53.171728  3886 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:13:53.205679  3902 log.cc:927] Time spent T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:13:53.201982   479 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:53.179951  3818 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.213277  3818 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:53.215771  3880 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:13:53.217806   482 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:13:53.220788  3818 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:53.224265  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:53.225003  1175 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:53.227876  3857 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:53.178534  3792 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:53.222910  3818 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:53.232746  1175 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:13:53.233829   448 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:53.234895  3818 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:53.197566  3515 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:53.235769  3818 raft_consensus.cc:697] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:13:53.247838  3899 log.cc:927] Time spent T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:13:53.237108  3818 consensus_queue.cc:237] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:53.249370  3765 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:53.164180  3513 consensus_queue.cc:260] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:53.250918  3513 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:53.258805   479 raft_consensus.cc:1240] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: []
W20260709 13:13:53.261462   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:53.270568   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 127361us
I20260709 13:13:53.274399   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:53.165640  3774 consensus_queue.cc:1059] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:13:53.283221   550 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:13:53.286165  1175 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:53.293154   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:53.296116   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.297067  3747 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:53.297727  3747 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:53.302367   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:53.302569  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:53.303560   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:53.304229   555 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 8: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:53.305228  3747 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:53.316246   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:53.321720  3810 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:13:53.322540  3903 log.cc:927] Time spent T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:13:53.327514  3888 raft_consensus.cc:3055] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:53.328176  3888 raft_consensus.cc:740] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:53.330251   484 raft_consensus.cc:1240] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:53.336246  1141 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:53.337754   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.343400   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:53.344695   633 raft_consensus.cc:2410] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:13:53.348073   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:53.359282   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:53.362974   633 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:53.364874   477 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:53.372715   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:53.352509  3857 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:53.365949  3896 log.cc:927] Time spent T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:13:53.432125   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.402648   628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1655) took 1149 ms. Trace:
I20260709 13:13:53.413601  3130 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.416226   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1642) took 1172 ms. Trace:
I20260709 13:13:53.420258   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1652) took 1168 ms. Trace:
I20260709 13:13:53.421864  3664 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:53.400291  3906 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:13:53.436892   626 rpcz_store.cc:276] 0709 13:13:52.251983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.449477 (+197494us) service_pool.cc:224] Handling call
0709 13:13:52.449748 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.502620 (+ 52872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.419919 (+917299us) spinlock_profiling.cc:243] Waited 43.5 ms on lock 0x7b54002bbbd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:53.420173 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100082048}
I20260709 13:13:53.435958   629 rpcz_store.cc:276] 0709 13:13:52.243673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.261287 (+ 17614us) service_pool.cc:224] Handling call
0709 13:13:53.415923 (+1154636us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b5400123754. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:53.416126 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73782528}
I20260709 13:13:53.444655   477 raft_consensus.cc:1240] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:53.432771   628 rpcz_store.cc:276] 0709 13:13:52.253670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.588605 (+334935us) service_pool.cc:224] Handling call
0709 13:13:52.589049 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:52.589458 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.589490 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:53.155567 (+566077us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b2c00072b18. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b66d12a11 00007f4b66d22372 00007f4b68454a01 00007f4b6841943a 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2
0709 13:13:53.155978 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 13:13:53.268901 (+112923us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:53.268952 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.269048 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:53.402197 (+133149us) raft_consensus.cc:1685] finished
0709 13:13:53.402231 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.402547 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8871,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":732,"spinlock_wait_cycles":11432832,"thread_start_us":112454,"threads_started":1,"wal-append.queue_time_us":159624}
I20260709 13:13:53.355763  3754 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:13:53.451632   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:53.472785   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:53.432343  3830 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:53.481974   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:53.483913   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:53.485700   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:53.495378   552 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:53.501319   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:53.512243   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:53.512960   628 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:53.513832   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:53.515594   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:53.516619   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:53.517072   629 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:53.514935   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:53.524360   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:53.442754  3130 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:53.496491  3488 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.535130   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:53.532123   633 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:53.538151   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:53.542524   629 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
W20260709 13:13:53.530889  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 175960us
I20260709 13:13:53.545156  1141 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:53.548734   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:53.549600   628 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:13:53.550714   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:53.552264   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:53.553012   633 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:53.551601   626 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:13:53.579813   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:53.581595   626 raft_consensus.cc:2410] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:13:53.546914  3748 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:53.585114  1141 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:53.595418   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:53.596968   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 144650us
I20260709 13:13:53.598222   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 413) took 1250 ms. Trace:
I20260709 13:13:53.598886   626 rpcz_store.cc:276] 0709 13:13:52.342448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.586635 (+1244187us) service_pool.cc:224] Handling call
0709 13:13:53.591889 (+  5254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:53.592129 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:53.592167 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:53.592230 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:53.592290 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.592367 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.592520 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:53.598258   597 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:53.603562   633 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:13:53.547957  3488 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:53.606596  1138 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:53.608100   597 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:53.608321   633 raft_consensus.cc:1240] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:13:53.610350   629 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:13:53.610973   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 414) took 1267 ms. Trace:
I20260709 13:13:53.611475   629 rpcz_store.cc:276] 0709 13:13:52.343393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.587419 (+1244026us) service_pool.cc:224] Handling call
0709 13:13:53.605369 (+ 17950us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:53.610760 (+  5391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.610925 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:53.612701   626 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:53.600871  3727 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:53.621260   626 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:13:53.621888  3895 log.cc:927] Time spent T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.527s	user 0.001s	sys 0.000s
I20260709 13:13:53.623713  3916 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:53.624294  3916 raft_consensus.cc:697] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:53.624217  3515 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:53.625526  3916 consensus_queue.cc:237] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:53.626798  3515 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:53.624176  3898 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.518s	user 0.004s	sys 0.000s
I20260709 13:13:53.613556  3834 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:53.628760 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:53.629964   481 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:13:53.630745  3488 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:53.631446  3727 raft_consensus.cc:697] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:53.632520  3727 consensus_queue.cc:237] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:53.636389   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1842) took 1139 ms. Trace:
I20260709 13:13:53.636680   628 raft_consensus.cc:1240] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:53.636772   551 rpcz_store.cc:276] 0709 13:13:52.497119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.668975 (+171856us) service_pool.cc:224] Handling call
0709 13:13:52.671409 (+  2434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.671921 (+   512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.636158 (+964237us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b5400387f50. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:53.636302 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4809088}
I20260709 13:13:53.622625   597 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:53.631050  3717 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:53.639590   627 raft_consensus.cc:2393] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 8: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:53.640374  3717 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:53.647728   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1657) took 1392 ms. Trace:
W20260709 13:13:53.649771   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:53.652952  3911 log.cc:927] Time spent T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:13:53.619385  3748 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:53.618741  3792 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:53.648067   631 rpcz_store.cc:276] 0709 13:13:52.255217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.661396 (+406179us) service_pool.cc:224] Handling call
0709 13:13:52.661832 (+   436us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:52.682028 (+ 20196us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:52.724260 (+ 42232us) log.cc:844] Serialized 14 byte log entry
0709 13:13:53.098134 (+373874us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:53.130744 (+ 32610us) log.cc:844] Serialized 52 byte log entry
0709 13:13:53.130912 (+   168us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:53.131180 (+   268us) log.cc:844] Serialized 14 byte log entry
0709 13:13:53.138080 (+  6900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.138162 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:53.647526 (+509364us) raft_consensus.cc:1685] finished
0709 13:13:53.647549 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.647673 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25645,"prepare.queue_time_us":47862,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":89,"raft.queue_time_us":31254,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":13655,"spinlock_wait_cycles":12525312,"thread_start_us":348466,"threads_started":1,"wal-append.queue_time_us":452558}
I20260709 13:13:53.659035   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1689) took 1365 ms. Trace:
W20260709 13:13:53.655282   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.656188   478 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:53.659423   476 rpcz_store.cc:276] 0709 13:13:52.289880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.320603 (+ 30723us) service_pool.cc:224] Handling call
0709 13:13:53.655590 (+1334987us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b540020e9d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:53.655713 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256265088}
W20260709 13:13:53.654639  3582 consensus_meta.cc:287] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.002s
I20260709 13:13:53.664958   558 raft_consensus.cc:1240] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:53.660689   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:53.658900  3908 log.cc:927] Time spent T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:13:53.656186  3808 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:53.671993   552 raft_consensus.cc:1275] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:53.660137  3748 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:13:53.679595   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.681519   631 raft_consensus.cc:1240] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:53.669441  3582 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:53.668934  3792 raft_consensus.cc:697] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:53.689385  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:53.680850  3748 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:53.691308  1175 raft_consensus.cc:1240] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:53.692428  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 107447us
W20260709 13:13:53.691672  3914 log.cc:927] Time spent T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:13:53.693439  3130 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:53.694097  1141 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:53.696161   597 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:53.697795   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1692) took 1407 ms. Trace:
I20260709 13:13:53.698199   483 rpcz_store.cc:276] 0709 13:13:52.290612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.450243 (+159631us) service_pool.cc:224] Handling call
0709 13:13:52.450518 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.502063 (+ 51545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.697585 (+1195522us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b5400229f54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:53.697737 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30414592}
I20260709 13:13:53.698984  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:53.699761  1168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 529) took 1310 ms. Trace:
I20260709 13:13:53.700372   625 raft_consensus.cc:1240] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:53.700098  1168 rpcz_store.cc:276] 0709 13:13:52.389469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.389820 (+   351us) service_pool.cc:224] Handling call
0709 13:13:53.698835 (+1309015us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:13:53.699705 (+   870us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31755648}
I20260709 13:13:53.708432   625 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:13:53.707047  3859 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:13:53.695784  3915 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:53.712174  3629 raft_consensus.cc:3055] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:53.712551  3629 raft_consensus.cc:740] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:53.713332  3629 consensus_queue.cc:260] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:53.714864  3629 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:53.710134  3920 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:13:53.722033   557 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:13:53.722800   522 leader_election.cc:400] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9.
I20260709 13:13:53.724305   522 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:53.727612   522 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:53.733023   522 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:53.742198   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.705428  3834 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:53.748673   522 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:53.728295  3705 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:53.764703   447 leader_election.cc:336] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 1.557s (SENT)
I20260709 13:13:53.766506   632 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:13:53.766886   447 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:53.694808  3792 consensus_queue.cc:237] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:53.769292   632 raft_consensus.cc:1240] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:13:53.758333  3854 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:53.751577  3564 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:53.776573  3803 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:53.780112   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1656) took 1525 ms. Trace:
I20260709 13:13:53.780395   630 rpcz_store.cc:276] 0709 13:13:52.254909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.605786 (+350877us) service_pool.cc:224] Handling call
0709 13:13:52.606169 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:53.118391 (+512222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.779833 (+661442us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54001e4e54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:53.780061 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1171184512}
I20260709 13:13:53.790565  3705 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:53.791129  3705 raft_consensus.cc:697] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:13:53.792462   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 43874.3us
I20260709 13:13:53.771626  3854 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:53.799819  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.812700   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 505) took 1481 ms. Trace:
I20260709 13:13:53.813284   475 rpcz_store.cc:276] 0709 13:13:52.330973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.107869 (+776896us) service_pool.cc:224] Handling call
0709 13:13:53.119507 (+ 11638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:53.155780 (+ 36273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.812335 (+656555us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b540022d654. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:53.812588 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81414912}
I20260709 13:13:53.817135  3830 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.817730  3830 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:53.821040  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:53.822758  3830 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:53.802145  3854 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:53.792042  3705 consensus_queue.cc:237] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:53.836755  1166 raft_consensus.cc:1240] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:53.840179  1168 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:53.842284  3770 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:53.842784  3770 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:53.847307  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:13:53.857683  3922 log.cc:927] Time spent T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:13:53.860795   556 raft_consensus.cc:1275] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:13:53.803527  3748 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:53.879323   557 raft_consensus.cc:3055] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:53.879875   557 raft_consensus.cc:740] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:53.884640   557 consensus_queue.cc:260] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:53.888137  1168 raft_consensus.cc:1240] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:53.896504  3842 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:53.897154  3842 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:53.883060  3582 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.910789   557 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:53.886776  3857 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:53.917066  3888 consensus_queue.cc:260] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:53.918200  3888 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:53.921455   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:53.929522   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.930426  3876 raft_consensus.cc:3055] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:53.930804  3876 raft_consensus.cc:740] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:53.931685  3876 consensus_queue.cc:260] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:53.932768   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 168091us
I20260709 13:13:53.935487  3748 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:53.935591  3513 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:53.935148   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 107061us
I20260709 13:13:53.932806  3876 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:53.943357   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:53.943869   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.913224  3582 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:53.945883  3582 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:53.948244  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:53.923026   525 leader_election.cc:400] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10.
I20260709 13:13:53.962762   525 leader_election.cc:403] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:13:53.887437  3564 raft_consensus.cc:697] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:53.946959   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:53.975000   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:53.968314   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:53.975643   559 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:53.976267   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:53.979692   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:53.980228   556 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:53.985219   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:53.986018   551 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:13:53.990399   484 raft_consensus.cc:1275] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:13:53.990243   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:53.992743   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:54.000239   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:54.009637   556 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:13:53.973299  3838 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:13:53.993469  3904 log.cc:927] Time spent T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.817s	user 0.003s	sys 0.000s
W20260709 13:13:53.995839  3664 consensus_meta.cc:287] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.553s	user 0.006s	sys 0.004s
I20260709 13:13:54.021579   484 raft_consensus.cc:1275] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:13:54.033354   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 113168us
W20260709 13:13:54.035215   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:54.036963   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.041715   599 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:54.039095   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:54.050436   624 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:54.042475   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:54.078528   480 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:13:53.984454  3920 consensus_queue.cc:1059] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:13:54.081377   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 46248.3us
I20260709 13:13:54.082032   599 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:54.085851   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:54.086534   632 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:13:54.087387   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:54.088368   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:54.090359   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:53.994141  3854 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:54.105435   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:54.106864   631 raft_consensus.cc:2393] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 8: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:54.107723   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:54.108575   630 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
W20260709 13:13:54.109191   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 316004us
I20260709 13:13:54.102100   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:54.111346   628 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:54.115314   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:54.116150   632 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:54.125886   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1776) took 1215 ms. Trace:
I20260709 13:13:54.126371   633 rpcz_store.cc:276] 0709 13:13:52.910983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.609855 (+698872us) service_pool.cc:224] Handling call
0709 13:13:53.610210 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:53.610658 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:53.610699 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:53.611293 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:13:53.922411 (+311118us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b180016ada0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb90d1 00007f4b683d4a0f
0709 13:13:54.056272 (+133861us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:54.056325 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.056414 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:54.125563 (+ 69149us) raft_consensus.cc:1685] finished
0709 13:13:54.125582 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.125820 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27089,"raft.queue_time_us":1684,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":4170,"spinlock_wait_cycles":5757184,"thread_start_us":133677,"threads_started":1,"wal-append.queue_time_us":509819}
I20260709 13:13:54.128011   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:54.130334   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 370) took 1169 ms. Trace:
I20260709 13:13:54.130944   553 rpcz_store.cc:276] 0709 13:13:52.961076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.963045 (+  1969us) service_pool.cc:224] Handling call
0709 13:13:52.990782 (+ 27737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:53.002892 (+ 12110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:53.002939 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:53.903595 (+900656us) spinlock_profiling.cc:243] Waited 6.55 ms on lock 0x7b2c00070ee8. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b66d12a11 00007f4b66d22372 00007f4b68454a01 00007f4b6841943a 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2
0709 13:13:53.912015 (+  8420us) log.cc:844] Serialized 26 byte log entry
0709 13:13:54.129680 (+217665us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:54.129740 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.129835 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:54.129896 (+    61us) raft_consensus.cc:1685] finished
0709 13:13:54.129915 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.130262 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1937,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":7540,"spinlock_wait_cycles":15072128,"thread_start_us":182573,"threads_started":1,"wal-append.queue_time_us":177439}
I20260709 13:13:54.135630   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:54.139189   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:54.170224   630 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
W20260709 13:13:54.143932   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 209238us
I20260709 13:13:54.079753  3773 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.089510  3664 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:54.152963  3580 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:54.153704   632 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:13:54.155707   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1704) took 1777 ms. Trace:
I20260709 13:13:54.156248   558 raft_consensus.cc:1240] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 10. Current term is 11. Ops: []
W20260709 13:13:54.192286  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:54.159271   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.161229  3920 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:54.164685  3854 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:54.024535  3838 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:54.172382   447 leader_election.cc:336] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 1.582s (SENT)
I20260709 13:13:54.194624   447 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:54.195905   447 leader_election.cc:336] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 1.593s (SENT)
I20260709 13:13:54.196439   447 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:54.173220   553 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:13:54.188334   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:54.156584  3715 consensus_queue.cc:1048] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:54.190372   481 rpcz_store.cc:276] 0709 13:13:52.377934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.141097 (+763163us) service_pool.cc:224] Handling call
0709 13:13:53.141410 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:53.630390 (+488980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.155417 (+525027us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b540020e4d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:54.155636 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1122979712}
I20260709 13:13:54.203074   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:54.193295   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 270404us
I20260709 13:13:54.203863   631 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:13:54.199200  3803 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:54.210103  3684 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:54.212116   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:54.213188   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 131165us
I20260709 13:13:54.213989   597 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:54.221822  3754 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:54.222453  3754 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:54.223655  3488 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:54.224880  3580 raft_consensus.cc:697] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:54.225163  3715 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:54.225834  3580 consensus_queue.cc:237] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:54.226009   597 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:54.227146  3715 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:54.227756   597 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:54.228796  3664 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:54.230702  3664 consensus_queue.cc:1059] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:54.231586  3933 consensus_queue.cc:1059] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:54.235127   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:54.238464  1168 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:54.239464  3774 consensus_queue.cc:1048] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:13:54.244688   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 259373us
I20260709 13:13:54.253259   557 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:13:54.256546   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:54.165845  3717 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:13:54.266016   480 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:13:54.296002   448 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:54.207420  3879 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.288008   557 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:54.304312   448 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:54.312367  3791 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:13:54.316567   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 120600us
W20260709 13:13:54.328823   447 leader_election.cc:336] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 1.625s (SENT)
I20260709 13:13:54.329973   447 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:54.304481   631 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:13:54.321404   630 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:13:54.333577   631 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:54.266657  3814 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
W20260709 13:13:54.334851  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 194138us
I20260709 13:13:54.193032  3773 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:54.257671  3581 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:54.335572  3907 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:13:54.350302   630 raft_consensus.cc:1275] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:54.351926   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:54.356511   481 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:13:54.323496  3886 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:54.353386   447 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:54.350396  1139 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:54.144924  3564 consensus_queue.cc:237] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:54.365361   447 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:54.345786  3488 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:54.366132  3581 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:54.255438  3629 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:13:54.367395   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:54.370016  3886 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.343912  3130 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:54.385756   480 raft_consensus.cc:2410] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:13:54.343130  3929 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:54.334555  3204 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:13:54.303059  3770 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:54.336097  3927 consensus_queue.cc:1059] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:13:54.380513   447 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:54.370565   628 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:13:54.381943   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:54.393306   481 raft_consensus.cc:2393] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 8: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
W20260709 13:13:54.382524   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 176485us
I20260709 13:13:54.371541  3803 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:54.342051  3879 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:54.394796   525 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:54.382097  3513 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:54.385794  3886 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:54.420199  3826 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.423498   555 raft_consensus.cc:1275] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:54.371657  3939 consensus_queue.cc:1059] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 13:13:54.400161  3792 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.006s	sys 0.013s
I20260709 13:13:54.447108  3773 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:54.432060   624 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1751) took 2351 ms (client timeout 1947 ms). Trace:
W20260709 13:13:54.634392  3792 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.006s	sys 0.014s
W20260709 13:13:54.475119   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 80420.6us
I20260709 13:13:54.597643  3130 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:54.632510  3754 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:54.387816  3488 raft_consensus.cc:697] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:54.690302  3488 consensus_queue.cc:237] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:54.411584  3915 consensus_queue.cc:1059] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.239s
W20260709 13:13:54.641773   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.389778  3918 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.641669   633 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:13:54.393635   447 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:54.633797  3803 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:54.643457   624 rpcz_store.cc:269] 0709 13:13:52.080779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.083102 (+  2323us) service_pool.cc:224] Handling call
0709 13:13:54.431792 (+2348690us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b54001e3554. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:54.431959 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4522459008}
W20260709 13:13:54.632437  3919 log.cc:927] Time spent T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:13:54.452628  3877 raft_consensus.cc:3055] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:54.648150   525 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:54.657055   625 raft_consensus.cc:1240] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: []
W20260709 13:13:54.624244   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 319921us
I20260709 13:13:54.721012   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:54.689194  3959 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:54.408188  3683 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:54.645219  3859 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:54.392577  3929 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:54.707469  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.709810   626 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:13:54.740242  3773 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:54.708638  3629 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:54.766134   626 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:54.737340  1175 raft_consensus.cc:1240] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:54.724416   559 consensus_meta.cc:287] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.746s	user 0.006s	sys 0.005s
I20260709 13:13:54.767374   559 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:13:54.732039  3924 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.731796  3792 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.719749  3803 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:54.727289   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 333682us
I20260709 13:13:54.644793  3826 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:54.775323   447 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:54.732821  3513 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:54.741571   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 93510.3us
I20260709 13:13:54.780741   525 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:54.744606  3929 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:54.742216  3965 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:54.751102   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:54.791898   551 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:54.752849  3830 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.794268  3513 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:54.794580  3830 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:54.795564  3770 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:54.745005  3876 consensus_meta.cc:287] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.806s	user 0.009s	sys 0.000s
I20260709 13:13:54.720324  3754 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.797079  3513 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:54.796960  3754 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:54.797484  3803 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:54.799223  3754 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:54.719810  3877 raft_consensus.cc:740] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:54.768692  3705 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10.
I20260709 13:13:54.800319  3877 consensus_queue.cc:260] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:54.801354  3877 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:54.803592  1166 raft_consensus.cc:1275] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:13:54.812510   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1868) took 1528 ms. Trace:
I20260709 13:13:54.812942   555 rpcz_store.cc:276] 0709 13:13:53.284213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.304720 (+ 20507us) service_pool.cc:224] Handling call
0709 13:13:53.304987 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.468411 (+1163424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.812240 (+343829us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540031a6d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:54.812447 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2571152256}
I20260709 13:13:54.814670   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1672) took 1474 ms. Trace:
I20260709 13:13:54.815064   625 rpcz_store.cc:276] 0709 13:13:53.339990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.725596 (+385606us) service_pool.cc:224] Handling call
0709 13:13:53.725872 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.725508 (+999636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.814437 (+ 88929us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b5400123754. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:54.814608 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140975488}
W20260709 13:13:54.762933  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 52924.2us
I20260709 13:13:54.763947  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:54.693179  3130 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:54.746872  3859 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.738019  3966 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.772308   475 raft_consensus.cc:1240] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:54.776517   447 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:54.833346   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 56897.3us
I20260709 13:13:54.834048   447 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:54.717404  3918 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:54.836802  3130 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:54.838078  3918 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:54.838685  3803 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:54.732517  3838 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:54.844292  3826 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:54.844707  3962 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:13:54.806250  3965 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:54.790175   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.781939  3515 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:54.793852   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:54.850181   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 56453.8us
I20260709 13:13:54.822858   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:54.774679  3810 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:54.853521  3838 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:54.853933  3810 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:54.848035  3515 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:54.854525  3515 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:54.859443  3773 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:54.821482   525 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:54.859623   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:54.859886  3773 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.860265  3773 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:54.860630  3770 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:54.835827  3966 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:54.860268   558 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:54.862929  3966 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:54.826519  3969 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:54.863611  3969 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:54.863981  3969 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:54.866710  3515 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:54.867978  3926 consensus_queue.cc:1059] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:13:54.868870  3842 consensus_meta.cc:287] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.971s	user 0.011s	sys 0.000s
I20260709 13:13:54.869222  3826 raft_consensus.cc:3055] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:54.869328  3842 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:54.847271   447 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:54.863022   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:54.871196   555 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:54.869699  3515 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:54.872222  3838 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:54.832355  3859 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:54.871634   447 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:54.875998  3496 raft_consensus.cc:3055] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:54.876390  3496 raft_consensus.cc:740] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:54.876420  3838 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:54.877322  3496 consensus_queue.cc:260] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:54.878021   447 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:54.869690  3826 raft_consensus.cc:740] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:54.789916  3792 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:54.880115  3826 consensus_queue.cc:260] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:54.881565  3792 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:54.849519  3965 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:54.890350  3770 consensus_queue.cc:1059] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:54.891443  3959 raft_consensus.cc:3055] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:54.891870  3959 raft_consensus.cc:740] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:54.892403  3496 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:54.892884  3888 consensus_meta.cc:287] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.974s	user 0.013s	sys 0.000s
I20260709 13:13:54.893733   483 raft_consensus.cc:2410] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:13:54.846738   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.781453  3488 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:54.895143   597 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:13:54.895404   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.896852   447 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:54.899760   633 raft_consensus.cc:1275] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
W20260709 13:13:54.901245  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 48815.4us
I20260709 13:13:54.904255   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:54.907066   447 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:54.908792   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:54.912006   481 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:54.909070   475 raft_consensus.cc:1275] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:54.910058   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:54.914260   447 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:54.913065   633 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:54.917639   599 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:54.921867  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.922897   599 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:54.919056   597 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:54.893806  3582 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:13:54.916982  3879 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:54.881560  3826 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:54.929848  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:54.778626  3924 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:54.951610   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:54.952313   629 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
I20260709 13:13:54.910034  3838 raft_consensus.cc:2804] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:54.945989   447 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:54.950405   480 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:54.947777  1175 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:54.834764  3951 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:13:54.892696  3959 consensus_queue.cc:260] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:54.959193  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:54.959683  3959 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:54.960018  3842 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:54.960644   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:54.961541   480 raft_consensus.cc:2410] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:13:54.958935  3513 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.962621  3961 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:54.908918  3803 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.962945  3513 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:54.963610  3961 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:54.964039  3961 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.964425  3961 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:54.965338  3513 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:54.960659  3842 consensus_queue.cc:1059] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:13:54.963610  3803 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:54.967940   599 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:54.969707  3803 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:54.970072  3717 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:54.955590  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:54.971297  1169 raft_consensus.cc:2410] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:13:54.971432  3834 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:54.971875  3834 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.916360  3488 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:54.972512  3758 consensus_queue.cc:1048] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:54.973879  3488 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:54.917973  3888 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:54.917568  3921 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:13:54.978884  3965 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:54.981323   553 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 9. Ops: []
I20260709 13:13:54.917313  3939 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.982322  3939 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:54.983817  3947 raft_consensus.cc:3055] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:54.984222  3947 raft_consensus.cc:740] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:54.985069  3939 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:54.985030  3947 consensus_queue.cc:260] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:54.930378  3130 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:54.922572  3774 consensus_queue.cc:1048] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:13:54.986533  3947 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:54.915500  3727 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 13:13:54.996266  3936 log.cc:927] Time spent T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.609s	user 0.002s	sys 0.000s
I20260709 13:13:54.997062  3810 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:54.997458   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:54.998035   556 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:54.998971   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:54.999542   559 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:55.000586   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:54.915616  3515 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.915731  3918 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:55.009375  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:55.010357  1173 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
W20260709 13:13:55.001699   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 55780.5us
I20260709 13:13:54.926494  3204 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:55.015669  3204 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.016094  3204 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.015861  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:55.017019  1169 raft_consensus.cc:2393] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 8: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:55.017573  3924 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:55.018137  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:55.020399  1168 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:55.005717   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:55.014185   448 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:54.972218  3834 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.013159   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:55.030139  1138 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:54.956467  3838 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:55.062885  3838 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:55.066361   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 1833) took 1119 ms. Trace:
I20260709 13:13:55.066762   483 rpcz_store.cc:276] 0709 13:13:53.946580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.946692 (+   112us) service_pool.cc:224] Handling call
0709 13:13:55.066130 (+1119438us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b54002dd554. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:55.066298 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2111211264}
W20260709 13:13:55.115931  3927 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.005s	sys 0.005s
I20260709 13:13:55.048758   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:55.025542  3939 consensus_queue.cc:1059] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:13:54.948220  3942 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 13:13:55.153542  3791 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.153928  3204 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:55.154100  3791 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:55.029597  3886 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:55.021032  3515 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:55.009977  3130 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:55.056161  3965 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:55.058594  3958 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.585s	user 0.004s	sys 0.000s
I20260709 13:13:55.062089  3773 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:55.066967  3924 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:55.072182  3918 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.045365  3859 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:55.145493   478 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:55.131220  3581 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:55.176607   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:55.117473  3783 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:55.181041   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:55.181787   478 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:13:55.174103   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:55.174705  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:55.175444   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:55.183020   554 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:55.167392  3945 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.522s	user 0.000s	sys 0.002s
I20260709 13:13:55.012898   447 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:55.180691   482 raft_consensus.cc:1240] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:55.125948  3927 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.006s	sys 0.006s
I20260709 13:13:55.158144   629 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:13:55.035492  3969 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:55.223773  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:55.231714   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 218906us
W20260709 13:13:55.232398   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 316034us
I20260709 13:13:55.232988   447 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:55.235819  1174 raft_consensus.cc:2393] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 8: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:55.237144  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:55.238708  1173 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:55.156749  3810 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:55.240557   447 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:55.175473  3924 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.156153  3204 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:55.241329   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 272089us
I20260709 13:13:55.242417  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:55.247802  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:55.252995  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:55.157843  3791 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:55.252521   447 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:55.223825  3488 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:55.277789  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.301889  1141 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:55.310807   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.239609  3130 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:55.161334  3838 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:55.292526   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:55.316715   482 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:13:55.241441  3581 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:55.184576  3874 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:55.250172  3814 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:55.325012  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:55.249562  3927 consensus_queue.cc:1243] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer 6e6df7e8ed204f1db5c371536b5b0683 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:13:55.249989  3513 raft_consensus.cc:2749] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:55.245893  3924 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:55.181612  3918 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:55.250229  3715 raft_consensus.cc:2749] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:55.345774   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 112519us
I20260709 13:13:55.317050  3888 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:13:55.339344  3945 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:13:55.261929  3629 raft_consensus.cc:2764] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:13:55.188289  3783 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:55.323614  3974 log.cc:927] Time spent T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:13:55.300786  3683 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:55.357594   522 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:55.380304   484 raft_consensus.cc:1240] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:55.316237  3748 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:13:55.254822   365 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 227b93e1b31e4b058d5ec1fc69bd6849 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 50f7c2247be24f3685d7fbca7b6c71e3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:13:55.421981   365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 167377us
W20260709 13:13:55.422624  3975 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:13:55.423980  3773 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:55.427922   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 70387.4us
I20260709 13:13:55.430483   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:55.430483   556 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:55.424054  3770 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.431200   557 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:55.422096  3683 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.315881  3488 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:55.432987   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 511) took 1481 ms. Trace:
I20260709 13:13:55.341899  3581 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:55.433856   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 187542us
I20260709 13:13:55.461308   599 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:55.325817  3204 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.066s
W20260709 13:13:55.447113   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 188293us
I20260709 13:13:55.433002  1173 raft_consensus.cc:2393] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 8: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:55.455700   479 rpcz_store.cc:276] 0709 13:13:53.951219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.953370 (+  2151us) service_pool.cc:224] Handling call
0709 13:13:53.953768 (+   398us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:13:53.954193 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:53.954233 (+    40us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:13:53.979067 (+ 24834us) log.cc:844] Serialized 78 byte log entry
0709 13:13:54.240801 (+261734us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b4800002dd8. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6d342aa1 00007f4b6d339b37 00007f4b6d3399ca 00007f4b6d43126f 00007f4b6d430f37 00007f4b6d44555c 00007f4b6d445508 00007f4b6d445488 00007f4b6d445443 00007f4b6d4446ec 00007f4b6c36ea96
0709 13:13:54.378715 (+137914us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:54.378758 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.378821 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:55.057942 (+679121us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:55.432800 (+374858us) raft_consensus.cc:1685] finished
0709 13:13:55.432820 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:55.432935 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":934,"raft.run_cpu_time_us":1945,"raft.run_wall_time_us":267345,"spinlock_wait_cycles":433928448,"thread_start_us":351888,"threads_started":1,"wal-append.queue_time_us":470444}
I20260709 13:13:55.345323  3874 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:55.351014  3842 consensus_queue.cc:1059] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:13:55.464619   447 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:55.466655   557 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:13:55.474254   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:55.475008   550 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:55.381541  3965 consensus_queue.cc:1059] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:13:55.351014  3814 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:55.391371  3979 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:55.469436   559 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:55.430660  3834 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:55.381103  3921 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 13:13:55.456497  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 75825us
I20260709 13:13:55.385447  3705 consensus_queue.cc:1059] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:13:55.388680  3962 consensus_queue.cc:1059] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:13:55.638597  1141 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:55.484812   447 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:13:55.459816  3945 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:13:55.452521  3959 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:55.431404  3928 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:55.533116   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:55.556286   550 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:13:55.547403  3515 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:55.626814  3826 consensus_meta.cc:287] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.658s	user 0.005s	sys 0.002s
I20260709 13:13:55.564278  3783 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:55.565896  3581 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:55.455441  3773 consensus_queue.cc:1059] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:13:55.457830  3843 consensus_queue.cc:1059] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 13:13:55.457969  3770 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:55.543694  3629 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:55.460765  3683 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:55.545161  3810 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:55.568744  3976 log.cc:927] Time spent T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.265s	user 0.002s	sys 0.005s
I20260709 13:13:55.543280  3927 consensus_queue.cc:1048] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:13:55.599651  3684 raft_consensus.cc:3055] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:55.601004  3874 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:55.738049   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:55.580567  3859 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:55.574465  3854 consensus_queue.cc:1059] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:13:55.611569  1175 raft_consensus.cc:1240] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 13:13:55.612432  3961 consensus_meta.cc:287] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.000s
I20260709 13:13:55.616581  3814 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:55.586601  3886 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:55.623030   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:55.623730   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:55.667032  3928 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:55.661672   558 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
W20260709 13:13:55.564119  3986 log.cc:927] Time spent T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:13:55.593466  3969 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:55.673637   627 raft_consensus.cc:2393] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:13:55.676275   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 191566us
W20260709 13:13:55.679489   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 250252us
I20260709 13:13:55.680294   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:55.681783   478 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:13:55.641786  3918 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:55.728672  3792 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:55.724997   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:55.756373   482 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:55.647558  4000 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:55.694802  3629 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:55.732824  3683 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:55.732892  3996 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:55.688604  3959 raft_consensus.cc:697] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:13:55.734144  4001 log.cc:927] Time spent T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:13:55.694905  3515 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.701072  3488 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:55.747397   557 raft_consensus.cc:2393] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 8: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:55.645954   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:55.698827   554 consensus_meta.cc:287] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.000s
I20260709 13:13:55.755227   479 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:55.734978  3684 raft_consensus.cc:740] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:55.671149  3979 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:55.763964   522 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:55.766574   554 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:55.755854  3854 consensus_queue.cc:1243] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:13:55.756321  3859 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.755682  3791 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.755473  3581 raft_consensus.cc:3055] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:55.784734   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:55.760893  3629 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:55.805449   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:55.806283   554 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:13:55.810285   479 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:13:55.787714  3874 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:55.772277  3886 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.782779  3488 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.746991  3961 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:55.772145  3814 consensus_queue.cc:1048] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:13:55.812047  3834 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:55.811684  3684 consensus_queue.cc:260] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:55.787763  3918 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.813972  3928 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:55.814607  3979 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:55.817580   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:55.819712   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:55.848857   556 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:55.831893  3859 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:55.851023  3990 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:13:55.825817  1139 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:13:55.853271  3582 raft_consensus.cc:2804] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:13:55.853446  3999 log.cc:927] Time spent T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:13:55.853812  3582 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:55.854346  3582 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:55.759850  4000 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.831920   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:55.817304  3933 raft_consensus.cc:2764] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:13:55.783627  3996 raft_consensus.cc:697] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:55.866756   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:55.867545   479 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.761679  3792 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:55.832540  4001 log.cc:927] Time spent T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:13:55.772595  3773 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:55.858824   558 raft_consensus.cc:1240] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:55.805207  3581 raft_consensus.cc:740] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:55.864188   556 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:13:55.775090  3515 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:55.842377  3774 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.879456   557 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:13:55.817718  3791 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:55.887051   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:55.884922  1139 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:55.865988  4000 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.890322   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:55.896446   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:55.897166   480 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:13:55.876796  3928 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:55.845055  3886 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:55.846246  3488 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:55.844240  3874 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:55.889922  1139 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:55.889647   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:55.889020   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 151045us
I20260709 13:13:55.898782   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:55.896914   626 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:55.865805  3918 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:55.887797  3859 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:55.906060   633 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.909197   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:55.888162  4010 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.891177  3773 raft_consensus.cc:697] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:55.911381   479 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:13:55.912288   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:55.912817   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:55.913405   479 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:13:55.898391  3962 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:55.903023  3924 consensus_meta.cc:287] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.009s
I20260709 13:13:55.914870   479 raft_consensus.cc:1275] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:13:55.919024  3886 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:55.921025   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:55.922492  4002 log.cc:927] Time spent T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:13:55.925458   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:55.925884   479 pending_rounds.cc:85] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 3
I20260709 13:13:55.925837   478 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:55.883846  3774 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:55.945263  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:55.945722   448 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:55.945930  1168 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:55.928887   597 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:55.928715   483 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:55.950372   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:55.950949   483 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.928936   479 pending_rounds.cc:107] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:13:55.934394   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:55.952517   479 raft_consensus.cc:2889] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:55.952201   626 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:55.958583   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:55.960565   633 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:13:55.961558   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:55.963052  3886 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:55.963627  3886 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.964040  3886 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:55.964210   628 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:55.965420   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:55.965925   628 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:55.967578  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:55.967875  3773 consensus_queue.cc:237] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:55.968597   448 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:55.970125   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:55.971645   475 raft_consensus.cc:1275] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:55.972267  3515 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:55.972824   475 raft_consensus.cc:1240] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:55.973266   447 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:55.973809  3918 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:55.974402  3918 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:55.974762  3918 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.975968  3130 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:55.976418  3130 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:55.976827  3130 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:55.977695  3944 log.cc:927] Time spent T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 1.330s	user 0.004s	sys 0.000s
I20260709 13:13:55.973724  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:55.979586   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 510) took 2028 ms. Trace:
I20260709 13:13:55.980301  3791 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:55.976848  3838 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:55.962988  1169 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:55.963058   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:55.981899   480 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:55.979947   476 rpcz_store.cc:276] 0709 13:13:53.950882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.952015 (+  1133us) service_pool.cc:224] Handling call
0709 13:13:53.952361 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:53.952735 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:53.952760 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:53.953236 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:13:54.267003 (+313767us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:54.267066 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.267161 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:55.977011 (+1709850us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:13:55.979323 (+  2312us) raft_consensus.cc:1685] finished
0709 13:13:55.979344 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:55.979531 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1541,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":4656,"spinlock_wait_cycles":12778368,"thread_start_us":270336,"threads_started":1,"wal-append.queue_time_us":411270}
I20260709 13:13:55.923859  3951 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:55.991701   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:55.991951   447 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:55.959160   626 raft_consensus.cc:2376] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10. Re-sending same reply.
I20260709 13:13:55.992682   633 raft_consensus.cc:2393] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 10: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:55.987656   483 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:55.889422  3959 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:55.962952  3792 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:55.993016   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:55.994633   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:55.996343   633 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:55.906035  3928 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:55.975095  3918 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:55.990756  3838 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:13:55.954280  3503 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.997982   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:55.998291  3961 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:55.999302   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:56.033406   626 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:56.000698  4018 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:13:56.003446   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 74664.4us
I20260709 13:13:56.006423   628 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:56.011595   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:56.017866   478 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:13:56.011941   447 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:55.905588  3581 consensus_queue.cc:260] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:56.031668   476 raft_consensus.cc:2393] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:55.930481  3924 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:56.019647  3958 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:13:55.916841  4010 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:56.042301   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:56.042459   447 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:56.046383   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:56.027923  3951 raft_consensus.cc:697] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:56.058010   559 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:13:56.068229   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:56.059589   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:56.068805   628 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:56.069253   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.033180  3979 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.066756   626 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:13:56.074910   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:56.061970   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:56.072118  4026 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:56.008332  3886 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:55.943783  3996 consensus_queue.cc:237] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:56.035517  3503 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:56.120546  1171 raft_consensus.cc:2368] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11.
I20260709 13:13:56.105180   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:56.221309   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 191985us
I20260709 13:13:56.157294   628 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:13:56.237320   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:56.238366   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:56.238322   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:56.075157   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:56.233573   557 raft_consensus.cc:2393] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 8: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
W20260709 13:13:56.119019   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.240705   633 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:13:56.245030   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:56.055076  4018 raft_consensus.cc:697] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:56.245641   556 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
W20260709 13:13:56.234879   599 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.827s (SENT) [suppressed 25 similar messages]
W20260709 13:13:56.191130  3976 log.cc:927] Time spent T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:13:56.247267   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:56.131692  3958 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:13:56.245756   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:56.121204  3946 log.cc:927] Time spent T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 1.749s	user 0.001s	sys 0.002s
I20260709 13:13:56.158381  3924 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:56.156030  4010 leader_election.cc:290] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:56.173965  3629 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:56.146202  3838 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:56.144984  3874 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:56.130640  3942 raft_consensus.cc:3055] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:56.249419  1166 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:56.251096   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:56.227291  3995 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:56.171908  3774 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:56.259943   597 leader_election.cc:304] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:56.157099  3928 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:56.108902  4023 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:56.105789  3515 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.156s
I20260709 13:13:56.109676  3979 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:56.273646   476 raft_consensus.cc:2410] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 10 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:13:56.277396   482 raft_consensus.cc:1240] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:56.243383  3130 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:56.268802  3838 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:56.287041   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 244676us
I20260709 13:13:56.274925  3995 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.290360   447 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:56.294262   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 59408.7us
I20260709 13:13:56.295253   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:56.296406  3830 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:56.225584  4000 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:56.279031  3488 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:56.298367   475 raft_consensus.cc:2393] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:56.193051  3951 consensus_queue.cc:237] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:56.290563  3838 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:56.337037  3503 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:56.292336  3995 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:56.340812  3582 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:56.345844   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:56.346643   476 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:13:56.298381   633 raft_consensus.cc:2393] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 8: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:56.310379  3684 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:56.312049  3758 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:56.311743   626 raft_consensus.cc:1240] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:56.317864  3886 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:56.319964  3926 raft_consensus.cc:3055] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:56.323794  4000 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:56.325764   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1889) took 1575 ms. Trace:
I20260709 13:13:56.327934  3130 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:56.287206  3774 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:56.424239   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:56.424986   630 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:56.386392   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 96110us
I20260709 13:13:56.387799   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:56.428902   633 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:13:56.272573  3942 raft_consensus.cc:740] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:56.417702   555 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:56.422546   553 rpcz_store.cc:276] 0709 13:13:54.750357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.750798 (+   441us) service_pool.cc:224] Handling call
0709 13:13:54.769753 (+ 18955us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.981693 (+211940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:56.325557 (+1343864us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b540002add4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:56.325708 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486111488}
I20260709 13:13:56.385769  4010 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.419582  3488 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:56.444231   447 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:56.419190  3926 raft_consensus.cc:740] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:56.432981  3774 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.424502  3970 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:56.432773  3496 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.473433  3496 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:56.474565  4032 log.cc:927] Time spent T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:13:56.475487  3629 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:56.475888  3496 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:56.472865  3515 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:56.442797  4035 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:56.472486   447 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:56.463734  3773 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.492987   447 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:56.495810  3515 raft_consensus.cc:697] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:56.497131  3515 consensus_queue.cc:237] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:56.499876  3727 raft_consensus.cc:3055] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:56.500365  3727 raft_consensus.cc:740] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:56.501363  3727 consensus_queue.cc:260] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:56.502168   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:56.502650  3727 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:56.503078   476 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:13:56.503839  1173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 543) took 1202 ms. Trace:
I20260709 13:13:56.504233  1173 rpcz_store.cc:276] 0709 13:13:55.301318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.301543 (+   225us) service_pool.cc:224] Handling call
0709 13:13:56.503646 (+1202103us) spinlock_profiling.cc:243] Waited 88.3 ms on lock 0x7b54007201d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:56.503779 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203132800}
I20260709 13:13:56.495024  3773 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:56.472157  3488 raft_consensus.cc:697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:56.509505  3488 consensus_queue.cc:237] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:56.510304  1174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 682) took 1577 ms (client timeout 1785 ms). Trace:
W20260709 13:13:56.510856  1174 rpcz_store.cc:269] 0709 13:13:54.933190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.933421 (+   231us) service_pool.cc:224] Handling call
0709 13:13:56.510033 (+1576612us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b540048d354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:56.510229 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":612763392}
I20260709 13:13:56.516963  3770 leader_election.cc:290] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:56.519371  3629 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:56.511418  3995 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:56.494216  4035 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:56.524966  4035 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:56.527290   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:56.471522  3774 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:56.507830  3918 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:56.534053   632 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:56.535017   626 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:13:56.535825   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:56.536453   630 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
W20260709 13:13:56.546967   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 54109.4us
I20260709 13:13:56.547717   447 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:56.547799   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:56.548506   557 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:13:56.554450   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:56.555287   475 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:13:56.549341   522 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:56.556849   447 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:56.466652  4010 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:56.596504  4010 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:56.580475  3582 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:56.580786  3888 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:56.566226   522 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:56.559515  3886 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:56.585369  3918 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:56.562820  3629 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:56.567153  3130 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:56.526751  3942 consensus_queue.cc:260] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:56.489615  3970 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:56.423631  4018 consensus_queue.cc:237] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:56.545377  3503 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:13:56.557909  3926 consensus_queue.cc:260] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:56.581776   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 431) took 1536 ms. Trace:
I20260709 13:13:56.616235   629 rpcz_store.cc:276] 0709 13:13:55.045675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.045829 (+   154us) service_pool.cc:224] Handling call
0709 13:13:55.052714 (+  6885us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:55.234590 (+181876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:56.581496 (+1346906us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54000528d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:56.581708 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241890560}
I20260709 13:13:56.591993  3995 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:56.610698   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:56.567981  3826 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:56.611817  4008 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:56.606532  3888 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:56.627525   475 raft_consensus.cc:2368] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9.
I20260709 13:13:56.608718  3629 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:56.629469  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 160914us
I20260709 13:13:56.589859  3838 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:56.650151  1138 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:56.652086  1138 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:56.655776  3964 consensus_queue.cc:1059] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:56.657572   550 raft_consensus.cc:1275] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:13:56.692114   550 pending_rounds.cc:85] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 6
I20260709 13:13:56.692382   550 pending_rounds.cc:107] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:13:56.692651   550 raft_consensus.cc:2889] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:56.646919  3928 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:13:56.628317  3826 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.663559   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:56.669286  3970 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:56.645432  3879 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.677407  4012 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:56.709734  4012 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.651338  3629 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:56.709956  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:56.710783  1174 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:56.687879  3773 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:56.697017  3952 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:13:56.689874  3838 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:56.693667  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:56.694088  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:56.706550  3879 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:56.707703  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:56.702430  3826 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:56.720742  1173 raft_consensus.cc:2393] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 9: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:56.725505  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:56.733985  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:56.734431  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:56.735390  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:56.696866  3503 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:56.743142   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:56.750031   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 121516us
I20260709 13:13:56.757411   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:56.757648   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:56.759857  1174 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:13:56.763701  1172 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:56.710131  4012 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:56.765268   551 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:13:56.766268   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:56.768536  1139 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:56.772145   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:56.783274  1139 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:56.784821   633 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:13:56.703313  3774 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:56.811101   628 raft_consensus.cc:2393] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:56.780534  3765 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:56.796335  3952 raft_consensus.cc:2804] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:56.804710  3967 raft_consensus.cc:2804] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:56.802729  4008 raft_consensus.cc:697] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:56.823673  3979 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:56.818470  3765 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:56.829247  3765 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:56.832208  1169 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:56.834673  3967 raft_consensus.cc:697] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:56.835740  3967 consensus_queue.cc:237] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:56.836310  3879 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:56.817602  3952 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.860457  3774 leader_election.cc:290] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:56.897320   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:56.898048   475 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:56.897389   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:56.899971   480 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:13:56.905210   551 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:13:56.906821  3921 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:13:56.907425  3960 log.cc:927] Time spent T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 2.431s	user 0.007s	sys 0.001s
I20260709 13:13:56.920804   475 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:56.864861  3952 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:56.888085  3513 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:56.947060  4008 consensus_queue.cc:237] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:56.947660  3629 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:56.949707  3629 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:56.951364  3513 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:56.953415  3513 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:56.955928   630 raft_consensus.cc:1275] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:56.911501  3888 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:56.977433  3503 raft_consensus.cc:697] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:56.984709  3955 raft_consensus.cc:3055] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:56.989171  3955 raft_consensus.cc:740] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:56.992045  4064 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.001915  4064 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:57.003891  4011 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.004434  4011 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:57.005074  4046 log.cc:927] Time spent T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.377s	user 0.002s	sys 0.000s
I20260709 13:13:57.005751  4064 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:57.006511  4011 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:57.008136   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:57.009979   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:57.010593   556 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:13:57.015946   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:57.016640  3826 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:57.018172  4012 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:57.016602   475 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:57.019906   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:57.022104  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:57.022847  1174 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:57.020951   448 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:57.021509   556 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:57.028151  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:57.032305  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:57.032858  1167 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:57.033557   553 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:13:57.034749  3926 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:57.037551  3770 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:57.038076  4055 consensus_queue.cc:1048] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:57.027423  3513 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:57.039987  3929 raft_consensus.cc:3055] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:57.040477  3929 raft_consensus.cc:740] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:57.041249  3929 consensus_queue.cc:260] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:57.051956   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:57.052567   476 raft_consensus.cc:2376] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10. Re-sending same reply.
I20260709 13:13:57.052965  3888 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:57.053335   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:57.054111   476 raft_consensus.cc:2393] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:57.054287  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:57.054510   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:57.054792   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:57.055816   478 raft_consensus.cc:1240] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:57.056010   476 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
W20260709 13:13:57.057627   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.057394   476 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:57.058652   478 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:13:57.060721  1170 raft_consensus.cc:2393] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 8: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:57.061532   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:57.063865   552 raft_consensus.cc:3055] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:57.064257   552 raft_consensus.cc:740] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:57.065886  1174 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:13:57.027287  4064 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.092530  4064 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:57.095762  1167 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
W20260709 13:13:57.096622   525 connection.cc:256] RPC call timeout handler was delayed by -1.2249000980000346s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
W20260709 13:13:57.097128   525 connection.cc:256] RPC call timeout handler was delayed by -1.2186000980002518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
I20260709 13:13:57.065115   552 consensus_queue.cc:260] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:57.098621   552 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:57.097623  4064 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:57.018553  3503 consensus_queue.cc:237] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:57.099751   448 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:57.098239   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:57.102697   525 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:57.105690   525 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:57.098992  4055 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.055747  3952 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:57.107283   525 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:57.109640   525 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:57.111613   552 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:13:57.112335   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 382) took 2738 ms. Trace:
I20260709 13:13:57.112836   552 rpcz_store.cc:276] 0709 13:13:54.374063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.383779 (+  9716us) service_pool.cc:224] Handling call
0709 13:13:54.384921 (+  1142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:57.063771 (+2678850us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54001b0420. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68390dc0 00007f4b6841b1c0 00007f4b6841c231 00007f4b68418d8f 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c
0709 13:13:57.111865 (+ 48094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.112278 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2209343872}
I20260709 13:13:57.101828  3513 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:57.108327  4008 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:57.117372  4008 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:57.117816  4008 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:57.123471  3933 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:57.123379  3684 consensus_queue.cc:1048] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:13:57.114025  3950 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:13:57.125837  3564 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:57.125357  4008 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.126268  3564 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:57.126662  3564 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:57.128211  4008 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:57.127872  3955 consensus_queue.cc:260] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:57.128960  3955 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:57.129767   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.130776  1139 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:57.132899  4064 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:57.133236  4012 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:57.133044  3564 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:57.133883  3967 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:57.133334  4064 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:57.134403  3826 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:57.134658  4064 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:57.103994  3888 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:57.133986  3921 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:57.135353  3888 raft_consensus.cc:697] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:57.136191  3888 consensus_queue.cc:237] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:57.138469  3564 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:57.142475  4064 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:57.144682  4064 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:57.145221  3684 consensus_queue.cc:1059] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:57.146106   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1856) took 1468 ms. Trace:
I20260709 13:13:57.150238   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:57.153405   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:57.161135   629 raft_consensus.cc:1240] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:57.167024   480 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:57.167306   478 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:57.164547   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:57.112632  3947 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:57.156237   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:57.102618  3982 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:13:57.165278   477 rpcz_store.cc:276] 0709 13:13:55.677800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.677936 (+   136us) service_pool.cc:224] Handling call
0709 13:13:55.730031 (+ 52095us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:55.907446 (+177415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:55.907479 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:55.923819 (+ 16340us) log.cc:844] Serialized 52 byte log entry
0709 13:13:56.032786 (+108967us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:56.070510 (+ 37724us) log.cc:844] Serialized 14 byte log entry
0709 13:13:56.178179 (+107669us) log.cc:844] Serialized 14 byte log entry
0709 13:13:56.178418 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:56.178519 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:57.141854 (+963335us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b18002faa00. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6532c3f3 00007f4b6532e7c1 00007f4b6532e779 00007f4b6532e709 00007f4b6532e6d1 00007f4b6532d9cd 000000000038f354 000000000038f199 00007f4b6530f83a
0709 13:13:57.145915 (+  4061us) raft_consensus.cc:1685] finished
0709 13:13:57.145936 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.146053 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":146835,"prepare.queue_time_us":157650,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":17504,"raft.queue_time_us":296445,"raft.run_cpu_time_us":513,"raft.run_wall_time_us":27439,"spinlock_wait_cycles":18147584,"thread_start_us":231146,"threads_started":2,"wal-append.queue_time_us":161817}
W20260709 13:13:57.190222   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.193385   599 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:57.196211   599 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:57.107486  4057 consensus_queue.cc:1059] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:13:57.114907  4055 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.199929   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:57.201519   632 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:57.203148   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:57.203895   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:57.204517   553 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:57.203598   599 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:57.202275  3664 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:57.200122  4018 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:57.226368   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 527) took 1462 ms. Trace:
W20260709 13:13:57.235980   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.197520  3874 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:13:57.226918   482 rpcz_store.cc:276] 0709 13:13:55.763853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.763990 (+   137us) service_pool.cc:224] Handling call
0709 13:13:55.764280 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:56.286803 (+522523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.226066 (+939263us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b540022e054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:57.226287 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1176884608}
I20260709 13:13:57.210019  3791 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:57.202661  3977 consensus_queue.cc:1059] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:13:57.256048   553 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:13:57.258869  1139 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:13:57.261602   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.216074  3664 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:57.215668  4018 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:57.265765   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:57.266412   552 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:13:57.266522   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:57.267390   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:57.268675   554 raft_consensus.cc:1240] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:57.269322   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:57.265810   632 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:57.270637   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:57.273146   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:57.277127  1173 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: []
W20260709 13:13:57.274698  4072 log.cc:927] Time spent T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 13:13:57.275528  4073 log.cc:927] Time spent T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:13:57.275743  1170 raft_consensus.cc:1240] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:57.292059   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:57.295225   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:57.297711  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:57.298346   553 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:57.296978   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:57.298441  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:13:57.298686   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 97420.6us
I20260709 13:13:57.264487  3664 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:57.264209  3947 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.302089   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:57.302651   557 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:57.273150  4018 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:57.304615   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 50324.4us
W20260709 13:13:57.305963  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.308018  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:57.308852   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:57.309468   626 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:13:57.336669  1170 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:57.310787   629 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:13:57.337796   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:57.311724   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 435) took 1450 ms. Trace:
I20260709 13:13:57.281173  4064 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:57.312466   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 521) took 2167 ms. Trace:
I20260709 13:13:57.312670  3947 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.317625  1174 raft_consensus.cc:1240] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 6. Current term is 8. Ops: []
I20260709 13:13:57.318167   480 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:13:57.318290  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:57.318550   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:57.342119   484 rpcz_store.cc:276] 0709 13:13:55.144653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.144777 (+   124us) service_pool.cc:224] Handling call
0709 13:13:55.152582 (+  7805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:55.402466 (+249884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.312227 (+1909761us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b540020dad4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:57.312395 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470445824}
I20260709 13:13:57.344085   632 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:57.319095  3952 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:57.319885  4055 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:57.322160  1171 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 538) took 2144 ms (client timeout 1880 ms). Trace:
I20260709 13:13:57.322467   557 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:13:57.323629   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:13:57.318204  4074 log.cc:927] Time spent T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:13:57.324738  1166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 544) took 1392 ms. Trace:
I20260709 13:13:57.332420   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:57.346673   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 143135us
I20260709 13:13:57.334148  3582 raft_consensus.cc:3055] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:57.338403   556 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:57.336640   631 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:57.338905   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:57.337845  1138 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:57.338722   624 rpcz_store.cc:276] 0709 13:13:55.861992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.862165 (+   173us) service_pool.cc:224] Handling call
0709 13:13:55.880540 (+ 18375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:55.887427 (+  6887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:55.887461 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:55.887505 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:55.887539 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.311505 (+1423966us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b54001bba54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:57.311563 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.311672 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15400192}
I20260709 13:13:57.342932   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:57.347133   630 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:13:57.355012  1138 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:57.346710  1166 rpcz_store.cc:276] 0709 13:13:55.931932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.932074 (+   142us) service_pool.cc:224] Handling call
0709 13:13:57.324580 (+1392506us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54005eddd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:57.324683 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":621265792}
I20260709 13:13:57.338696   448 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:57.345464  1168 raft_consensus.cc:2368] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9.
I20260709 13:13:57.345835   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:13:57.345005  1171 rpcz_store.cc:269] 0709 13:13:55.177780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.178110 (+   330us) service_pool.cc:224] Handling call
0709 13:13:57.321934 (+2143824us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b54005a64d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:57.322060 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2019019008}
I20260709 13:13:57.347484   599 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:57.360641   599 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:57.358021  3513 raft_consensus.cc:2804] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:57.372965   556 raft_consensus.cc:2468] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:13:57.380067   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:57.342655  4003 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.388299   523 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:57.374802  1139 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:57.397714  3933 raft_consensus.cc:3055] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:57.398140  3933 raft_consensus.cc:740] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:57.346513  3955 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:57.373622   631 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:13:57.398964  3933 consensus_queue.cc:260] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.396293   599 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:57.394248  1138 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:57.399544  3955 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.400377  3933 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:57.402630  3955 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:57.403209   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:57.348500  4064 raft_consensus.cc:697] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:57.409315  3970 raft_consensus.cc:2804] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:57.404750   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:57.348430  3582 raft_consensus.cc:740] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:57.364746  3963 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:57.342494  3888 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:13:57.366130  4011 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:57.424072   599 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:57.365967  3513 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.389175  3727 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:57.421106  3970 raft_consensus.cc:697] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:57.426638  4011 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:57.421290  3967 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:57.410413  3951 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:13:57.428577  3947 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:57.434365   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:57.459076  1175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 482) took 2354 ms. Trace:
I20260709 13:13:57.459636   631 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
W20260709 13:13:57.442381  4081 log.cc:927] Time spent T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.132s	user 0.000s	sys 0.002s
I20260709 13:13:57.449206   522 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:57.446261   599 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:57.420085  3792 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:57.404776  3748 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:13:57.395413  3879 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:57.463406   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:57.463807   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:57.470162   475 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:13:57.445293  3791 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:57.468400   599 leader_election.cc:400] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9.
I20260709 13:13:57.459523  1175 rpcz_store.cc:276] 0709 13:13:55.104831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.105033 (+   202us) service_pool.cc:224] Handling call
0709 13:13:55.611338 (+506305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:55.743678 (+132340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.458836 (+1715158us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54004583d0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:57.459005 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1116990848}
W20260709 13:13:57.468628   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 80415.7us
I20260709 13:13:57.478439   599 leader_election.cc:403] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:57.479516   523 leader_election.cc:400] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9.
I20260709 13:13:57.479811   523 leader_election.cc:403] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:13:57.480170   599 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:57.446942  3513 raft_consensus.cc:3060] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:57.471011   476 raft_consensus.cc:2376] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11. Re-sending same reply.
I20260709 13:13:57.446753  4021 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:57.458767  4011 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:57.396938  4003 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:57.485571  3979 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:57.487876   522 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:13:57.481343   599 leader_election.cc:304] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:57.471443  3876 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:57.494179   599 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:57.472831  3748 consensus_queue.cc:1243] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:13:57.491410  3684 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:57.499444  3684 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.458326  3970 consensus_queue.cc:237] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:57.499884  3684 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:57.476895  3947 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:57.487088  4021 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.482961  3961 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:57.487186  4008 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9.
W20260709 13:13:57.498298  4076 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:13:57.492430   448 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:57.503727   599 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:57.504400  3581 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:57.495525  4055 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:57.518636  4055 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.491389  3879 raft_consensus.cc:697] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:57.519073  4055 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:57.519956  3879 consensus_queue.cc:237] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:57.522562   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.526026  4003 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:57.489681  4064 consensus_queue.cc:237] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:57.530588  4018 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.501260  3791 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:57.515328  4021 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:57.531819  3791 raft_consensus.cc:697] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:57.533020  3791 consensus_queue.cc:237] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.491111  3979 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.535356  4090 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:57.509959  4057 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.536405  4057 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:57.537096   625 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:13:57.513441   624 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:57.515430   556 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:13:57.517522   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.497248  3876 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:57.540624  3876 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:57.538933  4082 log.cc:927] Time spent T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:13:57.538930  4057 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:57.544404  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:57.506600  3664 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.547956   631 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:57.535476  3979 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:57.548120  3513 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:57.550241  3513 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:57.501778  4083 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:57.551426  4083 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.551844  4083 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:57.560411  3929 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:57.564132   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:57.564653  3977 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:57.565311   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:57.572052   525 leader_election.cc:304] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:57.572929  3950 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:57.573452  3950 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.573717   525 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:57.576136   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 72464us
W20260709 13:13:57.578621   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 86269.5us
I20260709 13:13:57.582547   479 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:13:57.582754  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 175107us
I20260709 13:13:57.586802  1138 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:13:57.574390  3928 consensus_queue.cc:1048] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:57.598141   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:57.598912   632 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:57.599750   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:57.609958   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:57.611613   556 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:57.614091   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:57.614801   552 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
W20260709 13:13:57.615289   597 connection.cc:256] RPC call timeout handler was delayed by -1.075918234000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
I20260709 13:13:57.617074  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:57.566089  3684 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.608364   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:57.622589   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:57.620544   525 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:57.588662  3581 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:57.633157  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:57.629874   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:57.589660  3933 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:57.631035   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:57.635308   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:57.596995  4008 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:57.638358   557 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:13:57.638587   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:57.619292  4064 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:57.641577   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:57.590234  4090 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:57.660791   597 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:57.656570   522 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:57.666024   551 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:57.627007  4010 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.598381  3977 consensus_queue.cc:1059] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:13:57.639911   525 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:57.670477   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:57.672303   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:57.671722   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:57.640978  3513 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:57.606884  3924 consensus_queue.cc:1059] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:13:57.676818   482 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:13:57.674722   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:57.677641   597 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:57.652629  3826 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:57.681907   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:57.634163  3748 consensus_queue.cc:1059] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:13:57.626936  3842 consensus_queue.cc:1059] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:13:57.681699   525 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:57.652079  4008 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:57.627072  4057 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:13:57.686038   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:57.703748   478 raft_consensus.cc:2393] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:57.704761   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:57.705329   478 raft_consensus.cc:2393] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 8: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:57.706184   478 raft_consensus.cc:1240] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:57.607105  4000 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:13:57.690611   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1911) took 2069 ms. Trace:
I20260709 13:13:57.707062   550 rpcz_store.cc:276] 0709 13:13:55.621297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.661815 (+ 40518us) service_pool.cc:224] Handling call
0709 13:13:55.662204 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:56.693056 (+1030852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.690390 (+997334us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b54000eb354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:57.690554 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2287930240}
I20260709 13:13:57.692917   597 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:57.638283  3774 consensus_queue.cc:1059] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 13:13:57.711455   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 131596us
I20260709 13:13:57.711972  4098 consensus_queue.cc:1059] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:57.712447   448 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:57.713541  4098 raft_consensus.cc:3055] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:57.711549  3879 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:57.713935  4098 raft_consensus.cc:740] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:57.676371  4064 raft_consensus.cc:697] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:57.687103  3629 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:57.715543  4021 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.718223   525 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:57.680538  3830 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:57.718858   448 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:13:57.665886  3876 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.726281   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:57.688196  3982 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:57.729030   525 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:57.691298  3959 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:57.730995   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:57.742832   481 raft_consensus.cc:2393] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 9: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:57.707935   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:57.735131   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:57.743489   478 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:13:57.744388   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:57.745400   478 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
W20260709 13:13:57.753152   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 100598us
W20260709 13:13:57.761600   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 68852us
I20260709 13:13:57.714978  4008 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:57.855477   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 137918us
I20260709 13:13:57.802080   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:57.853477   627 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54754 (request call id 432) took 2807 ms (client timeout 3307 ms). Trace:
I20260709 13:13:57.715061  3814 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:57.859886   550 raft_consensus.cc:1240] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:13:57.860635   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 98059.1us
I20260709 13:13:57.676235  4010 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.862169   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:57.864210   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:57.865535  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:57.883621   633 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:57.859051   478 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:13:57.869431   631 raft_consensus.cc:1240] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:57.884908   553 raft_consensus.cc:2410] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:13:57.880151  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:13:57.886902   597 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:57.888152   597 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:13:57.859906   627 rpcz_store.cc:269] 0709 13:13:55.046280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.046433 (+   153us) service_pool.cc:224] Handling call
0709 13:13:57.853176 (+2806743us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54001e3554. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:57.853384 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1260410240}
I20260709 13:13:57.892699   558 raft_consensus.cc:2393] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 9: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:13:57.699191  3967 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 13:13:57.689548  3513 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:57.892041  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:13:57.900509  1174 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:13:57.902029   554 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:57.674854  4090 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.904834   478 raft_consensus.cc:1240] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:57.905386  1168 raft_consensus.cc:1240] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:57.752246  3964 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:57.905157   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:57.731606  3950 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:57.752658  3684 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:57.799548  3581 raft_consensus.cc:697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:57.687566  4083 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.753088  3920 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:13:57.940343   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:57.941128   481 raft_consensus.cc:2393] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 9: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:57.884282  3888 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:57.920369  3947 raft_consensus.cc:3055] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:57.892855  3982 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:57.903016  4003 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:57.740355  3629 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.736114  4055 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.722590  4098 consensus_queue.cc:260] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.921010  3791 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:13:57.948678  4083 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:57.949735  4092 log.cc:927] Time spent T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:13:57.955439  4102 raft_consensus.cc:2764] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:13:57.956743  4021 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:57.957653  4100 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:13:57.959101  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.960881  3979 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.975139  3684 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:57.925323  3942 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:57.893000  3879 consensus_queue.cc:1059] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:13:57.932444  3835 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:57.929482  3964 raft_consensus.cc:697] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:57.965332  3947 raft_consensus.cc:740] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:58.008318   551 raft_consensus.cc:2393] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 9: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:57.961905  3920 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:58.028847  1141 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:13:58.014262  4098 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:57.970366   482 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:13:57.961900  4011 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:57.926877  4064 consensus_queue.cc:237] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:58.036931  4102 raft_consensus.cc:3055] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:58.070756   481 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:13:58.173314   624 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.011s	sys 0.007s
I20260709 13:13:58.155385  3876 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:13:58.153095   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 265005us
I20260709 13:13:58.702198   597 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:13:58.174093   476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.000s	sys 0.015s
I20260709 13:13:58.277336  3810 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:58.703902  3810 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:58.399169   479 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:58.711308   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:13:58.712877   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:58.713608   556 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:58.715387   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:58.716461   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:58.107770  4090 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:58.104852  3947 consensus_queue.cc:260] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:58.215651  4011 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:58.709321   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:58.066838  3888 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:58.014262  4100 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:58.189491  3967 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:13:58.152307  4094 log.cc:927] Time spent T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:13:58.199306  3979 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:58.185734  3920 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:57.939929 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:58.386116   625 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1681) took 2496 ms (client timeout 1670 ms). Trace:
W20260709 13:13:58.826202   625 rpcz_store.cc:269] 0709 13:13:55.889299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.889421 (+   122us) service_pool.cc:224] Handling call
0709 13:13:58.385860 (+2496439us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54001e4954. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:58.386020 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3733891968}
I20260709 13:13:58.827804   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:13:58.828620   625 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:58.173147  3830 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:58.107621  4010 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:58.226416  3964 consensus_queue.cc:237] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:58.192307  3961 consensus_meta.cc:287] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.669s	user 0.009s	sys 0.001s
I20260709 13:13:58.201994  3582 consensus_queue.cc:260] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:58.020326  3684 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:58.042820  3581 consensus_queue.cc:237] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:58.393819   627 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
W20260709 13:13:58.067044  4093 log.cc:927] Time spent T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
I20260709 13:13:58.394994   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:58.391600  3791 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:13:58.412292  4095 log.cc:927] Time spent T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.484s	user 0.001s	sys 0.000s
I20260709 13:13:58.559098  3792 raft_consensus.cc:3055] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:58.376549  4018 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:58.564636   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1713) took 1070 ms. Trace:
I20260709 13:13:58.899446   633 rpcz_store.cc:276] 0709 13:13:57.494517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.494995 (+   478us) service_pool.cc:224] Handling call
0709 13:13:57.495309 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:57.884225 (+388916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:58.564291 (+680066us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b540011a654. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:58.564555 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":892618624}
I20260709 13:13:58.662468  3765 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:58.362735  3664 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:58.366041  3952 raft_consensus.cc:3055] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:13:58.283732  4092 log.cc:927] Time spent T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:13:58.421401  4055 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:58.350397  4108 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.655320  4003 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:13:58.283886  4077 log.cc:927] Time spent T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.984s	user 0.011s	sys 0.023s
W20260709 13:13:58.345769  4099 log.cc:927] Time spent T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:13:58.286782  3513 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:58.395365   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:58.679782  3773 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:58.953555   482 raft_consensus.cc:2393] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 9: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:13:58.393802  3977 consensus_queue.cc:1059] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.292s
I20260709 13:13:58.399036  4057 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.399464   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:13:58.700717   624 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.021s	sys 0.024s
W20260709 13:13:58.703025   476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.107s	user 0.003s	sys 0.039s
I20260709 13:13:58.204463  3955 raft_consensus.cc:3055] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:58.709972   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:58.730612   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:58.961820   558 raft_consensus.cc:2393] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 9: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:13:58.762490   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:58.962596   481 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:13:58.921322  3952 raft_consensus.cc:740] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:58.914345  3792 raft_consensus.cc:740] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:58.968286   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:58.969071   482 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:58.948945  3582 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:58.283183  3929 consensus_meta.cc:287] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.722s	user 0.008s	sys 0.000s
W20260709 13:13:58.544075  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.457687   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:58.606977   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.780018  3810 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:58.735601  3874 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.016s	sys 0.032s
I20260709 13:13:58.784262   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:13:58.807629   448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.017s	sys 0.034s
W20260709 13:13:58.995785   448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.093s	user 0.017s	sys 0.034s
I20260709 13:13:58.732884   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:58.822503  3876 consensus_queue.cc:1059] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:13:58.841130  1141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.030s	sys 0.033s
W20260709 13:13:59.015528  1141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.030s	sys 0.033s
I20260709 13:13:59.015952  3876 raft_consensus.cc:3055] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:13:59.016176  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 987338us
I20260709 13:13:59.016415  3876 raft_consensus.cc:740] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:59.017447  3876 consensus_queue.cc:260] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:58.857323   626 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.027s	sys 0.033s
I20260709 13:13:58.862177   632 raft_consensus.cc:1240] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:59.019104   626 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.975s	user 0.027s	sys 0.033s
I20260709 13:13:59.021059   629 raft_consensus.cc:2393] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:13:58.941948  3765 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:58.961176  3955 raft_consensus.cc:740] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:13:58.472582  4063 raft_consensus.cc:3055] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:13:59.033399  1139 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.070s	user 0.014s	sys 0.095s
I20260709 13:13:58.511147  3826 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.446394  3959 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.880776   625 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:13:58.845578  3947 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:58.859984  4098 consensus_meta.cc:287] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.797s	user 0.007s	sys 0.003s
I20260709 13:13:58.948129   633 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:58.953397  4108 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:58.871938  3961 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9.
I20260709 13:13:58.833096  3888 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:58.958956   627 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:13:58.959329   484 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:13:58.731189   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:13:58.972649  4100 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:58.976431  3952 consensus_queue.cc:260] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:58.979387   525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.123s	user 0.114s	sys 0.216s
I20260709 13:13:59.025616  3774 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:59.062357   525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.206s	user 0.114s	sys 0.216s
W20260709 13:13:59.063165   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 1.33407e+06us
I20260709 13:13:58.964262  4057 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:58.994688  3874 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.140s	user 0.016s	sys 0.037s
I20260709 13:13:58.996959   448 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:59.066776  3810 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:13:59.070644   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 73754.2us
I20260709 13:13:59.070946  3810 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:59.073137  3810 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:59.075482  4100 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:59.076179  4098 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:59.076560  4100 consensus_queue.cc:1059] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:59.077627  4100 consensus_queue.cc:1243] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 6e6df7e8ed204f1db5c371536b5b0683 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:13:59.010229  3792 consensus_queue.cc:260] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:58.954943  4003 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:59.021821  1140 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.007s	user 0.042s	sys 0.067s
W20260709 13:13:59.078996  1140 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.065s	user 0.042s	sys 0.067s
I20260709 13:13:59.078796  3792 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:59.080430  4003 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:58.913894  3791 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:59.085454  3791 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:59.092913   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:59.094549   448 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:13:59.095443  4100 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.096242  4100 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:59.004611   479 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:59.020100   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1808) took 1423 ms. Trace:
I20260709 13:13:59.040486  4113 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:59.099207  4100 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:59.101361  4100 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.099548   626 rpcz_store.cc:276] 0709 13:13:57.597086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.598018 (+   932us) service_pool.cc:224] Handling call
0709 13:13:57.598393 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:57.620141 (+ 21748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:57.620173 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:57.620618 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:13:58.025502 (+404884us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:59.019554 (+994052us) log.cc:844] Serialized 14 byte log entry
0709 13:13:59.019784 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:59.019870 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:59.019920 (+    50us) raft_consensus.cc:1685] finished
0709 13:13:59.019932 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:59.020049 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5006,"raft.queue_time_us":7222,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":20757,"thread_start_us":1341332,"threads_started":2,"wal-append.queue_time_us":397472}
I20260709 13:13:59.100314   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:59.104350   479 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:59.032498   629 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:59.033381   555 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:58.873047   478 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:59.037345  1139 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.014s	sys 0.095s
I20260709 13:13:58.701112  4102 raft_consensus.cc:740] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:58.905762  4008 consensus_meta.cc:287] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 1.012s	user 0.011s	sys 0.000s
I20260709 13:13:59.018903  3876 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:59.050670   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1864) took 3119 ms. Trace:
W20260709 13:13:59.052209   447 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.109s	user 0.028s	sys 0.083s
I20260709 13:13:58.990653  3513 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:13:58.964818  4055 consensus_queue.cc:1059] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:13:58.960261  3773 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:59.020068  3977 raft_consensus.cc:3055] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:13:59.075703  4106 log.cc:927] Time spent T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:13:59.082834   484 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:59.152388   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:13:59.153028   484 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:59.114672  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.141834   447 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.199s	user 0.029s	sys 0.083s
I20260709 13:13:59.145324   479 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:59.158483   478 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:13:59.141739   483 rpcz_store.cc:276] 0709 13:13:55.931347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:56.008273 (+ 76926us) service_pool.cc:224] Handling call
0709 13:13:56.009343 (+  1070us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:56.220977 (+211634us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:56.243528 (+ 22551us) log.cc:844] Serialized 14 byte log entry
0709 13:13:57.498857 (+1255329us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b1800499a20. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb923a 00007f4b68423a2a
0709 13:13:57.870926 (+372069us) log.cc:844] Serialized 14 byte log entry
0709 13:13:57.871074 (+   148us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:57.896115 (+ 25041us) log.cc:844] Serialized 26 byte log entry
0709 13:13:57.898202 (+  2087us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:57.898616 (+   414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.898727 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:59.050461 (+1151734us) raft_consensus.cc:1685] finished
0709 13:13:59.050488 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:59.050612 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38090,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":4170,"raft.queue_time_us":136468,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":37452,"spinlock_wait_cycles":6322944,"thread_start_us":560219,"threads_started":3,"wal-append.queue_time_us":1423068}
I20260709 13:13:59.160776   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:59.056128  4090 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.043011  3929 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:58.971099  3629 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:59.034284  4063 raft_consensus.cc:740] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:13:59.102311  4100 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:59.132112  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 122724us
W20260709 13:13:59.171119   475 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.008s	sys 0.003s
I20260709 13:13:59.176654   483 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:13:59.196182   484 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:13:59.102351  4108 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:59.197822   483 raft_consensus.cc:1240] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:59.188832   479 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:59.136022  4008 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:58.776057   556 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:59.220961   482 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
W20260709 13:13:59.232692   475 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.010s	sys 0.003s
W20260709 13:13:59.216238   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.201480   483 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:13:59.204793   477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.215s	user 0.004s	sys 0.008s
W20260709 13:13:59.237601   477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.251s	user 0.005s	sys 0.009s
W20260709 13:13:59.136982  4097 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.217s	user 0.085s	sys 0.115s
W20260709 13:13:59.270386  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 74309.6us
I20260709 13:13:59.175756   378 catalog_manager.cc:5697] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 1 to 4, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 4 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:59.174343  3977 raft_consensus.cc:740] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:13:59.127562  3933 consensus_meta.cc:287] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 1.474s	user 0.013s	sys 0.001s
I20260709 13:13:59.285542   553 raft_consensus.cc:1240] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:59.285729   478 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:59.100607  4113 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:59.052258  3959 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:59.052300  3826 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:59.283052  4097 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.366s	user 0.089s	sys 0.118s
I20260709 13:13:59.197583   484 raft_consensus.cc:1240] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:59.315310  4117 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:59.191952  4090 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:59.186156  3513 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:59.198645  3929 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:59.324352   599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.025s	sys 0.011s
W20260709 13:13:59.324772   599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.025s	sys 0.011s
I20260709 13:13:59.282382  4110 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:59.177839  3955 consensus_queue.cc:260] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:59.280144  3920 consensus_queue.cc:1059] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:13:59.308761  3933 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:59.308168  4107 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:59.284292  3629 consensus_queue.cc:1059] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 13:13:59.343199   597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.060s	sys 0.099s
W20260709 13:13:59.344043   597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.060s	sys 0.099s
I20260709 13:13:59.322985  3684 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:59.336589  3942 consensus_meta.cc:287] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 1.314s	user 0.011s	sys 0.006s
I20260709 13:13:59.140507  4098 consensus_queue.cc:1059] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.140s
I20260709 13:13:59.302157   555 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:13:59.277180   481 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:59.348457   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:13:59.289410  3970 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.782s	user 0.009s	sys 0.012s
I20260709 13:13:59.344475  3955 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:59.352174   599 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:59.379137   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 424) took 1414 ms. Trace:
I20260709 13:13:59.385251   552 raft_consensus.cc:2410] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:13:59.388891   599 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:59.388708   553 rpcz_store.cc:276] 0709 13:13:57.965903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.966008 (+   105us) service_pool.cc:224] Handling call
0709 13:13:57.966243 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:59.285947 (+1319704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:59.378818 (+ 92871us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400151dd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:13:59.379059 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3033690496}
I20260709 13:13:59.389838   599 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:13:59.369896  3970 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.865s	user 0.009s	sys 0.012s
W20260709 13:13:59.397944   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.393982   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:13:59.404058   478 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:13:59.358870  3564 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:59.412837   552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1948) took 1741 ms (client timeout 1903 ms). Trace:
W20260709 13:13:59.413388   552 rpcz_store.cc:269] 0709 13:13:57.671658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.672071 (+   413us) service_pool.cc:224] Handling call
0709 13:13:59.412587 (+1740516us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54001d6d54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:59.412766 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3926838656}
I20260709 13:13:59.368276  3792 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.356110  3629 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:13:59.321126  4063 consensus_queue.cc:260] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:59.431805  4119 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:59.432665  4119 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:59.435313  4016 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:59.436395  3810 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:59.437028  3810 raft_consensus.cc:697] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:13:59.438086  3810 consensus_queue.cc:237] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:59.395298  4018 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:59.364790   557 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:13:59.313489  4102 consensus_queue.cc:260] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:59.369288  3684 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:59.397150  4097 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.387688  3765 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:59.371255  3791 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:13:59.418834  4110 raft_consensus.cc:3055] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:59.424549  3664 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:59.425904  3888 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:59.344023  4107 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:59.441466  3773 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:59.446857  4018 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:13:59.486035   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.421986  3564 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:59.453114  4057 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:59.455999  4110 raft_consensus.cc:740] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:59.423204  3792 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:59.455148  4100 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:59.425698  3629 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:13:59.416374   599 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:13:59.491029  4018 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:59.509370   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 93062us
I20260709 13:13:59.453804  4097 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:59.353629  3977 consensus_queue.cc:260] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:59.484020  3888 raft_consensus.cc:3055] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:59.482220  3664 raft_consensus.cc:697] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:59.452505  4010 consensus_queue.cc:1175] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" responder_term: 8 status { last_received { term: 8 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 8 index: 5 } }
W20260709 13:13:59.506789  4112 log.cc:927] Time spent T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:13:59.515599  3773 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:59.521991  4113 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:59.560338   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 453) took 1974 ms. Trace:
I20260709 13:13:59.525449  3929 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:59.560786   624 rpcz_store.cc:276] 0709 13:13:57.585609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.585732 (+   123us) service_pool.cc:224] Handling call
0709 13:13:57.585983 (+   251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:57.596260 (+ 10277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:57.596304 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:57.596717 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 13:13:58.958051 (+1361334us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:59.288387 (+330336us) log.cc:844] Serialized 14 byte log entry
0709 13:13:59.288612 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:59.288719 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:59.560151 (+271432us) raft_consensus.cc:1685] finished
0709 13:13:59.560169 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:59.560281 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21218,"prepare.queue_time_us":151422,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":31614,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":23366,"thread_start_us":1624452,"threads_started":2,"wal-append.queue_time_us":1498853}
I20260709 13:13:59.528995  3826 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:59.562997   522 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.003s	sys 0.024s
W20260709 13:13:59.561182  3964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.000s	sys 0.033s
W20260709 13:13:59.595806   554 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.017s	sys 0.021s
W20260709 13:13:59.605067   522 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.003s	sys 0.024s
I20260709 13:13:59.604441  3773 raft_consensus.cc:697] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:13:59.541591   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.492506  3684 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:59.606114   554 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.017s	sys 0.021s
W20260709 13:13:59.607419   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 603826us
I20260709 13:13:59.632651   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:59.633725   631 raft_consensus.cc:2410] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:13:59.636348   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:13:59.533344  3513 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:59.520325  3888 raft_consensus.cc:740] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:13:59.639048   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:13:59.640293   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.605898  3964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.001s	sys 0.033s
I20260709 13:13:59.526585  3959 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:59.505185  4008 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:59.624119  4119 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:13:59.643045  4064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.013s	sys 0.027s
W20260709 13:13:59.688202   525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.010s	sys 0.046s
W20260709 13:13:59.688689   525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.010s	sys 0.046s
I20260709 13:13:59.633194  3773 consensus_queue.cc:237] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:59.644933  4118 consensus_queue.cc:1059] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:13:59.674419  3888 consensus_queue.cc:260] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:13:59.676319  3826 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:13:59.624696  3664 consensus_queue.cc:237] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:59.685357  4064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.015s	sys 0.029s
I20260709 13:13:59.777806  4097 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:13:59.564216  4110 consensus_queue.cc:260] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:59.710215  3874 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.011s	sys 0.047s
W20260709 13:13:59.735970  4125 log.cc:927] Time spent T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:13:59.737084  4124 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:13:59.730230  3792 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:13:59.744717  4107 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:13:59.753400  3629 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:13:59.787830  3874 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.011s	sys 0.048s
W20260709 13:13:59.813170  1141 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.054s	sys 0.081s
W20260709 13:13:59.813530  1141 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.054s	sys 0.081s
W20260709 13:13:59.813796  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 763227us
W20260709 13:13:59.808036  3926 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.014s	sys 0.052s
W20260709 13:13:59.829780  3926 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.015s	sys 0.053s
W20260709 13:13:59.808061  3830 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.010s	sys 0.053s
I20260709 13:13:59.783143  3826 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:13:59.836149  4055 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.015s	sys 0.013s
W20260709 13:13:59.855585  4055 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.016s	sys 0.013s
I20260709 13:13:59.814250  3888 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:59.837373  3830 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.010s	sys 0.053s
W20260709 13:13:59.965807   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:00.039324   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.041610  4064 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.041805  3964 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:00.042783  4064 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:13:59.966847   476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.002s	user 0.014s	sys 0.016s
I20260709 13:13:59.976086   482 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
W20260709 13:13:59.978092   523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.025s	sys 0.013s
W20260709 13:13:59.979859   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.681595   555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43548 (request call id 411) took 2478 ms (client timeout 2023 ms). Trace:
W20260709 13:14:00.075726   476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.015s	sys 0.016s
W20260709 13:13:59.675972   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.983891   524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.005s	sys 0.005s
W20260709 13:14:00.094868   524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.006s	sys 0.005s
W20260709 13:13:59.989213   557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1949) took 2314 ms (client timeout 2112 ms). Trace:
I20260709 13:13:59.991320   550 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:13:59.682279   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 168686us
I20260709 13:13:59.702601   630 raft_consensus.cc:1240] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:00.103732   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1715) took 2600 ms. Trace:
I20260709 13:14:00.104182   630 rpcz_store.cc:276] 0709 13:13:57.502844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.503329 (+   485us) service_pool.cc:224] Handling call
0709 13:13:57.503605 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:00.101991 (+2598386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.103124 (+  1133us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b54001621d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:00.103467 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5056601344}
W20260709 13:13:59.995929   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.999771  1138 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.006s	sys 0.003s
W20260709 13:14:00.105705  1138 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.006s	sys 0.004s
I20260709 13:14:00.024951   378 catalog_manager.cc:5697] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 1 to 4, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 4 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.106207  4113 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:00.030948   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.107468  4113 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.109951  4063 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:00.033008  3581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.008s	sys 0.002s
W20260709 13:14:00.111518  3581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.008s	sys 0.003s
W20260709 13:14:00.033340  3582 consensus_meta.cc:287] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 1.046s	user 0.009s	sys 0.003s
I20260709 13:14:00.033823  3629 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:13:59.902276  3955 consensus_meta.cc:287] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.505s	user 0.000s	sys 0.009s
W20260709 13:14:00.114486   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.115376   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1953) took 1407 ms. Trace:
I20260709 13:13:59.903911  4102 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:00.034803  3792 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:00.067806   448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.000s	sys 0.016s
W20260709 13:14:00.116751   448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.000s	sys 0.017s
I20260709 13:14:00.117213  3792 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:00.068986   597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.007s	sys 0.010s
W20260709 13:14:00.119477   597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.007s	sys 0.010s
W20260709 13:14:00.119984   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 735336us
I20260709 13:14:00.121518  4055 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.121826  4144 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.912045  4018 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.123752  3929 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:00.124944  3929 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:00.069823   523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.025s	sys 0.013s
I20260709 13:14:00.127604  4008 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.128705  4008 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.129408  4064 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:00.065994   477 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.005s	sys 0.017s
W20260709 13:14:00.131529   477 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.006s	sys 0.018s
I20260709 13:14:00.133157  3926 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.134088   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 531) took 2460 ms. Trace:
I20260709 13:14:00.093608  3959 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:00.135551  3959 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.137131   599 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:00.137430  4142 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:00.138437  4142 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.139963  3684 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.141624  3929 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.142282  4142 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:00.106230  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 822002us
I20260709 13:14:00.127676  4134 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:00.143858  4134 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.145033   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1962) took 1429 ms. Trace:
I20260709 13:14:00.145516   550 rpcz_store.cc:276] 0709 13:13:58.716033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.760150 (+ 44117us) service_pool.cc:224] Handling call
0709 13:13:59.990053 (+1229903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:00.096739 (+106686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.144794 (+ 48055us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000492d0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:00.144965 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2827196672}
I20260709 13:14:00.111289  4010 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:00.148123  4147 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.134202  3926 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.149408  4147 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.138928  3959 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.114507  3629 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.147272  1166 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:14:00.155336   558 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:14:00.095985   557 rpcz_store.cc:269] 0709 13:13:57.674345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.674483 (+   138us) service_pool.cc:224] Handling call
0709 13:13:59.988471 (+2313988us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54000492d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:59.988858 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3825508096}
I20260709 13:14:00.122733  4144 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.115993  1175 raft_consensus.cc:2410] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:14:00.093341  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 79282.4us
I20260709 13:14:00.163087   557 raft_consensus.cc:1275] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:14:00.163439  3874 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:00.164229   624 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:00.164180  3874 raft_consensus.cc:697] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:00.164757  4134 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.164702  3952 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:00.165815  4011 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:00.165940  3874 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.147274  4010 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.171442  3920 raft_consensus.cc:3055] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:00.172091  3920 raft_consensus.cc:740] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:00.173080  4010 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.173542  3920 consensus_queue.cc:260] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.177229  4118 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.178051  4118 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.158844  4119 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.178727   378 catalog_manager.cc:5697] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 3 to 5, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 5 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:00.180099  4119 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.181543  3792 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.181821  3961 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.181242   378 catalog_manager.cc:5697] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:00.182732  4119 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.182520  3961 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.126757  4018 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:00.122462  4055 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.042797  3964 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:00.099097   555 rpcz_store.cc:269] 0709 13:13:57.202718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.202865 (+   147us) service_pool.cc:224] Handling call
0709 13:13:59.681424 (+2478559us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b5400346f54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:13:59.681529 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4207397248}
I20260709 13:14:00.183938  3629 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:00.185072  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.186348   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1885) took 2608 ms. Trace:
I20260709 13:14:00.182881  4134 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:00.197907   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.116070  3826 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.161067   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:00.173141  4144 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.161325  4113 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.115940   554 rpcz_store.cc:276] 0709 13:13:58.707580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.709480 (+  1900us) service_pool.cc:224] Handling call
0709 13:13:58.780508 (+ 71028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:58.934739 (+154231us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:59.628310 (+693571us) log.cc:844] Serialized 14 byte log entry
0709 13:14:00.113726 (+485416us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:00.113869 (+   143us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:00.113983 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.114828 (+   845us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54002003d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:00.114882 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:00.115090 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51385,"prepare.queue_time_us":857863,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":1326,"raft.queue_time_us":55307,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":221,"spinlock_wait_cycles":353983744,"thread_start_us":1103290,"threads_started":2,"wal-append.queue_time_us":433700}
I20260709 13:14:00.218170  3920 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:00.218282   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.225044  4147 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.225696  4144 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:00.226432  4144 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.227311  4142 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.227959  4142 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.228772  4144 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:00.229889   447 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.004s	user 0.013s	sys 0.021s
I20260709 13:14:00.230122  4142 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.231616   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.232612   558 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:00.234288   555 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:14:00.235908  3684 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:00.236680  3684 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.238545   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.231647   557 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:14:00.240015  1141 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:00.240867   554 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:14:00.243551  3582 consensus_queue.cc:1059] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:00.244452  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:00.245384  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.245672  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.246587  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:00.241160   380 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46008 (request call id 261) took 15805 ms (client timeout 15000 ms). Trace:
I20260709 13:14:00.247227  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:00.230278   447 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.013s	sys 0.021s
I20260709 13:14:00.217375   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.196259   476 rpcz_store.cc:276] 0709 13:13:57.577939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.579049 (+  1110us) service_pool.cc:224] Handling call
0709 13:13:57.579421 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:58.958603 (+1379182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:58.958637 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:58.960261 (+  1624us) log.cc:844] Serialized 26 byte log entry
0709 13:14:00.185782 (+1225521us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:00.185880 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.185994 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:00.186046 (+    52us) raft_consensus.cc:1685] finished
0709 13:14:00.186059 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:00.186217 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16382,"raft.queue_time_us":131987,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":2492398,"threads_started":2,"wal-append.queue_time_us":853049}
W20260709 13:14:00.222345   480 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.009s	sys 0.008s
I20260709 13:14:00.200644  3959 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:00.247227  3970 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:00.134713   477 rpcz_store.cc:276] 0709 13:13:57.673680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.674501 (+   821us) service_pool.cc:224] Handling call
0709 13:13:57.690195 (+ 15694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:57.928680 (+238485us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:13:57.986075 (+ 57395us) log.cc:844] Serialized 14 byte log entry
0709 13:14:00.132275 (+2146200us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:00.132446 (+   171us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:00.132586 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.133555 (+   969us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54000d75d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:00.133616 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:00.133934 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40972,"prepare.queue_time_us":57537,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":2665,"raft.queue_time_us":142618,"spinlock_wait_cycles":560450944,"thread_start_us":2104499,"threads_started":2,"wal-append.queue_time_us":1626509}
W20260709 13:14:00.258848   480 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.010s	sys 0.009s
I20260709 13:14:00.247581  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:00.266011   475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.005s	sys 0.017s
I20260709 13:14:00.258226  3970 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.290535  3970 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:00.268242  3955 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.291843  3955 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:00.293182  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 50262.1us
I20260709 13:14:00.258348  3929 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:00.271327   475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.006s	sys 0.018s
I20260709 13:14:00.260715  4142 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:00.273241  3876 consensus_meta.cc:287] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.097s	user 0.002s	sys 0.016s
I20260709 13:14:00.274893  1166 raft_consensus.cc:2410] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:14:00.275143  3564 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.275765   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.276055  4137 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:00.276505  3826 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:00.277218  3810 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.023s	sys 0.011s
I20260709 13:14:00.277908  4144 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.278992   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.279695   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.280746   522 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:00.303175   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1886) took 2725 ms. Trace:
I20260709 13:14:00.311738   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.312268   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.312693   556 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:14:00.313653   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.313711   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.314484   555 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:00.258134  4113 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.304068  4003 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:00.315671  4113 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.315868  4003 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.317389  3826 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.318005  4113 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.267436  4134 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.303895  3929 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.303723  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.313653  3961 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.282167   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.284463  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.281131  4055 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.285225  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.286247  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.288899  4147 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.289963   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.312430   558 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
I20260709 13:14:00.285025  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.320015   557 raft_consensus.cc:2393] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 9: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:00.322081  4090 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.392555  4134 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.393240  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.396298  4121 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:00.311578   475 rpcz_store.cc:276] 0709 13:13:57.578267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.579701 (+  1434us) service_pool.cc:224] Handling call
0709 13:13:57.579968 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:57.580209 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:57.620094 (+ 39885us) log.cc:844] Serialized 14 byte log entry
0709 13:13:58.364394 (+744300us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b180027f640. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb923a 00007f4b68423a2a
0709 13:14:00.302487 (+1938093us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:00.302593 (+   106us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:00.302738 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.302900 (+   162us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:00.303101 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51275,"prepare.queue_time_us":26718,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":137900,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":9888,"spinlock_wait_cycles":2358016,"thread_start_us":1890170,"threads_started":2,"wal-append.queue_time_us":2008463}
I20260709 13:14:00.331780   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:00.326197   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 45697.1us
I20260709 13:14:00.307418   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 547) took 1283 ms. Trace:
I20260709 13:14:00.396299   559 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:14:00.387830   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.412655   630 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
W20260709 13:14:00.332259  3810 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.023s	sys 0.011s
I20260709 13:14:00.319228  3964 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.409574   480 rpcz_store.cc:276] 0709 13:13:59.023919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.188453 (+164534us) service_pool.cc:224] Handling call
0709 13:13:59.188799 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:00.306959 (+1118160us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:00.307001 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:00.307051 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:00.307087 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.307173 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:00.307349 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12675,"raft.queue_time_us":149130,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6369,"thread_start_us":1074107,"threads_started":1}
I20260709 13:14:00.421536  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.324793  3582 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:00.301359  3955 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.319603  3826 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.396374  3629 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:00.428249  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.431377  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.321928  3929 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.417081  4055 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.413830  3564 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:14:00.436437  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 141682us
I20260709 13:14:00.429667   554 raft_consensus.cc:2376] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8. Re-sending same reply.
I20260709 13:14:00.321535  4137 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:00.438961   447 connection.cc:256] RPC call timeout handler was delayed by -1.3522871390000546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
I20260709 13:14:00.418385  3959 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:00.445592   447 connection.cc:256] RPC call timeout handler was delayed by -1.2757871389999309s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
I20260709 13:14:00.419034  4144 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:00.457562   447 connection.cc:256] RPC call timeout handler was delayed by -1.2145871390000593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 13:14:00.458113   447 connection.cc:256] RPC call timeout handler was delayed by -1.2046871390000433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
I20260709 13:14:00.457953  4090 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:00.433270  4142 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.437752  3582 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:00.458621   447 connection.cc:256] RPC call timeout handler was delayed by -1.0705871390000539s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
I20260709 13:14:00.443357  4113 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:00.247462   380 rpcz_store.cc:269] 0709 13:13:44.435637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.451013 (+ 15376us) service_pool.cc:224] Handling call
0709 13:14:00.240866 (+15789853us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:51.886988 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:51.887768 (+   780us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:51.887829 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:13:51.887862 (+    33us) tablet.cc:662] Decoding operations
0709 13:13:51.938986 (+ 51124us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:51.939052 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:51.939082 (+    30us) tablet.cc:685] Acquiring locks for 26 operations
0709 13:13:51.941450 (+  2368us) tablet.cc:701] Row locks acquired
0709 13:13:51.941498 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:13:51.941679 (+   181us) write_op.cc:270] Start()
0709 13:13:51.941840 (+   161us) write_op.cc:276] Timestamp: P: 1783602831941609 usec, L: 0
0709 13:13:51.941858 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:13:52.019691 (+ 77833us) log.cc:844] Serialized 10280 byte log entry
0709 13:13:53.173314 (+1153623us) op_driver.cc:464] REPLICATION: finished
0709 13:13:53.587027 (+413713us) write_op.cc:301] APPLY: starting
0709 13:13:53.598393 (+ 11366us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:53.643561 (+ 45168us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:53.643700 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:53.716041 (+ 72341us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:53.716443 (+   402us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=26
0709 13:13:53.716488 (+    45us) write_op.cc:312] APPLY: finished
0709 13:13:53.717034 (+   546us) log.cc:844] Serialized 176 byte log entry
0709 13:13:53.717875 (+   841us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:53.718077 (+   202us) write_op.cc:454] Released schema lock
0709 13:13:53.747676 (+ 29599us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:53.764633 (+ 16957us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:53.766299 (+  1666us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":385211,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":351086,"apply.run_cpu_time_us":9789,"apply.run_wall_time_us":184326,"num_ops":26,"prepare.queue_time_us":149815,"prepare.run_cpu_time_us":83427,"prepare.run_wall_time_us":481213,"raft.queue_time_us":276625,"raft.run_cpu_time_us":55834,"raft.run_wall_time_us":278768,"replication_time_us":1177057,"thread_start_us":593867,"threads_started":4,"wal-append.queue_time_us":384800,"wal-append.run_cpu_time_us":25495,"wal-append.run_wall_time_us":2318180}]]}
I20260709 13:14:00.463131  4136 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:00.471849   551 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:14:00.471967   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:00.472232   476 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:14:00.473088   478 raft_consensus.cc:1240] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:14:00.473214   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:00.474086   481 raft_consensus.cc:2393] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:00.474123   477 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:00.474840   484 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:14:00.439427  3929 consensus_queue.cc:1059] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:14:00.475993   482 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:14:00.476678  3564 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.477707   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.478596   480 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:00.480890  3926 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.458858  3629 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.483428   553 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:00.485205  3629 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.444083  4147 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:00.487591   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 260239us
W20260709 13:14:00.465724   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 49574.9us
I20260709 13:14:00.468654  4003 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:00.469066  3888 consensus_meta.cc:287] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.004s
I20260709 13:14:00.488323  1171 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
W20260709 13:14:00.512663   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 389720us
I20260709 13:14:00.514513  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.517876   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.518533   630 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:14:00.519299   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.520656   599 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:00.521898  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:00.522073   551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 1961) took 1806 ms (client timeout 2212 ms). Trace:
W20260709 13:14:00.522534   551 rpcz_store.cc:269] 0709 13:13:58.715804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.730970 (+ 15166us) service_pool.cc:224] Handling call
0709 13:14:00.521834 (+1790864us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001d6854. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:00.521994 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2441765120}
W20260709 13:14:00.524725  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 70089.5us
I20260709 13:14:00.526062  1141 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:00.528339  3920 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:00.530444  3920 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:00.466615  4098 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:00.531685  4098 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.532223  3564 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.526649  3970 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.533881  4098 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.534199  1172 raft_consensus.cc:2393] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 9: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:00.535569  4141 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:00.535885  3959 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.535807  4018 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:00.514374  3929 raft_consensus.cc:3055] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:00.536192  4141 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.536731  3773 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:14:00.537946   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.538568  4141 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.540702  4147 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:00.541146  3582 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.542472  4144 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.542830  3970 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:00.543093  3933 raft_consensus.cc:3055] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:00.543548  3933 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:00.544888  4118 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.544677  3933 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.546276  3933 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:00.540413   523 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:00.548902   448 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:00.551424  3629 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:00.552322   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.553198   554 raft_consensus.cc:2393] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 10: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:00.553057  3629 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:00.554627   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.554544   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.555531   554 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:14:00.556208  3773 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:00.536759  4018 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.556473  4113 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.557032   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.557288  3876 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:00.556960  3773 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.557773   554 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:14:00.558435  4018 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:00.559334   522 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:00.559473  3773 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:00.560073   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 46046.3us
I20260709 13:14:00.561270  3773 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:00.536938  3929 raft_consensus.cc:740] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:00.566129  3929 consensus_queue.cc:260] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.567520  3929 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:00.550791   448 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:00.571782  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.530910  3977 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:00.573480   475 raft_consensus.cc:2410] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:14:00.573539  1174 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:00.487218  4142 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.465003  4055 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.508814  4136 raft_consensus.cc:697] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:00.556077  4137 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.554673  3629 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:14:00.577432   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 56949.6us
I20260709 13:14:00.578858   629 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:00.580017  4136 consensus_queue.cc:237] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.546947  4090 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.580931  3664 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:00.581022  4161 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:00.582746  4008 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.574111  3959 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:00.585345   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.590683   551 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
W20260709 13:14:00.587731   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.585425   448 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:00.591841   599 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:00.599689   599 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:00.600008   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.600692   599 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:00.592306  3888 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:00.593573  4090 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.601432  3888 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:00.601859  3888 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:00.603494  3684 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.604277   624 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:00.604985  3921 raft_consensus.cc:3055] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:00.605643  3921 raft_consensus.cc:740] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:00.606773  3921 consensus_queue.cc:260] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.594022  3664 raft_consensus.cc:697] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:00.610512  3664 consensus_queue.cc:237] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.583020  3629 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:00.613782  3629 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:00.614485  4055 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.614377   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.615424   629 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
W20260709 13:14:00.595264  4123 log.cc:927] Time spent T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.951s	user 0.015s	sys 0.022s
I20260709 13:14:00.595913  4113 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.597242  4118 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:14:00.581714  4144 consensus_queue.cc:1059] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:14:00.598453   480 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10. Ops: []
W20260709 13:14:00.607350   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.607417  4110 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:00.589692  4141 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:14:00.608242  1175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36724 (request call id 490) took 3064 ms (client timeout 1898 ms). Trace:
I20260709 13:14:00.608808  1138 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:00.609140  1168 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
W20260709 13:14:00.613402   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.589275  4161 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:00.626451  1175 rpcz_store.cc:269] 0709 13:13:57.543983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.544139 (+   156us) service_pool.cc:224] Handling call
0709 13:14:00.607973 (+3063834us) spinlock_profiling.cc:243] Waited 2.57 s on lock 0x7b54004d3354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:00.608151 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5910774528}
W20260709 13:14:00.585515   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.621243   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.621269   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.621624  3773 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:00.621342  3921 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:00.594060   448 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:00.624353   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.625627   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:00.626694  1168 pending_rounds.cc:85] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Aborting all ops after (but not including) 9
I20260709 13:14:00.630800   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.632773   554 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:00.636343   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.634270  3961 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.641254  3961 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.629477  3810 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:00.643878  3810 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:00.644295  3810 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:00.629626  4161 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:00.648572   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 71933.9us
I20260709 13:14:00.651664  3791 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:00.652272  3791 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:00.652860  3791 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:00.655396   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:00.655552   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 61561.6us
I20260709 13:14:00.655658  4113 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:00.656215   552 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:14:00.656247  4113 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.656966  4113 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:00.657250   553 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:14:00.632740  1168 pending_rounds.cc:107] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:14:00.658111  1168 raft_consensus.cc:2889] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:00.656397   448 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:00.627540  4141 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.665336   557 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:14:00.668556   448 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:00.669317   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.669562   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.634588  3773 raft_consensus.cc:697] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:00.671814   631 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:14:00.666384  4141 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:00.676407   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.676851  4143 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:00.679267   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.678421   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.679221   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.679553   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.679968   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.683182   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.683907   484 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:14:00.683959   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.684971   475 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:00.685338   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:00.685993   482 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:00.686208  3773 consensus_queue.cc:237] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.687377  4097 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:00.687813  4097 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.688189  4097 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:00.690240   477 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:14:00.697392   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:00.697536   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.697989   476 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:00.698659   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.699318   477 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 5.
I20260709 13:14:00.700206   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.700923   477 raft_consensus.cc:2393] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 6: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:00.705353   476 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:00.706368   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.706873  4117 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:00.711663  3582 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.712023  4117 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.712458  4117 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:00.712157  3582 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.714263  3582 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.676904  3876 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:14:00.715432  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.682102  4143 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.707788  3684 raft_consensus.cc:3055] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:00.699139  3961 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:00.682061   448 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:00.716125  4143 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:00.716848   478 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:14:00.726505   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.726019   554 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:14:00.728673   478 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:14:00.725176   597 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:00.730105  3961 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:00.730659  3961 raft_consensus.cc:697] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:00.731475   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.731555  3961 consensus_queue.cc:237] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.733242  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.727718  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.734529  1174 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:14:00.716447  3684 raft_consensus.cc:740] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:00.736104  3684 consensus_queue.cc:260] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.737598  3684 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:00.734752  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.739289   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.739724  1172 raft_consensus.cc:2393] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 10: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:00.729637   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.681866  3921 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:14:00.725008   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:00.743602  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.743871   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:00.745708   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:00.783572   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 108345us
I20260709 13:14:00.785286   476 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:00.785887  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.786419   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.787317  4110 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:00.787536   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.787967   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.788700  1175 raft_consensus.cc:2393] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 9: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:00.787662   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.803573   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.804435   483 raft_consensus.cc:2393] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 10: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:00.805334   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.806001   483 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 5.
I20260709 13:14:00.806898   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.791579   447 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:00.723884  4113 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.789229   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:00.785562  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 44675.4us
I20260709 13:14:00.810750   557 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:14:00.816733   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.817121   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.817335   554 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:00.822094   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.823496   476 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:14:00.825277   481 raft_consensus.cc:2393] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 9: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:00.720311  3888 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.809587  4110 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:00.831545  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.831741   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.832229  1171 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:00.832311   558 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:14:00.829360   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.833232  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.833353  4018 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.833508   630 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:00.833966  4018 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.834403  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.835621  4098 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:00.836135  4018 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.832847   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.836886   552 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:00.838106  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.840523   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.840857  4161 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.843526   551 raft_consensus.cc:2393] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 10: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:00.831038  3967 consensus_queue.cc:1048] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:14:00.843538   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:00.806025  4097 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.839088  4110 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:00.848047  4097 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.847944  3629 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.831470   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.850164   477 raft_consensus.cc:1240] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:00.850271  3629 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.850598  3888 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.841362   483 raft_consensus.cc:2410] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:14:00.846282   480 raft_consensus.cc:2393] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:00.852352   482 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:00.832502   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.854746   559 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:14:00.856683   481 raft_consensus.cc:2393] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 10: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:00.857350   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.857468  1175 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:14:00.859349   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.859513   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.860028   630 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:14:00.859077  1139 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:00.860147   481 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:14:00.861914   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.864174   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.865033   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.865330  1139 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:00.866034   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:00.866968  3582 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:00.867440  3582 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:00.867650  3967 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:00.867843  3582 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:00.874068  3967 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.874565  3967 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:00.877183  3888 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:00.877767  3888 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.878816  4113 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.879848  3888 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:00.880147   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:00.887817  4169 log.cc:927] Time spent T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:14:00.888381   630 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:00.898541   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.899168   477 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:14:00.889410   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.889748   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.890604   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.900404   625 raft_consensus.cc:2393] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 9: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:00.891003   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.900914   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.901285   628 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:14:00.901640   477 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:14:00.889369   631 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:00.893412   626 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:00.893204  3810 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.894419  3791 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.894749   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.856860  3773 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.895463   483 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:14:00.896323   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.899588   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.892424   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.856146  4161 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.898581   481 raft_consensus.cc:2393] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 9: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:00.908390   476 raft_consensus.cc:2376] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11. Re-sending same reply.
I20260709 13:14:00.918615   627 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 5.
I20260709 13:14:00.907364   480 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:00.920406   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:00.921365   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 52903us
W20260709 13:14:00.921598   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 130152us
I20260709 13:14:00.922089   448 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:00.922322   447 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:00.922606   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.922976   448 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:00.923382   624 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:14:00.923763   447 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:00.924027   448 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:00.924530   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.924839   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.925419   447 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:00.925732   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.925545   626 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:00.926977   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.928498   482 raft_consensus.cc:2393] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:00.930614   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.931622   631 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:00.931506  1141 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:00.934232  3888 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:00.934489   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.934688  3888 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:00.935163   480 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:14:00.935462   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.936164   476 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:14:00.936405  4098 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:00.937055   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:00.938335   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.938398   476 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:14:00.938978   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.939507   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.939666  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.940117   629 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:00.940275  1175 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:00.940281   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:00.942464   554 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:14:00.945816   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.945942  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.936164   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.900830  4110 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.949893   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:00.950577  1139 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:00.951490   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.918241  3810 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:00.956879  3791 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:00.958293  4113 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:00.945163   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.930071  3773 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:00.981416   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.981786   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.982016  1139 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:00.983301  1139 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:00.986203  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.908828  4143 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:00.972589   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:00.947729   480 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:14:00.971745  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:00.992223  1172 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
W20260709 13:14:00.988972  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 57581.6us
I20260709 13:14:00.935158  3888 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:00.944408  4097 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:00.998162   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:00.999786   482 raft_consensus.cc:2393] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 11: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:00.964708  3629 raft_consensus.cc:2749] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:01.008617  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:01.007532   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:01.012351  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:01.015137   475 raft_consensus.cc:2393] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 9: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:00.941713  4117 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.994421  4063 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:00.990072  4064 raft_consensus.cc:2804] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:00.998312  3970 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:01.019379   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:01.032200   624 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:00.994599  4162 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:00.998683  4097 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:01.022826  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:01.025491  3582 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:00.966328  4141 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:01.050698   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:01.029452   480 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:14:01.015687   523 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:00.947692  3967 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:01.034013   482 raft_consensus.cc:1240] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:01.037832   554 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:01.040127  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:01.069808   558 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:01.071847  1168 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:01.073307  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 79386.7us
I20260709 13:14:01.073796   624 raft_consensus.cc:1240] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:01.074520   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:01.043535   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:01.048386   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.074023  1141 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:01.079281   481 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11. Ops: []
W20260709 13:14:01.078301   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 75736.3us
I20260709 13:14:01.033597  4063 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:01.104118   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 178819us
I20260709 13:14:01.048887  4097 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:01.045488  3961 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.039899  4162 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:01.032361  4064 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:01.109407   478 raft_consensus.cc:2393] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 11: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:01.119170   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:01.116298   599 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:01.119925   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:01.126683   475 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:14:01.120494   556 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:01.122761  1175 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 8: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:01.135893   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:01.136713   554 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
W20260709 13:14:01.137583   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.108208  3933 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:01.142765   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:01.152752   555 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:01.157950   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:01.158710   550 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:01.159901   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 54841.6us
I20260709 13:14:01.164378   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:01.119700  4064 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:01.121810  4162 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:01.169097   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:01.178051   482 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:01.142782  4118 raft_consensus.cc:2804] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:14:01.182756  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 108803us
I20260709 13:14:01.183315   447 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:01.142287  4063 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:01.185978  1141 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:01.179641   599 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:14:01.184751  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 75216.9us
I20260709 13:14:01.221854   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:01.222848   628 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
I20260709 13:14:01.170418  3664 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:01.226531   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:01.226523   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:01.127823  3961 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:01.227512   555 raft_consensus.cc:2393] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 9: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:01.177125  4098 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:01.230997   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:01.182992  3933 raft_consensus.cc:697] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:14:01.243654   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 175398us
I20260709 13:14:01.260198  4147 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:01.184342  4118 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.274060   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:01.282235  4118 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:01.230615  3664 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:01.276746  4176 log.cc:927] Time spent T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:14:01.277199   483 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:01.278261  3791 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:01.279047   480 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:01.279261   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:01.614136  4102 consensus_queue.cc:1059] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:01.614897   479 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:14:01.615998  3961 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:01.617100  3961 raft_consensus.cc:3055] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:01.617432  3961 raft_consensus.cc:740] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:01.617471  4097 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:01.620066   558 consensus_meta.cc:287] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.544s	user 0.012s	sys 0.012s
I20260709 13:14:01.283602  3664 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:01.244532  4110 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:01.312491   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.315690   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:01.316560  4143 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:01.310832  4155 log.cc:927] Time spent T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:14:01.312531  4175 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:14:01.421339  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 231071us
W20260709 13:14:01.464484   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:01.653033   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.370028  3970 raft_consensus.cc:697] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:01.243131  4121 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:01.292589   628 raft_consensus.cc:1240] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:01.383637  3933 consensus_queue.cc:237] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:01.671729  3582 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:01.436120   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 253551us
I20260709 13:14:01.601754  1168 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:01.304919  1169 raft_consensus.cc:1240] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:14:01.177609  4100 consensus_queue.cc:1059] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.264s
I20260709 13:14:01.611544   550 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
W20260709 13:14:01.633939   557 consensus_meta.cc:287] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.659s	user 0.014s	sys 0.004s
I20260709 13:14:01.890650  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:01.892369   557 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
W20260709 13:14:01.627782  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 388092us
I20260709 13:14:01.636173   554 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:14:01.646142   482 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
W20260709 13:14:01.656950   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.651182   448 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:01.635154  3684 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:14:01.618479  3961 consensus_queue.cc:260] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:01.669843  3888 consensus_meta.cc:287] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.016s
I20260709 13:14:01.596205  4090 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.607307  3929 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.631009   556 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
W20260709 13:14:01.708824   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 568584us
I20260709 13:14:01.904358   551 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:14:01.675926  3773 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:01.701371   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 421458us
I20260709 13:14:01.914806   522 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:01.721001   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 469240us
I20260709 13:14:01.748373   552 raft_consensus.cc:1275] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:01.696745  4141 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:01.761468   525 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 2.640s (SENT) [suppressed 10 similar messages]
I20260709 13:14:01.696386  4117 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:01.740836  4118 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:01.922994  4118 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:01.694150  3970 consensus_queue.cc:237] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:01.776793  4097 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:01.803031  3967 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:01.923834  4177 log.cc:927] Time spent T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.665s	user 0.003s	sys 0.000s
W20260709 13:14:01.801041  4064 consensus_meta.cc:287] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.015s
I20260709 13:14:01.811728   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1927) took 1059 ms. Trace:
I20260709 13:14:01.695082  4187 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.133s
W20260709 13:14:01.842808  4162 consensus_meta.cc:287] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.629s	user 0.000s	sys 0.016s
I20260709 13:14:01.834139  4199 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:01.926206   483 rpcz_store.cc:276] 0709 13:14:00.751943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.285905 (+533962us) service_pool.cc:224] Handling call
0709 13:14:01.286227 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:01.286461 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:01.306065 (+ 19604us) log.cc:844] Serialized 14 byte log entry
0709 13:14:01.810161 (+504096us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:01.811402 (+  1241us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:01.811455 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:01.811528 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:01.811666 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":213,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":10714,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":1888,"thread_start_us":136742,"threads_started":1,"wal-append.queue_time_us":232651}
I20260709 13:14:01.927381  3582 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:01.927663  4199 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:01.927938  3582 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:01.928239  4018 consensus_queue.cc:1059] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:01.929234  4018 raft_consensus.cc:3055] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:01.929562  4018 raft_consensus.cc:740] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:01.929941  4199 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:01.930130  3582 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:01.930399  4018 consensus_queue.cc:260] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:01.860682   553 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:01.931674  4018 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:01.853003  4063 consensus_meta.cc:287] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.624s	user 0.004s	sys 0.008s
I20260709 13:14:01.870702   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 565) took 1051 ms. Trace:
I20260709 13:14:01.888473  3664 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:01.894133   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.891858  4147 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:01.901786  4100 raft_consensus.cc:3055] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:01.940793  4100 raft_consensus.cc:740] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:01.941741  4100 consensus_queue.cc:260] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:01.902004   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 251022us
I20260709 13:14:01.943338  4063 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:01.943688   448 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:01.902602  4110 raft_consensus.cc:2804] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:01.944686  4110 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.945084  4110 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:01.945756  4063 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:01.927418  4162 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:01.908354  4098 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:01.947475  4098 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:01.948616  4162 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:01.926225  4064 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:01.903964  3888 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:01.952190  4064 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:01.953146  3888 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:01.907931  3929 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:01.955644  3929 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:01.909278   447 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:01.909760  4090 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:01.957247   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:01.957602  3810 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:01.958338  4090 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:01.958176  3810 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:01.911913  4193 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:01.903282  4195 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:14:01.805099   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 558) took 1094 ms. Trace:
I20260709 13:14:01.959494   476 rpcz_store.cc:276] 0709 13:14:00.710190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.939160 (+228970us) service_pool.cc:224] Handling call
0709 13:14:00.968916 (+ 29756us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:01.012627 (+ 43711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:01.012658 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:01.034617 (+ 21959us) log.cc:844] Serialized 26 byte log entry
0709 13:14:01.214393 (+179776us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:01.214432 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:01.214497 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:01.804817 (+590320us) raft_consensus.cc:1685] finished
0709 13:14:01.804836 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:01.805019 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36091,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":8419,"thread_start_us":94115,"threads_started":1,"wal-append.queue_time_us":723416}
I20260709 13:14:01.960229  4193 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:01.961253   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:01.961966   476 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
W20260709 13:14:01.962080  4188 log.cc:927] Time spent T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:14:01.920244   522 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:01.962845   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:01.960435  1169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 561) took 1245 ms. Trace:
I20260709 13:14:01.963851   522 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:01.964311  4183 consensus_queue.cc:1059] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:14:01.932541   480 rpcz_store.cc:276] 0709 13:14:00.818823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.612848 (+794025us) service_pool.cc:224] Handling call
0709 13:14:01.613290 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:01.613598 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:01.613636 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:01.614112 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:14:01.753505 (+139393us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:01.753555 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:01.753642 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:01.870423 (+116781us) raft_consensus.cc:1685] finished
0709 13:14:01.870452 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:01.870624 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":138906,"threads_started":1,"wal-append.queue_time_us":192254}
I20260709 13:14:01.965468  4183 raft_consensus.cc:3055] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:01.937879   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 1966) took 1001 ms. Trace:
I20260709 13:14:01.961349   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:01.937278   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:01.965346   522 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:01.997577   479 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:01.998106   476 raft_consensus.cc:1240] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:01.998570   522 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:01.999615   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:02.000367   476 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:01.965894  4183 raft_consensus.cc:740] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:01.964105  1169 rpcz_store.cc:276] 0709 13:14:00.715368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.716385 (+  1017us) service_pool.cc:224] Handling call
0709 13:14:00.716732 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:01.894467 (+1177735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:01.960143 (+ 65676us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54005eea54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:01.960346 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":808419712}
I20260709 13:14:01.958424   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:14:01.994211   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 50615.5us
I20260709 13:14:01.955572  1172 raft_consensus.cc:2393] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:01.996994   482 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:02.001631   483 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:14:02.003955   448 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:01.943064  4100 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:01.996613  3929 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:02.007505   599 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:02.006318   522 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:02.018157   448 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:01.998117  3933 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:01.993619  3684 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:01.997068  4141 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.001442  4198 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:02.073879  3933 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.074146  4198 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:02.074316  3933 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:02.074473  4192 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.026196  4143 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:02.075466  3629 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:02.075254  4192 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:02.016294  4090 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:02.076719  4199 consensus_queue.cc:1059] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:02.077317  4102 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:02.077764  4102 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.007133  4196 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:02.078200  4102 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:02.078542   482 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:02.079867   476 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:14:02.080569   482 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:02.081041   476 raft_consensus.cc:1240] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:02.033994  4097 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:02.059579   477 raft_consensus.cc:1240] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:02.083370  4097 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:02.084085  4097 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:02.084214   475 raft_consensus.cc:1240] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:02.047559  4203 consensus_queue.cc:1059] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:14:02.086781  3876 raft_consensus.cc:3055] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:02.086942  1172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36724 (request call id 507) took 1081 ms. Trace:
I20260709 13:14:02.087278  3876 raft_consensus.cc:740] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:02.087455  1172 rpcz_store.cc:276] 0709 13:14:01.005427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.008397 (+  2970us) service_pool.cc:224] Handling call
0709 13:14:02.086728 (+1078331us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54004d3354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:02.086865 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2175809408}
I20260709 13:14:02.088286  3876 consensus_queue.cc:260] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:02.089315  4192 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:02.089450  3876 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:01.966113   559 rpcz_store.cc:276] 0709 13:14:00.936244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.936720 (+   476us) service_pool.cc:224] Handling call
0709 13:14:00.937023 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:00.937361 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:00.937389 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:00.937825 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:14:01.012400 (+ 74575us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:01.012439 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:01.012505 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:01.923157 (+910652us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:01.932817 (+  9660us) raft_consensus.cc:1685] finished
0709 13:14:01.932839 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:01.937813 (+  4974us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2282,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":12082560,"thread_start_us":74207,"threads_started":1,"wal-append.queue_time_us":229980}
I20260709 13:14:02.051792  3929 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:02.090567  3929 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.090909  3929 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:02.069054  3961 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:02.072322   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 563) took 1359 ms. Trace:
W20260709 13:14:02.072654   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:02.067637   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 158501us
I20260709 13:14:02.072938   479 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
W20260709 13:14:02.055897   478 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1782) took 1328 ms (client timeout 1582 ms). Trace:
I20260709 13:14:02.100098   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:02.101203   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:02.097159  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:02.101842   551 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:02.053092  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:02.105361   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:02.105698   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:02.108033   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:02.108606   479 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:14:02.109717  1141 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:02.111182   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:14:02.100915   478 rpcz_store.cc:269] 0709 13:14:00.727409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.729392 (+  1983us) service_pool.cc:224] Handling call
0709 13:14:02.055647 (+1326255us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b5400131d54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:02.055818 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840935168}
I20260709 13:14:02.111754   631 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:14:02.112247   523 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:02.113022   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:02.113273   523 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:02.114576   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:02.117619   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:02.118366   559 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:02.122575   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:02.123147   553 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:02.123270   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 361779us
I20260709 13:14:02.123875   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:02.124399   624 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:02.124621   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:02.125198   625 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:02.074604  4198 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:02.124372   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 164575us
I20260709 13:14:02.130532   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:02.098805   484 rpcz_store.cc:276] 0709 13:14:00.713219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.000837 (+287618us) service_pool.cc:224] Handling call
0709 13:14:01.015900 (+ 15063us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:01.041543 (+ 25643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:01.041576 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:01.108604 (+ 67028us) log.cc:844] Serialized 52 byte log entry
0709 13:14:01.585327 (+476723us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:01.677915 (+ 92588us) log.cc:844] Serialized 14 byte log entry
0709 13:14:01.678490 (+   575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:01.678859 (+   369us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:01.961450 (+282591us) spinlock_profiling.cc:243] Waited 7.47 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:02.072042 (+110592us) raft_consensus.cc:1685] finished
0709 13:14:02.072132 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.072269 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":92257,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":21128,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":27686,"spinlock_wait_cycles":17173888,"thread_start_us":426549,"threads_started":1,"wal-append.queue_time_us":661322}
I20260709 13:14:02.130896   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:02.133823   552 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:02.131872   629 raft_consensus.cc:1240] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:02.132483   447 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:02.132318   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:02.048799  3664 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:02.048758  3810 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:02.139557   597 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:02.110682  4090 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.130336  3791 raft_consensus.cc:697] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:02.122172  3684 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:02.120493  4182 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:02.077725  4199 consensus_queue.cc:1059] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:14:02.148569   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:02.122390  3629 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.135951  4161 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:02.158147   630 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:14:02.143692  4143 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:02.115203  4141 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:02.174726   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.157177  4182 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.189599   482 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:02.181667   551 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
W20260709 13:14:02.180881   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 47381.1us
I20260709 13:14:02.140285  4097 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:02.191861   631 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:14:02.180903   447 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:02.180371  4121 consensus_queue.cc:1059] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:14:02.183156  4196 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.187904   557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:14:02.204782   557 raft_consensus.cc:606] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:02.205327   557 raft_consensus.cc:614] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:02.188804  4141 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:02.200313   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 194069us
I20260709 13:14:02.201462  1138 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:02.208765   522 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:02.209978   522 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:02.210824   522 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:02.163698  4203 consensus_queue.cc:1059] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:14:02.163487  4090 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:02.192591  4182 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:02.175376  3933 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:02.210853   624 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:14:02.207566  3664 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:02.204694  4199 raft_consensus.cc:3055] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:14:02.213517   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.179330  3629 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:02.216230   476 raft_consensus.cc:1240] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:02.213850   597 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:02.212357   522 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:02.214075   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:02.213915   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 58452.7us
W20260709 13:14:02.227032   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 218474us
I20260709 13:14:02.234844   448 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:02.240537  4203 raft_consensus.cc:3055] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:02.241047  4203 raft_consensus.cc:740] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:02.245363  4110 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:02.247651  4221 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:02.248088  4221 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:02.248440  4221 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:02.216063  4143 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:02.206821  4098 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:02.259562  4216 raft_consensus.cc:2764] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:14:02.260438  4216 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:02.261523  4098 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:02.237843  1138 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:14:02.263851   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 50083.3us
I20260709 13:14:02.264191   481 raft_consensus.cc:2393] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:02.237500   599 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:02.225481  4064 raft_consensus.cc:2804] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:02.267930   625 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
W20260709 13:14:02.270712   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.273607  4162 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:02.274222  4162 raft_consensus.cc:697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:02.275470  3765 raft_consensus.cc:2764] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:14:02.276188  4162 consensus_queue.cc:237] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:02.280316   525 leader_election.cc:336] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.528s (SENT)
I20260709 13:14:02.280838   525 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:02.181479  3791 consensus_queue.cc:237] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:02.272723   597 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:02.285060   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 72769.5us
I20260709 13:14:02.285791   522 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:02.290155  1138 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:02.296433   559 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:02.230894  3664 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:02.301955   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 66791.8us
I20260709 13:14:02.304100  3684 raft_consensus.cc:697] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:02.232290  4199 raft_consensus.cc:740] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:02.305812  3664 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:02.308465  3970 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:02.309290  4090 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:02.311360  4206 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:02.311668  4183 consensus_queue.cc:260] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:02.313127  4183 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:02.313607  3765 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:02.312157   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1921) took 1592 ms. Trace:
I20260709 13:14:02.314278   477 rpcz_store.cc:276] 0709 13:14:00.720105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.000915 (+280810us) service_pool.cc:224] Handling call
0709 13:14:02.059349 (+1058434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.083860 (+ 24511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.311972 (+228112us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400131d50. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:02.312098 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2391567616}
I20260709 13:14:02.306291   599 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:14:02.317911   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.321873   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:02.328454   559 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11. Ops: []
W20260709 13:14:02.331857   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 46132.8us
I20260709 13:14:02.332729   522 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:02.336134  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:02.284264  4216 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:02.339047   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 104248us
I20260709 13:14:02.342412   448 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:02.343873   448 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:02.347364   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:02.347628   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:02.350661   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 44459.5us
W20260709 13:14:02.351807   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 71520.8us
I20260709 13:14:02.307122  4064 raft_consensus.cc:697] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:02.360090   599 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:02.317396  4206 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.212517  4196 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:02.319583  4098 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:02.369369   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:02.365494   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 184695us
I20260709 13:14:02.394786  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:14:02.396009   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 63382.7us
I20260709 13:14:02.403532   556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59102
W20260709 13:14:02.408267   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 64443us
I20260709 13:14:02.419950   556 raft_consensus.cc:606] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:02.409905  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:02.361580  4090 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:02.424054   554 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:14:02.422996   556 raft_consensus.cc:614] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:02.361778  4143 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:02.376113  3765 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:02.421182   448 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:02.305342  3684 consensus_queue.cc:237] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:02.431501  1172 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:02.355561  4216 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:02.434109  4227 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.317121  4203 consensus_queue.cc:260] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:02.434680   447 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:02.435462  4199 consensus_queue.cc:260] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:02.421568  4217 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:02.426887  3810 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:14:02.439226  4097 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:02.432365  3876 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:14:02.432674  4143 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:02.443625  4064 consensus_queue.cc:237] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:02.443769  3929 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:02.445158  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:02.448978   553 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:02.450587   550 raft_consensus.cc:1275] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:02.447992  1170 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:14:02.377193  4223 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:02.498317  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:02.421018  4110 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:02.515578  4241 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:14:02.470218   525 leader_election.cc:336] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.638s (SENT)
I20260709 13:14:02.539661   525 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:02.501683  4190 consensus_queue.cc:1059] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:14:02.541919   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 71763us
I20260709 13:14:02.542906  4097 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:02.544597  4242 raft_consensus.cc:3055] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:02.545007  4242 raft_consensus.cc:740] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:02.545926  4242 consensus_queue.cc:260] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:02.547518  4242 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:02.552047  4102 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:02.553375  4182 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:02.554224  4102 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:02.592427  4198 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:02.594735  4198 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:02.596635  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.597496  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:02.600919  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:02.601707  4237 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:02.511147  4236 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:14:02.606210   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 209153us
I20260709 13:14:02.595511  4199 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:02.612072   553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:14:02.612681   553 raft_consensus.cc:606] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:02.613003   553 raft_consensus.cc:614] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:02.613196   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:02.613862   482 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:02.597441  4203 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:02.618887   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:02.619385   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.496412  4161 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:02.601722  4216 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:02.634644   597 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:02.505612  4212 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:14:02.465052  3664 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:02.504760  4143 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:02.512022  4223 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.511638  3929 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:02.376214  3970 raft_consensus.cc:697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:02.522056  4196 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:02.518692  4141 raft_consensus.cc:3055] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:02.513607   557 raft_consensus.cc:2393] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 10: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
W20260709 13:14:02.484200   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 63202.6us
I20260709 13:14:02.537171   552 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:14:02.538094  1168 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:14:02.554841  1175 raft_consensus.cc:2393] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 8: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:02.495213  4217 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.427035  4018 consensus_queue.cc:1059] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
W20260709 13:14:02.600991   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 166419us
I20260709 13:14:02.500864  4227 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:02.516772  3629 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:02.698848   597 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:02.602779   476 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:14:02.460726  4100 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:02.597364  3933 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:02.619115   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:02.673717  3810 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:02.622977   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:02.508950  3791 consensus_queue.cc:1059] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:14:02.605230  4182 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:02.605948  4236 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.636652   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:02.636706   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:02.638535   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:14:02.640241   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.636540   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:02.642182   626 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:02.648502   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:02.376060  4206 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:02.427219  4225 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:02.517066  4234 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:02.661782   482 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:14:02.666015   556 raft_consensus.cc:1240] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:14:02.664495   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:02.670620   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:02.636386  4198 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:02.674873   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 210755us
I20260709 13:14:02.680243   559 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:02.681732   448 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:02.726500   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 44852.5us
I20260709 13:14:02.727394   448 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:02.684253  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 66231.1us
I20260709 13:14:02.697134   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:02.621049   631 raft_consensus.cc:1240] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:02.673755  4223 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:02.673511  4102 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:02.710806   551 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:02.681102  4141 raft_consensus.cc:740] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:02.683625  4217 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:02.684026  3765 raft_consensus.cc:697] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:02.680850  4190 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:14:02.714766  4236 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:02.721705   522 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:02.722051   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.741124   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:02.741705   554 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:02.709300  4100 raft_consensus.cc:697] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:02.732586   448 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:02.735324   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:02.733990   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:02.738727   476 raft_consensus.cc:1275] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:14:02.740837   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:02.731707  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 84685us
I20260709 13:14:02.743402  3765 consensus_queue.cc:237] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:02.744596   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:02.745253   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:02.764616   448 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:02.773671   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 54989.8us
I20260709 13:14:02.772348   475 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:02.774235   448 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:02.702549  4221 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:02.768033   552 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
I20260709 13:14:02.780092   483 raft_consensus.cc:1275] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:02.736753  3629 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:02.724666  4234 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:02.776693   448 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:02.740561  4110 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:02.713397  3970 consensus_queue.cc:237] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:02.783075   479 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:14:02.783684   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:02.787602   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 88800.4us
I20260709 13:14:02.801429   558 raft_consensus.cc:1240] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:02.775123  4090 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:02.762543  4247 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.802327   551 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:14:02.740525  4198 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:02.780618  4225 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:02.813455   552 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:02.816457  4212 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.816896   597 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:02.779569  4098 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:02.796900  4234 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:02.839289   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.782290  4229 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:02.762243  4193 consensus_queue.cc:1059] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:14:02.857877   550 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:14:02.792029  3961 consensus_queue.cc:1059] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:14:02.803542  3629 raft_consensus.cc:697] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:02.784833  3684 consensus_queue.cc:1059] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:14:02.822510  4190 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:02.888231  1169 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:57004
W20260709 13:14:02.872315   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 55500.4us
I20260709 13:14:02.783222  4102 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:02.797313  4248 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:14:02.923408   597 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:02.917975   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.925041   554 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
I20260709 13:14:02.925410   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:02.837828  4090 raft_consensus.cc:697] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:02.859205  4110 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:14:02.934438   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 151164us
I20260709 13:14:02.942174   597 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:02.960947  4236 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:02.922891  1169 raft_consensus.cc:606] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:02.938006   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 161386us
I20260709 13:14:02.938086   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:02.894695  4231 log.cc:927] Time spent T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:14:02.822053  4097 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
W20260709 13:14:02.966266   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.967747   629 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:02.871150  4098 raft_consensus.cc:697] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:02.888455  4242 raft_consensus.cc:2764] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:14:02.980207  4110 raft_consensus.cc:697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:02.980726   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:02.980417  4098 consensus_queue.cc:237] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:02.981853   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:02.981491  4110 consensus_queue.cc:237] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:02.982430   554 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:14:02.858525  4184 consensus_queue.cc:1059] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:14:02.923581  4190 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.910455  4198 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:02.914731  4221 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:02.962324  4252 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:02.985240  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 177095us
W20260709 13:14:03.012354   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 43800.8us
I20260709 13:14:02.928540   475 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:03.013232   447 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:02.986148   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:03.018487   554 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:14:03.020430   626 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:02.913537  4223 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:02.915346  4227 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:02.987376   448 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:02.927400  4229 raft_consensus.cc:697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:02.855083  4250 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.146s
I20260709 13:14:02.837774  4247 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:02.990267  3961 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:02.994709  4190 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:02.969266  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 189138us
I20260709 13:14:02.914731  4100 consensus_queue.cc:237] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:03.051512   554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:14:03.065513   554 raft_consensus.cc:606] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:03.065912   554 raft_consensus.cc:614] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:03.077754   554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:14:03.078367   554 raft_consensus.cc:606] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:03.078689   554 raft_consensus.cc:614] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:03.079496  3629 consensus_queue.cc:237] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:03.080139 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:14:03.086227  4251 log.cc:927] Time spent T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:14:03.092101  4209 raft_consensus.cc:3055] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:03.091790  4229 consensus_queue.cc:237] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:03.093214  4090 consensus_queue.cc:237] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:03.094309   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:03.094938   553 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:03.097630   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:03.064165  4195 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:14:03.116256  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 337287us
I20260709 13:14:03.092558  4209 raft_consensus.cc:740] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:14:03.122943   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 135626us
I20260709 13:14:03.120198  1141 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:02.921722  4141 consensus_queue.cc:260] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:03.051966  4121 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:03.174751  4209 consensus_queue.cc:260] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:03.175346  1139 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:03.176209  4209 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:03.176505  4259 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:14:03.171432   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.865092  4212 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:03.175371  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:14:03.225495   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 212343us
I20260709 13:14:03.226511   447 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:03.220659  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 45413.8us
I20260709 13:14:03.228618  1139 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:03.232089  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 75801.5us
I20260709 13:14:03.177775  4252 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.242527  1139 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:03.210450  4259 raft_consensus.cc:697] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:03.198843  4183 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.210110  3967 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:03.219715  3888 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:03.212399  4199 consensus_meta.cc:287] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.003s
I20260709 13:14:03.230052  4110 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.263314  4255 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:03.264387  4255 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:03.264724  4255 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:03.263933  4064 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:03.271773  4223 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:03.258831  4183 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:03.276429  4225 raft_consensus.cc:3055] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:03.276878  4225 raft_consensus.cc:740] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:03.280486  4257 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:03.281899   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:03.282518   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:03.247396  3664 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:03.283351   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:03.283942   631 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:03.284410  4097 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:03.284833  4097 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:03.285175  4097 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:03.261096  3888 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:03.291968  3888 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:03.292511  3888 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:03.293434  4247 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:03.296063  4264 log.cc:927] Time spent T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:14:03.298043  4246 raft_consensus.cc:3055] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:03.298445  4246 raft_consensus.cc:740] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:03.300171  4236 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:03.300798  4110 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:03.302847  4110 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:03.304527   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:03.306015  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 63571.7us
I20260709 13:14:03.306784  1139 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:03.248477  4253 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:03.318204   631 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:03.275071  4183 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:03.254652  4102 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:03.321587   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:03.323719   624 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:03.322099   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:03.322599   522 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:03.326704  1139 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:03.324445   448 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:03.327165   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 359564us
I20260709 13:14:03.312394  4147 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:03.331928   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:03.328202   448 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:03.334146   479 raft_consensus.cc:2393] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 10: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:03.337608   629 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:03.339715   558 raft_consensus.cc:1240] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:14:03.339947   523 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:03.341674  3876 raft_consensus.cc:3055] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:03.342072  3876 raft_consensus.cc:740] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:03.342344   482 raft_consensus.cc:1240] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:03.346794   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:03.347651   558 raft_consensus.cc:2410] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:14:03.353786   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:03.330807  3933 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:03.358893  1169 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:03.360402  1168 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:14:03.356153   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:03.368865   482 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:14:03.332670  4110 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:03.386762   624 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
W20260709 13:14:03.414533   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 66255.1us
I20260709 13:14:03.337209  4184 raft_consensus.cc:2804] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:03.415557   522 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:03.418159   597 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:03.348609  4227 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:03.348743  4223 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:03.353298  4102 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:14:03.330205  4183 consensus_queue.cc:1059] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:14:03.245292  4252 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:03.344787  4192 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:14:03.342908  3876 consensus_queue.cc:260] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:03.436281   599 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:03.413465  4110 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:03.416445  4248 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:03.348253  4250 consensus_queue.cc:1059] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:14:03.272357  4259 consensus_queue.cc:237] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:03.299263  4246 consensus_queue.cc:260] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:03.304088  4257 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:03.429374  4217 consensus_meta.cc:287] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.655s	user 0.015s	sys 0.000s
I20260709 13:14:03.430678  4227 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:03.432530  4184 raft_consensus.cc:697] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:03.425114  4199 consensus_queue.cc:1048] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:14:03.479612  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:03.482918  1172 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:03.436379  3933 raft_consensus.cc:697] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:03.444739   597 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:03.277647  4225 consensus_queue.cc:260] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:03.471199   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:03.355916  4234 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:03.428462  4256 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:03.450354  4110 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:03.444089  4273 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.487493   479 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:03.524748  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:14:03.529043   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:03.491596  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:03.444880  4064 raft_consensus.cc:697] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:03.463075  4227 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:03.525771   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 59342.1us
I20260709 13:14:03.540606   448 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:03.486891  3876 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:03.478400  4237 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:03.478531  4212 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:03.463407  4217 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:03.462546  4248 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:03.696138   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:03.464792  3765 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
W20260709 13:14:03.708750   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:03.707644   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:03.833246   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:03.716361  4198 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.759347  4200 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:03.762413  4244 log.cc:927] Time spent T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.774s	user 0.004s	sys 0.000s
W20260709 13:14:03.763989  4265 log.cc:927] Time spent T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.564s	user 0.001s	sys 0.000s
W20260709 13:14:03.770684  4203 consensus_meta.cc:287] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 1.138s	user 0.008s	sys 0.008s
I20260709 13:14:03.745251  3933 consensus_queue.cc:237] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:03.772049  4252 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:03.843142   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 302582us
I20260709 13:14:03.774960  4257 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:03.779552  4260 log.cc:927] Time spent T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.458s	user 0.001s	sys 0.000s
I20260709 13:14:03.779606  4064 consensus_queue.cc:237] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:03.476943  4268 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.261s
W20260709 13:14:03.790164   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 345652us
W20260709 13:14:03.757751  4209 consensus_meta.cc:287] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.001s
I20260709 13:14:03.552645  4273 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:03.486016  3791 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:03.789868  3629 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:03.870692  3629 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:03.871102  3629 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:03.873447  1171 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
W20260709 13:14:03.825279   525 leader_election.cc:336] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.547s (SENT)
I20260709 13:14:03.875526   525 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:03.876459   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 51239.9us
W20260709 13:14:03.877978   525 leader_election.cc:336] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.558s (SENT)
I20260709 13:14:03.878366   525 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:03.779991  4184 consensus_queue.cc:237] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:03.882200  4221 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:03.833377   477 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
I20260709 13:14:03.746057  4223 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:03.883709  4223 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:03.886118  4223 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:03.831458  4190 consensus_meta.cc:287] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.711s	user 0.005s	sys 0.013s
I20260709 13:14:03.886853  4190 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:03.887274  3967 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.887776  3967 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:03.888921  4190 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:03.831717  4206 consensus_meta.cc:287] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.118s	user 0.002s	sys 0.009s
I20260709 13:14:03.773620  4234 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:03.831712   447 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.006s	sys 0.052s
W20260709 13:14:03.890185   447 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.006s	sys 0.053s
W20260709 13:14:03.890493   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 628011us
I20260709 13:14:03.891150   447 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:03.845338   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:03.851958   559 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:14:03.896261  4206 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:03.904633  4246 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:03.906158  4206 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:03.906921   633 raft_consensus.cc:2393] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 8: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:03.902112   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1770) took 1278 ms. Trace:
I20260709 13:14:03.909263   628 raft_consensus.cc:2393] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:03.902424   630 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:03.908861   629 rpcz_store.cc:276] 0709 13:14:02.624104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.624224 (+   120us) service_pool.cc:224] Handling call
0709 13:14:03.901924 (+1277700us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b5400023354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:03.902058 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589344512}
I20260709 13:14:03.839360  4198 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:03.917052   559 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:03.848539  4237 raft_consensus.cc:697] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:03.907737  4162 raft_consensus.cc:3055] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:03.841284  4200 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:03.929615   447 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:03.919344  4265 log.cc:927] Time spent T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:14:03.899106  4090 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:03.900254  4182 raft_consensus.cc:3055] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:03.943377  4223 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.946220  4217 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:03.948307   525 leader_election.cc:336] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.518s (SENT)
I20260709 13:14:03.964861   525 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:03.966930   525 leader_election.cc:336] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.526s (SENT)
I20260709 13:14:03.949038  4227 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:03.949956  4255 consensus_meta.cc:287] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.685s	user 0.010s	sys 0.000s
I20260709 13:14:03.953995  4277 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:03.929517  4162 raft_consensus.cc:740] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:03.914052  4234 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:03.962456   556 raft_consensus.cc:2410] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:14:03.903851  4274 log.cc:927] Time spent T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
W20260709 13:14:03.968441   525 leader_election.cc:336] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.636s (SENT)
W20260709 13:14:03.996342   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:03.996482   525 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:03.997521   525 leader_election.cc:336] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.671s (SENT)
I20260709 13:14:03.997969   525 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:03.974455  4282 log.cc:927] Time spent T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:14:03.960146  4182 raft_consensus.cc:740] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
W20260709 13:14:03.975587  4280 log.cc:927] Time spent T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:14:03.968919  4223 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:03.979341  4237 consensus_queue.cc:237] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:03.980207  4279 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:14:03.980516  4198 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:03.982062  4200 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:03.985009  4097 consensus_meta.cc:287] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.699s	user 0.009s	sys 0.000s
I20260709 13:14:03.985605  4256 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:03.976539  4110 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:03.988044   628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1768) took 1365 ms. Trace:
I20260709 13:14:04.034366   628 rpcz_store.cc:276] 0709 13:14:02.622140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.622261 (+   121us) service_pool.cc:224] Handling call
0709 13:14:03.987796 (+1365535us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400161cd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:03.987976 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2721015552}
I20260709 13:14:03.988430   522 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:03.922497  4293 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:14:04.051162  4227 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:03.999698  3933 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:03.997668  4100 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:04.012356   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1952) took 1270 ms. Trace:
W20260709 13:14:04.024817   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:04.022274   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 463081us
W20260709 13:14:04.037339   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 49010.1us
W20260709 13:14:04.040176  4121 consensus_meta.cc:287] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.865s	user 0.004s	sys 0.013s
I20260709 13:14:04.040452  4097 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:03.995482  4296 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:04.043830  4182 consensus_queue.cc:260] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:04.046777  4143 consensus_meta.cc:287] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 1.371s	user 0.018s	sys 0.001s
I20260709 13:14:04.108139  4143 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:04.110387  4143 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:03.999751  4199 consensus_queue.cc:1059] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:14:04.047637  4162 consensus_queue.cc:260] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:03.975433   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 493) took 1247 ms. Trace:
I20260709 13:14:04.127384   630 rpcz_store.cc:276] 0709 13:14:02.728471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.729385 (+   914us) service_pool.cc:224] Handling call
0709 13:14:03.902249 (+1172864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:03.910229 (+  7980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:03.975198 (+ 64969us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400023350. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:03.975364 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2623814912}
W20260709 13:14:04.059468   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 204519us
W20260709 13:14:04.000084   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 70555.6us
I20260709 13:14:04.130584   447 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:04.131685   447 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:04.132786  4246 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:04.134127  4246 consensus_queue.cc:1048] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:04.063050  3791 raft_consensus.cc:697] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:04.135917  3791 consensus_queue.cc:237] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:04.137141  4097 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:04.137804  4097 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:04.138401  4097 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:04.138912  4097 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:03.993052  4255 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:04.140822  4255 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:04.065186  4272 log.cc:927] Time spent T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.393s	user 0.000s	sys 0.001s
I20260709 13:14:04.091398   484 rpcz_store.cc:276] 0709 13:14:02.742286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.742423 (+   137us) service_pool.cc:224] Handling call
0709 13:14:02.759716 (+ 17293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:02.760086 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:02.760116 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:02.760577 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:14:03.027653 (+267076us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:03.027708 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:03.027804 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:04.012065 (+984261us) raft_consensus.cc:1685] finished
0709 13:14:04.012097 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:04.012272 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1044,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":12648,"thread_start_us":266697,"threads_started":1,"wal-append.queue_time_us":486029}
I20260709 13:14:04.093257   599 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:14:04.142782   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 49653.8us
I20260709 13:14:04.143699  4267 raft_consensus.cc:2764] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:14:04.144464  4267 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:14:04.094430   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 96927.5us
I20260709 13:14:04.146632  4162 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:04.147315   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.147867  4199 raft_consensus.cc:3055] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:04.148293  4199 raft_consensus.cc:740] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:04.149096  4199 consensus_queue.cc:260] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:04.151392   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.036430  4290 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.156301   476 raft_consensus.cc:2410] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:04.157850   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:04.059702  4234 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:04.160291   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:04.161018   628 raft_consensus.cc:2393] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 6: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:04.162189   553 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:04.162384   482 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:14:04.163110   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.156030  3933 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:04.164472  3933 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:04.168466  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:04.169193  1168 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
W20260709 13:14:04.063413  3961 consensus_meta.cc:287] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.998s	user 0.007s	sys 0.004s
I20260709 13:14:04.075348  4110 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:04.100845  4223 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:04.107643  4182 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:04.115960   481 raft_consensus.cc:1240] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:04.119849   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:04.217767  3810 consensus_queue.cc:1059] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:04.122010   557 raft_consensus.cc:1275] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:14:04.219949   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:04.220871   557 raft_consensus.cc:2393] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 10: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:04.062355  4198 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:04.159373  4199 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:04.096850  4121 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:04.174605   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:04.230858   630 raft_consensus.cc:2393] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:04.218634  3810 raft_consensus.cc:3055] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:04.231247  3810 raft_consensus.cc:740] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:04.170730  4290 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:04.232048  3810 consensus_queue.cc:260] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:04.233256  3810 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:04.233630  4290 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:04.234211   625 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:04.176542  4245 raft_consensus.cc:3055] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:04.234833  4245 raft_consensus.cc:740] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:04.235510   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:04.166491  3933 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:04.197484  1171 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 719) took 1752 ms (client timeout 1854 ms). Trace:
W20260709 13:14:04.147986   525 leader_election.cc:336] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.758s (SENT)
I20260709 13:14:04.244182   525 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:04.190850   555 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:14:04.245401   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:04.179507   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:04.190135   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:04.246954   558 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:04.215479  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:04.218581   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:04.224009   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:03.995699  4277 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:04.103103  4273 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:04.226413   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:04.254565   557 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:14:04.111168  4248 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:04.159521  4097 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:04.236433   624 raft_consensus.cc:2410] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:14:04.242513   553 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:04.259634   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:04.237195   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:04.180687  3967 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:14:04.219367  3961 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:04.248029  1168 raft_consensus.cc:2393] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
W20260709 13:14:04.263638   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.248286   629 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:14:04.264407  4303 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:04.264998  4303 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:04.250176   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:14:04.243444  1171 rpcz_store.cc:269] 0709 13:14:02.444718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.444856 (+   138us) service_pool.cc:224] Handling call
0709 13:14:04.197305 (+1752449us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400655ed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:04.197426 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3078055808}
I20260709 13:14:04.236701  4198 raft_consensus.cc:697] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:04.268886   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:14:04.269150   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 121187us
I20260709 13:14:04.255622   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:04.269496   483 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:14:04.257076   631 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:14:04.258478   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:04.258769   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:04.269814   525 leader_election.cc:336] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.582s (SENT)
I20260709 13:14:04.270947   525 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:04.152199  4209 consensus_queue.cc:1175] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" responder_term: 9 status { last_received { term: 9 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 9 index: 5 } }
I20260709 13:14:04.179180  3629 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:04.276952   525 leader_election.cc:336] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.631s (SENT)
I20260709 13:14:04.277487   525 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:04.278555   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.271134   557 raft_consensus.cc:2393] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 9: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:04.262177   630 raft_consensus.cc:2410] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:14:04.269819   555 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:04.279920  4229 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:04.280536  4229 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:04.282897  4229 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:04.235709  4245 consensus_queue.cc:260] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:04.290102   597 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:04.290920  4261 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:04.297906   627 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:04.302624   597 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:04.303936   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:04.306905   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 462) took 1023 ms. Trace:
I20260709 13:14:04.307894   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:04.288831  4242 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.289541  4217 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.296201  4248 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:04.268886  4187 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:14:04.326116   558 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
W20260709 13:14:04.330143  4287 log.cc:927] Time spent T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.845s	user 0.001s	sys 0.001s
I20260709 13:14:04.331072   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:04.332300   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:04.333289   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:04.333763   632 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:14:04.334645   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:04.335559   632 raft_consensus.cc:2393] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:04.313227   551 rpcz_store.cc:276] 0709 13:14:03.283066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.304222 (+ 21156us) service_pool.cc:224] Handling call
0709 13:14:03.304520 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:03.304712 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:14:03.323569 (+ 18857us) log.cc:844] Serialized 14 byte log entry
0709 13:14:04.183905 (+860336us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b18003a2dc0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb923a 00007f4b68423a2a
0709 13:14:04.306434 (+122529us) log.cc:844] Serialized 14 byte log entry
0709 13:14:04.306598 (+   164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:04.306642 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:04.306687 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.306750 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:04.306854 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21621,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2459,"raft.queue_time_us":1426,"spinlock_wait_cycles":5694720,"thread_start_us":120575,"threads_started":1}
I20260709 13:14:04.315546   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:04.316558   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:04.339854   553 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:04.293890  4223 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:04.297212  4064 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.337152   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:04.343839   558 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:04.341074   555 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:14:04.310907  3933 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:04.304781  3961 consensus_queue.cc:1059] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:14:04.341519   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:04.344062   597 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:04.347911   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:04.348338   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:04.349481   555 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:04.315200  4196 consensus_queue.cc:1059] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:14:04.307193  4268 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:14:04.351402   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:04.356570   523 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:04.360531   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1953) took 1031 ms. Trace:
I20260709 13:14:04.361054   475 rpcz_store.cc:276] 0709 13:14:03.328827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.328950 (+   123us) service_pool.cc:224] Handling call
0709 13:14:03.343778 (+ 14828us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:03.352516 (+  8738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:03.352560 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:03.413144 (+ 60584us) log.cc:844] Serialized 52 byte log entry
0709 13:14:03.488133 (+ 74989us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:03.488171 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:03.488233 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:04.329536 (+841303us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:04.360134 (+ 30598us) raft_consensus.cc:1685] finished
0709 13:14:04.360165 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:04.360456 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8336,"raft.queue_time_us":117857,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":19332,"spinlock_wait_cycles":104445312,"thread_start_us":44987,"threads_started":1,"wal-append.queue_time_us":53981}
I20260709 13:14:04.364073   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.364998  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:04.365737  1168 raft_consensus.cc:2393] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 11: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:04.309022  4261 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:04.365754   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.367483   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.338238  3791 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:04.368386   475 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:04.327343  4217 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:04.369560   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:04.378463   630 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:04.355788   448 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:04.384477   483 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:04.385387   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:04.386133   475 raft_consensus.cc:2393] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 8: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:04.389411   555 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:14:04.391633   553 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:04.393388   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:04.394559   475 raft_consensus.cc:2410] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:14:04.403959   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 47456us
I20260709 13:14:04.404794   523 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:04.406070   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:04.326150  4242 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:04.410702   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:04.412663   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.380009  4273 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.413370   558 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:04.354291  4252 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:04.349931  4306 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:04.379597  4267 raft_consensus.cc:3055] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:04.371518  4217 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:04.386161  4121 consensus_queue.cc:1048] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:14:04.391840  4229 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:04.415791   448 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:04.370119  4304 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:04.426420  3629 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:04.414295  4196 raft_consensus.cc:3055] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:04.386397  4296 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:14:04.428627   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:04.429713   632 raft_consensus.cc:2393] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 7: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:04.430567   551 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:04.413651  3961 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.432298   628 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:04.431797   448 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:04.418433  4248 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:04.436115   555 pending_rounds.cc:85] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 4
I20260709 13:14:04.348425  4064 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:04.438362   555 pending_rounds.cc:107] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:14:04.438724   555 raft_consensus.cc:2889] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:04.419817  4252 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:04.447412   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 99465.8us
I20260709 13:14:04.452703  4304 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.441879   448 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:04.428190  4267 raft_consensus.cc:740] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:04.461922  4254 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:04.462371   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.464722  4064 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:04.437070  4110 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:04.468739  4305 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:04.412194  4223 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:14:04.354108  4198 consensus_queue.cc:237] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:04.465168  3629 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.422857  3664 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:14:04.437026  4196 raft_consensus.cc:740] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:04.491185   553 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:04.439525  4248 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:04.424474  4273 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:04.453449  4304 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:04.458673  4252 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:04.509526   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.429538  4306 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:04.513232   550 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:04.513487   482 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 6: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:04.512382   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:04.517418   556 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:04.440692  3961 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:04.457901  4229 raft_consensus.cc:697] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:04.487756  4279 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:04.527946   483 raft_consensus.cc:2410] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:14:04.510298  4248 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:04.507704  4277 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:04.509099  4254 raft_consensus.cc:697] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:04.530479   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:04.533159   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:04.537379   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.520684  4255 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:04.550859   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.543623   631 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:04.523983  4261 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:04.524875  4110 raft_consensus.cc:697] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:04.538043  4279 raft_consensus.cc:697] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:04.518468  3629 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:04.535207  4267 consensus_queue.cc:260] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:04.635569   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:04.635569   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:04.670040  4316 log.cc:927] Time spent T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 13:14:04.671140  4315 log.cc:927] Time spent T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:14:04.675727  4267 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:04.683297  4306 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:04.568264  4121 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 13:14:04.687600  4229 consensus_queue.cc:237] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:04.688078  4320 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:04.688647  4279 consensus_queue.cc:237] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:04.689163  4254 consensus_queue.cc:237] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:04.692062   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.693231   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.693912   482 raft_consensus.cc:2393] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 12: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:04.694623   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.695703  4242 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:04.697151   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:04.698812   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.828038   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.608299  4255 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:04.866700   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.792574  3888 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:04.863787   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 342663us
I20260709 13:14:04.803136  4229 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:04.867365   482 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:04.628779  4196 consensus_queue.cc:260] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:04.889106   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:04.892180   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:04.893380   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.904381   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:04.905210   482 raft_consensus.cc:2376] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10. Re-sending same reply.
I20260709 13:14:04.906126   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.906744   482 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
W20260709 13:14:04.907550  4097 consensus_meta.cc:287] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.000s
I20260709 13:14:04.907982  4097 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:04.910162  4097 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:04.911571   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.912233   482 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:14:04.913232   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:04.913774   482 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:04.915830  3961 leader_election.cc:290] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:04.877310  3888 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:04.917439  4234 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.918073  3888 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:04.917917  4234 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:04.886981  4110 consensus_queue.cc:237] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:04.924377  3933 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:04.924898  3933 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:04.928705   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.929857   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.930845   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:04.931607  4270 log.cc:927] Time spent T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 1.446s	user 0.002s	sys 0.001s
I20260709 13:14:04.933233   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.933779   475 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:04.934491   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:04.934921   475 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:04.937247   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.938251   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:04.939906  4283 log.cc:927] Time spent T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 1.456s	user 0.008s	sys 0.000s
I20260709 13:14:04.941789   475 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
W20260709 13:14:04.941931  4281 log.cc:927] Time spent T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 1.456s	user 0.009s	sys 0.000s
W20260709 13:14:04.943279  4310 log.cc:927] Time spent T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.614s	user 0.004s	sys 0.004s
I20260709 13:14:04.944145   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1776) took 1662 ms. Trace:
I20260709 13:14:04.944353  4183 raft_consensus.cc:3055] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:04.944746  4183 raft_consensus.cc:740] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:04.945544  4183 consensus_queue.cc:260] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:04.946576  4183 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:04.944541   626 rpcz_store.cc:276] 0709 13:14:03.281634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.290702 (+  9068us) service_pool.cc:224] Handling call
0709 13:14:03.291059 (+   357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:03.294424 (+  3365us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:03.294707 (+   283us) log.cc:844] Serialized 14 byte log entry
0709 13:14:03.490492 (+195785us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:03.556630 (+ 66138us) log.cc:844] Serialized 52 byte log entry
0709 13:14:03.556784 (+   154us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:03.557037 (+   253us) log.cc:844] Serialized 14 byte log entry
0709 13:14:03.984071 (+427034us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b18001c79e0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b652a6c0a 00007f4b6e9e6219 00007f4b6532ea40 00007f4b653294e4 00007f4b65329455 00007f4b68411060 00007f4b68423716 00007f4b68434287 00007f4b68434208
0709 13:14:04.027534 (+ 43463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.027643 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:04.941344 (+913701us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:04.943942 (+  2598us) raft_consensus.cc:1685] finished
0709 13:14:04.943961 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:04.944092 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114122,"prepare.queue_time_us":643,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":438854,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":7316,"spinlock_wait_cycles":537029760,"thread_start_us":238651,"threads_started":2,"wal-append.queue_time_us":190439}
I20260709 13:14:04.949577  4141 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:04.883066  4229 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:04.957139  4229 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:04.962966  4318 log.cc:927] Time spent T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:14:04.939141   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:04.969115   483 raft_consensus.cc:2368] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10.
I20260709 13:14:04.950312   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:14:04.980274  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.896004  4261 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:04.996341  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:05.002168   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:05.001187  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:05.006125  1168 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:05.008735  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:05.009704  1168 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:05.010998   482 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:05.028837   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:05.030964  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:05.025417   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:05.032481   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:05.032549  1141 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:05.033279   482 raft_consensus.cc:2393] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:05.034162  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:05.035385   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:05.037300   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 62544.3us
I20260709 13:14:05.036535 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:05.006629  4304 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:05.044307   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:05.042163   483 raft_consensus.cc:2393] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 11: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
W20260709 13:14:05.035092  4275 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 1.254s	user 0.000s	sys 0.015s
I20260709 13:14:05.023975  4064 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.047626   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:05.050436   626 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
I20260709 13:14:05.051875   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:05.053691   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:04.993995  4261 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:05.058599  4261 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:05.046870  4305 consensus_meta.cc:287] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.000s
I20260709 13:14:05.060761   482 raft_consensus.cc:2368] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10.
I20260709 13:14:05.063302   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:05.065860   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:05.067910   550 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:14:05.069084   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:05.070370   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:05.074021  3876 raft_consensus.cc:3055] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:05.061647  1168 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:05.074352   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:05.083532   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:05.085219   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.074462  3876 raft_consensus.cc:740] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:14:05.128335   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 255795us
W20260709 13:14:05.132472   525 leader_election.cc:336] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.695s (SENT)
I20260709 13:14:05.133038   525 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:05.056152  4064 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:05.134366   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:05.419288   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1948) took 2678 ms. Trace:
W20260709 13:14:05.696069   552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.008s	sys 0.011s
W20260709 13:14:05.493991   553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.051s	sys 0.046s
I20260709 13:14:05.751560   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:05.755362   552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.008s	sys 0.011s
W20260709 13:14:05.695333  4252 consensus_meta.cc:287] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.164s	user 0.010s	sys 0.001s
I20260709 13:14:05.755805   550 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:05.756225  4252 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:05.757089   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:05.757346   624 raft_consensus.cc:2393] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:05.757714   550 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:05.758811   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:05.691851  4275 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:14:05.759582   553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.053s	sys 0.071s
W20260709 13:14:05.753319   630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1844) took 1471 ms (client timeout 1880 ms). Trace:
W20260709 13:14:05.744801  4267 consensus_meta.cc:287] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.061s	user 0.012s	sys 0.000s
I20260709 13:14:05.752599   480 rpcz_store.cc:276] 0709 13:14:02.741124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.742455 (+  1331us) service_pool.cc:224] Handling call
0709 13:14:02.782665 (+ 40210us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:02.969692 (+187027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:02.969722 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:03.069184 (+ 99462us) log.cc:844] Serialized 52 byte log entry
0709 13:14:03.436963 (+367779us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:03.785643 (+348680us) log.cc:844] Serialized 14 byte log entry
0709 13:14:03.809945 (+ 24302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:03.810042 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:04.869356 (+1059314us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:05.402038 (+532682us) raft_consensus.cc:1685] finished
0709 13:14:05.419003 (+ 16965us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:05.419192 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12831,"prepare.queue_time_us":400900,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":80783,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":20383,"spinlock_wait_cycles":8797056,"thread_start_us":671128,"threads_started":3,"wal-append.queue_time_us":332387}
W20260709 13:14:05.142138   525 leader_election.cc:336] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.807s (SENT)
I20260709 13:14:05.827469   525 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:05.139183   554 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:05.767032   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:05.184399   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.821508   626 consensus_meta.cc:287] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.733s	user 0.012s	sys 0.000s
W20260709 13:14:05.821491   630 rpcz_store.cc:269] 0709 13:14:04.281688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.333060 (+ 51372us) service_pool.cc:224] Handling call
0709 13:14:05.753153 (+1420093us) spinlock_profiling.cc:243] Waited 36.4 ms on lock 0x7b54001aefd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:05.753266 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83802368}
W20260709 13:14:05.828724   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 686568us
W20260709 13:14:05.751425   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 569139us
I20260709 13:14:05.835645   626 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
W20260709 13:14:05.836323   525 leader_election.cc:336] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.811s (SENT)
I20260709 13:14:05.836437   597 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:05.752578   482 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 5.
W20260709 13:14:05.418058   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.306164   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.841077   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.836476   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1847) took 1530 ms. Trace:
W20260709 13:14:05.841930   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.841249   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:05.841864   626 rpcz_store.cc:276] 0709 13:14:04.305762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.074107 (+768345us) service_pool.cc:224] Handling call
0709 13:14:05.836406 (+762299us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:05.837296   525 leader_election.cc:336] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.850s (SENT)
I20260709 13:14:05.843257   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:05.843848   626 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 6.
W20260709 13:14:05.844632   525 leader_election.cc:336] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.854s (SENT)
I20260709 13:14:05.845220   525 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:05.843856   630 raft_consensus.cc:2410] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:14:05.088927   483 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:14:05.846378   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1846) took 1542 ms. Trace:
I20260709 13:14:05.846895   630 rpcz_store.cc:276] 0709 13:14:04.304386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.841000 (+1536614us) service_pool.cc:224] Handling call
0709 13:14:05.846327 (+  5327us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:05.837726  1141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.008s	sys 0.008s
I20260709 13:14:05.847775   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:05.848479  1141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.008s	sys 0.008s
W20260709 13:14:05.322314  4248 consensus_meta.cc:287] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.781s	user 0.006s	sys 0.004s
I20260709 13:14:05.076968  3629 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:05.848335   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:05.816380  4254 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.000s	sys 0.024s
I20260709 13:14:05.583295  3933 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:05.299757  4304 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.585s
W20260709 13:14:05.927996  1138 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.902s	user 0.005s	sys 0.038s
I20260709 13:14:05.935364   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1908) took 1657 ms. Trace:
I20260709 13:14:05.983424   626 raft_consensus.cc:2393] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 10: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:05.132751  4223 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:05.983608  1138 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.018s	sys 0.043s
I20260709 13:14:05.851163   559 raft_consensus.cc:2393] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 9: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:05.401533  4253 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.094403  4305 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:05.883268   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:05.166126  4321 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:14:05.849129  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 816634us
I20260709 13:14:05.813608  4143 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:05.876447   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:05.939898   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1913) took 1604 ms. Trace:
I20260709 13:14:05.852350   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:05.135092  4234 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:05.843983  4327 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:05.922474  4141 consensus_meta.cc:287] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.972s	user 0.013s	sys 0.000s
I20260709 13:14:05.991335   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:05.905066   633 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54754 (request call id 494) took 3170 ms (client timeout 2001 ms). Trace:
W20260709 13:14:05.208544  4323 log.cc:927] Time spent T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:14:06.162112   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2006) took 1944 ms. Trace:
I20260709 13:14:06.162557   555 rpcz_store.cc:276] 0709 13:14:04.217832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.435554 (+217722us) service_pool.cc:224] Handling call
0709 13:14:04.435857 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:04.442448 (+  6591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:04.442481 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:04.442882 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 13:14:04.538520 (+ 95638us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:04.538572 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.538708 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:06.161798 (+1623090us) raft_consensus.cc:1685] finished
0709 13:14:06.161826 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.162048 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":24484,"threads_started":1,"wal-append.queue_time_us":392060}
I20260709 13:14:06.164503  4303 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:06.164705   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:06.165369   558 raft_consensus.cc:1240] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
W20260709 13:14:05.985978  4254 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.006s	sys 0.029s
I20260709 13:14:05.988513  3933 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:06.166671  4196 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:06.166883  3933 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:06.169076  3933 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:05.996564  4064 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:06.170498  4064 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.994765   630 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:05.988103   482 raft_consensus.cc:2393] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:06.170936  4064 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:05.898380   556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.006s	sys 0.010s
W20260709 13:14:06.171881   556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.111s	user 0.011s	sys 0.012s
I20260709 13:14:06.172585   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2007) took 1954 ms. Trace:
I20260709 13:14:06.172976  4064 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:05.420212  3810 consensus_meta.cc:287] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.186s	user 0.013s	sys 0.001s
I20260709 13:14:06.173710  4225 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:05.854261  4267 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:06.174407   629 raft_consensus.cc:2410] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:14:05.998809  4221 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:05.992210   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:06.175926   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1785) took 1901 ms. Trace:
I20260709 13:14:06.000033   559 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:14:06.176438   626 rpcz_store.cc:276] 0709 13:14:04.274123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.991954 (+1717831us) service_pool.cc:224] Handling call
0709 13:14:06.175872 (+183918us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.176864   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1818) took 1706 ms. Trace:
I20260709 13:14:06.177443   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:05.291113  4255 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:06.178197   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1864) took 1799 ms. Trace:
I20260709 13:14:05.849536  4332 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:05.976039  4324 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.006s	sys 0.014s
I20260709 13:14:05.995477   480 raft_consensus.cc:2393] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 10: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
W20260709 13:14:05.999354   633 rpcz_store.cc:269] 0709 13:14:02.734659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.735037 (+   378us) service_pool.cc:224] Handling call
0709 13:14:05.904609 (+3169572us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54000bead4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:05.904884 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2626137088}
I20260709 13:14:06.177244   482 rpcz_store.cc:276] 0709 13:14:04.465077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.875356 (+1410279us) service_pool.cc:224] Handling call
0709 13:14:06.171564 (+296208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.171521   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1859) took 1793 ms. Trace:
I20260709 13:14:06.172942   556 rpcz_store.cc:276] 0709 13:14:04.218132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.525261 (+307129us) service_pool.cc:224] Handling call
0709 13:14:04.525653 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:04.993214 (+467561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:04.993245 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:05.019735 (+ 26490us) log.cc:844] Serialized 26 byte log entry
0709 13:14:06.172253 (+1152518us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:06.172296 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.172365 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:06.172411 (+    46us) raft_consensus.cc:1685] finished
0709 13:14:06.172423 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.172534 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":170223,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":70,"thread_start_us":1578406,"threads_started":2,"wal-append.queue_time_us":889937}
I20260709 13:14:06.178546   626 rpcz_store.cc:276] 0709 13:14:04.378948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.177217 (+1798269us) service_pool.cc:224] Handling call
0709 13:14:06.178147 (+   930us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.176681   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 2018) took 1103 ms. Trace:
I20260709 13:14:06.182041   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:06.182827   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 600) took 1144 ms. Trace:
I20260709 13:14:06.182279   559 rpcz_store.cc:276] 0709 13:14:05.073146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.991034 (+917888us) service_pool.cc:224] Handling call
0709 13:14:06.176628 (+185594us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.183202   480 rpcz_store.cc:276] 0709 13:14:05.038858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.827450 (+788592us) service_pool.cc:224] Handling call
0709 13:14:06.182770 (+355320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.181876   630 rpcz_store.cc:276] 0709 13:14:04.377631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.848546 (+1470915us) service_pool.cc:224] Handling call
0709 13:14:06.171455 (+322909us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:05.983683   553 rpcz_store.cc:276] 0709 13:14:04.277753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.687427 (+409674us) service_pool.cc:224] Handling call
0709 13:14:04.687769 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:04.701334 (+ 13565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:04.701382 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:04.804470 (+103088us) log.cc:844] Serialized 26 byte log entry
0709 13:14:05.760242 (+955772us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:05.760303 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:05.760396 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:05.935081 (+174685us) raft_consensus.cc:1685] finished
0709 13:14:05.935110 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:05.935294 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13163,"raft.queue_time_us":229176,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":882268,"threads_started":1,"wal-append.queue_time_us":1050133}
I20260709 13:14:06.175449  4303 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.181566   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:05.170280  4277 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:06.192711   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 473) took 1805 ms. Trace:
I20260709 13:14:06.213107   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:06.194022   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1851) took 1874 ms. Trace:
I20260709 13:14:05.953567  4252 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:05.994856   552 rpcz_store.cc:276] 0709 13:14:04.335545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.946174 (+610629us) service_pool.cc:224] Handling call
0709 13:14:04.946505 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:04.946832 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:04.946859 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:04.947298 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:14:05.755848 (+808550us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:05.755889 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:05.755958 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:05.939609 (+183651us) raft_consensus.cc:1685] finished
0709 13:14:05.939636 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:05.939822 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5515,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":186,"thread_start_us":808141,"threads_started":1,"wal-append.queue_time_us":965193}
I20260709 13:14:06.162292  4206 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.999270  4292 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.865411  4248 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:06.201198   479 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:14:06.228790   479 pending_rounds.cc:85] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 7
I20260709 13:14:06.229041   479 pending_rounds.cc:107] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:14:06.229271   479 raft_consensus.cc:2889] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:06.229437   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:06.183316  4324 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.008s	sys 0.014s
I20260709 13:14:06.202279   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1959) took 2847 ms. Trace:
I20260709 13:14:06.203118   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:06.236961   482 raft_consensus.cc:2393] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:05.995199  4253 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:05.995689  4223 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:05.165700  3876 consensus_queue.cc:260] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:06.209141   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:06.210527   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:06.214434   626 rpcz_store.cc:276] 0709 13:14:04.319857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.181832 (+1861975us) service_pool.cc:224] Handling call
0709 13:14:06.193951 (+ 12119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.214792   556 rpcz_store.cc:276] 0709 13:14:04.387402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.191733 (+1804331us) service_pool.cc:224] Handling call
0709 13:14:06.192059 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.192266 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.192304 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:06.192359 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:06.192403 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.192471 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.192643 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.216168   633 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:06.213631   478 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:06.201388  4303 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:06.224476   625 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1835) took 2073 ms (client timeout 2146 ms). Trace:
W20260709 13:14:06.225559   624 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1788) took 1950 ms (client timeout 2092 ms). Trace:
I20260709 13:14:06.226583   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 472) took 2077 ms. Trace:
I20260709 13:14:06.178524  4143 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:06.232193   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:06.233417   552 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:14:06.212761  4277 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.244860   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:06.235603   476 raft_consensus.cc:2410] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:14:06.237452   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1828) took 1730 ms. Trace:
I20260709 13:14:06.244974   554 rpcz_store.cc:276] 0709 13:14:04.149588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.150471 (+   883us) service_pool.cc:224] Handling call
0709 13:14:04.163726 (+ 13255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:05.841545 (+1677819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.226356 (+384811us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b5400152cd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:06.226516 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2242778880}
I20260709 13:14:06.196659   559 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:06.236042   481 rpcz_store.cc:276] 0709 13:14:03.354948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.355092 (+   144us) service_pool.cc:224] Handling call
0709 13:14:03.425161 (+ 70069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:04.217526 (+792365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.202042 (+1984516us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54000d70d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:06.202223 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1588083968}
I20260709 13:14:06.238265   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:06.246819   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2012) took 1780 ms. Trace:
I20260709 13:14:06.246881   477 raft_consensus.cc:2410] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:14:06.247172   552 rpcz_store.cc:276] 0709 13:14:04.466593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.218366 (+1751773us) service_pool.cc:224] Handling call
0709 13:14:06.233196 (+ 14830us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:06.246565 (+ 13369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.246768 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.245594   482 rpcz_store.cc:276] 0709 13:14:04.507142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.188853 (+1681711us) service_pool.cc:224] Handling call
0709 13:14:06.237400 (+ 48547us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.241514   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1839) took 1364 ms. Trace:
I20260709 13:14:06.240944   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:06.248216   478 rpcz_store.cc:276] 0709 13:14:04.877535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.198650 (+1321115us) service_pool.cc:224] Handling call
0709 13:14:06.241457 (+ 42807us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.245694   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1829) took 1716 ms. Trace:
W20260709 13:14:06.249718   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.240635   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1840) took 1350 ms. Trace:
W20260709 13:14:06.243067   625 rpcz_store.cc:269] 0709 13:14:04.150861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.157615 (+  6754us) service_pool.cc:224] Handling call
0709 13:14:06.224249 (+2066634us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b54001ad6d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:06.224392 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174211328}
I20260709 13:14:06.249585   476 rpcz_store.cc:276] 0709 13:14:04.533844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.229179 (+1695335us) service_pool.cc:224] Handling call
0709 13:14:06.245639 (+ 16460us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.245688   631 raft_consensus.cc:2393] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:14:06.244499   624 rpcz_store.cc:269] 0709 13:14:04.274948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.340241 (+ 65293us) service_pool.cc:224] Handling call
0709 13:14:06.225306 (+1885065us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400160dd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:06.225475 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3224108800}
I20260709 13:14:06.251765   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:06.252972   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1782) took 1979 ms. Trace:
I20260709 13:14:06.240741   630 raft_consensus.cc:2410] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:14:06.251677   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1781) took 1978 ms. Trace:
I20260709 13:14:06.250375   480 rpcz_store.cc:276] 0709 13:14:04.889995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.199598 (+1309603us) service_pool.cc:224] Handling call
0709 13:14:06.240577 (+ 40979us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.253640   625 rpcz_store.cc:276] 0709 13:14:04.272968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.250893 (+1977925us) service_pool.cc:224] Handling call
0709 13:14:06.251162 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.251353 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.251377 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:06.251417 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:06.251452 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.251510 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.251625 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.253340   631 rpcz_store.cc:276] 0709 13:14:04.273278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.252257 (+1978979us) service_pool.cc:224] Handling call
0709 13:14:06.252506 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.252671 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.252699 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:06.252738 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:06.252768 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.252818 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.252922 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.260159   625 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:06.260921   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1861) took 1882 ms. Trace:
I20260709 13:14:06.261324   625 rpcz_store.cc:276] 0709 13:14:04.378162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.259431 (+1881269us) service_pool.cc:224] Handling call
0709 13:14:06.259754 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.260634 (+   880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.260856 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.262769   625 raft_consensus.cc:1240] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:06.263727   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1792) took 1219 ms. Trace:
I20260709 13:14:06.264410   630 rpcz_store.cc:276] 0709 13:14:05.043972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.195227 (+1151255us) service_pool.cc:224] Handling call
0709 13:14:06.263650 (+ 68423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.248625   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2011) took 1782 ms. Trace:
I20260709 13:14:06.265668   559 rpcz_store.cc:276] 0709 13:14:04.466379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.195655 (+1729276us) service_pool.cc:224] Handling call
0709 13:14:06.196303 (+   648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.248405 (+ 52102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.248578 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.238628  4254 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:14:06.267750   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 431349us
I20260709 13:14:06.267886   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1835) took 1588 ms. Trace:
I20260709 13:14:06.268251   477 rpcz_store.cc:276] 0709 13:14:04.679846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.238016 (+1558170us) service_pool.cc:224] Handling call
0709 13:14:06.267829 (+ 29813us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.268132  4254 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:06.238703  4162 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.269805  4162 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:06.270421  4254 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:06.271641  4162 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:06.271950   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1784) took 1998 ms. Trace:
I20260709 13:14:06.244736  4285 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.272537   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:06.272377   624 rpcz_store.cc:276] 0709 13:14:04.273857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.252286 (+1978429us) service_pool.cc:224] Handling call
0709 13:14:06.271509 (+ 19223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.271668 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.271692 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:06.271732 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:06.271761 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.271811 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.271898 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.255369  4277 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:06.274458   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:06.275105   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1838) took 1436 ms. Trace:
I20260709 13:14:06.275465   478 rpcz_store.cc:276] 0709 13:14:04.838583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.249320 (+1410737us) service_pool.cc:224] Handling call
0709 13:14:06.275061 (+ 25741us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.276027   552 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:06.276610   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1918) took 1310 ms. Trace:
I20260709 13:14:06.276979   552 rpcz_store.cc:276] 0709 13:14:04.966090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.275405 (+1309315us) service_pool.cc:224] Handling call
0709 13:14:06.275697 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.276387 (+   690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.276557 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.277976   552 raft_consensus.cc:1240] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:14:06.278472   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2015) took 1206 ms. Trace:
I20260709 13:14:06.278673   552 rpcz_store.cc:276] 0709 13:14:05.072323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.277495 (+1205172us) service_pool.cc:224] Handling call
0709 13:14:06.277714 (+   219us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:06.278310 (+   596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.278437 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.279844   552 raft_consensus.cc:1275] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:06.279809   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:06.241453   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1789) took 1962 ms. Trace:
I20260709 13:14:06.281054   633 rpcz_store.cc:276] 0709 13:14:04.279186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.181348 (+1902162us) service_pool.cc:224] Handling call
0709 13:14:06.241398 (+ 60050us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.280587   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2017) took 1207 ms. Trace:
I20260709 13:14:06.282214   552 rpcz_store.cc:276] 0709 13:14:05.072839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.279245 (+1206406us) service_pool.cc:224] Handling call
0709 13:14:06.279547 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.280350 (+   803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.280534 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.283859   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2021) took 1200 ms. Trace:
I20260709 13:14:06.284231   552 rpcz_store.cc:276] 0709 13:14:05.083652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.283084 (+1199432us) service_pool.cc:224] Handling call
0709 13:14:06.283380 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.283546 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.283572 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:06.283614 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:06.283645 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.283701 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.283807 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.280587   482 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:06.285698   552 raft_consensus.cc:1240] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:06.286541   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2022) took 1157 ms. Trace:
I20260709 13:14:06.287156   550 raft_consensus.cc:2393] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 9: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:06.286854   552 rpcz_store.cc:276] 0709 13:14:05.129311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.285227 (+1155916us) service_pool.cc:224] Handling call
0709 13:14:06.285519 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.286313 (+   794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.286494 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.289474  4223 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:06.290122   552 raft_consensus.cc:1275] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:06.197860  4332 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:06.292958   630 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:06.293083  4332 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:06.293584   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1790) took 1362 ms. Trace:
I20260709 13:14:06.293959   630 rpcz_store.cc:276] 0709 13:14:04.931403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.292396 (+1360993us) service_pool.cc:224] Handling call
0709 13:14:06.292665 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.293347 (+   682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.293529 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.294075   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:06.295825   551 raft_consensus.cc:1240] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:06.295702   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1862) took 1917 ms. Trace:
I20260709 13:14:06.296576   625 rpcz_store.cc:276] 0709 13:14:04.378434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.262222 (+1883788us) service_pool.cc:224] Handling call
0709 13:14:06.262550 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.295427 (+ 32877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.295625 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.298503   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 500) took 1320 ms. Trace:
I20260709 13:14:06.270939  4254 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:06.299104   625 rpcz_store.cc:276] 0709 13:14:04.978230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.297691 (+1319461us) service_pool.cc:224] Handling call
0709 13:14:06.297911 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.298110 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.298146 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:06.298200 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:06.298245 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.298313 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.298429 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.301116   630 raft_consensus.cc:1275] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:06.301317   484 raft_consensus.cc:2410] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:14:06.302101   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 501) took 1320 ms. Trace:
I20260709 13:14:06.303020   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1836) took 1508 ms. Trace:
I20260709 13:14:06.300072   597 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:06.302944   625 rpcz_store.cc:276] 0709 13:14:04.981692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.301379 (+1319687us) service_pool.cc:224] Handling call
0709 13:14:06.301652 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.301820 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.301842 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:06.301890 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:06.301919 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.301964 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.302058 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.301923   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1858) took 1924 ms. Trace:
I20260709 13:14:06.303433   484 rpcz_store.cc:276] 0709 13:14:04.795145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.239386 (+1444241us) service_pool.cc:224] Handling call
0709 13:14:06.302962 (+ 63576us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.302012   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1791) took 1370 ms. Trace:
I20260709 13:14:06.304343   626 rpcz_store.cc:276] 0709 13:14:04.377373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.258320 (+1880947us) service_pool.cc:224] Handling call
0709 13:14:06.258649 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.301583 (+ 42934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.301614 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:06.301656 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:06.301700 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.301759 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.301860 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.238528  4064 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.304852   630 rpcz_store.cc:276] 0709 13:14:04.931686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.294760 (+1363074us) service_pool.cc:224] Handling call
0709 13:14:06.300756 (+  5996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.301806 (+  1050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.301964 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.241995  4300 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.307960  4254 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:06.321113  4300 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:06.302709  4306 consensus_queue.cc:1059] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:14:06.322852  4306 raft_consensus.cc:3055] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:06.314700  4304 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.315426  4267 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:06.230500  4206 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:06.323222  4306 raft_consensus.cc:740] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:06.323617  4304 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:06.325315  4206 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:06.317461  3810 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:06.318608  4253 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:06.319324  4183 consensus_meta.cc:287] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 1.372s	user 0.013s	sys 0.000s
I20260709 13:14:06.319912  4064 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:06.326922   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:06.328102   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:06.328585  4064 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:06.328624   552 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
I20260709 13:14:06.324961  4306 consensus_queue.cc:260] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:06.323828  4267 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.330686  4306 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:06.323362  4254 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:06.326043  4304 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:06.329905   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:06.231181  4292 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:06.312808   476 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:14:06.335431   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1969) took 2144 ms. Trace:
I20260709 13:14:06.337602   480 rpcz_store.cc:276] 0709 13:14:04.190993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.299064 (+2108071us) service_pool.cc:224] Handling call
0709 13:14:06.334633 (+ 35569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.334858 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.334894 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:06.334950 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:06.334994 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.335098 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.335361 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.332616   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:06.331094   522 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:06.317287  4277 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:06.255314  4341 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:14:06.343571   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.345424   484 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:14:06.353231   484 pending_rounds.cc:85] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 6
I20260709 13:14:06.353519   484 pending_rounds.cc:107] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:14:06.353754   484 raft_consensus.cc:2889] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:06.354431   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1799) took 1996 ms. Trace:
I20260709 13:14:06.354799   597 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:06.354761   484 rpcz_store.cc:276] 0709 13:14:04.357872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.334204 (+1976332us) service_pool.cc:224] Handling call
0709 13:14:06.345113 (+ 10909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.354176 (+  9063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.354361 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.356268   484 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:14:06.356587   484 pending_rounds.cc:85] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 9
I20260709 13:14:06.330709  4267 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:06.331429  4225 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:06.305121   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 502) took 1318 ms. Trace:
I20260709 13:14:06.358659   599 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:06.363217   625 rpcz_store.cc:276] 0709 13:14:04.986307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.304217 (+1317910us) service_pool.cc:224] Handling call
0709 13:14:06.304681 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.304836 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.304871 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:06.304911 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:06.304937 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.304984 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.305077 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.364538   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:06.358893   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.356613   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1915) took 1837 ms. Trace:
I20260709 13:14:06.367343   480 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:06.360060   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1779) took 3062 ms. Trace:
I20260709 13:14:06.366377   556 rpcz_store.cc:276] 0709 13:14:04.519105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.241251 (+1722146us) service_pool.cc:224] Handling call
0709 13:14:06.241534 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:06.256964 (+ 15430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.256993 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:06.257426 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:14:06.354882 (+ 97456us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:06.354921 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.354985 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:06.356272 (+  1287us) raft_consensus.cc:1685] finished
0709 13:14:06.356333 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.356468 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15096,"raft.queue_time_us":15770,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":6960,"thread_start_us":31297,"threads_started":1,"wal-append.queue_time_us":43254}
I20260709 13:14:06.368144   627 rpcz_store.cc:276] 0709 13:14:03.297949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.305184 (+  7235us) service_pool.cc:224] Handling call
0709 13:14:03.305475 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:04.301862 (+996387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.359761 (+2057899us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b54000bf4d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:06.359985 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2281806208}
I20260709 13:14:06.361799   484 pending_rounds.cc:107] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 9.10
W20260709 13:14:06.361192   525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.008s	sys 0.021s
I20260709 13:14:06.370945   484 raft_consensus.cc:2889] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:06.373055  1139 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:06.390290   597 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:06.390755   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1833) took 1711 ms. Trace:
I20260709 13:14:06.391161   484 rpcz_store.cc:276] 0709 13:14:04.679017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.355674 (+1676657us) service_pool.cc:224] Handling call
0709 13:14:06.355969 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.371487 (+ 15518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.390699 (+ 19212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.390357   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:06.389745   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1830) took 1819 ms. Trace:
I20260709 13:14:06.395601   480 rpcz_store.cc:276] 0709 13:14:04.569990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.343031 (+1773041us) service_pool.cc:224] Handling call
0709 13:14:06.361439 (+ 18408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.367830 (+  6391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.389685 (+ 21855us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.396070   484 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:06.396644   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1841) took 1431 ms. Trace:
I20260709 13:14:06.396963   484 rpcz_store.cc:276] 0709 13:14:04.965022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.392791 (+1427769us) service_pool.cc:224] Handling call
0709 13:14:06.393052 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.396417 (+  3365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.396593 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.313489  4285 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:06.371098   525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.008s	sys 0.021s
I20260709 13:14:06.398707   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 595) took 1417 ms. Trace:
I20260709 13:14:06.411650   484 rpcz_store.cc:276] 0709 13:14:04.980823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.398010 (+1417187us) service_pool.cc:224] Handling call
0709 13:14:06.398273 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.398438 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.398461 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:06.398500 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:06.398529 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.398576 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.398660 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.413522   484 raft_consensus.cc:1275] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:06.414049   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 596) took 1429 ms. Trace:
I20260709 13:14:06.414350   484 rpcz_store.cc:276] 0709 13:14:04.984530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.412777 (+1428247us) service_pool.cc:224] Handling call
0709 13:14:06.413096 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.413829 (+   733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.413999 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.357307  4304 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.358529  4321 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:06.416857   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 598) took 1409 ms. Trace:
W20260709 13:14:06.419008   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 308002us
W20260709 13:14:06.423065   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 578400us
W20260709 13:14:06.419992  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 430040us
W20260709 13:14:06.389719  4328 log.cc:927] Time spent T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.400s	user 0.000s	sys 0.001s
I20260709 13:14:06.422557   484 rpcz_store.cc:276] 0709 13:14:05.007765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.415137 (+1407372us) service_pool.cc:224] Handling call
0709 13:14:06.416407 (+  1270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.416568 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.416592 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:06.416631 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:06.416665 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.416713 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.416808 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.429065   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 602) took 1385 ms. Trace:
I20260709 13:14:06.429443   484 rpcz_store.cc:276] 0709 13:14:05.043969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.428377 (+1384408us) service_pool.cc:224] Handling call
0709 13:14:06.428628 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.428784 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.428807 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:06.428847 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:06.428878 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.428928 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.429015 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:06.427732   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:06.363274  4254 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:14:06.433022   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:06.434918   525 connection.cc:256] RPC call timeout handler was delayed by -1.4770795419999558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
W20260709 13:14:06.437127   525 leader_election.cc:336] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.765s (SENT)
W20260709 13:14:06.438547   525 connection.cc:256] RPC call timeout handler was delayed by -1.384379541999806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
W20260709 13:14:06.439069   525 leader_election.cc:336] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.901s (SENT)
I20260709 13:14:06.439560   525 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:06.443383   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 53206.3us
I20260709 13:14:06.445365   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:06.447924   480 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:06.405032  4252 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:14:06.421217  4333 log.cc:927] Time spent T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.432s	user 0.001s	sys 0.001s
I20260709 13:14:06.416644  4209 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:06.415778  4345 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:06.461496  4290 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:06.411288  4223 consensus_queue.cc:1048] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:14:06.468714  1168 raft_consensus.cc:1240] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:14:06.491534   626 raft_consensus.cc:1275] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:06.390125  4225 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:06.458323   482 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:06.493014   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1973) took 2255 ms. Trace:
I20260709 13:14:06.493547   482 rpcz_store.cc:276] 0709 13:14:04.237681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.285654 (+2047973us) service_pool.cc:224] Handling call
0709 13:14:06.285961 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.458171 (+172210us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b54001241a0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68390dc0 00007f4b6841b1c0 00007f4b6841c231 00007f4b68418d8f 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c
0709 13:14:06.492702 (+ 34531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.492934 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23923456}
W20260709 13:14:06.471261   632 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1852) took 2132 ms (client timeout 2052 ms). Trace:
I20260709 13:14:06.440387  4305 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.390734  4332 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:14:06.474259   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 593) took 2664 ms. Trace:
W20260709 13:14:06.475005   628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1837) took 2251 ms (client timeout 2201 ms). Trace:
I20260709 13:14:06.427026  4344 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.476897   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2008) took 2258 ms. Trace:
W20260709 13:14:06.474301   629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1854) took 2098 ms (client timeout 1728 ms). Trace:
I20260709 13:14:06.433251  4327 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.428378  4321 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:06.462028  4277 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:06.469702   448 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:06.472790   525 leader_election.cc:336] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.941s (SENT)
I20260709 13:14:06.515960   525 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:06.494537   632 rpcz_store.cc:269] 0709 13:14:04.338913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.347693 (+  8780us) service_pool.cc:224] Handling call
0709 13:14:06.471028 (+2123335us) spinlock_profiling.cc:243] Waited 81.1 ms on lock 0x7b54001bba54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:06.471170 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186513664}
I20260709 13:14:06.500890  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:06.490240  4253 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:06.464561  4245 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:06.507539   629 rpcz_store.cc:269] 0709 13:14:04.376246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.696912 (+320666us) service_pool.cc:224] Handling call
0709 13:14:06.474110 (+1777198us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54000523d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:06.474230 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3395288960}
I20260709 13:14:06.455494  4252 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:06.522378  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 98116.4us
I20260709 13:14:06.504058   479 rpcz_store.cc:276] 0709 13:14:03.810036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.810384 (+   348us) service_pool.cc:224] Handling call
0709 13:14:03.810742 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.240107 (+2429365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.473927 (+233820us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b5400058554. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:06.474195 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5496659200}
I20260709 13:14:06.467857  3933 raft_consensus.cc:2749] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:06.481081  4209 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.506819   558 rpcz_store.cc:276] 0709 13:14:04.218519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.526802 (+308283us) service_pool.cc:224] Handling call
0709 13:14:04.527070 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.165785 (+1638715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.476673 (+310888us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54000eb354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:06.476829 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3767280000}
W20260709 13:14:06.504133   628 rpcz_store.cc:269] 0709 13:14:04.223329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.223817 (+   488us) service_pool.cc:224] Handling call
0709 13:14:06.474805 (+2250988us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54001e3054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:06.474930 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391029632}
I20260709 13:14:06.537997   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:06.539534   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:06.434103  4304 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:06.518678  1169 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:06.360585  4341 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:06.561206   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 503) took 1574 ms. Trace:
I20260709 13:14:06.561616   626 rpcz_store.cc:276] 0709 13:14:04.986613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.305286 (+1318673us) service_pool.cc:224] Handling call
0709 13:14:06.471996 (+166710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.491964 (+ 19968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.561017 (+ 69053us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54001bba50. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:06.561148 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275356544}
W20260709 13:14:06.564278   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 91522.4us
W20260709 13:14:06.564986   525 leader_election.cc:336] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 2.010s (SENT)
I20260709 13:14:06.565361   525 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:06.525847  4143 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:06.524192  1141 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:06.498847  4255 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.542306   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:06.575894   558 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:14:06.543344   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:06.518579  1174 raft_consensus.cc:2410] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:14:06.576826   479 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 7.
I20260709 13:14:06.465665  4254 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:06.506685  4343 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:06.551342  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:06.583280  1169 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:06.553023   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:06.583791   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:06.584414   475 raft_consensus.cc:2393] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 9: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
W20260709 13:14:06.557411   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 198846us
I20260709 13:14:06.569542   484 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:14:06.517406  4321 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:06.528781  4225 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:06.579206   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2005) took 2350 ms. Trace:
I20260709 13:14:06.520144  4221 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:06.590092  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:06.578820   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:06.578765   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:06.529181  4252 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:06.586608   599 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:06.586171   551 rpcz_store.cc:276] 0709 13:14:04.215428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.435472 (+220044us) service_pool.cc:224] Handling call
0709 13:14:04.437711 (+  2239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.296258 (+1858547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.537527 (+241269us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b54001518d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:06.566139 (+ 28612us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4272767872}
I20260709 13:14:06.520174  4253 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.622702   627 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:06.550043  4209 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:06.623839  1139 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:06.589789   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1972) took 2362 ms. Trace:
I20260709 13:14:06.625241  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:06.626478   478 rpcz_store.cc:276] 0709 13:14:04.227670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.276103 (+2048433us) service_pool.cc:224] Handling call
0709 13:14:06.276392 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.276588 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:06.418263 (+141675us) log.cc:844] Serialized 14 byte log entry
0709 13:14:06.582759 (+164496us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:06.582811 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:06.582857 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.582922 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.589359 (+  6437us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":304913,"threads_started":2}
I20260709 13:14:06.548904  4296 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.634984  1138 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:14:06.590557  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 66426.7us
I20260709 13:14:06.579030  4273 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:06.494454  4345 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:06.581866  3933 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.512686  4305 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:06.582352  4248 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:06.524864  4327 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:06.647503   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 60968.8us
I20260709 13:14:06.624958  4277 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:14:06.644876   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 175264us
I20260709 13:14:06.520380  4344 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:06.658141   447 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:06.654739  1141 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:14:06.661437   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.631502  4253 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:06.631196  4338 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:06.644811  4352 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:06.683815   447 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:06.693367   447 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:06.646989  4332 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:06.652323  4064 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:06.688594  4248 consensus_queue.cc:1059] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:06.689729   523 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:06.653141  4206 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:06.663717  4277 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:06.699067  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 53404.8us
I20260709 13:14:06.656639  4292 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:06.587837  4255 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:06.698438  4285 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:06.758077   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.676311  4121 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:06.675916  4360 raft_consensus.cc:2764] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:14:06.592435  4343 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:06.657598  3933 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:06.712610  4064 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:06.793887   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 116382us
W20260709 13:14:06.770684   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 81012.3us
I20260709 13:14:06.804327   523 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:06.777521  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 61401.7us
W20260709 13:14:06.773254   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 91140.2us
I20260709 13:14:06.717281  4162 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:14:06.796764  4356 log.cc:927] Time spent T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:14:06.717811  4277 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:06.692764  4352 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:06.813519   523 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:06.837303   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 144000us
I20260709 13:14:06.833015  4368 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:06.793215  4248 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:06.847812   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1856) took 2471 ms. Trace:
W20260709 13:14:06.848664  4355 log.cc:927] Time spent T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:14:06.776106  4361 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:06.849355  4341 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:06.813872  4064 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:06.717512  4332 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 13:14:06.775017  4206 raft_consensus.cc:697] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:06.816491  4162 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.814574  4141 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:06.648607  4296 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:06.217255 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:06.875607   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 428455us
I20260709 13:14:07.088727   597 leader_election.cc:304] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:06.879456   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 45176.7us
I20260709 13:14:06.692904  4338 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:06.849408  4353 log.cc:927] Time spent T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:14:06.881758   447 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:06.889966   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 88516us
W20260709 13:14:07.023767  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 369437us
I20260709 13:14:07.111328  1138 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:07.029403   481 raft_consensus.cc:1240] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:14:07.112975   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1971) took 2921 ms. Trace:
I20260709 13:14:07.113390   481 rpcz_store.cc:276] 0709 13:14:04.191572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.273784 (+2082212us) service_pool.cc:224] Handling call
0709 13:14:06.274021 (+   237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:07.029136 (+755115us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b54000e86a0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68390dc0 00007f4b6841b1c0 00007f4b6841c231 00007f4b68418d8f 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c
0709 13:14:07.112606 (+ 83470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:07.112888 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49297152}
I20260709 13:14:07.037928   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 594) took 2062 ms. Trace:
I20260709 13:14:07.115659   480 rpcz_store.cc:276] 0709 13:14:04.975522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.396431 (+1420909us) service_pool.cc:224] Handling call
0709 13:14:06.427681 (+ 31250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.448294 (+ 20613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:07.037642 (+589348us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b54000d57d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:07.037848 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17855232}
I20260709 13:14:07.044521   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 505) took 2057 ms. Trace:
I20260709 13:14:07.117283   627 rpcz_store.cc:276] 0709 13:14:04.987185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.403471 (+1416286us) service_pool.cc:224] Handling call
0709 13:14:06.539054 (+135583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.623888 (+ 84834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:07.044276 (+420388us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b54001617d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:07.044448 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114117888}
W20260709 13:14:07.065933   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:06.880461   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 67022.1us
I20260709 13:14:07.122799  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:07.123749  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:06.888267   550 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 2016) took 1810 ms (client timeout 1807 ms). Trace:
W20260709 13:14:07.124351   550 rpcz_store.cc:269] 0709 13:14:05.072576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.758505 (+685929us) service_pool.cc:224] Handling call
0709 13:14:06.883004 (+1124499us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b5400388954. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:06.883164 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1213097728}
I20260709 13:14:07.077877  4064 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:07.130422  4064 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:07.130539  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 324098us
I20260709 13:14:07.134172  4255 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:07.135162  4246 consensus_queue.cc:1059] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:06.887053  4206 consensus_queue.cc:237] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:07.135954  4196 consensus_meta.cc:287] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.969s	user 0.012s	sys 0.000s
I20260709 13:14:07.136094  4246 consensus_queue.cc:1048] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:06.802290  4121 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:07.137740   555 raft_consensus.cc:2410] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:14:07.138217  4247 raft_consensus.cc:3055] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:07.138381  4121 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:06.881508   631 rpcz_store.cc:276] 0709 13:14:04.376804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.258046 (+1881242us) service_pool.cc:224] Handling call
0709 13:14:06.258319 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:06.260383 (+  2064us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.260412 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:06.336686 (+ 76274us) log.cc:844] Serialized 26 byte log entry
0709 13:14:06.387825 (+ 51139us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:06.389321 (+  1496us) log.cc:844] Serialized 14 byte log entry
0709 13:14:06.397853 (+  8532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.397928 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:06.847420 (+449492us) raft_consensus.cc:1685] finished
0709 13:14:06.847462 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.847697 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8302,"prepare.queue_time_us":197437,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":140297,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":13408,"thread_start_us":17484,"threads_started":2,"wal-append.queue_time_us":89137}
W20260709 13:14:07.140991   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 259337us
I20260709 13:14:07.147573   447 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:07.074975   378 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48622 (request call id 249) took 35759 ms (client timeout 15000 ms). Trace:
W20260709 13:14:07.141887   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 44351.7us
W20260709 13:14:07.142282   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 44466.9us
I20260709 13:14:07.138899  1174 raft_consensus.cc:1240] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:14:07.143738   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:07.150920   550 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:07.150916   599 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:07.159806  1168 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:07.050824  4334 log.cc:927] Time spent T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 1.072s	user 0.003s	sys 0.006s
I20260709 13:14:06.880963  4368 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.887269  4162 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:07.158107  4351 log.cc:927] Time spent T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.576s	user 0.001s	sys 0.000s
I20260709 13:14:07.170542   557 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:07.225165   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:07.171083   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:07.227041   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:07.227697   552 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:07.228130   550 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
W20260709 13:14:07.172582   477 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.012s	sys 0.008s
I20260709 13:14:07.172806   551 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:07.228454   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:06.880002  4352 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:06.894796  4225 raft_consensus.cc:3055] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:07.078579  4361 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:07.229465  4225 raft_consensus.cc:740] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:07.177594  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:07.177882  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:07.174026   447 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:07.180823   476 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:14:07.169509   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:07.225806   557 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
W20260709 13:14:07.171094   448 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.17.132:39939 timed out after 1.508s (SENT) [suppressed 35 similar messages]
I20260709 13:14:07.138684  4247 raft_consensus.cc:740] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:14:07.240643   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 75057.8us
I20260709 13:14:07.241986  1175 raft_consensus.cc:1240] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:07.243099   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:07.139006  4234 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.139667  4254 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:06.880244  4192 consensus_queue.cc:1048] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.287s
I20260709 13:14:06.897527  4296 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:07.093892  4372 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:07.124796  4342 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:06.880307  4369 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:06.900856  4303 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:06.900285  4300 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:07.217809   525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.006s	sys 0.015s
I20260709 13:14:07.218994   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:07.156771  4064 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:07.222420  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:14:07.291699   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 117799us
I20260709 13:14:07.292078   475 raft_consensus.cc:2410] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 11 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:14:07.228003  1168 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:14:07.229030   552 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:07.231009  1169 raft_consensus.cc:2368] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11.
W20260709 13:14:07.236325   477 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.013s	sys 0.008s
I20260709 13:14:07.292567   447 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:07.068706   379 catalog_manager.cc:5697] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 3 to 6, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 6 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
W20260709 13:14:07.237576   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.873356  4365 consensus_queue.cc:1059] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.335s
I20260709 13:14:07.181346  4368 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:07.149231   378 rpcz_store.cc:269] 0709 13:13:31.316066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.316587 (+   521us) service_pool.cc:224] Handling call
0709 13:14:07.074879 (+35758292us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:00.479742 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:00.480501 (+   759us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:00.480556 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:14:00.480576 (+    20us) tablet.cc:662] Decoding operations
0709 13:14:00.481253 (+   677us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:00.481349 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:00.481374 (+    25us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:14:00.481922 (+   548us) tablet.cc:701] Row locks acquired
0709 13:14:00.481965 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:14:00.482155 (+   190us) write_op.cc:270] Start()
0709 13:14:00.482305 (+   150us) write_op.cc:276] Timestamp: P: 1783602840482084 usec, L: 0
0709 13:14:00.482361 (+    56us) op_driver.cc:348] REPLICATION: starting
0709 13:14:00.483189 (+   828us) log.cc:844] Serialized 1701 byte log entry
0709 13:14:00.920961 (+437772us) op_driver.cc:464] REPLICATION: finished
0709 13:14:01.278279 (+357318us) write_op.cc:301] APPLY: starting
0709 13:14:01.278378 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:01.278541 (+   163us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:01.278716 (+   175us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:01.330030 (+ 51314us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:01.767318 (+437288us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:14:01.783643 (+ 16325us) write_op.cc:312] APPLY: finished
0709 13:14:01.844600 (+ 60957us) log.cc:844] Serialized 41 byte log entry
0709 13:14:01.855484 (+ 10884us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:01.870342 (+ 14858us) write_op.cc:454] Released schema lock
0709 13:14:01.882183 (+ 11841us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:01.916022 (+ 33839us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:01.918340 (+  2318us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3166514,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":330544,"apply.run_cpu_time_us":19266,"apply.run_wall_time_us":618984,"num_ops":4,"prepare.queue_time_us":180600,"prepare.run_cpu_time_us":28395,"prepare.run_wall_time_us":236201,"raft.queue_time_us":126361,"raft.run_cpu_time_us":22186,"raft.run_wall_time_us":102052,"replication_time_us":438414,"thread_start_us":440032,"threads_started":4,"wal-append.queue_time_us":281219,"wal-append.run_cpu_time_us":15405,"wal-append.run_wall_time_us":2118497}]]}
I20260709 13:14:07.140128  3810 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:14:07.250087  1175 raft_consensus.cc:1240] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:07.249092   483 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:14:07.320632  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.246241   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:07.158784  4279 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
W20260709 13:14:07.253247   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 82187.4us
I20260709 13:14:07.255155   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:07.266978   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1916) took 2416 ms. Trace:
I20260709 13:14:07.265817   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:07.322896   556 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:14:07.271782   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:07.277115   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:07.293299   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:07.294962   525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.011s	sys 0.017s
I20260709 13:14:07.324244   550 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:14:07.322870   554 rpcz_store.cc:276] 0709 13:14:04.850936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.255326 (+1404390us) service_pool.cc:224] Handling call
0709 13:14:06.273222 (+ 17896us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:06.273595 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.273623 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:06.274072 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:14:06.418711 (+144639us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:06.418762 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.418836 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:07.266759 (+847923us) raft_consensus.cc:1685] finished
0709 13:14:07.266783 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:07.266918 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14972,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":144272,"threads_started":1,"wal-append.queue_time_us":264019}
I20260709 13:14:07.309178  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:07.323253   482 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:07.270622   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1921) took 2241 ms. Trace:
I20260709 13:14:07.326159   555 rpcz_store.cc:276] 0709 13:14:05.029059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.164451 (+1135392us) service_pool.cc:224] Handling call
0709 13:14:07.270399 (+1105948us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54001d6354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:07.270553 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2235512192}
I20260709 13:14:07.296244  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:07.327958  1169 raft_consensus.cc:2368] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10.
I20260709 13:14:07.264156  4342 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.219609  4223 consensus_queue.cc:1059] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:14:07.343151  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:07.343652   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 51195us
I20260709 13:14:07.344528   447 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:07.346971   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1970) took 3155 ms. Trace:
I20260709 13:14:07.349220   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:07.350049   631 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:07.267349  3970 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:14:07.348650   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:07.354244  3970 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:07.348162   477 rpcz_store.cc:276] 0709 13:14:04.191300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.268885 (+2077585us) service_pool.cc:224] Handling call
0709 13:14:06.269180 (+   295us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:14:06.425381 (+156201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.425418 (+    37us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:14:06.426156 (+   738us) log.cc:844] Serialized 78 byte log entry
0709 13:14:06.555346 (+129190us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:07.293128 (+737782us) log.cc:844] Serialized 14 byte log entry
0709 13:14:07.345799 (+ 52671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:07.346190 (+   391us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:07.346324 (+   134us) raft_consensus.cc:1685] finished
0709 13:14:07.346337 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:07.346809 (+   472us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52095,"prepare.queue_time_us":465047,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":69935,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":8146,"thread_start_us":956068,"threads_started":3,"wal-append.queue_time_us":216887}
W20260709 13:14:07.357620   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 792583us
W20260709 13:14:07.358551   525 leader_election.cc:336] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 2.081s (SENT)
W20260709 13:14:07.359658   525 leader_election.cc:336] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 2.153s (SENT)
I20260709 13:14:07.360087   525 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:07.294812  4361 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:07.343899  1166 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:14:07.220346  4376 consensus_queue.cc:1059] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:14:07.351378   522 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:07.251179  4234 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:07.245361  4364 consensus_queue.cc:1048] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 13:14:07.393085   522 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:07.394476   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:07.395323   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:07.323191  4254 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:14:07.403752   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 44122.2us
W20260709 13:14:07.389990   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 239146us
I20260709 13:14:07.332350  4344 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:07.357666  4342 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:07.364909  4303 raft_consensus.cc:2804] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:07.354794  3970 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:07.303798  4360 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
W20260709 13:14:07.421093   630 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.007s	sys 0.033s
W20260709 13:14:07.442422   630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.008s	sys 0.033s
I20260709 13:14:07.421610   482 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
W20260709 13:14:07.421416   525 leader_election.cc:336] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 2.180s (SENT)
I20260709 13:14:07.360865  4143 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:14:07.400561  4362 log.cc:927] Time spent T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:14:07.425019  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:07.463410   525 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:07.347476  4345 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:07.429194   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 84761.7us
I20260709 13:14:07.389642  4285 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:07.478544   551 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:07.479087  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:07.484925   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 474) took 3061 ms. Trace:
I20260709 13:14:07.485967  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:07.332981  4347 consensus_queue.cc:1048] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:14:07.406548  4242 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.487833   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:07.481410   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:07.483632   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:07.480398  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:07.406193  4223 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:07.486826  1175 raft_consensus.cc:2376] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11. Re-sending same reply.
I20260709 13:14:07.405908  4369 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:07.389916  4327 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:07.401304  4141 raft_consensus.cc:697] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:07.488451   625 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:14:07.485358   553 rpcz_store.cc:276] 0709 13:14:04.424014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.195566 (+1771552us) service_pool.cc:224] Handling call
0709 13:14:06.209842 (+ 14276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:06.215775 (+  5933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.215815 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:06.220251 (+  4436us) log.cc:844] Serialized 26 byte log entry
0709 13:14:06.385037 (+164786us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:06.385094 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.385186 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:07.484718 (+1099532us) raft_consensus.cc:1685] finished
0709 13:14:07.484739 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:07.484865 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2387,"raft.queue_time_us":15085,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":7335,"thread_start_us":164347,"threads_started":1,"wal-append.queue_time_us":282250}
I20260709 13:14:07.508688  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:07.510481   379 catalog_manager.cc:5697] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 2 to 5, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 5 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:07.423357  4279 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.425680  4248 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:07.513952   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:07.511855   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:07.405961  4246 consensus_queue.cc:1059] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:14:07.521183  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:07.432368  4303 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.602231  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:07.605460  1138 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:07.513175  4267 consensus_meta.cc:287] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.120s	user 0.009s	sys 0.003s
I20260709 13:14:07.504488  3876 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:07.530418  4223 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:14:07.616312   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 142347us
I20260709 13:14:07.618880   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:07.617439   632 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:14:07.516465  3933 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:07.504194  4254 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:07.414651  4382 consensus_queue.cc:1059] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.211s
W20260709 13:14:07.656744   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 233803us
I20260709 13:14:07.616724   628 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:14:07.623736   379 catalog_manager.cc:5697] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 4 to 5, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 5 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:07.624238  4279 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:07.508841  4242 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:07.667742   625 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:07.660931  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:07.669703  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:07.670527  1175 raft_consensus.cc:2393] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 11: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
W20260709 13:14:07.612794  4370 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.505s	user 0.000s	sys 0.001s
I20260709 13:14:07.657863   448 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:07.660265   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:07.661021  1140 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.002s	sys 0.003s
W20260709 13:14:07.673081  1140 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.002s	sys 0.003s
I20260709 13:14:07.516958  4394 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.138s
I20260709 13:14:07.619887  4341 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:07.653932  4303 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:07.718803   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 297422us
W20260709 13:14:07.702301  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 89794.1us
I20260709 13:14:07.656682  4223 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:07.704159   448 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:07.720196   525 leader_election.cc:336] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 2.233s (SENT)
I20260709 13:14:07.720911  1141 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:07.722462   627 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:07.624605  4255 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:14:07.665884  4285 raft_consensus.cc:697] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:07.731604   448 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:07.649585  4267 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:07.709661  4372 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:07.615620  4399 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 13:14:07.702596  4338 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:07.703069  3629 consensus_queue.cc:1059] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 13:14:07.740617  4388 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.438s	user 0.001s	sys 0.000s
I20260709 13:14:07.735678  4387 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:07.751912   447 connection.cc:256] RPC call timeout handler was delayed by -2.0065829010000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
I20260709 13:14:07.753005  4402 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:07.753106   448 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:07.797412  4267 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:07.730376  4395 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:07.804690  4395 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:07.805251  4395 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:07.805936   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 52909.2us
I20260709 13:14:07.806758   448 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:07.754846  3970 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:07.808143  4394 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:07.808080  4285 consensus_queue.cc:237] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:07.808969  4394 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:07.760294  4392 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:07.810418  4392 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:07.799858  4321 consensus_meta.cc:287] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 1.175s	user 0.005s	sys 0.005s
I20260709 13:14:07.763077  4242 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:07.764410  4389 log.cc:927] Time spent T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:14:07.859611  4321 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:07.765020  4386 log.cc:927] Time spent T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
W20260709 13:14:07.765244   366 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4e472c1c82c9467a9a5563d6b06e3b53 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:14:07.861032   366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 348432us
I20260709 13:14:07.765781  4141 consensus_queue.cc:237] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:07.767148  4400 log.cc:927] Time spent T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:14:07.770148  4253 consensus_meta.cc:287] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 1.078s	user 0.009s	sys 0.002s
I20260709 13:14:07.865557  4253 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:07.774303  4252 consensus_meta.cc:287] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.121s	user 0.007s	sys 0.003s
I20260709 13:14:07.867513  4252 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:07.869961  4252 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:07.743016  4143 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 13:14:07.781509  4352 consensus_meta.cc:287] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.552s	user 0.007s	sys 0.000s
I20260709 13:14:07.742583  4372 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:07.871532  4372 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:07.872104  4253 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:07.875551  4352 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:07.783746  3629 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.876984  3629 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:07.788954  4254 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.879684  4352 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:07.879524  4254 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:07.881807  4254 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:07.882465   478 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:07.790249  4300 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:07.879223  3629 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:07.790768  4245 consensus_meta.cc:287] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.252s	user 0.004s	sys 0.004s
I20260709 13:14:07.726759  4380 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:14:07.886912   629 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:14:07.716353  4344 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 13:14:07.801455   447 connection.cc:256] RPC call timeout handler was delayed by -1.7149829009999848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260709 13:14:07.888765   447 connection.cc:256] RPC call timeout handler was delayed by -1.5808829009999954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
W20260709 13:14:07.889200   447 connection.cc:256] RPC call timeout handler was delayed by -1.1691539329999614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1734s for a response
W20260709 13:14:07.889514   447 connection.cc:256] RPC call timeout handler was delayed by -1.1160539329998755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
I20260709 13:14:07.761714  4279 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:07.813295  4374 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:07.891130   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:07.815505  4392 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:07.816048  4394 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:07.802585   379 catalog_manager.cc:5697] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 1 to 5, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 5 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:07.892092   475 raft_consensus.cc:2393] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:07.892172   477 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:14:07.893326   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:07.893791   480 raft_consensus.cc:1240] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:07.894940   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:07.894519   379 catalog_manager.cc:5697] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 4 to 5, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 5 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:07.895794   479 raft_consensus.cc:2410] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:14:07.818437  4162 consensus_meta.cc:287] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.585s	user 0.007s	sys 0.001s
I20260709 13:14:07.897358  4162 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:07.897781  4398 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.898573  1170 raft_consensus.cc:1240] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:07.898353  4398 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:07.798840  4209 consensus_meta.cc:287] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.152s	user 0.009s	sys 0.002s
I20260709 13:14:07.818764  4378 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:07.899655  4209 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:07.900079  4378 raft_consensus.cc:697] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:07.901033  4378 consensus_queue.cc:237] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:07.901840  4209 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:07.795099  4277 consensus_meta.cc:287] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.953s	user 0.007s	sys 0.000s
I20260709 13:14:07.902616  4277 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:07.831135  4395 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:07.837517   633 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:14:07.904906   633 pending_rounds.cc:85] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 9
I20260709 13:14:07.905161   633 pending_rounds.cc:107] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:14:07.905380   633 raft_consensus.cc:2889] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:07.906113  1174 raft_consensus.cc:2368] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7.
W20260709 13:14:07.778491  4306 consensus_meta.cc:287] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.447s	user 0.007s	sys 0.004s
I20260709 13:14:07.866959  4321 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:07.783209  1171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 519) took 1315 ms. Trace:
I20260709 13:14:07.830673  4223 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:07.911281   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 187049us
W20260709 13:14:07.917769   525 leader_election.cc:336] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 2.640s (SENT)
I20260709 13:14:07.913316  1171 rpcz_store.cc:276] 0709 13:14:06.468178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.468321 (+   143us) service_pool.cc:224] Handling call
0709 13:14:06.496096 (+ 27775us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:06.516243 (+ 20147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.516273 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:06.531158 (+ 14885us) log.cc:844] Serialized 52 byte log entry
0709 13:14:06.687483 (+156325us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:06.853305 (+165822us) log.cc:844] Serialized 14 byte log entry
0709 13:14:06.887458 (+ 34153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.887537 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:07.782988 (+895451us) raft_consensus.cc:1685] finished
0709 13:14:07.783008 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:07.783150 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106416,"prepare.queue_time_us":106146,"prepare.run_cpu_time_us":3702,"prepare.run_wall_time_us":28110,"raft.queue_time_us":54737,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":9069,"thread_start_us":157217,"threads_started":2,"wal-append.queue_time_us":202083}
W20260709 13:14:07.973657   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 55931.6us
W20260709 13:14:07.974781   525 connection.cc:256] RPC call timeout handler was delayed by -1.0625146239999594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
W20260709 13:14:07.945190  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 220588us
I20260709 13:14:07.987990 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:08.009652   630 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.014s	sys 0.023s
W20260709 13:14:08.010492   630 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.014s	sys 0.023s
I20260709 13:14:08.012298   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1793) took 2952 ms. Trace:
I20260709 13:14:08.012923   630 rpcz_store.cc:276] 0709 13:14:05.060026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.488509 (+1428483us) service_pool.cc:224] Handling call
0709 13:14:06.542630 (+ 54121us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:06.542853 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:06.714663 (+171810us) log.cc:844] Serialized 14 byte log entry
0709 13:14:08.011025 (+1296362us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:08.011118 (+    93us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:08.011193 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.011338 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:08.012214 (+   876us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":106381,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":358428,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":1467342,"threads_started":3,"wal-append.queue_time_us":923387}
W20260709 13:14:08.028373  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 52203us
W20260709 13:14:07.912899  4064 consensus_meta.cc:287] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.001s
I20260709 13:14:08.026141   525 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:08.034706   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:08.029527   597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.004s	sys 0.028s
I20260709 13:14:08.029726  1141 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:07.917986  4392 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.916432  3791 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:08.036500   597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.004s	sys 0.028s
I20260709 13:14:08.042891   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:08.039940  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:08.049706   597 connection.cc:256] RPC call timeout handler was delayed by -1.4582519160001084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260709 13:14:08.050216   597 connection.cc:256] RPC call timeout handler was delayed by -1.1783519160001106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
W20260709 13:14:08.021858   599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.016s	sys 0.017s
W20260709 13:14:08.050930   599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.016s	sys 0.017s
I20260709 13:14:08.050676  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:08.050714   597 connection.cc:256] RPC call timeout handler was delayed by -1.1670649390000563s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
W20260709 13:14:08.052413   597 connection.cc:256] RPC call timeout handler was delayed by -1.1247649389999879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
I20260709 13:14:08.053303   525 leader_election.cc:400] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10.
I20260709 13:14:08.053673   525 leader_election.cc:403] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:14:08.055652   525 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:08.055935   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:08.056527   477 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:08.058650   525 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:08.051537   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 630947us
I20260709 13:14:08.042076  4341 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:08.024068  4321 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:08.067822   599 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:08.035626   630 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:14:08.060894  4395 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:08.068387  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:08.069211   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:08.069566  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:08.069748   630 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:08.070605  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:08.071476  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:08.072445  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:08.073271  4392 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:08.053574  4253 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:08.062070  4405 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.074609  4253 raft_consensus.cc:697] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:08.037499  4406 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:08.074752  4405 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:08.075544  4253 consensus_queue.cc:237] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:08.063042  4368 consensus_meta.cc:287] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.733s	user 0.008s	sys 0.002s
I20260709 13:14:08.063453  4277 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:14:08.063694  4372 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:08.064582  3791 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:08.065064  4223 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:07.970160  4342 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:08.065806  4324 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:08.066901   525 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:08.100761   525 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:08.060001  4384 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10.
I20260709 13:14:08.067881  4321 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:08.062232  4162 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:08.078480   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:08.106880   480 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:08.078820   448 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:08.081681   599 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:08.084117   630 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:14:08.036948  4380 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:14:08.089947  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:08.092425  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:08.095522  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:08.102046   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:07.966595  4303 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:08.060374  4404 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:08.108207   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:08.124508   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:08.125278   630 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:08.088359  1172 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.003s	sys 0.011s
W20260709 13:14:08.126811  1172 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.003s	sys 0.011s
I20260709 13:14:08.075718  4406 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:08.114357   556 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:08.130036   525 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:08.042788  4064 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:08.133294   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 51696.7us
I20260709 13:14:08.102837  4341 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:08.110428  4223 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:08.108081  4392 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:08.112670  4395 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:08.156687   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:08.157305   556 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:08.094851  4368 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:08.151391  4306 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:14:08.164311  4358 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.005s	sys 0.012s
I20260709 13:14:08.112802  4327 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:14:08.128963  4404 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:14:08.168524  4358 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.006s	sys 0.013s
I20260709 13:14:08.153314  4384 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:08.122601  3933 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:14:08.187268   559 raft_consensus.cc:1240] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 10. Ops: []
W20260709 13:14:08.172789   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 107725us
I20260709 13:14:08.128861  4296 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
W20260709 13:14:08.183000   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 51794.1us
I20260709 13:14:08.201323   525 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:08.168152   630 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:14:08.169167  4414 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:08.169019  4376 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:08.169097  4377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.000s	sys 0.014s
I20260709 13:14:08.168938  4415 consensus_queue.cc:1059] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:14:08.192121  4368 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:08.214740   525 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:08.192837  4321 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:08.192956  4342 leader_election.cc:290] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:08.194875  4372 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:08.195457   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:08.216277  4321 consensus_queue.cc:1059] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:08.216940   558 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:08.217491  4321 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:08.217947   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:08.218248  4321 raft_consensus.cc:3055] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:08.218660  4321 raft_consensus.cc:740] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:14:08.168633  4349 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.003s	sys 0.009s
W20260709 13:14:08.219458  4349 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.003s	sys 0.010s
I20260709 13:14:08.197204  4303 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:08.185708  1139 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:08.179596  4404 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:08.213362   597 leader_election.cc:336] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Timed out: RequestConsensusVote RPC to 127.31.17.132:39939 timed out after 1.854s (SENT)
I20260709 13:14:08.221762   597 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:08.202620   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:08.224613   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:08.225437   630 raft_consensus.cc:2410] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:14:08.211550  1172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 526) took 1088 ms. Trace:
I20260709 13:14:08.166767  4306 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:08.223587   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:08.227843   624 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:08.227452  1172 rpcz_store.cc:276] 0709 13:14:07.122708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.122870 (+   162us) service_pool.cc:224] Handling call
0709 13:14:07.123200 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:07.124053 (+   853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:07.124102 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:07.139354 (+ 15252us) log.cc:844] Serialized 26 byte log entry
0709 13:14:08.127699 (+988345us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:08.127760 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.127868 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:08.211309 (+ 83441us) raft_consensus.cc:1685] finished
0709 13:14:08.211329 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:08.211486 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10907,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":94,"thread_start_us":912040,"threads_started":1,"wal-append.queue_time_us":1013929}
I20260709 13:14:08.205653   480 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:14:08.230482  1141 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:08.231313   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:08.232475   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:08.236074   630 raft_consensus.cc:2410] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:14:08.236853   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:08.237394   630 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:08.150710  4369 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:14:08.242321   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:08.250743   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:08.220328  4223 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:08.264523   556 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:08.265981   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:08.238888  4349 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:08.225898  4405 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:08.173152  4341 consensus_queue.cc:1059] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:14:08.247008  4306 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:08.254914  4348 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:08.222883  4415 consensus_queue.cc:1243] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:14:08.334523   556 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:08.246863   630 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:14:08.343683   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:08.346837   558 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
W20260709 13:14:08.335472   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 88828.8us
I20260709 13:14:08.246811  4342 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:14:08.340039   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 125372us
I20260709 13:14:08.349341   624 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:08.359643   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:08.360337   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:08.367726   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:08.370568   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.370980   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.371718   480 raft_consensus.cc:2410] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:14:08.373040   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.375092   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.376636   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.376963   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.377599   480 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:08.379410   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.379721   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.381506   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:08.382494   479 raft_consensus.cc:2393] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:08.384248   479 raft_consensus.cc:1275] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:08.385840   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:08.388613   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.389253   525 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:08.389376   480 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:14:08.391211   480 raft_consensus.cc:1240] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:14:08.402771   558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:14:08.403580   558 raft_consensus.cc:606] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:08.404021   558 raft_consensus.cc:614] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:08.343715  4206 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.190s	user 0.011s	sys 0.000s
W20260709 13:14:08.410120  4206 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.272s	user 0.012s	sys 0.000s
I20260709 13:14:08.414992  4406 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:08.226043  4376 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:08.303043  4393 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:08.416452  4393 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:08.417661  4225 consensus_queue.cc:260] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:08.418694  4225 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:08.409024  4348 raft_consensus.cc:697] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:08.420938  4348 consensus_queue.cc:237] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:08.430814   556 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:08.432718   477 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:14:08.433804  1141 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:08.435642   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1809) took 1040 ms. Trace:
I20260709 13:14:08.435998   629 rpcz_store.cc:276] 0709 13:14:07.394811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.395017 (+   206us) service_pool.cc:224] Handling call
0709 13:14:08.435489 (+1040472us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b54002e63d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:08.435589 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1071272832}
I20260709 13:14:08.436609   556 raft_consensus.cc:1240] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:08.437058   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:08.437779   631 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:14:08.440264  4393 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:08.441964   558 raft_consensus.cc:1275] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:08.442618   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1935) took 1047 ms. Trace:
I20260709 13:14:08.443070   558 rpcz_store.cc:276] 0709 13:14:07.394743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.434794 (+1040051us) service_pool.cc:224] Handling call
0709 13:14:08.441656 (+  6862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:08.442350 (+   694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.442555 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:08.446111   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:08.447175   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1936) took 1042 ms. Trace:
I20260709 13:14:08.447933   556 rpcz_store.cc:276] 0709 13:14:07.394994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.436180 (+1041186us) service_pool.cc:224] Handling call
0709 13:14:08.436454 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:08.436963 (+   509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.437131 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:08.348623  4305 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:08.348568  4349 raft_consensus.cc:697] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:08.485951  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:08.484724  1166 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:08.449887  4387 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:08.446305  4365 consensus_queue.cc:1059] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:14:08.442332  4398 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:08.307801  4321 consensus_queue.cc:260] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:08.435086  4341 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:08.496802   597 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:08.486233   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:08.497677   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:08.499508   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 110363us
I20260709 13:14:08.500735   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1937) took 1105 ms. Trace:
I20260709 13:14:08.516425   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.517264   477 raft_consensus.cc:2393] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 12: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:08.516636   558 rpcz_store.cc:276] 0709 13:14:07.395331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.486443 (+1091112us) service_pool.cc:224] Handling call
0709 13:14:08.499917 (+ 13474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:08.500102 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:08.500127 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:08.500166 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:08.500193 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.500245 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:08.500676 (+   431us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:08.517289   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:08.554246  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:08.501921  4305 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:08.555892  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:08.560913  1166 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:14:08.556946   525 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:08.508494  4387 raft_consensus.cc:697] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:08.519774  4365 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:08.518625  4398 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:08.568135   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:08.571842   597 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:08.567713  4369 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:08.575696   629 raft_consensus.cc:2410] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:14:08.576535   597 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:08.563095   525 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:08.581079  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:08.628120   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:08.628561   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:08.628829   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 479) took 2331 ms. Trace:
I20260709 13:14:08.629371   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:08.629230   559 rpcz_store.cc:276] 0709 13:14:06.297356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.297641 (+   285us) service_pool.cc:224] Handling call
0709 13:14:06.883135 (+585494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:08.199832 (+1316697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.557813 (+357981us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400388954. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:08.628653 (+ 70840us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b5400388950. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:08.628774 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4344502400}
W20260709 13:14:08.631412   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 55674.5us
I20260709 13:14:08.560492  4429 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:08.632619   597 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:08.637878  1166 raft_consensus.cc:2410] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 9 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:14:08.629194   550 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:08.640854   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:08.641445   550 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:14:08.519160  4341 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:08.652076   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:08.657733   550 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:08.661952   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:08.662427   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 100066us
I20260709 13:14:08.663873   525 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:08.663775   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:08.665365   550 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:08.658227  4365 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:08.633184  4292 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:08.658404  4321 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:08.665424  4223 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:08.688212   629 raft_consensus.cc:2410] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:14:08.687614   554 raft_consensus.cc:2410] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:14:08.659457  4349 consensus_queue.cc:237] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:08.683260  4405 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:08.672617  4369 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:08.697893  4413 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:08.698455  4432 log.cc:927] Time spent T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:14:08.706647  4433 log.cc:927] Time spent T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 13:14:08.707588  4424 log.cc:927] Time spent T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:14:08.690646  4376 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:08.717348  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:08.628002  4398 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:08.718943   550 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:08.720860   447 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:08.694299  4292 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:08.709087  4341 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:08.658399  4429 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:08.751502   447 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:08.754186   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:08.756161  4381 log.cc:927] Time spent T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 1.274s	user 0.006s	sys 0.009s
I20260709 13:14:08.727967  4206 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:14:08.759363  4371 log.cc:927] Time spent T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 1.514s	user 0.006s	sys 0.000s
I20260709 13:14:08.759742  4206 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:08.762208  4234 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:08.762650  4206 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:08.748453  4292 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:08.766637  1174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 728) took 1460 ms (client timeout 1854 ms). Trace:
I20260709 13:14:08.769268  4373 raft_consensus.cc:3055] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:08.769836  4373 raft_consensus.cc:740] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:14:08.767150  1174 rpcz_store.cc:269] 0709 13:14:07.306279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.308887 (+  2608us) service_pool.cc:224] Handling call
0709 13:14:08.766413 (+1457526us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b5400655ed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:08.766571 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335851904}
I20260709 13:14:08.774991  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:08.776466  4306 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:08.778029  4141 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:08.778898  4306 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:08.743389  4324 consensus_meta.cc:287] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.639s	user 0.016s	sys 0.000s
I20260709 13:14:08.720400  4405 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:08.729427  4369 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:08.785640   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.786559   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.824540   482 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:08.787307   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1800) took 2150 ms. Trace:
I20260709 13:14:08.825830   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.825403   626 rpcz_store.cc:276] 0709 13:14:06.636639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.636833 (+   194us) service_pool.cc:224] Handling call
0709 13:14:06.655203 (+ 18370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:06.662752 (+  7549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.662799 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:06.681870 (+ 19071us) log.cc:844] Serialized 26 byte log entry
0709 13:14:06.875282 (+193412us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:06.875338 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.875417 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:08.755439 (+1880022us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:08.779682 (+ 24243us) raft_consensus.cc:1685] finished
0709 13:14:08.779714 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:08.787210 (+  7496us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":61666,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":43611,"spinlock_wait_cycles":7323904,"thread_start_us":176496,"threads_started":1,"wal-append.queue_time_us":626231}
I20260709 13:14:08.787964   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.785439   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:08.790997  4435 log.cc:927] Time spent T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.100s	user 0.001s	sys 0.001s
W20260709 13:14:08.791306  4414 consensus_meta.cc:287] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.578s	user 0.008s	sys 0.003s
W20260709 13:14:08.793538  4384 consensus_meta.cc:287] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.000s
I20260709 13:14:08.795571  4398 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:08.779227  4373 consensus_queue.cc:260] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:08.798331  4404 consensus_meta.cc:287] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.549s	user 0.006s	sys 0.003s
I20260709 13:14:08.799434   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 608) took 1560 ms. Trace:
I20260709 13:14:08.842247   478 rpcz_store.cc:276] 0709 13:14:07.238763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.238932 (+   169us) service_pool.cc:224] Handling call
0709 13:14:07.268680 (+ 29748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:07.882888 (+614208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.799145 (+916257us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54002b25d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:08.799351 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1411015936}
I20260709 13:14:08.800516   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.839479  4384 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:08.804237   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:08.805579   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:08.827400  4141 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:08.805608  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:08.799080  4292 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:08.812140  4304 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:08.813109   448 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:08.814952   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:08.815097  1138 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:08.741503  4413 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:08.819135  4429 leader_election.cc:290] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:08.820268   550 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:08.856963  1138 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:08.858588  1138 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:08.692329  4387 consensus_queue.cc:237] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:08.821935  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:08.783696   447 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:14:08.862679   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 79097.6us
I20260709 13:14:08.863708   447 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:08.829159   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:08.830156   599 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:08.830919  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:08.824757   483 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:08.832262   484 raft_consensus.cc:1275] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:08.837584   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:08.867134   480 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:08.819198  4343 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:08.868014   447 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:08.839498   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:14:08.843556   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 179739us
I20260709 13:14:08.869961   525 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:08.802779   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:08.871519   557 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:14:08.831815  4405 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:08.884645   550 raft_consensus.cc:2410] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:08.851310   555 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:14:08.832087  4369 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:08.855041   448 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:08.855623   628 raft_consensus.cc:2376] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11. Re-sending same reply.
I20260709 13:14:08.887526  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:08.887737   448 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:08.860754   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1934) took 1466 ms. Trace:
I20260709 13:14:08.865989   626 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:08.839594   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:08.890062   475 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:08.844238   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.843796  4414 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:08.872562   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:08.893064   557 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:14:08.893908  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:08.896143   523 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:08.833596  4324 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:08.878736   447 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:08.898054   525 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:08.889209   448 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:08.903687   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:08.905535  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:08.907073  1174 raft_consensus.cc:2368] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11.
I20260709 13:14:08.901702   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:08.909070   628 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:08.912703   480 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:08.913673   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:08.914672   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.914923  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:08.915689   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:08.916283   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.916676   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.917333   480 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:08.915705  1175 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:08.918119   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.916705   448 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:08.920013   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:08.921096   555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:14:08.921869   555 raft_consensus.cc:606] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:08.922323   555 raft_consensus.cc:614] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:08.924993   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 46387.5us
I20260709 13:14:08.926563   477 raft_consensus.cc:1240] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:14:08.919554  4384 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:08.862634  4364 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:08.934926  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:08.851224  4404 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:08.886510  4393 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:08.886754  4361 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:08.886204  4338 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:08.938124   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:08.892910  4429 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:08.968040   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1939) took 1156 ms. Trace:
I20260709 13:14:08.968439   558 rpcz_store.cc:276] 0709 13:14:07.811663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.536510 (+724847us) service_pool.cc:224] Handling call
0709 13:14:08.562521 (+ 26011us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:08.563370 (+   849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:08.566628 (+  3258us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:08.571775 (+  5147us) log.cc:844] Serialized 26 byte log entry
0709 13:14:08.848907 (+277132us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:08.848949 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.849029 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:08.967827 (+118798us) raft_consensus.cc:1685] finished
0709 13:14:08.967850 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:08.967985 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":178646,"threads_started":1,"wal-append.queue_time_us":335656}
I20260709 13:14:08.969985   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:08.932482  4234 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:08.897078  4372 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:08.898180  4418 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:08.911698  4273 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:08.914261  4373 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:08.914427  4347 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:08.944707   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:08.954012   557 raft_consensus.cc:1240] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:08.951428  4143 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:08.930876  4141 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:08.966699  4413 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:08.994393   626 raft_consensus.cc:2410] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:14:08.884439  4304 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:08.962385  4338 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:08.961213  4361 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:08.998317   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:09.000849   624 raft_consensus.cc:2368] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8.
I20260709 13:14:08.981616  1172 raft_consensus.cc:1240] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:14:08.986523   475 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:14:08.938988  4364 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:08.911348  4343 consensus_queue.cc:1048] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:14:08.933341  4344 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:08.924690  4341 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:08.955945  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:08.980837  4234 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:09.018476  4234 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:08.981391  4418 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:09.019531  4418 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:08.995891  4143 raft_consensus.cc:697] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:08.892526  4363 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:14:08.902850  4377 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:08.996407   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:08.994266  4372 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:09.013147  4361 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:09.024324  4442 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:09.026264  4405 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.074091   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1938) took 1678 ms. Trace:
I20260709 13:14:09.029695   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1940) took 1217 ms. Trace:
I20260709 13:14:09.039456  4247 consensus_queue.cc:260] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.042615  3791 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:09.043617  1168 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36724 (request call id 525) took 1921 ms (client timeout 2229 ms). Trace:
I20260709 13:14:09.043802  1173 raft_consensus.cc:1240] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:08.997532  4304 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:09.046305   554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1933) took 1652 ms (client timeout 1762 ms). Trace:
W20260709 13:14:09.106108   554 rpcz_store.cc:269] 0709 13:14:07.394186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.415777 (+ 21591us) service_pool.cc:224] Handling call
0709 13:14:09.046043 (+1630266us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400151dd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:09.046227 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2712600448}
I20260709 13:14:08.994870  4347 raft_consensus.cc:697] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:09.047355  4341 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:08.990469  4393 consensus_queue.cc:1048] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:14:09.054147  1170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 722) took 1876 ms. Trace:
I20260709 13:14:09.055488  4296 raft_consensus.cc:3055] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:09.056290  4267 raft_consensus.cc:3055] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:09.058981  4344 raft_consensus.cc:697] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:08.994009  4305 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:09.023386   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:09.016947  4364 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:08.998556  4338 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:09.074713   559 rpcz_store.cc:276] 0709 13:14:07.811970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.643808 (+831838us) service_pool.cc:224] Handling call
0709 13:14:08.644122 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:08.662130 (+ 18008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:08.662159 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:08.669416 (+  7257us) log.cc:844] Serialized 26 byte log entry
0709 13:14:08.979966 (+310550us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:08.980007 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.980069 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:09.029378 (+ 49309us) raft_consensus.cc:1685] finished
0709 13:14:09.029411 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:09.029613 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17623,"raft.queue_time_us":19035,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":6549,"thread_start_us":260317,"threads_started":1,"wal-append.queue_time_us":336347}
W20260709 13:14:09.082916   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:09.118984   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:09.074644   556 rpcz_store.cc:276] 0709 13:14:07.395663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.514640 (+1118977us) service_pool.cc:224] Handling call
0709 13:14:08.559020 (+ 44380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:08.559463 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:08.559506 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:08.569091 (+  9585us) log.cc:844] Serialized 26 byte log entry
0709 13:14:08.693857 (+124766us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:08.693906 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.693990 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:09.073813 (+379823us) raft_consensus.cc:1685] finished
0709 13:14:09.073842 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:09.074009 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":475,"raft.queue_time_us":158,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9418,"thread_start_us":27912,"threads_started":1,"wal-append.queue_time_us":228949}
W20260709 13:14:09.101854  1168 rpcz_store.cc:269] 0709 13:14:07.122326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.122550 (+   224us) service_pool.cc:224] Handling call
0709 13:14:09.043416 (+1920866us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b54003f9654. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:09.043556 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83468672}
W20260709 13:14:09.104542   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 172927us
I20260709 13:14:09.065896  4377 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.112236  1170 rpcz_store.cc:276] 0709 13:14:07.177496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.178313 (+   817us) service_pool.cc:224] Handling call
0709 13:14:07.233247 (+ 54934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:07.899056 (+665809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.053785 (+1154729us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b54003a3ed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:09.054055 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1529535360}
I20260709 13:14:09.134776   624 raft_consensus.cc:2368] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11.
I20260709 13:14:09.109086  4304 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:09.137487   554 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:14:09.137492   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:09.139479   523 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:09.139782   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:09.070672  4372 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.117256  4296 raft_consensus.cc:740] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:09.118170  4141 raft_consensus.cc:3055] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:09.118453  4247 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:09.145812   476 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:09.158334   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:09.160439   525 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:09.159709   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:09.136051  4267 raft_consensus.cc:740] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:09.167104  4296 consensus_queue.cc:260] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.168560  4296 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:09.168937  4341 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:09.169555  4341 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:09.169886  4341 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.170205  4341 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:09.176294  4404 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:09.177165   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 507) took 4189 ms. Trace:
I20260709 13:14:09.178207  4372 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:09.149652  4343 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:09.181478  4343 raft_consensus.cc:697] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:09.182210  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:09.182351  4343 consensus_queue.cc:237] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:09.183023  1167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 588) took 1702 ms. Trace:
I20260709 13:14:09.154120  4141 raft_consensus.cc:740] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:09.183445  1167 rpcz_store.cc:276] 0709 13:14:07.480264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.480912 (+   648us) service_pool.cc:224] Handling call
0709 13:14:09.182008 (+1701096us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b5800003c98. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f4a22 00007f4b6e20dc09 00007f4b6d367ee0 00007f4b6d4310ab 00007f4b6d431131 00007f4b6d3df0a0 00007f4b6d3de984 00007f4b669596d4 00007f4b66959662
0709 13:14:09.182953 (+   945us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14027520}
I20260709 13:14:09.076664  4442 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:09.177539   633 rpcz_store.cc:276] 0709 13:14:04.987956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.475904 (+1487948us) service_pool.cc:224] Handling call
0709 13:14:06.476203 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:07.910972 (+1434769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.176925 (+1265953us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54000528d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:09.177108 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3129700608}
I20260709 13:14:09.186965   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:09.143744  4377 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:09.187970   624 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:14:09.190104   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:09.192114   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:09.195328   626 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:09.197824   481 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:14:09.207477   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 68557.4us
I20260709 13:14:09.140869  4143 consensus_queue.cc:237] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.140213  4305 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.184093  4141 consensus_queue.cc:260] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.275277  1175 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:09.276552   522 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:09.277707   523 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:09.196743  4273 raft_consensus.cc:697] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:09.188449  4385 consensus_queue.cc:1059] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:14:09.212025   448 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:09.199826  4349 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:14:09.209270   554 raft_consensus.cc:1240] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:14:09.265102  4305 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:09.243991  4225 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:09.286435  4223 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.291317  4327 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:09.266249  4267 consensus_queue.cc:260] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:09.285495  4141 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:09.280544  4429 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:09.283412  4332 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.183038  4369 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.266492   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:09.338809   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 126905us
I20260709 13:14:09.288407  3933 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:14:09.310135  4321 consensus_meta.cc:287] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.617s	user 0.007s	sys 0.004s
I20260709 13:14:09.312610  4456 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:09.343822   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:09.335881  4393 raft_consensus.cc:3055] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:09.345934  4267 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:09.338784  4405 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:09.289039  4344 consensus_queue.cc:237] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:09.366425   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:09.328434  4225 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.341617  4332 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:09.385335  4225 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:09.386013   554 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:09.343083  4451 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:09.378971   553 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:14:09.395287  4453 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
W20260709 13:14:09.403368  4448 log.cc:927] Time spent T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:14:09.279686  4347 consensus_queue.cc:237] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:09.406200  4304 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.407558   633 raft_consensus.cc:2393] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 11: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:09.408536   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1941) took 1596 ms. Trace:
I20260709 13:14:09.409198  4304 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:09.408937   557 rpcz_store.cc:276] 0709 13:14:07.812257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.893742 (+1081485us) service_pool.cc:224] Handling call
0709 13:14:08.894236 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:08.990489 (+ 96253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.408295 (+417806us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b5400048dd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:09.408476 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136889600}
I20260709 13:14:09.412250   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:09.413046   629 raft_consensus.cc:2368] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13.
I20260709 13:14:09.413861   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:09.414381   629 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:09.415650  4454 log.cc:927] Time spent T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:14:09.416220   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:09.416592  4449 log.cc:927] Time spent T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:14:09.419919   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1881) took 1269 ms. Trace:
I20260709 13:14:09.420334   624 rpcz_store.cc:276] 0709 13:14:08.150321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.141879 (+991558us) service_pool.cc:224] Handling call
0709 13:14:09.419759 (+277880us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b54001617d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:09.419860 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60323072}
I20260709 13:14:09.421530   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:09.410341   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:09.423707   557 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:09.425774   597 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:09.427198   597 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:09.331386  4223 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:09.432164  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:09.428944  4373 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.351867  3933 raft_consensus.cc:697] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:09.451086   597 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:09.357127  4393 raft_consensus.cc:740] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:09.463292   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:09.462901   597 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:09.471227   557 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:14:09.385444  4332 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:09.344769  4429 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:09.571331  1169 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:09.504426  4416 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:09.585078  4416 raft_consensus.cc:697] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:09.585979  4416 consensus_queue.cc:237] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.590641   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:09.591477   558 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:09.592099   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:09.592631   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1942) took 1780 ms. Trace:
I20260709 13:14:09.433104  4405 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:09.593271  4405 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.593109   558 rpcz_store.cc:276] 0709 13:14:07.812532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.970811 (+1158279us) service_pool.cc:224] Handling call
0709 13:14:09.591299 (+620488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:09.591857 (+   558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.592462 (+   605us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b54000492d0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:09.592580 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1426215808}
I20260709 13:14:09.593906  4405 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:09.462144  4414 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:09.595695  4414 raft_consensus.cc:697] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:09.596493   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:09.597128   481 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:09.596764  4414 consensus_queue.cc:237] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.515761  3933 consensus_queue.cc:237] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:09.459682  4365 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:09.603500  4365 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.608600   447 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:09.458730  4273 consensus_queue.cc:237] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:09.632843   447 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:09.507731   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:09.525492  4361 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:09.527657  4369 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:09.529456   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:09.530609  1174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 739) took 1017 ms. Trace:
W20260709 13:14:09.531392  4458 log.cc:927] Time spent T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:14:09.675529  1174 rpcz_store.cc:276] 0709 13:14:08.513079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.774676 (+261597us) service_pool.cc:224] Handling call
0709 13:14:09.530394 (+755718us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540069e954. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:09.530546 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301234432}
I20260709 13:14:09.676899  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:09.678038  1174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ade492740624caba667436aa666025c"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:57004
I20260709 13:14:09.678604  1174 raft_consensus.cc:606] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:09.543861  4292 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:09.546542  4452 log.cc:927] Time spent T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.259s	user 0.000s	sys 0.000s
I20260709 13:14:09.352137  4456 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.549171  1173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 726) took 2284 ms. Trace:
I20260709 13:14:09.549610  4223 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:09.551177   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:09.724181   554 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:08.888898   552 rpcz_store.cc:276] 0709 13:14:07.394477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.438495 (+1044018us) service_pool.cc:224] Handling call
0709 13:14:08.438770 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:08.438952 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:08.686357 (+247405us) log.cc:844] Serialized 14 byte log entry
0709 13:14:08.860314 (+173957us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:08.860396 (+    82us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:08.860453 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.860541 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:08.860683 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":277904,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":110,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":21817,"thread_start_us":374535,"threads_started":2}
I20260709 13:14:09.725813   552 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:09.560204   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:09.555642   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:09.726307   630 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:14:09.726753   626 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:09.560400  4338 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:09.723869  1173 rpcz_store.cc:276] 0709 13:14:07.264623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.268469 (+  3846us) service_pool.cc:224] Handling call
0709 13:14:09.043629 (+1775160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:09.102081 (+ 58452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.548893 (+446812us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54003f9650. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:09.549069 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4063996800}
I20260709 13:14:09.728645   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2042) took 1055 ms. Trace:
I20260709 13:14:09.728950  1171 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:14:09.729058   552 rpcz_store.cc:276] 0709 13:14:08.673613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.725372 (+1051759us) service_pool.cc:224] Handling call
0709 13:14:09.725651 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:09.728391 (+  2740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.728592 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:09.551553   629 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:09.730890   475 raft_consensus.cc:1240] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:14:09.563403   627 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1807) took 2169 ms (client timeout 1932 ms). Trace:
W20260709 13:14:09.731374   627 rpcz_store.cc:269] 0709 13:14:07.394080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.394222 (+   142us) service_pool.cc:224] Handling call
0709 13:14:09.563191 (+2168969us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54002bb6d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:09.563324 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":708601088}
I20260709 13:14:09.732786   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:09.733788   627 raft_consensus.cc:2410] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:14:09.564069   551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 2026) took 2320 ms (client timeout 2379 ms). Trace:
W20260709 13:14:09.734184   551 rpcz_store.cc:269] 0709 13:14:07.243322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.245684 (+  2362us) service_pool.cc:224] Handling call
0709 13:14:09.563910 (+2318226us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54001d6354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:09.564011 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354602368}
W20260709 13:14:09.564759  4447 log.cc:927] Time spent T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c: Append to log took a long time: real 0.446s	user 0.002s	sys 0.000s
I20260709 13:14:09.565568   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:09.573066   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:09.575629  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:09.739579   628 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:09.576668  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:09.740350  1175 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:09.577379  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:09.742463   523 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:09.577383  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:09.743685   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1892) took 1228 ms. Trace:
I20260709 13:14:09.580415   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:09.744095   627 rpcz_store.cc:276] 0709 13:14:08.515522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.732491 (+1216969us) service_pool.cc:224] Handling call
0709 13:14:09.743622 (+ 11131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:09.581218   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2034) took 1005 ms. Trace:
I20260709 13:14:09.581849  4429 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:09.590732   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:09.752332  1172 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:09.592726   476 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:09.745057   559 rpcz_store.cc:276] 0709 13:14:08.576079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.144140 (+568061us) service_pool.cc:224] Handling call
0709 13:14:09.144399 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:09.263917 (+119518us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:09.264273 (+   356us) log.cc:844] Serialized 14 byte log entry
0709 13:14:09.313942 (+ 49669us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:09.314012 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:09.314074 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.580911 (+266837us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54001d6d54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:09.580974 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:09.581144 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1398,"prepare.queue_time_us":238,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":4662,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":6747,"spinlock_wait_cycles":274365312,"thread_start_us":48793,"threads_started":1,"wal-append.queue_time_us":200383}
I20260709 13:14:09.510982   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1947) took 1606 ms. Trace:
I20260709 13:14:09.754359   559 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:09.513942  4341 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.608892  4365 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:09.610138  4364 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.616441   525 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:09.785275   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 168946us
I20260709 13:14:09.786604   525 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:09.523857  4455 log.cc:927] Time spent T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:14:09.788009   630 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:09.789767   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:09.507952   624 raft_consensus.cc:2393] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:14:09.507041   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 44175.4us
I20260709 13:14:09.634120   557 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:09.793354   597 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:14:09.654374   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:09.635913   447 leader_election.cc:400] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8.
I20260709 13:14:09.798748   447 leader_election.cc:403] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:14:09.799437   597 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:09.678457   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:09.675529   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 277657us
I20260709 13:14:09.685911   599 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:09.803927   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 118092us
I20260709 13:14:09.805197   599 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:09.535662  4345 raft_consensus.cc:3055] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:14:09.693688   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:09.722617   632 raft_consensus.cc:2368] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12.
I20260709 13:14:09.615846  4398 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.725653   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:09.561554  4442 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:09.816577   633 raft_consensus.cc:2393] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 11: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:09.630239  4304 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:09.730823   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:09.562676   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 511) took 2080 ms. Trace:
I20260709 13:14:09.636981  4372 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:09.736851   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1879) took 1594 ms. Trace:
I20260709 13:14:09.629963  4141 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:09.681165  4451 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:09.462685  4373 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.582434   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2031) took 2337 ms. Trace:
I20260709 13:14:09.747911   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:09.751722  1173 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:09.754088   556 rpcz_store.cc:276] 0709 13:14:07.904310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.137780 (+1233470us) service_pool.cc:224] Handling call
0709 13:14:09.144736 (+  6956us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:09.155389 (+ 10653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:09.155436 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:09.156126 (+   690us) log.cc:844] Serialized 52 byte log entry
0709 13:14:09.333241 (+177115us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:09.333301 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.333423 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:09.510762 (+177339us) raft_consensus.cc:1685] finished
0709 13:14:09.510783 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:09.510925 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2434,"raft.queue_time_us":3697,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":3159,"thread_start_us":120791,"threads_started":1,"wal-append.queue_time_us":319518}
W20260709 13:14:09.816646  4418 consensus_meta.cc:287] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.797s	user 0.012s	sys 0.000s
I20260709 13:14:09.465602  4234 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:09.772946   554 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:14:09.859102   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1953) took 1081 ms. Trace:
I20260709 13:14:09.836860   557 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:09.859473   554 rpcz_store.cc:276] 0709 13:14:08.777736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.772377 (+994641us) service_pool.cc:224] Handling call
0709 13:14:09.772721 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:09.858860 (+ 86139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.859049 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:09.775169   552 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:14:09.861109   557 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:14:09.776602  1171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 601) took 1317 ms. Trace:
I20260709 13:14:09.862599  1171 rpcz_store.cc:276] 0709 13:14:08.459339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.498790 (+ 39451us) service_pool.cc:224] Handling call
0709 13:14:09.712845 (+1214055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:09.729374 (+ 16529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.776369 (+ 46995us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54005b4350. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:09.776533 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2748986624}
I20260709 13:14:09.781240   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:09.799552   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 163772us
I20260709 13:14:09.863886   628 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:14:09.864200   447 leader_election.cc:400] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11.
I20260709 13:14:09.810245   597 leader_election.cc:304] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:09.712319  1169 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 731) took 2231 ms (client timeout 2088 ms). Trace:
W20260709 13:14:09.864893  1169 rpcz_store.cc:269] 0709 13:14:07.481178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.515014 (+ 33836us) service_pool.cc:224] Handling call
0709 13:14:09.712054 (+2197040us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b54005b4354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:09.712225 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4488069376}
I20260709 13:14:09.812116   448 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:09.814307   599 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:09.751796  4223 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:09.860365   554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:14:09.723726  4247 consensus_queue.cc:1048] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:14:09.817080   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1874) took 1679 ms. Trace:
I20260709 13:14:09.728549  4183 consensus_queue.cc:1059] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:14:09.826076   631 rpcz_store.cc:276] 0709 13:14:07.482283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.482425 (+   142us) service_pool.cc:224] Handling call
0709 13:14:08.437580 (+955155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:08.438012 (+   432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.562457 (+1124445us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54002e63d0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:09.562613 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2195943296}
I20260709 13:14:09.824901   555 raft_consensus.cc:2393] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 11: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:09.827652   626 rpcz_store.cc:276] 0709 13:14:08.142313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.555374 (+1413061us) service_pool.cc:224] Handling call
0709 13:14:09.736793 (+181419us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:09.823537  3810 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:09.836091   480 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:09.851635   553 rpcz_store.cc:276] 0709 13:14:07.244747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.648721 (+403974us) service_pool.cc:224] Handling call
0709 13:14:07.697553 (+ 48832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:09.392082 (+1694529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.582199 (+190117us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b5400387f54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:09.582378 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3866270592}
I20260709 13:14:09.815470  4404 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:09.849452   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1891) took 1340 ms. Trace:
I20260709 13:14:09.890199   627 rpcz_store.cc:276] 0709 13:14:08.508645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.747666 (+1239021us) service_pool.cc:224] Handling call
0709 13:14:09.849383 (+101717us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:09.891418   627 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:09.892539  1138 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:09.895088   475 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:09.897687   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1876) took 1756 ms. Trace:
I20260709 13:14:09.898093   627 rpcz_store.cc:276] 0709 13:14:08.141612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.890951 (+1749339us) service_pool.cc:224] Handling call
0709 13:14:09.891221 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:09.897356 (+  6135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.897517 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:09.899932   627 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:09.900907   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1880) took 1750 ms. Trace:
I20260709 13:14:09.901319   627 rpcz_store.cc:276] 0709 13:14:08.150077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.898998 (+1748921us) service_pool.cc:224] Handling call
0709 13:14:09.899529 (+   531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:09.900661 (+  1132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.900852 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:09.902736   627 raft_consensus.cc:1240] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:09.903366   552 raft_consensus.cc:1240] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:09.868920   557 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:09.815644  4429 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:09.817701  4332 consensus_queue.cc:1059] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 13:14:09.871944   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 59950.4us
I20260709 13:14:09.871754   633 rpcz_store.cc:276] 0709 13:14:08.137877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.725450 (+1587573us) service_pool.cc:224] Handling call
0709 13:14:09.817001 (+ 91551us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:09.873248   522 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.079s	sys 0.094s
W20260709 13:14:09.912919   522 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.079s	sys 0.094s
W20260709 13:14:09.913321   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 551650us
I20260709 13:14:09.823592  4192 consensus_queue.cc:1059] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:14:09.875382  4223 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.819046   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:09.825454  4304 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.817574  4453 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8.
I20260709 13:14:09.823493  4292 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:09.827525  4372 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:09.818142  4345 raft_consensus.cc:740] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:14:09.909493   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:09.870373   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:09.936101   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:09.936626   556 raft_consensus.cc:2410] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:14:09.894178  4267 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:09.941195   556 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:09.916265   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:09.894969  4415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.196s	user 0.017s	sys 0.005s
I20260709 13:14:09.916967   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1882) took 1764 ms. Trace:
I20260709 13:14:09.823704  4382 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:09.919071   447 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:09.779299  4393 consensus_queue.cc:260] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.878815  4121 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:09.827654  4398 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.885282  3810 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:09.937570  4372 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:09.903833  4436 log.cc:927] Time spent T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 1.202s	user 0.004s	sys 0.001s
I20260709 13:14:09.911222   476 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:09.987615   476 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:14:09.838557  4141 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:09.870246  4418 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:09.946983   627 rpcz_store.cc:276] 0709 13:14:08.152422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.902141 (+1749719us) service_pool.cc:224] Handling call
0709 13:14:09.902469 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:09.916751 (+ 14282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.916913 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:09.963644   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:10.006848   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:09.929137  4223 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:09.931771  4304 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:09.976505   556 raft_consensus.cc:1275] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:14:09.976954   633 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:09.933360  4292 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:09.903920  4377 consensus_meta.cc:287] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.699s	user 0.010s	sys 0.000s
I20260709 13:14:09.981189   522 leader_election.cc:400] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13.
I20260709 13:14:09.983858  3810 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:09.982618   475 raft_consensus.cc:1240] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:14:10.015166  4377 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:09.937520  4248 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.968946  4416 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:10.007717   554 raft_consensus.cc:606] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:10.009173   557 raft_consensus.cc:1275] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:10.013260   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:10.015733   522 leader_election.cc:403] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:09.981623   632 raft_consensus.cc:1240] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:10.016450   556 raft_consensus.cc:1240] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:09.944828  4387 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:14:09.983695  4442 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.985764  4393 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:09.972563  4415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.247s	user 0.017s	sys 0.005s
I20260709 13:14:10.021044  1170 raft_consensus.cc:1240] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:10.024102  4406 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:10.025230   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:10.067277   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:10.067828   629 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:10.068682  1139 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:10.026060   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:10.031733   481 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:10.011176  4361 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:10.080173   631 raft_consensus.cc:1275] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:14:10.080543   631 pending_rounds.cc:85] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 4
I20260709 13:14:10.080500   477 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:10.054944   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:10.013964  4364 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:10.061810   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 80814.4us
I20260709 13:14:10.015995  4292 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:10.080929   631 pending_rounds.cc:107] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:14:10.083772   631 raft_consensus.cc:2889] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:10.084183   522 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:10.019531  4338 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:10.084502   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1884) took 1900 ms. Trace:
I20260709 13:14:10.088794   631 rpcz_store.cc:276] 0709 13:14:08.184311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.070709 (+1886398us) service_pool.cc:224] Handling call
0709 13:14:10.079829 (+  9120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:10.084282 (+  4453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.084444 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:10.085644   522 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:14:10.081307  4344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.007s	sys 0.019s
I20260709 13:14:10.092844   629 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
W20260709 13:14:10.066207  4465 log.cc:927] Time spent T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.249s	user 0.001s	sys 0.001s
I20260709 13:14:10.102468  4347 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:10.103111  4413 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:10.108697   522 leader_election.cc:304] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:10.056669  4456 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:10.079434  4341 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:10.081645  4404 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13.
I20260709 13:14:10.140192   631 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:14:10.098971  4344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.008s	sys 0.019s
I20260709 13:14:10.100907   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1904) took 1401 ms. Trace:
I20260709 13:14:10.094180  4225 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:10.088361  4363 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:10.146855   629 rpcz_store.cc:276] 0709 13:14:08.699223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.099898 (+1400675us) service_pool.cc:224] Handling call
0709 13:14:10.100244 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:10.100452 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:10.100558 (+   106us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:10.100614 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:10.100658 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.100726 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:10.100843 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:10.104568  4405 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:10.147903   522 leader_election.cc:400] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12.
I20260709 13:14:10.053916  4248 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:10.118815  4436 log.cc:927] Time spent T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:14:10.061401  4442 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:10.017901  4345 consensus_queue.cc:260] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:10.116945  4234 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:10.182766   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2046) took 1342 ms. Trace:
I20260709 13:14:10.115640  4373 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:10.103997  4361 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:10.083573  4406 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:10.145807  4384 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:14:10.191521   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 381312us
I20260709 13:14:10.269394   597 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:10.195896   625 raft_consensus.cc:2368] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11.
I20260709 13:14:10.202055   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1875) took 2063 ms. Trace:
I20260709 13:14:10.271282   626 rpcz_store.cc:276] 0709 13:14:08.138121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.874564 (+1736443us) service_pool.cc:224] Handling call
0709 13:14:09.874877 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:10.201633 (+326756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:10.201667 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:10.201716 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:10.201749 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.201833 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:10.201973 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106132,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":19813,"thread_start_us":326344,"threads_started":1}
I20260709 13:14:10.204560   522 leader_election.cc:403] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:14:10.273964   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 126236us
I20260709 13:14:10.274864   522 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:10.219702   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 405558us
I20260709 13:14:10.187362  3933 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:10.185681  4341 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:10.188556  4225 raft_consensus.cc:697] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:10.243762   550 rpcz_store.cc:276] 0709 13:14:08.840839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.752978 (+912139us) service_pool.cc:224] Handling call
0709 13:14:09.753283 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:09.753463 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:14:09.796131 (+ 42668us) log.cc:844] Serialized 14 byte log entry
0709 13:14:10.182295 (+386164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:10.182345 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:10.182392 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.182474 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:10.182709 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36978,"prepare.queue_time_us":80988,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":39561,"spinlock_wait_cycles":5275904,"thread_start_us":348822,"threads_started":1}
I20260709 13:14:10.256950  4398 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:10.258148  1166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36724 (request call id 530) took 1450 ms. Trace:
I20260709 13:14:10.260572  4360 raft_consensus.cc:3055] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:10.308275   553 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:14:10.265501  1138 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:10.280877   599 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:10.281068   597 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:10.284438   626 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:14:10.309142  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 43747.7us
I20260709 13:14:10.309999   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1907) took 1608 ms. Trace:
I20260709 13:14:10.310247   553 pending_rounds.cc:85] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 8
I20260709 13:14:10.306806  1166 rpcz_store.cc:276] 0709 13:14:08.807689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.918267 (+110578us) service_pool.cc:224] Handling call
0709 13:14:10.257914 (+1339647us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b5400652f54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:10.258061 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1980358400}
I20260709 13:14:10.262866   632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1869) took 2126 ms. Trace:
I20260709 13:14:10.214737  4321 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:10.315284   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1859) took 1928 ms. Trace:
I20260709 13:14:10.311249   632 rpcz_store.cc:276] 0709 13:14:08.135948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.827095 (+1691147us) service_pool.cc:224] Handling call
0709 13:14:09.830018 (+  2923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:10.042462 (+212444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.262634 (+220172us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54001e3f54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:10.262793 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348184832}
I20260709 13:14:10.310765   553 pending_rounds.cc:107] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:14:10.315083   599 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:10.316151   522 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:10.316712   553 raft_consensus.cc:2889] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:10.315737   479 rpcz_store.cc:276] 0709 13:14:08.387120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.387252 (+   132us) service_pool.cc:224] Handling call
0709 13:14:08.387617 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:08.413003 (+ 25386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:08.413032 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:08.413570 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:14:08.519076 (+105506us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:08.562768 (+ 43692us) log.cc:844] Serialized 14 byte log entry
0709 13:14:08.563154 (+   386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.563222 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:09.723480 (+1160258us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:10.291311 (+567831us) raft_consensus.cc:1685] finished
0709 13:14:10.315059 (+ 23748us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:10.315204 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24955,"prepare.queue_time_us":43446,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":27163,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":4852,"spinlock_wait_cycles":67823488,"thread_start_us":105140,"threads_started":1,"wal-append.queue_time_us":258208}
I20260709 13:14:10.311020   626 rpcz_store.cc:276] 0709 13:14:08.702220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.273103 (+1570883us) service_pool.cc:224] Handling call
0709 13:14:10.273478 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:10.309653 (+ 36175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.309927 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:10.323339   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:10.325670   599 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:10.280158  4345 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:10.268384  4143 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.008s	sys 0.017s
I20260709 13:14:10.288635  4373 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:10.327327  4247 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:10.310027  4341 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:10.332846   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:10.307976  4414 consensus_queue.cc:1059] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 13:14:10.340103   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 421093us
I20260709 13:14:10.288189  4343 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12.
I20260709 13:14:10.347013   626 raft_consensus.cc:1240] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:14:10.353271   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1908) took 1424 ms. Trace:
I20260709 13:14:10.353652   626 rpcz_store.cc:276] 0709 13:14:08.928709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.321747 (+1393038us) service_pool.cc:224] Handling call
0709 13:14:10.346766 (+ 25019us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:10.353010 (+  6244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.353219 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:10.312479  4418 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:10.338865   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1883) took 2172 ms. Trace:
I20260709 13:14:10.356108   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:10.327672  4338 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:10.309181  4361 raft_consensus.cc:697] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:10.308097  4415 consensus_queue.cc:1059] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:14:10.323560  4324 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:10.323657  4234 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:10.357071   632 raft_consensus.cc:2393] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 11: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:10.308665  4360 raft_consensus.cc:740] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:10.356169   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:10.356539   633 rpcz_store.cc:276] 0709 13:14:08.166401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.912909 (+1746508us) service_pool.cc:224] Handling call
0709 13:14:09.913177 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:10.012985 (+ 99808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.338579 (+325594us) spinlock_profiling.cc:243] Waited 63.5 ms on lock 0x7b54002bbbd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:10.338793 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146124544}
I20260709 13:14:10.358773  1166 raft_consensus.cc:1240] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:10.383111   633 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:10.383906   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1818) took 1209 ms. Trace:
I20260709 13:14:10.384280   633 rpcz_store.cc:276] 0709 13:14:09.174129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.382563 (+1208434us) service_pool.cc:224] Handling call
0709 13:14:10.382885 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:10.383635 (+   750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.383847 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:10.386039   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:10.387413   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:10.388664   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:10.364768   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:10.314002  4267 consensus_queue.cc:1059] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:14:10.280867  4384 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:10.370719   626 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:10.486073   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1813) took 1313 ms. Trace:
I20260709 13:14:10.486548   626 rpcz_store.cc:276] 0709 13:14:09.172908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.354437 (+1181529us) service_pool.cc:224] Handling call
0709 13:14:10.370561 (+ 16124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:10.485744 (+115183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.486003 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:10.373250   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:10.327461  4141 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:10.470469  4344 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:10.374689  4247 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:10.465387   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:10.505115   476 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:10.461488   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:10.375205  4416 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:10.375319  4338 raft_consensus.cc:697] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:10.360868  4377 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:10.327474  4321 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:10.420248   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:10.534859   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:10.343747  4143 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.009s	sys 0.018s
W20260709 13:14:10.466248  4480 log.cc:927] Time spent T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:14:10.506484  4382 raft_consensus.cc:3055] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:10.489598   632 raft_consensus.cc:1240] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:10.481189  4429 raft_consensus.cc:3055] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:14:10.491220  4479 log.cc:927] Time spent T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
W20260709 13:14:10.478292  4470 log.cc:927] Time spent T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
W20260709 13:14:10.475487  4471 log.cc:927] Time spent T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.322s	user 0.000s	sys 0.002s
I20260709 13:14:10.492064  4361 consensus_queue.cc:237] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:10.492751  4473 log.cc:927] Time spent T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:14:10.491964  4405 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:10.495417  4442 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:10.496344  4478 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 13:14:10.496644  4469 log.cc:927] Time spent T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 13:14:10.471264  4482 raft_consensus.cc:2804] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:10.347705  4373 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.502884  4384 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:10.495628  4475 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
W20260709 13:14:10.521476  1174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.033s	sys 0.043s
W20260709 13:14:10.511281  4474 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 13:14:10.523226  4141 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:10.515419  4247 raft_consensus.cc:697] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:10.533937  4369 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.473353  4225 consensus_queue.cc:237] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:10.536631  4121 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:10.506565  4344 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:10.541213  4382 raft_consensus.cc:740] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:10.543293  4429 raft_consensus.cc:740] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:10.554102  4248 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:10.537380  4450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.002s	sys 0.038s
I20260709 13:14:10.572825  4373 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:10.576608  4406 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:10.549197  4360 consensus_queue.cc:260] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:10.587380  4341 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:10.507311   448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.030s	sys 0.041s
I20260709 13:14:10.679713  4494 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:14:10.644248   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:10.687584  4494 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:10.508064   479 raft_consensus.cc:2393] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 11: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:10.643532   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1870) took 1504 ms. Trace:
I20260709 13:14:10.546136   483 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:10.690414  4494 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:10.688879   478 rpcz_store.cc:276] 0709 13:14:09.139026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.400590 (+261564us) service_pool.cc:224] Handling call
0709 13:14:09.401010 (+   420us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:09.401397 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:09.401428 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:09.402057 (+   629us) log.cc:844] Serialized 52 byte log entry
0709 13:14:09.872884 (+470827us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:09.924259 (+ 51375us) log.cc:844] Serialized 14 byte log entry
0709 13:14:10.359864 (+435605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.359949 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:10.642281 (+282332us) raft_consensus.cc:1685] finished
0709 13:14:10.642378 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:10.642957 (+   579us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48261,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":4521,"raft.queue_time_us":81209,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":8561,"thread_start_us":899281,"threads_started":2,"wal-append.queue_time_us":669653}
W20260709 13:14:10.547326   484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.022s	sys 0.013s
W20260709 13:14:10.691671   484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.022s	sys 0.013s
I20260709 13:14:10.670949  4121 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:10.606963  4382 consensus_queue.cc:260] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:10.695363   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:10.649333   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2036) took 2072 ms. Trace:
I20260709 13:14:10.530592   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:10.528927   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2048) took 1635 ms. Trace:
I20260709 13:14:10.530370   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:10.708087  4488 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.708897   553 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:10.709223  4488 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:10.709856   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:10.577752  1174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.033s	sys 0.044s
I20260709 13:14:10.712877  1174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 602) took 1024 ms. Trace:
I20260709 13:14:10.704906   559 rpcz_store.cc:276] 0709 13:14:08.893567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.755133 (+861566us) service_pool.cc:224] Handling call
0709 13:14:09.755429 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:09.755626 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:10.082733 (+327107us) log.cc:844] Serialized 14 byte log entry
0709 13:14:10.528549 (+445816us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:10.528611 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:10.528660 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.528732 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:10.528863 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48453,"prepare.queue_time_us":139118,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":5919,"raft.queue_time_us":4229,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6816,"thread_start_us":689612,"threads_started":2,"wal-append.queue_time_us":514901}
W20260709 13:14:10.652105   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 285074us
I20260709 13:14:10.653366   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 520) took 2856 ms. Trace:
I20260709 13:14:10.541165   632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1820) took 1366 ms. Trace:
W20260709 13:14:10.532035  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 448159us
I20260709 13:14:10.586339  4369 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:10.660267  4162 raft_consensus.cc:3055] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:10.735244  4162 raft_consensus.cc:740] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:10.736830  4162 consensus_queue.cc:260] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:10.737793  4369 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:10.738245  4162 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:10.600548  4429 consensus_queue.cc:260] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:10.739741  4429 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:10.741178  4347 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:14:10.743213   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:10.743330   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:10.744099   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:10.746611   597 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:10.665294  4248 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:10.748118  4248 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:10.666297  4247 consensus_queue.cc:237] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:10.589224  4482 raft_consensus.cc:697] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:14:10.600273  4487 log.cc:927] Time spent T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:14:10.755867  4488 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:10.756105  4482 consensus_queue.cc:237] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:10.756934   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1955) took 1545 ms. Trace:
I20260709 13:14:10.757443   551 rpcz_store.cc:276] 0709 13:14:09.211444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.772814 (+561370us) service_pool.cc:224] Handling call
0709 13:14:09.823979 (+ 51165us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:09.829004 (+  5025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:09.829033 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:09.856828 (+ 27795us) log.cc:844] Serialized 26 byte log entry
0709 13:14:10.240383 (+383555us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:10.240442 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.240539 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:10.756515 (+515976us) raft_consensus.cc:1685] finished
0709 13:14:10.756553 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:10.756725 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7922,"raft.queue_time_us":5131,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":7211,"thread_start_us":315061,"threads_started":1,"wal-append.queue_time_us":622925}
W20260709 13:14:10.760401  4223 consensus_meta.cc:287] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.742s	user 0.014s	sys 0.006s
I20260709 13:14:10.764544  4223 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:10.766918   557 raft_consensus.cc:1240] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 11. Ops: []
I20260709 13:14:10.766845  4415 raft_consensus.cc:3055] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:10.767745  4415 raft_consensus.cc:740] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:10.769716   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2057) took 1350 ms. Trace:
I20260709 13:14:10.769241  4415 consensus_queue.cc:260] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:10.770182   557 rpcz_store.cc:276] 0709 13:14:09.419332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.080901 (+661569us) service_pool.cc:224] Handling call
0709 13:14:10.104233 (+ 23332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:10.767660 (+663427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.769397 (+  1737us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b54000eb354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:10.769621 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1523146112}
W20260709 13:14:10.593377  4450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.005s	sys 0.038s
I20260709 13:14:10.583891  4141 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:10.674978   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1990) took 1886 ms. Trace:
I20260709 13:14:10.675612  4495 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:10.676580  4498 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.601454  4360 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:10.810065  4467 log.cc:927] Time spent T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.804s	user 0.006s	sys 0.000s
I20260709 13:14:10.579440  4338 consensus_queue.cc:237] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:10.811896  4508 raft_consensus.cc:2764] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:14:10.812552   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 1997) took 2021 ms. Trace:
I20260709 13:14:10.812927   477 rpcz_store.cc:276] 0709 13:14:08.790857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.929959 (+139102us) service_pool.cc:224] Handling call
0709 13:14:08.930193 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:10.080992 (+1150799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.812015 (+731023us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002dcb54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:10.812357 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2645013248}
I20260709 13:14:10.814170  4498 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:10.817031  4498 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:10.818645  4495 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:10.819958   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:10.820648   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:10.821585  4495 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:10.665339  4406 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:10.823442  4406 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:10.826645  4248 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:10.829988   625 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1893) took 2266 ms (client timeout 2686 ms). Trace:
I20260709 13:14:10.830484   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:10.683791  4321 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:10.685962  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:10.686825   448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.030s	sys 0.041s
W20260709 13:14:10.646932   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 321191us
I20260709 13:14:10.696784  4382 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:10.700402  4121 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:10.697460   558 rpcz_store.cc:276] 0709 13:14:08.576646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.594415 (+1017769us) service_pool.cc:224] Handling call
0709 13:14:09.594742 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:09.595099 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:09.595129 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:09.618970 (+ 23841us) log.cc:844] Serialized 26 byte log entry
0709 13:14:10.037993 (+419023us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:10.094595 (+ 56602us) log.cc:844] Serialized 14 byte log entry
0709 13:14:10.094791 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.094867 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:10.648604 (+553737us) raft_consensus.cc:1685] finished
0709 13:14:10.648640 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:10.648952 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2297,"prepare.queue_time_us":55321,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":35940,"raft.run_cpu_time_us":6000,"raft.run_wall_time_us":53269,"thread_start_us":298066,"threads_started":1,"wal-append.queue_time_us":608131}
I20260709 13:14:10.718146  4399 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:10.718094   632 rpcz_store.cc:276] 0709 13:14:09.174580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.386266 (+1211686us) service_pool.cc:224] Handling call
0709 13:14:10.489301 (+103035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:10.540060 (+ 50759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.541102 (+  1042us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:10.718834   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 499) took 1413 ms. Trace:
I20260709 13:14:10.715626   624 rpcz_store.cc:276] 0709 13:14:07.796487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.797489 (+2001002us) service_pool.cc:224] Handling call
0709 13:14:09.858318 (+ 60829us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:09.858785 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:09.858811 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:09.859226 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:14:10.362779 (+503553us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:10.362817 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.362887 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:10.652778 (+289891us) raft_consensus.cc:1685] finished
0709 13:14:10.652814 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:10.653114 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":6530,"thread_start_us":420913,"threads_started":1,"wal-append.queue_time_us":670807}
I20260709 13:14:10.718199   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:10.724721   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 516) took 3132 ms. Trace:
I20260709 13:14:10.716037  4344 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:10.730333  3810 consensus_meta.cc:287] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.690s	user 0.018s	sys 0.002s
I20260709 13:14:10.731594  4365 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:10.754400   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 1872) took 1565 ms. Trace:
I20260709 13:14:10.713513  1174 rpcz_store.cc:276] 0709 13:14:09.687933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.735526 (+ 47593us) service_pool.cc:224] Handling call
0709 13:14:09.735827 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:09.736190 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:09.736219 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:09.736657 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:14:10.712005 (+975348us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:10.712107 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.712275 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:10.712350 (+    75us) raft_consensus.cc:1685] finished
0709 13:14:10.712376 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:10.712616 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3270,"raft.queue_time_us":4000,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":2005,"thread_start_us":914506,"threads_started":1,"wal-append.queue_time_us":837944}
I20260709 13:14:10.778118   553 raft_consensus.cc:2410] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:10.785409   555 raft_consensus.cc:1240] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:10.787101  4223 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:10.771215  4415 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:10.806227  4141 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:10.802034   480 rpcz_store.cc:276] 0709 13:14:08.788717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.922180 (+133463us) service_pool.cc:224] Handling call
0709 13:14:08.922953 (+   773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:09.879122 (+956169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.674182 (+795060us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b5400370fd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:10.674699 (+   517us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2099615616}
I20260709 13:14:10.856585   478 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:14:10.836491   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 90070.8us
W20260709 13:14:10.880152  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:10.850571   550 raft_consensus.cc:2410] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:14:10.851408   554 raft_consensus.cc:1275] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:14:10.859933   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1903) took 2160 ms. Trace:
I20260709 13:14:10.858282   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 2006) took 2064 ms. Trace:
W20260709 13:14:10.885087   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 113497us
W20260709 13:14:10.852352  4472 log.cc:927] Time spent T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.769s	user 0.003s	sys 0.001s
I20260709 13:14:11.013648   479 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:10.835593   557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:14:11.016827  3810 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:11.018277   626 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:10.827055  4406 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:11.020560   475 raft_consensus.cc:1240] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:14:11.021418   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 524) took 1433 ms. Trace:
I20260709 13:14:11.021929   626 rpcz_store.cc:276] 0709 13:14:09.587660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.487590 (+899930us) service_pool.cc:224] Handling call
0709 13:14:10.513058 (+ 25468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.018684 (+505626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.021046 (+  2362us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b54000af854. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:11.021345 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1161154432}
I20260709 13:14:11.023355   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:11.024185   626 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:14:11.025863   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:11.008548   482 rpcz_store.cc:276] 0709 13:14:09.189382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.723820 (+534438us) service_pool.cc:224] Handling call
0709 13:14:09.724168 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:09.724502 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:14:09.773151 (+ 48649us) log.cc:844] Serialized 14 byte log entry
0709 13:14:10.251699 (+478548us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b18003f31c0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb923a 00007f4b68423a2a
0709 13:14:10.646162 (+394463us) log.cc:844] Serialized 14 byte log entry
0709 13:14:10.646386 (+   224us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:10.651311 (+  4925us) log.cc:844] Serialized 26 byte log entry
0709 13:14:10.651515 (+   204us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:10.651632 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.651826 (+   194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:10.754052 (+102226us) raft_consensus.cc:1685] finished
0709 13:14:10.754081 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:10.754237 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":54460,"prepare.run_cpu_time_us":152,"prepare.run_wall_time_us":155,"raft.queue_time_us":27095,"raft.run_cpu_time_us":569,"raft.run_wall_time_us":10147,"spinlock_wait_cycles":10845440,"thread_start_us":393097,"threads_started":1,"wal-append.queue_time_us":801906}
I20260709 13:14:10.849548  4398 raft_consensus.cc:3055] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:14:10.830669   625 rpcz_store.cc:269] 0709 13:14:08.563741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.580149 (+1016408us) service_pool.cc:224] Handling call
0709 13:14:10.829421 (+1249272us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54002bb6d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:10.829683 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1037377408}
I20260709 13:14:10.972806   559 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:11.009047   631 rpcz_store.cc:276] 0709 13:14:08.698933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.089642 (+1390709us) service_pool.cc:224] Handling call
0709 13:14:10.096402 (+  6760us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:10.145108 (+ 48706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.859265 (+714157us) spinlock_profiling.cc:243] Waited 43.5 ms on lock 0x7b54001aefd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:10.859710 (+   445us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99973504}
I20260709 13:14:10.845350   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 628) took 1048 ms. Trace:
I20260709 13:14:10.852752   525 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:11.010532   483 rpcz_store.cc:276] 0709 13:14:08.793556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.975587 (+182031us) service_pool.cc:224] Handling call
0709 13:14:08.975936 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:10.690509 (+1714573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.857652 (+167143us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54000d4dd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:10.858050 (+   398us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3610663168}
W20260709 13:14:11.056159  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 289689us
I20260709 13:14:11.057215  4399 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:11.057816  4399 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:10.835776  4248 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.881809   552 rpcz_store.cc:276] 0709 13:14:09.305334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.861969 (+556635us) service_pool.cc:224] Handling call
0709 13:14:09.862233 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:09.903766 (+ 41533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.718280 (+814514us) spinlock_profiling.cc:243] Waited 40.9 ms on lock 0x7b5400346a54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:10.718626 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94036736}
I20260709 13:14:10.970901   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:10.961500   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:10.965488  4345 consensus_meta.cc:287] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.009s
W20260709 13:14:10.962162   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 1.04884e+06us
I20260709 13:14:10.843398  4267 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.059161  4248 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.071954   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:11.053077  4398 raft_consensus.cc:740] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:10.882300   630 rpcz_store.cc:276] 0709 13:14:07.592004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.790780 (+2198776us) service_pool.cc:224] Handling call
0709 13:14:09.791097 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:09.791346 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:10.245518 (+454172us) log.cc:844] Serialized 14 byte log entry
0709 13:14:10.723910 (+478392us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:10.724047 (+   137us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:10.724157 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.724291 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:10.724467 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":749299,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":1744,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":294,"thread_start_us":804944,"threads_started":2,"wal-append.queue_time_us":363806}
I20260709 13:14:11.081947  4267 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.084918  4267 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:11.085985   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 233506us
W20260709 13:14:11.086575  4393 consensus_meta.cc:287] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 1.025s	user 0.008s	sys 0.015s
I20260709 13:14:11.087015   525 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:11.087437  4497 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:11.087738   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.088256  4497 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:10.971324  4373 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:11.090243   525 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:11.091522  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 95878.6us
W20260709 13:14:11.093716  4292 consensus_meta.cc:287] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.977s	user 0.023s	sys 0.009s
I20260709 13:14:11.094240  4292 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.095486   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:11.095638   628 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:14:11.095577   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 137280us
I20260709 13:14:11.078594   624 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:11.094888  1141 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:11.103899   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1957) took 1296 ms. Trace:
I20260709 13:14:11.098861   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:10.960631  4499 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 13:14:11.090847   448 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:11.116915  4292 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:11.117527   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:11.132048  4499 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.132357   525 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:11.132663   630 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:11.091111  4373 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:11.132838  4499 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:11.134483  3810 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:11.120177   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.136554   628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1878) took 2994 ms. Trace:
W20260709 13:14:11.120903   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.136930  4248 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:11.136965   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 219151us
I20260709 13:14:11.137805   627 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:11.138538  4499 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:11.139356   632 raft_consensus.cc:2393] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 12: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:11.140724  4223 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:11.141148  4499 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:11.142669   632 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:14:11.143890   626 raft_consensus.cc:2393] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:11.145328   626 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:14:11.123715   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 53658us
I20260709 13:14:11.146415   597 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:11.147471   599 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:11.148085   597 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:11.124678  4345 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:11.148408  4292 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:11.149257  4345 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:11.149938  4345 raft_consensus.cc:697] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:11.149397  4292 consensus_queue.cc:1059] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:11.150641   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1823) took 1216 ms. Trace:
I20260709 13:14:11.151661  4365 raft_consensus.cc:3055] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:11.152088  4365 raft_consensus.cc:740] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:11.136926   628 rpcz_store.cc:276] 0709 13:14:08.142094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.891668 (+1749574us) service_pool.cc:224] Handling call
0709 13:14:09.925699 (+ 34031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.117509 (+1191810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.136299 (+ 18790us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001612d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:11.136475 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2689456384}
I20260709 13:14:11.153362  4365 consensus_queue.cc:260] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.154430  4248 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.154745  4365 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:11.126719  4497 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:11.155056  4248 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.155753  4267 consensus_queue.cc:1059] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:14:11.127352  4304 consensus_meta.cc:287] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.108s	user 0.004s	sys 0.020s
I20260709 13:14:11.156705  4267 raft_consensus.cc:3055] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:11.157176  4267 raft_consensus.cc:740] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:11.157428  4248 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:11.157013  4304 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:11.126406  4372 consensus_meta.cc:287] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 1.119s	user 0.013s	sys 0.017s
I20260709 13:14:11.159631  4372 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:11.159802   629 raft_consensus.cc:1240] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:11.151069   627 rpcz_store.cc:276] 0709 13:14:09.934597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.054671 (+120074us) service_pool.cc:224] Handling call
0709 13:14:11.150407 (+1095736us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400123754. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:11.150558 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2340505984}
I20260709 13:14:11.162156   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1906) took 2460 ms. Trace:
I20260709 13:14:11.162312  4372 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:11.158499  4267 consensus_queue.cc:260] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.129619  4162 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:11.130267  4413 consensus_queue.cc:1059] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:11.151031   522 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:11.163486   481 raft_consensus.cc:1240] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:11.164490  4267 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:11.164645   522 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:11.164994   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 633) took 1093 ms. Trace:
I20260709 13:14:11.165050   525 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:11.165496   481 rpcz_store.cc:276] 0709 13:14:10.071100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.072328 (+  1228us) service_pool.cc:224] Handling call
0709 13:14:10.072609 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.163978 (+1091369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.164752 (+   774us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400370ad4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:11.164940 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2507844480}
I20260709 13:14:11.166177  4406 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:11.166554  4406 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:11.155782  4497 consensus_queue.cc:1059] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:14:11.167923  4497 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:11.145251  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:11.169247  4162 raft_consensus.cc:3055] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:11.169745  4162 raft_consensus.cc:740] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:11.095912  4277 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:14:11.171044  4304 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:11.167011  4406 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:11.173447  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:11.173566  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:11.129303  4192 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.175045  4192 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:11.175742  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:11.151062  4345 consensus_queue.cc:237] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.176417  1170 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:11.177404  4192 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:11.121158  4398 consensus_queue.cc:260] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.163010   627 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:14:11.153815   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:11.054350   484 rpcz_store.cc:276] 0709 13:14:09.796800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.938419 (+141619us) service_pool.cc:224] Handling call
0709 13:14:09.938771 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:09.985633 (+ 46862us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:10.002826 (+ 17193us) log.cc:844] Serialized 14 byte log entry
0709 13:14:10.692429 (+689603us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:10.692537 (+   108us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:10.692686 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.844915 (+152229us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b54000d57d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:10.844985 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:10.845242 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17845,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":4901,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":2720,"spinlock_wait_cycles":107253504,"thread_start_us":689016,"threads_started":1,"wal-append.queue_time_us":600305}
I20260709 13:14:11.104283   555 rpcz_store.cc:276] 0709 13:14:09.807688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.088550 (+280862us) service_pool.cc:224] Handling call
0709 13:14:10.118589 (+ 30039us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.014872 (+896283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.065373 (+ 50501us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54000ec754. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:11.103832 (+ 38459us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1507993856}
I20260709 13:14:11.162635   629 rpcz_store.cc:276] 0709 13:14:08.701394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.156455 (+1455061us) service_pool.cc:224] Handling call
0709 13:14:10.202867 (+ 46412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.160823 (+957956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.161768 (+   945us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b54001608d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:11.162079 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2199592192}
I20260709 13:14:11.156909   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1910) took 1549 ms. Trace:
I20260709 13:14:11.095204  4273 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.182559   631 rpcz_store.cc:276] 0709 13:14:09.607675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.155835 (+1548160us) service_pool.cc:224] Handling call
0709 13:14:11.156241 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.156545 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:11.156578 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:11.156623 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:11.156679 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.156739 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:11.156835 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:11.186053   632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 528) took 1593 ms. Trace:
I20260709 13:14:11.171011   597 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:11.186434   632 rpcz_store.cc:276] 0709 13:14:09.588822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.141875 (+1553053us) service_pool.cc:224] Handling call
0709 13:14:11.142358 (+   483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:11.143112 (+   754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.182386 (+ 39274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:11.181455   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:11.185779   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1911) took 1574 ms. Trace:
I20260709 13:14:11.200659   627 rpcz_store.cc:276] 0709 13:14:09.608045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.161985 (+1553940us) service_pool.cc:224] Handling call
0709 13:14:11.162586 (+   601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.178967 (+ 16381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.182241 (+  3274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:11.199103   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:11.202291   624 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:11.198670   525 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:11.211696   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 47162.6us
I20260709 13:14:11.215514   522 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:11.098330  4348 consensus_queue.cc:1059] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:14:11.217067  4304 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.219043  4304 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.221239  4304 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:11.222723   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:11.225163  1170 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:11.170877  4162 consensus_queue.cc:260] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:11.198305  4497 raft_consensus.cc:3055] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:11.203720  4273 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:11.231602   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 60708us
I20260709 13:14:11.232437  4273 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:11.233265  4343 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:11.233785   597 leader_election.cc:400] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11.
I20260709 13:14:11.234007  4343 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:11.234506  4343 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:11.234891  4343 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:11.234717  4064 consensus_queue.cc:1059] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:11.235962  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:11.237272  4453 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:11.237612   624 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:11.237735  4453 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:11.238190  4453 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:11.238664   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:11.239333   624 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
I20260709 13:14:11.240267   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:11.241101   624 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
I20260709 13:14:11.242381   624 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:14:11.231069   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 140381us
I20260709 13:14:11.234141   597 leader_election.cc:403] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:14:11.245558  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:11.214911  4344 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.210467  4498 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:14:11.251681  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 114851us
I20260709 13:14:11.257397   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:11.250258  4429 consensus_meta.cc:287] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.510s	user 0.012s	sys 0.007s
I20260709 13:14:11.257736   523 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:11.247611  4162 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:11.267499  4384 consensus_meta.cc:287] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.667s	user 0.009s	sys 0.013s
I20260709 13:14:11.267788   522 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:11.271513  1173 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
W20260709 13:14:11.279126   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.280764  4347 raft_consensus.cc:3055] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:11.281759  4183 raft_consensus.cc:3055] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:11.282860   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:11.250981  4248 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:11.283704   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:11.290302   550 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:11.284052   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:11.285835   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 104783us
I20260709 13:14:11.245683  4497 raft_consensus.cc:740] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:11.283375   555 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:11.288656   626 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:11.255016  4498 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:11.265684  4506 raft_consensus.cc:2749] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11.
I20260709 13:14:11.289749   484 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:11.278589  4399 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:11.296792   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 529) took 1703 ms. Trace:
I20260709 13:14:11.299077   626 rpcz_store.cc:276] 0709 13:14:09.589138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.144732 (+1555594us) service_pool.cc:224] Handling call
0709 13:14:11.145132 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.291966 (+146834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.292232 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:11.297780  1174 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:11.303556   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:11.306321   554 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:11.307054   553 raft_consensus.cc:2393] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 11: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:11.289595  4183 raft_consensus.cc:740] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:11.287952  4347 raft_consensus.cc:740] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:11.290009  4248 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:11.314261   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:11.312731   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 530) took 1677 ms. Trace:
I20260709 13:14:11.294314  4508 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:11.298007  4498 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:11.314060   559 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:11.315557   631 rpcz_store.cc:276] 0709 13:14:09.630454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.185112 (+1554658us) service_pool.cc:224] Handling call
0709 13:14:11.247498 (+ 62386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.302343 (+ 54845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:11.302361 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:11.307966 (+  5605us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:11.308063 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.308122 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:11.308223 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:11.301311  4321 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:11.318852   633 raft_consensus.cc:1240] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:14:11.320574  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:11.323580  1166 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
W20260709 13:14:11.321782   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:11.327345   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 69686.3us
I20260709 13:14:11.324270   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:11.326970   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:11.296253  4192 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:14:11.311800  4304 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.316987  4248 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:11.285475  4344 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:11.335644   558 raft_consensus.cc:2410] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:11.319334  3810 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:11.296372  4384 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.346529   523 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:11.318861  4225 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:11.345335   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:11.350534   632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 531) took 1410 ms. Trace:
I20260709 13:14:11.355274  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:11.356899   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1830) took 1026 ms. Trace:
I20260709 13:14:11.357323   625 rpcz_store.cc:276] 0709 13:14:10.330810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.308869 (+978059us) service_pool.cc:224] Handling call
0709 13:14:11.322792 (+ 13923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.356572 (+ 33780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:11.356611 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:11.356654 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:11.356687 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.356741 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:11.356838 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:11.353668   632 rpcz_store.cc:276] 0709 13:14:09.940193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.218421 (+1278228us) service_pool.cc:224] Handling call
0709 13:14:11.298355 (+ 79934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.336811 (+ 38456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:11.336842 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:11.336885 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:11.350265 (+ 13380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.350351 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:11.350480 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14796,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5794}
I20260709 13:14:11.363057   552 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:11.364871   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.366314  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:11.366564  4520 consensus_queue.cc:1059] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:11.377094  4521 raft_consensus.cc:3055] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:11.377620  4521 raft_consensus.cc:740] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
W20260709 13:14:11.379902  4518 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:14:11.376029   447 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:11.386042   631 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:14:11.374366  1138 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:11.383765   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 527) took 1795 ms. Trace:
I20260709 13:14:11.386415   631 pending_rounds.cc:85] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 8
I20260709 13:14:11.351082  4304 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:11.392299   630 rpcz_store.cc:276] 0709 13:14:09.588514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.133498 (+1544984us) service_pool.cc:224] Handling call
0709 13:14:11.133943 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:11.134500 (+   557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:11.134540 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:11.135174 (+   634us) log.cc:844] Serialized 26 byte log entry
0709 13:14:11.317538 (+182364us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:11.317591 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.317686 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:11.383550 (+ 65864us) raft_consensus.cc:1685] finished
0709 13:14:11.383568 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:11.383709 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":819,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":115,"thread_start_us":179103,"threads_started":1,"wal-append.queue_time_us":240070}
I20260709 13:14:11.402027   558 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:11.396384  1138 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:14:11.400169   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 60336.4us
I20260709 13:14:11.401823   631 pending_rounds.cc:107] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:14:11.412245   631 raft_consensus.cc:2889] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:11.417196   626 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:11.351204  4497 consensus_queue.cc:260] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.389942  4225 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:11.443835   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 100643us
I20260709 13:14:11.444475  4225 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.444993  4225 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.445792   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:11.447367  4360 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:11.447774  4360 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:11.448123  4495 consensus_queue.cc:1059] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:11.448868  4495 consensus_queue.cc:1243] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:14:11.449436  4495 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:11.449802  4398 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:11.451304   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:11.447597  4273 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:11.452275  4393 raft_consensus.cc:3055] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:11.452680  4393 raft_consensus.cc:740] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:11.453011   476 raft_consensus.cc:2410] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:11.452947  4064 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:11.453497  4393 consensus_queue.cc:260] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.454777  4393 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:11.406486  4277 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:11.456321  4277 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:11.456784  4482 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.456996   597 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:11.457211   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:11.457396  4482 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:11.373843  4183 consensus_queue.cc:260] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:11.427461  4363 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:11.436745   556 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:14:11.436959   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 171365us
I20260709 13:14:11.439530  4450 consensus_queue.cc:1059] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:11.441913  4451 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.442750  4413 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:11.443115  4453 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.487475  4453 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:11.487519   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:11.489662   478 raft_consensus.cc:1240] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:11.461884   555 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
I20260709 13:14:11.458252   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:11.492733   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:11.472606  4406 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.494756  4406 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:11.472054   559 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:11.416164  4399 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:11.501333   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.456787  4277 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:11.503283   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.447093  4225 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:11.448133  4360 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:11.505962   558 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:14:11.508407   557 raft_consensus.cc:606] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:11.508970   557 raft_consensus.cc:614] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:11.510311   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:11.498169   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:11.451052  4495 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 13:14:11.480836  4518 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:14:11.379029  4521 consensus_queue.cc:260] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:11.520920   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:11.529451   552 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
W20260709 13:14:11.535157  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:11.559478   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 45368.4us
W20260709 13:14:11.563613   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 117809us
I20260709 13:14:11.528975  4225 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:11.550524  4141 raft_consensus.cc:3055] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:11.574086   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:11.577108   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1826) took 1636 ms. Trace:
I20260709 13:14:11.526551  4321 raft_consensus.cc:697] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:11.584612   559 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:11.500347  4451 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:11.572638  4497 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:11.464671  4347 consensus_queue.cc:260] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:11.559183  4372 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:11.564935  4406 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:11.591470  4523 log.cc:927] Time spent T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:14:11.591933  4344 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:11.592100  4321 consensus_queue.cc:237] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:11.592953  4482 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:11.585966   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 127747us
W20260709 13:14:11.600910  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 99980.4us
I20260709 13:14:11.616755   550 raft_consensus.cc:2410] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:14:11.581480  4183 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:11.618194  1169 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:11.578177  4141 raft_consensus.cc:740] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:14:11.632059  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:11.632829  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.620963  4162 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:11.633579  4162 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:11.633240  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.636179  4162 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:11.631524  4141 consensus_queue.cc:260] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.637600  4141 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:11.600551  4384 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:11.652217   597 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:11.652902  4384 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:11.653561   597 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:11.648063   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1828) took 1712 ms. Trace:
I20260709 13:14:11.577894  4498 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:11.657037  4372 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:11.654623   627 rpcz_store.cc:276] 0709 13:14:09.935897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.201469 (+1265572us) service_pool.cc:224] Handling call
0709 13:14:11.225273 (+ 23804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.263061 (+ 37788us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:11.407380 (+144319us) log.cc:844] Serialized 14 byte log entry
0709 13:14:11.647727 (+240347us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:11.647777 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:11.647819 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.647895 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:11.648005 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":302899,"prepare.run_cpu_time_us":191,"prepare.run_wall_time_us":173,"raft.queue_time_us":99,"thread_start_us":272529,"threads_started":2}
I20260709 13:14:11.668033  4536 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:11.670142  4247 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:11.671846   559 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:11.672519  4482 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:11.674098   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:11.674911   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1832) took 1343 ms. Trace:
I20260709 13:14:11.675431   626 rpcz_store.cc:276] 0709 13:14:10.331505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.322120 (+990615us) service_pool.cc:224] Handling call
0709 13:14:11.339794 (+ 17674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.417721 (+ 77927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.674695 (+256974us) spinlock_profiling.cc:243] Waited 76.9 ms on lock 0x7b54001e3a54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:11.674856 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176958720}
W20260709 13:14:11.677420   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.674726   627 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:11.685683  4451 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:11.685843   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:11.687094   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:11.687646   627 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:11.687783  4450 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:11.688364  4450 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.690476  4450 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:11.693481   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:11.694072   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:11.694303   477 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
I20260709 13:14:11.648397  4292 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:11.614076  4529 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:11.695211   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:11.710983   550 raft_consensus.cc:1240] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:14:11.695524   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:11.712642   626 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:11.610852  4225 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.697623   627 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:14:11.735249   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:11.726944  1141 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:14:11.706323   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.727996   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:11.737030   626 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:11.708731   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 92453.9us
W20260709 13:14:11.748639   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.752562   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:11.753012   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:11.710148  4498 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:11.768424   448 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:11.703434  4304 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:11.653592  4384 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.767923   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:11.774375   627 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:11.700057  4539 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:11.772652   632 raft_consensus.cc:2368] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11.
I20260709 13:14:11.700862  4162 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
W20260709 13:14:11.773216  4535 log.cc:927] Time spent T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:14:11.789975   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:11.790777   632 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
W20260709 13:14:11.773394  4365 consensus_meta.cc:287] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.602s	user 0.011s	sys 0.000s
I20260709 13:14:11.707031  4183 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:14:11.776755   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:11.752828  4415 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:11.793411   523 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:14:11.805006  4532 log.cc:927] Time spent T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:14:11.708439  4537 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:11.805747  4537 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.758373  4347 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:11.801923   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 43741.6us
I20260709 13:14:11.799207   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:11.807870   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:11.710179  4406 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:11.814525   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.816656   625 raft_consensus.cc:2410] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:14:11.820317  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:11.728981  4121 consensus_queue.cc:1059] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:14:11.707999  4343 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:11.821070   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 163196us
I20260709 13:14:11.822235   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:11.828513   632 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:11.829041   599 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:11.830142  4338 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:11.830570  4338 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:11.830826   476 raft_consensus.cc:1275] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:14:11.831071  4533 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:11.831590  4533 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:11.728549  4529 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.831919  4533 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:11.833631  4529 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:11.830945  4338 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:11.806941  4415 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:11.836589   481 raft_consensus.cc:2410] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:14:11.853451   626 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:11.854665  4415 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:11.822914  4429 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.858100  4429 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.858973 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:11.801410  4453 consensus_queue.cc:1059] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:14:11.860424  4429 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:11.861692  4537 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:11.862579   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:11.823189  4539 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:11.858742  4538 log.cc:927] Time spent T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:14:11.891016   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:11.896674  4248 consensus_meta.cc:287] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.000s
I20260709 13:14:11.897163  4248 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.898520  4539 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:11.907006   630 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:11.909705   597 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:11.881584  4365 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:11.883605  4453 consensus_queue.cc:1243] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:14:11.922605   599 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:11.899159  4248 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:11.929586  4543 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:11.930151  4543 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:11.930496  4543 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:11.931298  4453 consensus_queue.cc:1048] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:14:11.913374  4373 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.932364  4373 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.934391  4373 leader_election.cc:290] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:11.881584  4415 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:11.935739  4372 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:11.936969  4415 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:11.938179   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:11.939040   553 raft_consensus.cc:2410] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:11.883740  4141 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
W20260709 13:14:11.949520  4382 consensus_meta.cc:287] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.978s	user 0.011s	sys 0.008s
W20260709 13:14:11.953828   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 126589us
I20260709 13:14:11.901491  4277 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:11.938735  4338 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:11.960880   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:11.942015  4495 raft_consensus.cc:3055] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:11.962054   553 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:11.970050   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.950073  4372 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.976238   628 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:11.985289  1173 raft_consensus.cc:1240] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:14:11.986275   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 70284.6us
I20260709 13:14:11.958865  4451 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:11.988221   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 175506us
I20260709 13:14:11.990852  1174 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:11.960855  4247 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:11.968756  4495 raft_consensus.cc:740] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:14:11.994088  4393 consensus_meta.cc:287] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.538s	user 0.012s	sys 0.000s
I20260709 13:14:12.011302   632 raft_consensus.cc:1275] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:12.004817  4225 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:11.987703  4372 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:12.044821   477 raft_consensus.cc:1240] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:12.044937  4372 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:11.996634  4415 consensus_queue.cc:1059] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:14:12.031152  4541 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:12.046015  4415 raft_consensus.cc:3055] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:12.046375  4415 raft_consensus.cc:740] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:12.046489  4541 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:12.047325  4415 consensus_queue.cc:260] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:12.048939  4398 consensus_meta.cc:287] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.599s	user 0.000s	sys 0.010s
I20260709 13:14:12.049589   631 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:12.049717  4541 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:12.032327  4406 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:12.033427  4495 consensus_queue.cc:260] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:12.051640  4495 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:12.052589  4277 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:12.034933  4533 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:12.055675   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:12.056429   559 raft_consensus.cc:2393] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 11: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:12.057076  4533 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:12.003616  4292 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 13:14:12.036957  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.060359  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:12.061172  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:12.061497  4338 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:12.008052  4248 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.041777  4360 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:12.061196  1170 raft_consensus.cc:2410] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:14:12.057173   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:12.072889   559 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:12.041968   553 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:12.075491   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:12.075513  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:12.076107   480 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:12.078209   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:12.078882   553 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:12.079877   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:12.080502   447 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:12.081791  4552 consensus_queue.cc:1059] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:12.082535   447 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:12.082778  4552 consensus_queue.cc:1243] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:14:12.083472   447 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:12.084000   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:12.091868  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:12.083473  4552 consensus_queue.cc:1059] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:14:12.095204  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:12.095947  1167 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:12.096915  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:12.098588  4548 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:12.103643   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:12.107666   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:12.108438   557 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:12.112804  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:12.077596  4248 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:12.115700  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.116237  1172 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:14:12.117036   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:12.119805  4547 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:12.119869   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:12.120127  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:12.120451  4547 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.120869   475 raft_consensus.cc:2410] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:12.120903  4547 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:12.121302  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:12.121910   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:12.122457   475 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:12.123338  4372 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:12.123899  4372 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:12.126052  4372 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:12.126902   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 43502.6us
I20260709 13:14:12.119891   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:12.127775   447 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:12.128048   553 raft_consensus.cc:2393] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 9: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:12.128942   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:12.116094  4344 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:12.129688  4344 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.130230  4344 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:12.130470   553 raft_consensus.cc:1275] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:14:12.131808   553 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:14:12.132874   553 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:14:12.129729  4497 consensus_meta.cc:287] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.000s
I20260709 13:14:12.133924   553 raft_consensus.cc:1240] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:12.129068   447 leader_election.cc:400] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11.
I20260709 13:14:12.137874   447 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:12.138137  4543 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:12.140347  4550 consensus_queue.cc:1059] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:14:12.127116   480 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:14:12.147173  4360 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:12.148206   553 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:12.136372   475 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:12.147130   480 raft_consensus.cc:1275] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:14:12.152947  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:12.169793   597 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:12.171432   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:12.177695  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:12.176738   559 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:12.149020  4248 leader_election.cc:290] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:12.188488   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:12.184262   484 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:14:12.167060  4121 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:12.178352  4393 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:12.185405  4304 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:12.185803  4495 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:12.219396   599 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:12.209156   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:12.231410   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 525) took 2643 ms. Trace:
I20260709 13:14:12.193249  4552 raft_consensus.cc:3055] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:12.232002   633 rpcz_store.cc:276] 0709 13:14:09.587953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.737548 (+1149595us) service_pool.cc:224] Handling call
0709 13:14:10.738278 (+   730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:11.324610 (+586332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:12.231105 (+906495us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b54001bba54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:12.231339 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1258564352}
I20260709 13:14:12.185876  4548 consensus_queue.cc:1048] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:14:12.237664   559 raft_consensus.cc:1240] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:12.192817  4267 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:12.243441   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:12.248687  4541 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:12.231467  4565 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:12.252214  4541 raft_consensus.cc:697] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:12.254061  4121 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:12.254712  4557 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.258265  4561 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.260883   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:12.234107  4552 raft_consensus.cc:740] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:12.264003  4561 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:12.264370  4121 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:12.264420  4541 consensus_queue.cc:237] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:12.265532   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:12.265264  4557 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:12.264621  4543 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:12.267288   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:12.267980   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:12.282498   559 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:12.284580   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:12.285873   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:12.286985  4524 log.cc:927] Time spent T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.835s	user 0.005s	sys 0.001s
I20260709 13:14:12.288579  1171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 551) took 1067 ms. Trace:
I20260709 13:14:12.288972  1171 rpcz_store.cc:276] 0709 13:14:11.220837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.222717 (+  1880us) service_pool.cc:224] Handling call
0709 13:14:11.223062 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:11.223587 (+   525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:11.223617 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:11.224126 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:14:11.343103 (+118977us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:11.343161 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.343265 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:12.251376 (+908111us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b24002e3e68. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b651b29c4 00007f4b651b0acb 00007f4b6536bdc9 00007f4b6536ba55 00007f4b6536b09d 00007f4b67f9d10e 00007f4b67fb488c 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221
0709 13:14:12.288163 (+ 36787us) raft_consensus.cc:1685] finished
0709 13:14:12.288186 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:12.288391 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24133,"raft.queue_time_us":28099,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":5683,"spinlock_wait_cycles":54830464,"thread_start_us":115236,"threads_started":1,"wal-append.queue_time_us":217270}
I20260709 13:14:12.295897   628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1843) took 1145 ms. Trace:
I20260709 13:14:12.296347   628 rpcz_store.cc:276] 0709 13:14:11.150476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.153489 (+  3013us) service_pool.cc:224] Handling call
0709 13:14:12.295706 (+1142217us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54001ad1d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:12.295834 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814326144}
I20260709 13:14:12.297750   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:12.298988   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:12.290401  4384 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:12.248912  4382 consensus_queue.cc:1048] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:14:12.249075  4292 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:14:12.312381   552 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:12.308665  4344 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:12.337985  4344 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:12.338853  4121 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:12.340273   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:14:12.341765  4553 log.cc:927] Time spent T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:14:12.346210   559 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:12.355466  4192 raft_consensus.cc:3055] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:12.355958  4192 raft_consensus.cc:740] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:12.356905  4192 consensus_queue.cc:260] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:12.357316   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:12.358034   632 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:14:12.262678  4267 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:12.360700  1141 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:12.376535   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:12.379066   479 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:12.382014  4520 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:12.382603  4520 raft_consensus.cc:697] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:12.272650  4565 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:12.342155  4547 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:13.016212   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:12.435763  4543 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.018194  4561 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:13.018821  4543 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:13.019392   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:12.416591   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:12.630198  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.943616  4418 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.021538  4418 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:12.491508   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 508) took 1178 ms. Trace:
W20260709 13:14:13.030061   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.485188   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:13.026935   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:13.028692   558 rpcz_store.cc:276] 0709 13:14:11.313050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.459125 (+146075us) service_pool.cc:224] Handling call
0709 13:14:11.501426 (+ 42301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:11.507155 (+  5729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:12.491206 (+984051us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b5400387f50. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:12.491431 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96484224}
I20260709 13:14:13.020367   479 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
W20260709 13:14:13.045953   557 consensus_meta.cc:287] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.933s	user 0.009s	sys 0.001s
I20260709 13:14:13.046308   557 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:13.046773   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1961) took 1007 ms. Trace:
W20260709 13:14:13.047907   480 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.002s	sys 0.002s
W20260709 13:14:13.055166   631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1917) took 1589 ms (client timeout 1573 ms). Trace:
W20260709 13:14:13.055857   631 rpcz_store.cc:269] 0709 13:14:11.447133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.562374 (+115241us) service_pool.cc:224] Handling call
0709 13:14:13.036159 (+1473785us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54002e72d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:13.036312 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1079274240}
W20260709 13:14:13.048466   480 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.003s	sys 0.002s
I20260709 13:14:13.047045   557 rpcz_store.cc:276] 0709 13:14:12.039835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:12.090809 (+ 50974us) service_pool.cc:224] Handling call
0709 13:14:13.046718 (+955909us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:12.490324  4464 raft_consensus.cc:993] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
W20260709 13:14:12.919623  4393 consensus_meta.cc:287] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.713s	user 0.010s	sys 0.000s
W20260709 13:14:12.488669  4531 log.cc:927] Time spent T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.787s	user 0.005s	sys 0.000s
W20260709 13:14:13.044329  4499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.007s	sys 0.001s
W20260709 13:14:13.076062   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 58928.3us
I20260709 13:14:13.083873   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:13.084159   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:13.085170   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:13.093418   631 raft_consensus.cc:2393] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 11: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:13.058687  4192 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:13.050661  4267 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:13.111328   476 raft_consensus.cc:2393] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:13.116676  4345 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:13.116542  4520 consensus_queue.cc:237] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.117326  4345 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:13.117635  4579 consensus_queue.cc:1059] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:13.118382  4508 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:13.118929  4508 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.119681  4345 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:13.120217  4345 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.120884   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:13.121454   476 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:13.122005  4247 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.122553  4247 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.120678  4345 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.123821   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 517) took 1675 ms. Trace:
I20260709 13:14:13.124168  1174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 554) took 1317 ms. Trace:
I20260709 13:14:13.124634  1174 rpcz_store.cc:276] 0709 13:14:11.807263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.807382 (+   119us) service_pool.cc:224] Handling call
0709 13:14:11.822508 (+ 15126us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.994565 (+172057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.123971 (+1129406us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400600254. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:13.124116 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386622720}
I20260709 13:14:13.127581   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:13.126411   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:13.124256   550 rpcz_store.cc:276] 0709 13:14:11.448403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.642776 (+194373us) service_pool.cc:224] Handling call
0709 13:14:11.663718 (+ 20942us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:11.711618 (+ 47900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.123529 (+1411911us) spinlock_profiling.cc:243] Waited 46.5 ms on lock 0x7b5400151dd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:13.123755 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106974592}
I20260709 13:14:13.128249   479 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:14:13.081624  4393 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:13.129169   631 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:11.580461   629 rpcz_store.cc:276] 0709 13:14:09.935318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.185534 (+1250216us) service_pool.cc:224] Handling call
0709 13:14:11.185893 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.294206 (+108313us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:14:11.407142 (+112936us) log.cc:844] Serialized 14 byte log entry
0709 13:14:11.571194 (+164052us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:11.571265 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:11.571310 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.571372 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:11.571478 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":282405,"thread_start_us":157373,"threads_started":2}
I20260709 13:14:13.061993  4550 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:14:13.132534   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 644) took 1693 ms. Trace:
I20260709 13:14:13.150693   482 rpcz_store.cc:276] 0709 13:14:11.439015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.443666 (+  4651us) service_pool.cc:224] Handling call
0709 13:14:11.443986 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:11.709048 (+265062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:11.709125 (+    77us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:11.709959 (+   834us) log.cc:844] Serialized 26 byte log entry
0709 13:14:11.813442 (+103483us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:11.813478 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.126441 (+1312963us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b540027c9d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:13.126512 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:13.126576 (+    64us) raft_consensus.cc:1685] finished
0709 13:14:13.126593 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:13.132448 (+  5855us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50571,"raft.queue_time_us":66313,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":32147,"spinlock_wait_cycles":471509248,"thread_start_us":102993,"threads_started":1,"wal-append.queue_time_us":203119,"wal-append.run_cpu_time_us":1722,"wal-append.run_wall_time_us":1012997}
I20260709 13:14:13.148492   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:14:13.082877  4499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.008s	sys 0.001s
I20260709 13:14:13.154745   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:13.155658   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:13.117412  4418 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:12.392067  4552 consensus_queue.cc:260] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:13.163734   631 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:14:13.167884  4247 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:13.170883  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:13.173727   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 534) took 2910 ms. Trace:
I20260709 13:14:13.166658  4543 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:13.174435   624 rpcz_store.cc:276] 0709 13:14:10.263014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.243219 (+980205us) service_pool.cc:224] Handling call
0709 13:14:11.243590 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:11.243961 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:11.243988 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:11.244445 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:14:11.516748 (+272303us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:11.516805 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.516891 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:12.487908 (+971017us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:13.169056 (+681148us) raft_consensus.cc:1685] finished
0709 13:14:13.169075 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:13.173667 (+  4592us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1404,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":15412,"spinlock_wait_cycles":12752256,"thread_start_us":271848,"threads_started":1,"wal-append.queue_time_us":456521}
I20260709 13:14:13.173678 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:13.180095   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:13.171154  4499 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.182255   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:13.182762   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:13.183660   624 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:14:13.184540   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:13.186807   631 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:13.187096   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1926) took 1017 ms. Trace:
I20260709 13:14:13.176600  4565 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:13.187588   624 rpcz_store.cc:276] 0709 13:14:12.167598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:13.177388 (+1009790us) service_pool.cc:224] Handling call
0709 13:14:13.183427 (+  6039us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:13.184311 (+   884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.184527 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:13.187691   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 544) took 1156 ms. Trace:
I20260709 13:14:13.177891  4580 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:13.189622   631 rpcz_store.cc:276] 0709 13:14:12.031511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:13.168345 (+1136834us) service_pool.cc:224] Handling call
0709 13:14:13.178750 (+ 10405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:13.187434 (+  8684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.187642 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:13.194564  4345 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:13.198406   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:13.199113   475 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:14:13.200066   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:13.192305  4499 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.201226   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:13.201959   475 raft_consensus.cc:2393] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 11: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:13.202298  4499 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:13.203568   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:13.203742   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:13.204231   475 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:13.188791  4508 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:13.206990   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:13.191676   380 catalog_manager.cc:5697] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 6 to 8, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 8 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:13.208847   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1958) took 3400 ms. Trace:
I20260709 13:14:13.206565  4581 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.209604  4581 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:13.212627  4582 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:13.213191  4582 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.214407   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:13.215830  1173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 553) took 1409 ms. Trace:
I20260709 13:14:13.216099   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:13.216753   482 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:13.218295   482 raft_consensus.cc:1240] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:13.216339  1173 rpcz_store.cc:276] 0709 13:14:11.806931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.807067 (+   136us) service_pool.cc:224] Handling call
0709 13:14:11.819594 (+ 12527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:11.987944 (+168350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.215532 (+1227588us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540048d354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:13.215760 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380290304}
I20260709 13:14:13.209250   556 rpcz_store.cc:276] 0709 13:14:09.808047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.245820 (+437773us) service_pool.cc:224] Handling call
0709 13:14:10.246189 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.495884 (+1249695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.208562 (+1712678us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54000eae54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:13.208775 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2582510336}
I20260709 13:14:13.239666   597 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:13.242446   483 raft_consensus.cc:2393] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:13.244109   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:13.244284   597 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:13.196575  4547 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:13.246939   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:13.251461   597 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:13.254014   476 raft_consensus.cc:2410] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:14:13.261907   597 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:13.216764  4582 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:13.238302  4543 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.305024   479 raft_consensus.cc:1240] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 11. Current term is 12. Ops: []
W20260709 13:14:13.316967  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 164597us
I20260709 13:14:13.238126  4247 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:13.237746  4292 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:13.325049   483 raft_consensus.cc:1240] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:13.325318   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:13.260241  4581 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:13.197639  4580 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:13.257862  4267 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:13.258431  4508 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:13.339439   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 262557us
I20260709 13:14:13.340411  1141 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:13.342109   597 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:13.375298   448 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:13.331111  4464 raft_consensus.cc:1081] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:14:13.376911   484 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:13.328680  4582 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.377075   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:13.337096  4581 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:13.393399  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:13.371843  4570 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:13.375092  4579 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.408214   476 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:13.409662   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:13.410310   552 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:14:13.408572   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:13.335623  4247 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:13.336553  4543 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:13.336799  4292 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.401729   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:13.400986   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:14:13.419728   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 78633.1us
I20260709 13:14:13.420377   556 raft_consensus.cc:2393] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 11: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
W20260709 13:14:13.402791   447 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 1.573s (SENT) [suppressed 27 similar messages]
I20260709 13:14:13.393621  4508 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:13.395421  4541 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:13.400117  4267 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:13.403728  4570 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.429456   448 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:13.410943  4587 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:13.422109  4572 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 13:14:13.392592  4582 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:13.407822  4321 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:13.442289  1169 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 748) took 2092 ms (client timeout 1973 ms). Trace:
I20260709 13:14:13.436352   478 raft_consensus.cc:3055] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:13.445812   478 raft_consensus.cc:740] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:13.402961  4499 consensus_queue.cc:1059] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 13:14:13.445012  1169 rpcz_store.cc:269] 0709 13:14:11.343447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.343576 (+   129us) service_pool.cc:224] Handling call
0709 13:14:13.435768 (+2092192us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54005f1ed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:13.435899 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297022336}
W20260709 13:14:13.451921   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 49151.6us
I20260709 13:14:13.436353  4570 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:13.426071  4584 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:13.420827  4581 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:13.466518   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:13.419579  4579 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:13.470485   478 consensus_queue.cc:260] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:13.478796  1166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 749) took 2107 ms. Trace:
I20260709 13:14:13.479194   478 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:13.483500  4592 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:14:13.484025   625 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1915) took 2037 ms (client timeout 1583 ms). Trace:
W20260709 13:14:13.484500   625 rpcz_store.cc:269] 0709 13:14:11.446585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.457963 (+ 11378us) service_pool.cc:224] Handling call
0709 13:14:13.483795 (+2025832us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b5400161cd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:13.483958 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745781504}
I20260709 13:14:13.484865  4585 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:13.485801   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:13.486436   625 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:13.471135  4589 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:13.453400  4464 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:13.461519  4506 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:13.591975   478 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:14:13.443740  4541 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.592610   478 pending_rounds.cc:85] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 6
I20260709 13:14:13.590942   483 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:13.479246  1166 rpcz_store.cc:276] 0709 13:14:11.371504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.372026 (+   522us) service_pool.cc:224] Handling call
0709 13:14:11.385787 (+ 13761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:12.185835 (+800048us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:12.185865 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:12.185920 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:12.185959 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.478531 (+1292572us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b5400444654. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:13.478573 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:13.478708 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30251,"raft.queue_time_us":34858,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":12146,"spinlock_wait_cycles":1769460992}
W20260709 13:14:13.592490  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:13.457008  4588 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:13.596763   478 pending_rounds.cc:107] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:14:13.598763   478 raft_consensus.cc:2889] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:13.484519  4580 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:13.442816  4587 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:13.604408   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 151591us
W20260709 13:14:13.605245   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 178890us
I20260709 13:14:13.498354  4589 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:13.610743   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 2027) took 1792 ms. Trace:
I20260709 13:14:13.470184  4321 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.611948   478 rpcz_store.cc:276] 0709 13:14:11.818602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.818890 (+   288us) service_pool.cc:224] Handling call
0709 13:14:11.835776 (+ 16886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:13.436255 (+1600479us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b5400139820. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68390dc0 00007f4b6841b1c0 00007f4b6841c231 00007f4b68418d8f 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c
0709 13:14:13.608553 (+172298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.610652 (+  2099us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371278720}
I20260709 13:14:13.614234   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:13.536271  4586 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:13.536588  4551 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
W20260709 13:14:13.614589  4534 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:14:13.484110  4592 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:13.655778  1138 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:13.658805  4592 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:13.660985  4592 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:13.659906   553 raft_consensus.cc:2410] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:14:13.662488  4592 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.616664  4580 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:13.671016   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:13.590628  4464 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.674350   551 raft_consensus.cc:1240] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:14:13.675388  4464 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:13.675546   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:13.676298   551 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:13.644562  4596 raft_consensus.cc:3055] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:13.677163  4596 raft_consensus.cc:740] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:13.678375  4321 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:13.678047  4596 consensus_queue.cc:260] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:13.678536  4192 consensus_meta.cc:287] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.000s
I20260709 13:14:13.680255  4582 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:13.642546  4543 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:13.682910  4521 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:13.684062  4581 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:13.684655  4587 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:13.684873  4597 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:13.623288  4508 raft_consensus.cc:697] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:13.614964  4589 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:13.636538  4591 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:13.686157   558 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:14:13.677172   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:13.643936  4583 log.cc:927] Time spent T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:14:13.537904  4585 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.708930   551 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:13.603631  4506 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.717155   558 raft_consensus.cc:1240] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:13.670504  4588 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.687443  4596 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:13.716701  4520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.005s	sys 0.022s
I20260709 13:14:13.703667  4292 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:13.720381  4602 log.cc:927] Time spent T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:14:13.742775  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 84882.8us
I20260709 13:14:13.743883   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:13.749941   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:13.750670   552 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:14:13.751748   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:13.753422   552 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
W20260709 13:14:13.739806  4520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.005s	sys 0.022s
I20260709 13:14:13.723706  4590 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:14:13.707082  4580 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.744419  4613 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:13.777096   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 543) took 1747 ms. Trace:
I20260709 13:14:13.759666  4247 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:13.722251  4591 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.780704   629 rpcz_store.cc:276] 0709 13:14:12.029305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:13.146953 (+1117648us) service_pool.cc:224] Handling call
0709 13:14:13.158921 (+ 11968us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:13.159306 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:13.159340 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:13.175691 (+ 16351us) log.cc:844] Serialized 26 byte log entry
0709 13:14:13.319499 (+143808us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:13.319542 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.319608 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:13.776805 (+457197us) raft_consensus.cc:1685] finished
0709 13:14:13.776828 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:13.777008 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":4346,"thread_start_us":132480,"threads_started":1,"wal-append.queue_time_us":189310}
I20260709 13:14:13.798169  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:13.809999  1169 raft_consensus.cc:2393] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 12: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:13.815361  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:13.819413  1166 raft_consensus.cc:2393] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 11: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:13.743403  4588 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:13.821147  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:13.821849  1173 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:13.823572  4592 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:13.824152  4605 log.cc:927] Time spent T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:14:13.824484  4247 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:13.825055  4247 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:13.823602  4627 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.827838  4627 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.829970  4627 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:13.833002  4603 log.cc:927] Time spent T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:14:13.833636  4591 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:13.808930  4613 raft_consensus.cc:697] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:13.834192   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1933) took 1662 ms. Trace:
I20260709 13:14:13.834966  4613 consensus_queue.cc:237] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.841080   625 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
W20260709 13:14:13.844471   630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1913) took 2398 ms (client timeout 1780 ms). Trace:
W20260709 13:14:13.844995   630 rpcz_store.cc:269] 0709 13:14:11.446032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.456928 (+ 10896us) service_pool.cc:224] Handling call
0709 13:14:13.844243 (+2387315us) spinlock_profiling.cc:243] Waited 67.3 ms on lock 0x7b54001adbd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:13.844367 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154841856}
I20260709 13:14:13.857198   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:13.857865   628 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:13.858206   632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1934) took 1685 ms. Trace:
I20260709 13:14:13.858582   632 rpcz_store.cc:276] 0709 13:14:12.172470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:13.857353 (+1684883us) service_pool.cc:224] Handling call
0709 13:14:13.857651 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:13.857869 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:13.857897 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:13.857939 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:13.857968 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.858020 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:13.858130 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:13.859365   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:13.864981  4623 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:14:13.866073  4580 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:13.868981   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 515) took 2421 ms. Trace:
I20260709 13:14:13.869439   555 rpcz_store.cc:276] 0709 13:14:11.447759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.612993 (+165234us) service_pool.cc:224] Handling call
0709 13:14:11.613385 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.847580 (+234195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:11.847628 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:11.847687 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:11.847736 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.868751 (+2021015us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54001ca554. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:13.868797 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:13.868922 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537981824}
I20260709 13:14:13.870867  4343 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:13.838292   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:13.834573   631 rpcz_store.cc:276] 0709 13:14:12.171823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:13.195760 (+1023937us) service_pool.cc:224] Handling call
0709 13:14:13.238079 (+ 42319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:13.253885 (+ 15806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:13.253918 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:13.328599 (+ 74681us) log.cc:844] Serialized 26 byte log entry
0709 13:14:13.453682 (+125083us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:13.453781 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.454152 (+   371us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:13.833988 (+379836us) raft_consensus.cc:1685] finished
0709 13:14:13.834007 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:13.834136 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":73327,"threads_started":1,"wal-append.queue_time_us":243638}
I20260709 13:14:13.880353  4579 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:13.786171  4508 consensus_queue.cc:237] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.889959  4550 raft_consensus.cc:3055] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:13.890456  4550 raft_consensus.cc:740] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:13.891448  4550 consensus_queue.cc:260] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.892563  4550 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:13.893065  4506 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:13.894152   629 raft_consensus.cc:1240] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:14:13.894788   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1936) took 1721 ms. Trace:
I20260709 13:14:13.895380   629 rpcz_store.cc:276] 0709 13:14:12.173537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:13.893557 (+1720020us) service_pool.cc:224] Handling call
0709 13:14:13.893916 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:13.894524 (+   608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.894735 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:13.911150  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:13.911813   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:13.912437  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:13.913040  1173 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
W20260709 13:14:13.921344  4595 log.cc:927] Time spent T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.446s	user 0.002s	sys 0.000s
I20260709 13:14:13.931433   625 raft_consensus.cc:1240] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:13.933122   625 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:14:13.933748   628 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:13.936269  4589 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:13.940161   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:13.941035   475 raft_consensus.cc:2410] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:14:14.022661  4570 consensus_meta.cc:287] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.537s	user 0.005s	sys 0.001s
I20260709 13:14:14.025684  4365 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.059197   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 542) took 2531 ms. Trace:
I20260709 13:14:14.027305  4415 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:14.030580   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:13.949992   551 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:14.059664   626 rpcz_store.cc:276] 0709 13:14:11.502890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.884630 (+381740us) service_pool.cc:224] Handling call
0709 13:14:11.906445 (+ 21815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:13.027150 (+1120705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:13.027194 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:13.063823 (+ 36629us) log.cc:844] Serialized 26 byte log entry
0709 13:14:13.372529 (+308706us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:13.372580 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.885723 (+513143us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b54003e0154. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:13.885774 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:13.920634 (+ 34860us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:14.033904 (+113270us) raft_consensus.cc:1685] finished
0709 13:14:14.033933 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:14.034085 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43937,"raft.queue_time_us":609685,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":7861,"spinlock_wait_cycles":1250171904,"thread_start_us":259631,"threads_started":1,"wal-append.queue_time_us":338095}
I20260709 13:14:14.117060   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:14.117937   482 raft_consensus.cc:2410] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:14:14.127280   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:14.128252   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:14.129036   478 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
W20260709 13:14:14.063421  4267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.000s	sys 0.012s
I20260709 13:14:14.130115   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:14.135764   476 raft_consensus.cc:2393] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 12: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:14.115706  4345 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.059253  4338 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:14.143618   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:14.141975   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:14.139878  4267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.000s	sys 0.013s
I20260709 13:14:14.124300  4348 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:14:14.158895   597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.014s	sys 0.051s
I20260709 13:14:14.123278  4601 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:14.167737   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:14.159046   479 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
W20260709 13:14:14.168278   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:14.136384  4589 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:14.165436  1141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.013s	sys 0.018s
W20260709 13:14:14.170687   525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.009s	sys 0.037s
W20260709 13:14:14.170928  1141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.013s	sys 0.018s
I20260709 13:14:14.116222  4592 consensus_queue.cc:1059] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:14:14.172190   525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.009s	sys 0.037s
I20260709 13:14:14.118932  4365 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:14.165048   597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.014s	sys 0.051s
I20260709 13:14:14.167500   447 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:14.172613   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 558768us
W20260709 13:14:14.379062   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 1.03698e+06us
I20260709 13:14:14.058913  4591 consensus_queue.cc:1059] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 13:14:14.379840   597 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:14.160130  4345 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:14.379637   525 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:14.384951   525 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:14.386309   525 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:14.181147   522 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:14.336655  4599 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.008s	sys 0.024s
I20260709 13:14:14.182060  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:14.117579  4570 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:14.181164  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:14.161415  4267 raft_consensus.cc:697] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:14.221937  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:14.228137  4624 log.cc:927] Time spent T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:14:14.229934   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:14.231153  4592 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:14:14.184628  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:14:14.235343   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:14.236631   484 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:14.232609  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:14.246626   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:14.315860  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:14.232322  4521 consensus_meta.cc:287] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.003s
I20260709 13:14:14.319139  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:14.393769   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 226345us
I20260709 13:14:14.162191  4338 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:14.320585  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:14.327076   557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.008s	sys 0.023s
I20260709 13:14:14.417403   447 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:14.417718   557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.008s	sys 0.023s
I20260709 13:14:14.332612   599 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:14:14.418344   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 85814.4us
I20260709 13:14:14.419389   599 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:14.169293  4348 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:14.173103  4601 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:14.314298  4450 raft_consensus.cc:3055] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:14:14.331569  4192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.014s	sys 0.017s
W20260709 13:14:14.171392  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 761148us
I20260709 13:14:14.408929   476 raft_consensus.cc:2393] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 9: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
W20260709 13:14:14.390416  4599 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.008s	sys 0.025s
I20260709 13:14:14.387913   597 leader_election.cc:304] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:14.372094  4609 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.005s	sys 0.013s
I20260709 13:14:14.336799  4626 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.402798  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:14.410741  1171 raft_consensus.cc:2393] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:14:14.406582   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:14.181435  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:14.416297  4582 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:14.409231  1166 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:14.393445  4613 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.037s	sys 0.047s
I20260709 13:14:14.429901   479 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:14:14.402732  4506 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:14.436692  4192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.014s	sys 0.017s
W20260709 13:14:14.453339   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 65498.1us
I20260709 13:14:14.455196  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:14.403954  4365 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:14.409771  4581 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:14.409739  4592 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:14.448132  4611 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:14.510800  4611 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.511381  4611 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:14.511906  4541 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:14.514256   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1916) took 3067 ms. Trace:
I20260709 13:14:14.404294  4345 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:14.408139  4591 raft_consensus.cc:3055] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:14.515870  4591 raft_consensus.cc:740] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:14.516371  4247 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:14.516793  4591 consensus_queue.cc:260] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:14.517782  4578 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.518118  4591 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:14.518353  4578 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:14.521564  4338 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:14.434883  4618 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:14.458858  1174 raft_consensus.cc:2410] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:14:14.461067  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:14.461114   447 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:14:14.530640   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 69602.8us
I20260709 13:14:14.460294  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:14.222179 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:14.460294   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:14.407512  4633 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:14.443351  4609 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.005s	sys 0.013s
I20260709 13:14:14.408443  4628 raft_consensus.cc:2764] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:14:14.436759  4450 raft_consensus.cc:740] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:14.474814  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:14.465291  4597 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:14.480788  1168 raft_consensus.cc:1275] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:14.482795  4557 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:14.474128  4586 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:14.491201   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:14.493005  4598 log.cc:927] Time spent T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 1.007s	user 0.006s	sys 0.009s
I20260709 13:14:14.486981  1166 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:14.494621  4321 raft_consensus.cc:3055] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:14.460374  4399 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.496083   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:14.461289  4626 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:14.500795   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:14.500276  4267 consensus_queue.cc:237] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:14.455969  4632 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.456516  4631 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.504215  4570 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:14.505048   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:14.507457  4601 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:14.507589  4585 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:14.475837  4581 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:14.510013  1171 raft_consensus.cc:1240] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:14:14.509753  1138 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:14.514777   627 rpcz_store.cc:276] 0709 13:14:11.446864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.821334 (+374470us) service_pool.cc:224] Handling call
0709 13:14:13.017637 (+1196303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:13.057413 (+ 39776us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:13.057448 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:13.057501 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:13.057547 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.057614 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:14.167809 (+1110195us) spinlock_profiling.cc:243] Waited 7.93 ms on lock 0x7b480024e358. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6d342aa1 00007f4b6d339b37 00007f4b6d3399ca 00007f4b6d43126f 00007f4b6d430f37 00007f4b6d44555c 00007f4b6d445508 00007f4b6d445488 00007f4b6d445443 00007f4b6d4446ec 00007f4b6c36ea96
0709 13:14:14.512976 (+345167us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b1800315160. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b652fa2a6 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4
0709 13:14:14.514070 (+  1094us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54001ad1d0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:14.514195 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17400,"raft.queue_time_us":38989,"raft.run_cpu_time_us":7185,"raft.run_wall_time_us":1109932,"spinlock_wait_cycles":1105863680}
W20260709 13:14:14.456724  4613 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.037s	sys 0.048s
I20260709 13:14:14.463256   597 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:14.532300   447 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:14.531843   476 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:14:14.542879  4450 consensus_queue.cc:260] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:14.543733   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:14:14.544865  4634 log.cc:927] Time spent T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:14:14.531615  4618 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.549471   482 raft_consensus.cc:2410] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:14.535629  4612 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:14:14.550505   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 369400us
I20260709 13:14:14.551723   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:14.564080   477 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
W20260709 13:14:14.565428  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 55780.5us
I20260709 13:14:14.545836  4586 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:14.568111   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 104964us
I20260709 13:14:14.568281   484 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:14.568388  1141 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:14.566576  4581 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:14.569903   478 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:14.547438  4321 raft_consensus.cc:740] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:14.547142  4348 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:14.576701   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:14.588912   522 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:14.588021   447 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:14.604013   447 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:14.587128  4626 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:14.561352  4633 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.584120  4618 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:14.560472  4399 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:14.578631  4577 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:14.592778   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:14.567867  4277 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:14.610707  4550 consensus_queue.cc:1059] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:14:14.624310  4629 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:14.624707  4550 raft_consensus.cc:3055] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:14.625093  4550 raft_consensus.cc:740] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:14.624909  4629 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:14.625998  4550 consensus_queue.cc:260] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:14.611126  4534 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:14.600065  4586 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:14.566476  4631 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:14.610802  4393 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:14.606971  4613 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:14.606766  4609 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:14.569653  4585 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:14.562668  4632 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:14.571611  4450 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:14.618875  4247 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:14:14.602600  4415 consensus_queue.cc:1048] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:14:14.593590  4612 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:14:14.591620   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 205347us
I20260709 13:14:14.588546  4627 consensus_queue.cc:1059] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:14:14.609027   597 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:14.629922   522 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:14.651415   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:14.652307   559 raft_consensus.cc:2410] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:14:14.653298   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:14.637065   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1931) took 2466 ms. Trace:
W20260709 13:14:14.616873   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:14.654335   624 rpcz_store.cc:276] 0709 13:14:12.170676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:13.189305 (+1018629us) service_pool.cc:224] Handling call
0709 13:14:13.203382 (+ 14077us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:13.226189 (+ 22807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:13.226240 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:13.244708 (+ 18468us) log.cc:844] Serialized 26 byte log entry
0709 13:14:13.418217 (+173509us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:13.536429 (+118212us) log.cc:844] Serialized 14 byte log entry
0709 13:14:13.686955 (+150526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.687084 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:14.492298 (+805214us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:14.636735 (+144437us) raft_consensus.cc:1685] finished
0709 13:14:14.636851 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:14.637004 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9973,"prepare.queue_time_us":476427,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":134864,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":11318,"spinlock_wait_cycles":24850048,"thread_start_us":307073,"threads_started":3,"wal-append.queue_time_us":224988}
I20260709 13:14:14.649293   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1938) took 1227 ms. Trace:
I20260709 13:14:14.656515   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:14.652320   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:14.617661   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 66011.6us
I20260709 13:14:14.659226   448 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:14.622516   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:14.623574   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:14.660665   632 raft_consensus.cc:2376] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10. Re-sending same reply.
I20260709 13:14:14.656965   629 rpcz_store.cc:276] 0709 13:14:13.421733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:13.896484 (+474751us) service_pool.cc:224] Handling call
0709 13:14:14.002890 (+106406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:14.008898 (+  6008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:14.008949 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:14.504049 (+495100us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b2c00072b18. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b66d12a11 00007f4b66d22372 00007f4b68454a01 00007f4b6841943a 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2
0709 13:14:14.504639 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:14:14.599518 (+ 94879us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:14.599569 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:14.601451 (+  1882us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:14.643168 (+ 41717us) raft_consensus.cc:1685] finished
0709 13:14:14.643187 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:14.649230 (+  6043us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":137,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":80966912,"thread_start_us":94400,"threads_started":1,"wal-append.queue_time_us":115832}
W20260709 13:14:14.644318   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:14.617463  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 169994us
I20260709 13:14:14.628818   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:14.660218   625 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:14:14.661948   630 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:14.662421   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:14.644280   478 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
I20260709 13:14:14.629375   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:14.664036  1141 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:14.664157   628 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:14.659766  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:14.664979   523 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:14.628510   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:14.627198   633 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:14.646178   525 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:14.669986   556 raft_consensus.cc:2410] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:14:14.639879   380 catalog_manager.cc:5697] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:14.672058   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:14.671983   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:14.672951   559 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:14.673520   558 raft_consensus.cc:2410] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:14:14.642994  4577 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:14.678409   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:14.678723  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:14.679334   553 raft_consensus.cc:2410] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:14:14.679914   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:14.675359  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:14.628371  4641 log.cc:927] Time spent T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:14:14.676178   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:14.693426   550 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:14.675896  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:14.675906   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:14.694667  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:14.684593  4577 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:14.643201  4633 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:14.685038  4628 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:14.598255  4642 consensus_queue.cc:1059] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:14:14.675772  4596 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:14.685385   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:14.685709   448 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:14.686251  4630 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:14.687671   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:14.628216  4534 raft_consensus.cc:697] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:14.684803   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:14.739166   478 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
W20260709 13:14:14.688797  4576 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 1.477s	user 0.004s	sys 0.014s
I20260709 13:14:14.639065  4550 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:14.635963  4393 raft_consensus.cc:697] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:14.751312   477 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:14.690501  4399 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:14.636436  4613 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.634713  4601 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:14:14.697541   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 51448.9us
I20260709 13:14:14.662070  4247 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:14.697480  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:14.753738  1168 raft_consensus.cc:2393] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 11: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:14.637107  4631 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:14.638919  4632 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:14.760685  4247 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:14.762379  4551 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:14.763019  4551 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:14.763696   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:14.764993   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:14.765678  4551 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:14.751430  4596 raft_consensus.cc:697] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:14.768105  4596 consensus_queue.cc:237] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:14.768435  4582 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:14.769644  4534 consensus_queue.cc:237] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:14.747618  4645 log.cc:927] Time spent T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:14:14.720830   447 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:14.649541  4612 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:14.785828  1141 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:14.734158   630 raft_consensus.cc:1240] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:14:14.636674  4635 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:14:14.737877   380 catalog_manager.cc:5697] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:14:14.740868   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 55247.8us
I20260709 13:14:14.788631   448 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:14.741254  4626 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:14.741839  4633 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:14.742619  4628 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:14.743675  4642 raft_consensus.cc:3055] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:14.745046   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:14.789848   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 109169us
W20260709 13:14:14.790594   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 69850.8us
W20260709 13:14:14.791226   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 161377us
W20260709 13:14:14.778988   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 120585us
I20260709 13:14:14.627669  4321 consensus_queue.cc:260] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:14.735378  4591 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:14.635485  4592 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:14:14.765694   626 raft_consensus.cc:2393] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:14.665823  4536 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.792376   522 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:14.839454  4536 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:14.839856   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 47576.3us
I20260709 13:14:14.798565  4609 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:14.841459  4609 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:14.841840  4609 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:14.843505  4601 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:14.843938  4601 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.844287  4601 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:14.845216  4578 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:14.845816  4536 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:14.846544   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:14.850114   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:14.853380  4593 log.cc:927] Time spent T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 1.369s	user 0.010s	sys 0.012s
I20260709 13:14:14.783361  4611 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:14.857717  4611 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:14.858544   631 raft_consensus.cc:2368] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12.
I20260709 13:14:14.859570  4393 consensus_queue.cc:237] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:14.864786   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:14.865526   558 raft_consensus.cc:2393] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 10: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:14.775359   525 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:14.829026   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:14.830956  4628 raft_consensus.cc:697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:14.797837   380 catalog_manager.cc:5697] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 7 to 10, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 10 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:14.829563  4629 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:14.827795  4591 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:14.830540   379 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46024 (request call id 251) took 34641 ms (client timeout 15000 ms). Trace:
I20260709 13:14:14.871451   597 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:14.835093   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:14.835675   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:14.789866  4642 raft_consensus.cc:740] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:14.793905  4348 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:14.838619   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:14.866845   626 raft_consensus.cc:2393] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:14.867444   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:14.881004   597 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:14.882740   597 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:14.883445   633 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1927) took 2715 ms (client timeout 2224 ms). Trace:
I20260709 13:14:14.884037   597 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:14.884125   633 rpcz_store.cc:269] 0709 13:14:12.168241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:12.339993 (+171752us) service_pool.cc:224] Handling call
0709 13:14:14.883195 (+2543202us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b5400051ed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:14.883341 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5107664768}
I20260709 13:14:14.885763   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:14.887750   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:14.873713   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 98454.1us
I20260709 13:14:14.876452   380 catalog_manager.cc:5697] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 8 to 11, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 11 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:14.878824   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 90254.5us
I20260709 13:14:14.772888  4613 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:14.889901  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 52914.3us
I20260709 13:14:14.889314   558 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:14:14.956281   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:14.960431   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:14.961165   626 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:14:15.010402   380 catalog_manager.cc:5697] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
W20260709 13:14:15.011113   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 54947.1us
I20260709 13:14:15.012333   597 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:15.013701   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:15.013901   597 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:15.014484   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:15.015112   627 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:15.015287   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:15.015832   625 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:14:15.014375   624 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:15.016250   597 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:15.021014   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:14.875614  4633 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:14.879426  4591 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:14.958562  4629 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:14:15.043180   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 153217us
I20260709 13:14:14.877358  4450 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:15.043813   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 67263.6us
I20260709 13:14:14.955495  4345 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:15.043939   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 2036) took 2821 ms. Trace:
I20260709 13:14:15.059217   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:15.061199   480 rpcz_store.cc:276] 0709 13:14:12.189060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:12.191710 (+  2650us) service_pool.cc:224] Handling call
0709 13:14:12.191990 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:12.204311 (+ 12321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:12.204342 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:12.263736 (+ 59394us) log.cc:844] Serialized 26 byte log entry
0709 13:14:13.058339 (+794603us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:13.058396 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.058504 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:14.679681 (+1621177us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:14.878403 (+198722us) raft_consensus.cc:1685] finished
0709 13:14:14.878429 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:15.010499 (+132070us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38588,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":5811,"spinlock_wait_cycles":22119680,"thread_start_us":749868,"threads_started":1,"wal-append.queue_time_us":931616}
I20260709 13:14:15.061049   525 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:15.063664   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:15.064602   525 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:15.046190   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:15.048683   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:14.891528  4611 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:14.879206  4589 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.062925   380 catalog_manager.cc:5697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 2 to 7, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 7 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:14.895227  4348 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.077975   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:15.051506  4638 consensus_queue.cc:1059] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:14:15.058470   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:15.065878   633 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
W20260709 13:14:15.073535   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 57433.6us
I20260709 13:14:15.068419   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:14.976720  4631 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:15.078574   630 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:15.086850   525 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:15.047111  4464 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.079150   559 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:14:15.011509  4536 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:15.080049   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:15.047580  4415 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:15.089895   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:15.097535   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:15.097926   627 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
I20260709 13:14:15.060843  4373 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:15.095101   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:15.052039  4508 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:15.048018  4599 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:15.100495   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:15.069196  4648 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:15.084007  4348 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:15.119019   626 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
I20260709 13:14:15.105921  1139 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:15.057644  4642 consensus_queue.cc:260] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:15.105819   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 232265us
I20260709 13:14:15.083787  4659 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.107153   633 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:15.118191   380 catalog_manager.cc:5697] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 5 to 7, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 7 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:15.070331  4629 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:15.096035  4536 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.105288  4611 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:15.118803   627 raft_consensus.cc:1240] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: [9.7-10.8]
I20260709 13:14:15.104657  4373 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.074929  4581 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.132200   380 catalog_manager.cc:5697] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 5 to 8, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 8 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:15.085139  4450 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.116319  4638 raft_consensus.cc:3055] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:15.102398  4660 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:15.103968  4587 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:15.094775  4633 consensus_queue.cc:1059] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:14:15.088917  4589 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:15.151889   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 91074.4us
I20260709 13:14:15.153469   522 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:15.130653  4399 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:15.130375  4629 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:15.098584  4464 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.134873  4536 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:15.184120  4588 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:15.190686  4552 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:15.191061   380 catalog_manager.cc:5697] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:15.192088  4652 log.cc:927] Time spent T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:14:15.193583   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 2043) took 1284 ms. Trace:
I20260709 13:14:15.193394   380 catalog_manager.cc:5697] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 4 to 9, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 9 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.194121   483 rpcz_store.cc:276] 0709 13:14:13.908909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:13.909735 (+   826us) service_pool.cc:224] Handling call
0709 13:14:13.912660 (+  2925us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:13.935034 (+ 22374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:13.935065 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:14.489391 (+554326us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b2c000014c8. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b66d12a11 00007f4b66d22372 00007f4b68454a01 00007f4b6841943a 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2
0709 13:14:14.489883 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:14:14.606257 (+116374us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:14.606298 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:14.606362 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:15.193308 (+586946us) raft_consensus.cc:1685] finished
0709 13:14:15.193327 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:15.193527 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":252680576,"thread_start_us":115473,"threads_started":1,"wal-append.queue_time_us":285349}
I20260709 13:14:15.195853  4450 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:15.165267   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:15.135461  4659 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:14.875818   379 rpcz_store.cc:269] 0709 13:13:40.239941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.273625 (+ 33684us) service_pool.cc:224] Handling call
0709 13:14:14.830334 (+34556709us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:08.451135 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:08.668030 (+216895us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:08.670837 (+  2807us) write_op.cc:435] Acquired schema lock
0709 13:14:08.672490 (+  1653us) tablet.cc:662] Decoding operations
0709 13:14:08.771836 (+ 99346us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:08.771921 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:08.771968 (+    47us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:14:08.772657 (+   689us) tablet.cc:701] Row locks acquired
0709 13:14:08.772685 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:14:08.772883 (+   198us) write_op.cc:270] Start()
0709 13:14:08.773055 (+   172us) write_op.cc:276] Timestamp: P: 1783602848772817 usec, L: 0
0709 13:14:08.773092 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:14:08.773815 (+   723us) log.cc:844] Serialized 2089 byte log entry
0709 13:14:10.590474 (+1816659us) op_driver.cc:464] REPLICATION: finished
0709 13:14:10.619084 (+ 28610us) write_op.cc:301] APPLY: starting
0709 13:14:10.619172 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:10.619370 (+   198us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:10.619494 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:10.803984 (+184490us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:10.967592 (+163608us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:14:10.967680 (+    88us) write_op.cc:312] APPLY: finished
0709 13:14:10.968186 (+   506us) log.cc:844] Serialized 47 byte log entry
0709 13:14:10.968450 (+   264us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:10.968760 (+   310us) write_op.cc:454] Released schema lock
0709 13:14:10.968826 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:10.969560 (+   734us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:10.969602 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2281073,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":24194,"apply.run_cpu_time_us":4401,"apply.run_wall_time_us":350335,"num_ops":5,"prepare.queue_time_us":297021,"prepare.run_cpu_time_us":128599,"prepare.run_wall_time_us":567084,"raft.queue_time_us":705426,"raft.run_cpu_time_us":17432,"raft.run_wall_time_us":163896,"replication_time_us":1807030,"thread_start_us":892474,"threads_started":4,"wal-append.queue_time_us":299641,"wal-append.run_cpu_time_us":26217,"wal-append.run_wall_time_us":2951971}]]}
I20260709 13:14:15.136302  4373 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:15.138278   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:15.069525  4628 consensus_queue.cc:237] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.149456  4642 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:15.173426   522 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:15.193521  4141 raft_consensus.cc:3055] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:15.094503  4631 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:15.199393   448 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:15.195034   380 catalog_manager.cc:5697] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 6 to 9, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 9 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:15.164073   557 raft_consensus.cc:1240] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:15.205971   599 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:15.206259   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:15.200464   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 113706us
I20260709 13:14:15.210218   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:15.172447  4399 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.169469  4638 raft_consensus.cc:740] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:14:15.184120  4586 consensus_meta.cc:287] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.552s	user 0.008s	sys 0.000s
I20260709 13:14:15.260123  4399 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:15.260408  4586 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:15.260838  4638 consensus_queue.cc:260] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:15.262598  4638 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:15.262645  4586 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:15.258698   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 85341.1us
I20260709 13:14:15.263691   482 raft_consensus.cc:1240] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:15.258695   380 catalog_manager.cc:5697] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 2 to 9, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 9 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:15.264533   522 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:15.265044   380 catalog_manager.cc:5697] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 4 to 5, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 5 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:15.266767   380 catalog_manager.cc:5697] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:15.199803  4587 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:14:15.270731   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 64841.5us
I20260709 13:14:15.287606   599 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:15.274163   380 catalog_manager.cc:5697] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:14:15.273201   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:15.288866   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:15.291726   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:15.296511   447 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:15.296437   599 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:15.300062   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:15.278228   556 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:14:15.298612   624 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:14:15.257863  4627 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.221498  4141 raft_consensus.cc:740] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:14:15.282925  4662 log.cc:927] Time spent T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:14:15.281067  4618 consensus_meta.cc:287] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.624s	user 0.004s	sys 0.003s
W20260709 13:14:15.304361   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 105041us
I20260709 13:14:15.308871   380 catalog_manager.cc:5697] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 9 to 10, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 10 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:15.304536   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:15.304141   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:15.286437  4611 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:15.271550  4667 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:15.319327   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:15.306124   553 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:15.305721   447 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:15.323593   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:15.324358   478 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:15.307315   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:15.311859   559 raft_consensus.cc:2393] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 10: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
W20260709 13:14:15.312655   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:15.313295   448 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:15.282248  4591 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:15.299435  4534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.004s	sys 0.018s
I20260709 13:14:15.299314  4345 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:15.304147  4599 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:15.289819  4601 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.355954   481 raft_consensus.cc:3055] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:14:15.354849   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 53518.3us
W20260709 13:14:15.360216   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 90613.4us
I20260709 13:14:15.274546  4660 consensus_queue.cc:1059] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:14:15.363600   481 raft_consensus.cc:740] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:15.316576  4666 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:15.320941  4393 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:15.374740   525 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:15.346545  4534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.004s	sys 0.018s
I20260709 13:14:15.297945  4612 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:15.376636   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:15.373930   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 109434us
I20260709 13:14:15.319327  4611 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:15.395646   380 catalog_manager.cc:5697] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.357683  4415 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.378167  4666 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.393641  4659 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:15.373893  4670 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:15.349033  4343 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:15.347471  4345 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:15.399286  4601 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:15.446825   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 73336.3us
I20260709 13:14:15.343880  4552 consensus_queue.cc:1059] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:14:15.403829   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:15.447738   559 raft_consensus.cc:2376] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11. Re-sending same reply.
I20260709 13:14:15.354712  4464 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:15.389925  4141 consensus_queue.cc:260] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:15.408906   525 leader_election.cc:304] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:15.456938   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 48144.8us
I20260709 13:14:15.457944   525 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:15.458235   380 catalog_manager.cc:5697] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 3 to 9, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 9 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:14:15.391620  4550 consensus_meta.cc:287] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.618s	user 0.004s	sys 0.004s
I20260709 13:14:15.309975  4627 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.437283  4611 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:15.422127   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 44039.1us
I20260709 13:14:15.430668   522 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:15.449421  4666 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:15.377105  4633 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:15.456151  4345 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:15.476078  4670 raft_consensus.cc:697] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:15.484958  4670 consensus_queue.cc:237] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.479537  4682 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:15.487470  4601 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:14:15.479770   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 49228.4us
I20260709 13:14:15.389499  4589 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:15.446250   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 131104us
I20260709 13:14:15.326164  4618 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.461485   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:15.410945  4577 consensus_meta.cc:287] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.664s	user 0.002s	sys 0.008s
I20260709 13:14:15.375851   481 consensus_queue.cc:260] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:15.495872   481 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:15.488518   483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38134
I20260709 13:14:15.389976  4660 raft_consensus.cc:3055] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:15.504407   448 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:15.496965   483 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:15.507962   483 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:15.489343   522 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:15.509765   522 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:15.495066   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:15.490703   599 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:15.511724   479 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:15.516788   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:15.441977  4581 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:15.440874  4508 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.447813  4587 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:15.535027   380 catalog_manager.cc:5697] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 8 to 10, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 10 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.536621   448 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:15.538538  4681 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:15.546229   380 catalog_manager.cc:5697] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 5 to 8, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 8 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:15.547180   448 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:15.548295   448 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:15.487811  4141 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:15.487980  4659 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:15.551450  4659 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.551863  4659 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:15.551070   448 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:15.548214   380 catalog_manager.cc:5697] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:15.547219  4681 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.540277   525 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:15.507056  4534 raft_consensus.cc:3055] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:15.504436  4633 raft_consensus.cc:697] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:15.504048  4660 raft_consensus.cc:740] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:15.448328  4415 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:15.534366  4601 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:15.544288  4589 consensus_queue.cc:1059] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 13:14:15.587088  4671 log.cc:927] Time spent T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
W20260709 13:14:15.588537  4675 log.cc:927] Time spent T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:14:15.555995  4552 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:15.554438  4587 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:15.545490  4682 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.479732  4373 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.610062   380 catalog_manager.cc:5697] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.622823   380 catalog_manager.cc:5697] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 4 to 9, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 9 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:15.559669  4550 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:15.557538   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:15.516911  4599 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:14:15.576061  4534 raft_consensus.cc:740] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:15.505124  4577 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:15.635946   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:15.594784  4601 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.559423  4508 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:15.629650  4609 consensus_meta.cc:287] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.787s	user 0.011s	sys 0.001s
I20260709 13:14:15.620666  4587 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:15.702580   475 raft_consensus.cc:1240] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:15.608511  4393 raft_consensus.cc:697] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:15.613135  4552 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:15.612309  4399 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:15.663944  4508 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:15.665589  4415 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:15.646983  4693 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:15.687487  4464 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:15.688360  4450 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:15.689072  4687 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:14:15.689595  4677 log.cc:927] Time spent T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:14:15.689958  4660 consensus_queue.cc:260] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.629029  4581 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:14:15.695688   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 140098us
W20260709 13:14:15.696547   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:15.700870   483 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:15.648576  4601 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:15.497541  4678 consensus_queue.cc:1175] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" responder_term: 12 status { last_received { term: 9 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: [11.11-11.11]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:15.702813  4550 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:15.774484  4581 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:15.788491  1172 raft_consensus.cc:1240] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:15.788825  4581 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:15.789603  1168 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:14:15.790803  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:15.791356  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:15.792356  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:15.781246  4550 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:15.791482  1172 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:15.793375  4550 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:15.785923  4399 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:15.795465  4673 log.cc:927] Time spent T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:14:15.797385  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:15.629246  4682 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.800028  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:15.800559  1166 raft_consensus.cc:3055] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:15.800848  1166 raft_consensus.cc:740] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:15.759654  4552 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:15.779285   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:15.802178   448 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:15.801664  1166 consensus_queue.cc:260] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:15.802928  1166 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:15.805281  4691 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:15.805739  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:15.805809  4691 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.806703  4577 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:15.810143  4581 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:15.780543   483 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:15.774305  4690 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:15.801666  4682 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:15.882417  4690 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:15.884822  4672 log.cc:927] Time spent T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.294s	user 0.004s	sys 0.000s
I20260709 13:14:15.884979  4690 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:15.886086  4581 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:15.813409  1166 raft_consensus.cc:2410] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:14:15.887379   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:15.888563   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:15.889091  4626 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:15.889498  4626 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.889598   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:15.889889  4626 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:15.890228   483 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:15.893682  4678 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:15.894193  4678 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.895933   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1866) took 1039 ms. Trace:
W20260709 13:14:15.788228  4348 consensus_meta.cc:287] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.000s
W20260709 13:14:15.828081  4683 log.cc:927] Time spent T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:14:15.767756  4464 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:15.761579  4693 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:15.909345  4693 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:15.915868  1169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 567) took 1541 ms. Trace:
I20260709 13:14:15.916260  4464 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:15.917429   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 676) took 1450 ms. Trace:
I20260709 13:14:15.917801   477 rpcz_store.cc:276] 0709 13:14:14.467012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:14.596107 (+129095us) service_pool.cc:224] Handling call
0709 13:14:14.606530 (+ 10423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:14.751733 (+145203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:15.917196 (+1165463us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54002ddf54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:15.917371 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301619584}
W20260709 13:14:15.919847   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:15.916299  1169 rpcz_store.cc:276] 0709 13:14:14.374417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:14.407539 (+ 33122us) service_pool.cc:224] Handling call
0709 13:14:14.407846 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:14.458211 (+ 50365us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:14.534297 (+ 76086us) log.cc:844] Serialized 14 byte log entry
0709 13:14:14.687458 (+153161us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b18003aad40. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb923a 00007f4b68423a2a
0709 13:14:15.044030 (+356572us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:15.044109 (+    79us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:15.044178 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:15.915617 (+871439us) spinlock_profiling.cc:243] Waited 50.1 ms on lock 0x7b54003f9654. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:15.915674 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:15.915804 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":163119,"prepare.queue_time_us":75590,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":149769,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":17991,"spinlock_wait_cycles":120464384,"thread_start_us":207050,"threads_started":1,"wal-append.queue_time_us":570065}
I20260709 13:14:15.919018   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:15.923452   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:15.924101  4550 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.926923  4550 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:15.750634  4591 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:15.845890  4612 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:15.779497  4393 consensus_queue.cc:237] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.850817   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:15.851840  4681 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:15.705307  4609 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.760370  4633 consensus_queue.cc:237] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.751663  4534 consensus_queue.cc:260] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.859896  4630 raft_consensus.cc:3055] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:15.788519  4660 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:15.862619  4685 log.cc:927] Time spent T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:14:15.946152   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:14:15.866115   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:15.866721  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:15.949339   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:15.950155   552 raft_consensus.cc:2410] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:15.867566   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 674) took 1424 ms. Trace:
I20260709 13:14:15.875785  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:15.812304  4666 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.891031   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:15.955384   483 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:15.896293   630 rpcz_store.cc:276] 0709 13:14:14.856616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:15.084652 (+228036us) service_pool.cc:224] Handling call
0709 13:14:15.100706 (+ 16054us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:15.101226 (+   520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:15.101258 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:15.110200 (+  8942us) log.cc:844] Serialized 26 byte log entry
0709 13:14:15.306222 (+196022us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:15.306557 (+   335us) log.cc:844] Serialized 14 byte log entry
0709 13:14:15.558952 (+252395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:15.559028 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:15.884513 (+325485us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b24001de058. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b651b29c4 00007f4b651b0acb 00007f4b6536bdc9 00007f4b6536ba55 00007f4b6536b09d 00007f4b67f9d10e 00007f4b67fb488c 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221
0709 13:14:15.895662 (+ 11149us) raft_consensus.cc:1685] finished
0709 13:14:15.895762 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:15.895882 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20655,"prepare.queue_time_us":148,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":41437,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":17260,"spinlock_wait_cycles":98562176,"thread_start_us":402865,"threads_started":2,"wal-append.queue_time_us":345235}
I20260709 13:14:15.955901   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:15.773592  4687 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.823791  4345 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:15.961453   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 451731us
I20260709 13:14:15.962163   522 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:15.830845  4631 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:15.881767  4629 consensus_meta.cc:287] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.675s	user 0.006s	sys 0.004s
I20260709 13:14:15.939639   478 raft_consensus.cc:2410] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:14:15.900848  4638 consensus_meta.cc:287] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.638s	user 0.007s	sys 0.005s
I20260709 13:14:15.940450   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:15.944626  4630 raft_consensus.cc:740] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:15.874370  4691 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:15.788048  4601 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:15.864526   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 678) took 1341 ms. Trace:
I20260709 13:14:15.984851   484 rpcz_store.cc:276] 0709 13:14:14.523465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:14.758375 (+234910us) service_pool.cc:224] Handling call
0709 13:14:14.758671 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:15.199089 (+440418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:15.199121 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:15.199160 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:15.199192 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:15.864277 (+665085us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54000d5cd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:15.864326 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:15.864463 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1012377856}
I20260709 13:14:15.953008   558 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:15.951480   475 rpcz_store.cc:276] 0709 13:14:14.443339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:14.587135 (+143796us) service_pool.cc:224] Handling call
0709 13:14:14.596567 (+  9432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:15.704000 (+1107433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:15.867364 (+163364us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540027c9d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:15.867514 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2543025408}
I20260709 13:14:15.954332   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:15.987159   552 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:15.988349   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:15.988967   552 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:15.954509   477 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:15.963260   522 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:15.964332   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:15.994966   633 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:15.965806   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:15.968879   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:15.970158   625 raft_consensus.cc:1240] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:14:15.904796  4348 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:15.975689   632 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:15.940799   628 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:15.977274  1138 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:15.980244   479 raft_consensus.cc:2410] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:14:15.982651   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:16.006567   522 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:16.008981   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:16.009526   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:16.010108   559 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:15.967952  4681 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:15.959432  4687 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:16.024561  4666 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:16.012732   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:16.026934   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:14:16.014442  4611 consensus_meta.cc:287] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.003s
I20260709 13:14:16.015435  4615 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:16.016004  4642 consensus_meta.cc:287] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.794s	user 0.011s	sys 0.000s
I20260709 13:14:16.015865  4348 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:16.016587  4667 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:16.017131  1174 raft_consensus.cc:2368] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10.
I20260709 13:14:16.018503  4345 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:16.019163   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:16.095618   478 raft_consensus.cc:2410] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:14:16.028156   484 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12. Ops: []
W20260709 13:14:16.034881  4684 log.cc:927] Time spent T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:14:16.035495   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:16.100386   475 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:14:16.041013   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 675) took 1580 ms. Trace:
I20260709 13:14:16.102115   482 rpcz_store.cc:276] 0709 13:14:14.460559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:14.595138 (+134579us) service_pool.cc:224] Handling call
0709 13:14:14.595504 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:15.264077 (+668573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:16.040724 (+776647us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b54002dc654. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:16.040943 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1536229760}
I20260709 13:14:15.980674  4629 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.042659   481 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:14:15.941015  4626 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.032639   522 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:16.109392   525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.016s	sys 0.032s
W20260709 13:14:16.058615  4343 consensus_meta.cc:287] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.603s	user 0.007s	sys 0.000s
W20260709 13:14:16.059439  4613 consensus_meta.cc:287] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 1.047s	user 0.006s	sys 0.006s
I20260709 13:14:16.061004  4609 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:16.062897  4601 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:16.063832  4678 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:16.005370  4587 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.066633  4693 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:16.010250  4536 consensus_meta.cc:287] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.826s	user 0.011s	sys 0.000s
I20260709 13:14:16.078801   447 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:16.089996   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:16.090348   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:14:16.094213   449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.000s	sys 0.020s
I20260709 13:14:16.094434   480 raft_consensus.cc:2410] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:14:16.133229   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 54520.9us
I20260709 13:14:16.029155  4682 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:16.028173  4192 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:16.050942  4659 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:16.109843   525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.016s	sys 0.032s
I20260709 13:14:16.145587   556 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11. Ops: []
W20260709 13:14:16.145649   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 605422us
I20260709 13:14:16.041196   559 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
W20260709 13:14:16.110061   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 101876us
I20260709 13:14:16.147949   522 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:16.111631   523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.017s	sys 0.031s
W20260709 13:14:16.120070  4588 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.007s	sys 0.015s
I20260709 13:14:16.107419  4642 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:16.152732  4642 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.154776  4642 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:16.154938  4626 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:16.138142  4609 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:16.133630   629 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:16.133751   449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.000s	sys 0.020s
W20260709 13:14:16.158058   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:16.158406   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:16.090875  4611 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:16.136897   631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1947) took 1522 ms (client timeout 1583 ms). Trace:
I20260709 13:14:16.138790   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:16.160333   626 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:16.160687  4611 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:16.161936  4141 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:16.162441  4141 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.139953   628 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:14:16.162896   629 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:16.092108  4615 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.164583  4141 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:16.164952  4587 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:16.165576  4615 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:16.142619   633 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:16.119552  4681 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:16.166473  4681 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:16.159382   631 rpcz_store.cc:269] 0709 13:14:14.614863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:14.642986 (+ 28123us) service_pool.cc:224] Handling call
0709 13:14:16.136709 (+1493723us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400161cd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:16.136841 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448935296}
I20260709 13:14:16.166896  4681 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:16.167490  4696 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.167986  4696 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.170176  4696 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:16.119848  4343 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:16.171162   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:16.139876   447 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:16.171793   478 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:14:16.172376   626 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:14:16.172863   447 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:16.173403  4609 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:16.173786  4609 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.174278  4609 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:16.174470  4666 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:16.174880  4666 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.175222  4666 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:16.176741  4552 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.178076   484 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:16.098255  4667 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:16.179443  4667 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:16.127199  4613 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.180565  1170 raft_consensus.cc:1240] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 13. Ops: []
I20260709 13:14:16.181982  4613 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:16.134756  4589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.014s	sys 0.039s
W20260709 13:14:16.182747  4589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.015s	sys 0.040s
I20260709 13:14:16.145211   482 raft_consensus.cc:1240] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
W20260709 13:14:16.148900   523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.018s	sys 0.031s
I20260709 13:14:16.158608  4687 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.184037   624 raft_consensus.cc:2368] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11.
I20260709 13:14:16.184078   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:16.184433  4678 consensus_queue.cc:1059] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:16.185912  4687 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:16.186890   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:16.187718   481 raft_consensus.cc:2410] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:14:16.188892  4693 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:16.191206  4681 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.191835   478 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:16.193374  4681 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:16.192852   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:16.187081  4666 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.194900   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:16.195648   478 raft_consensus.cc:2393] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 12: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:16.140924  4536 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.196022  4666 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:16.196429   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:16.174297   447 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:16.197903  4536 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:16.198971   627 raft_consensus.cc:1240] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:16.199783   447 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:16.200881  4642 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:16.201661  4642 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:16.202230  4642 raft_consensus.cc:697] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:16.203701   447 leader_election.cc:400] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12.
W20260709 13:14:16.205063   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 47713us
I20260709 13:14:16.207098   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:16.210417   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:16.218344   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:16.218772   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:16.225574   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:16.126343  4464 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.226881   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:16.236661   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:16.229176   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:16.230386   597 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:16.250135   525 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:16.251636   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:16.254396   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:16.225144  4642 consensus_queue.cc:237] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.255108   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:16.251586   597 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:16.260659   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:16.261375   478 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:16.271534   525 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:16.271927   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:16.167114  4141 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.272778   559 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:16.274861   597 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:16.275642   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 72110.1us
I20260709 13:14:16.227391  4687 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.227640  4588 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.293521   525 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:16.272774  4345 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:16.295961   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:16.298759   629 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:16.296862   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:16.282466  4592 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:16.304158   448 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:16.226538  4536 consensus_queue.cc:1059] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:14:16.273780  4587 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:16.281050  4585 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:16.280643  4599 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:16.280813  4551 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.316895   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:16.318805   559 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:16.235944   598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.005s	sys 0.025s
I20260709 13:14:16.285131  4552 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:16.314643  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 337473us
W20260709 13:14:16.320217   598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.006s	sys 0.025s
I20260709 13:14:16.309967  4666 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:16.334312  4611 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:16.334997  4611 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.336040  4615 consensus_queue.cc:1059] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:16.336867  4636 raft_consensus.cc:3055] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:16.337332  4636 raft_consensus.cc:740] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:16.341750  4615 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:16.337210   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 532) took 1471 ms. Trace:
I20260709 13:14:16.344887   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:16.346812   630 raft_consensus.cc:2393] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 12: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:16.301813  4629 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:16.283924  4141 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.305881  4601 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.350881   478 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:14:16.353878  4649 raft_consensus.cc:2764] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:14:16.317085  4585 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.358357   599 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:16.300824  4588 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.297341  4687 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.315621  4697 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:16.343418  4611 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:16.387588   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2091) took 1735 ms. Trace:
I20260709 13:14:16.348878  4628 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:16.401398   559 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
W20260709 13:14:16.419512   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 61213.7us
I20260709 13:14:16.357635  4681 raft_consensus.cc:2764] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:14:16.350503   629 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:16.425555   557 rpcz_store.cc:276] 0709 13:14:14.651699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:14.663379 (+ 11680us) service_pool.cc:224] Handling call
0709 13:14:14.692572 (+ 29193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:15.259043 (+566471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:16.387304 (+1128261us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54002008d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:16.387523 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083713792}
I20260709 13:14:16.442085   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:16.354727  4343 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:16.317190  4587 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.442212   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:16.436319  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 95689.6us
I20260709 13:14:16.450779   559 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:16.452642  1138 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:16.342773   555 rpcz_store.cc:276] 0709 13:14:14.865366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:14.976599 (+111233us) service_pool.cc:224] Handling call
0709 13:14:15.047597 (+ 70998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:15.047865 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:14:15.922717 (+874852us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b18003cece0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b67fc14bc 00007f4b6530f48b 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b65329455 00007f4b6be113c7 00007f4b684239a7 00007f4b684330bf
0709 13:14:15.922849 (+   132us) log.cc:844] Serialized 14 byte log entry
0709 13:14:16.336587 (+413738us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:16.336681 (+    94us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:16.336755 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:16.336879 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:16.337128 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":128210,"prepare.run_cpu_time_us":514,"prepare.run_wall_time_us":4531,"raft.queue_time_us":23123,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":1330,"spinlock_wait_cycles":14115712,"thread_start_us":600611,"threads_started":2,"wal-append.queue_time_us":431324}
I20260709 13:14:16.351526  4192 consensus_queue.cc:1059] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:14:16.327677  4551 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.457255   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:16.463225   557 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:16.390569  4585 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:16.435923  4629 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:14:16.466893   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 173403us
I20260709 13:14:16.360435  4601 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.468370   525 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:16.471654   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:16.473734   478 raft_consensus.cc:2393] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 12: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:16.442246  4689 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:14:16.464848  4660 consensus_meta.cc:287] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.003s
I20260709 13:14:16.475800  4660 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:16.475937  4141 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:16.352782  4636 consensus_queue.cc:260] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.477694   559 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:14:16.503824   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:16.461748  4714 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:16.501672   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:16.485584  4629 raft_consensus.cc:697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:16.484328  4689 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.493849  4141 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:16.509541  4698 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.510469  4588 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:16.510653  4399 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:16.456080  4343 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.476366  4551 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:16.513712   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:16.476315  4660 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.517658   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:16.521713   448 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:16.565650   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 46451.1us
I20260709 13:14:16.565939   478 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:16.516456   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:16.525118   557 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:16.520746  4689 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:16.565287   553 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:16.518581  4373 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:16.529845  4711 log.cc:927] Time spent T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:14:16.530758  4628 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:16.575739  4710 log.cc:927] Time spent T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:14:16.508405   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:16.534258   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2101) took 1837 ms. Trace:
W20260709 13:14:16.503947  4162 consensus_queue.cc:1175] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" responder_term: 7 status { last_received { term: 7 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 7 index: 7 } }
I20260709 13:14:16.513118  4636 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:16.564217  1171 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 758) took 1909 ms (client timeout 1936 ms). Trace:
I20260709 13:14:16.518539  4601 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:16.516379  4723 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:16.570670   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:16.570926   448 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:16.572356  4667 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.577607   555 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:16.570381  4633 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:16.580158  1171 rpcz_store.cc:269] 0709 13:14:14.655229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:14.655745 (+   516us) service_pool.cc:224] Handling call
0709 13:14:16.563952 (+1908207us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b5400656b54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:16.564141 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":931380480}
I20260709 13:14:16.575802  4628 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.577656   554 rpcz_store.cc:276] 0709 13:14:14.696729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:14.698631 (+  1902us) service_pool.cc:224] Handling call
0709 13:14:14.735516 (+ 36885us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:14.773230 (+ 37714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:14.773257 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:14.773668 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 13:14:15.869109 (+1095441us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b1800428020. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb90d1 00007f4b683d4a0f
0709 13:14:16.275778 (+406669us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:16.275816 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:16.275881 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:16.533956 (+258075us) raft_consensus.cc:1685] finished
0709 13:14:16.534003 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:16.534200 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20851,"raft.queue_time_us":34041,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":3243,"spinlock_wait_cycles":55021824,"thread_start_us":406490,"threads_started":1,"wal-append.queue_time_us":1734535}
W20260709 13:14:16.586853   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 155781us
I20260709 13:14:16.582785   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:16.584817   557 raft_consensus.cc:2393] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 10: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:16.536073  4609 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:16.581833  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 80937.2us
I20260709 13:14:16.594931   478 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:16.599025  1138 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:16.601099  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:16.602216  1168 raft_consensus.cc:2368] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11.
I20260709 13:14:16.607410   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:16.610476  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:16.610304   481 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:16.613090  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:16.615464  1172 pending_rounds.cc:85] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683: Aborting all ops after (but not including) 7
I20260709 13:14:16.615914  1172 pending_rounds.cc:107] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:14:16.616214  1172 raft_consensus.cc:2889] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:16.537873  4141 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.586529  4701 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:16.621881   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:16.622556  1171 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:14:16.542497  4698 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.624698  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:16.625854  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:16.622665   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:16.626034  4700 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.626967   557 raft_consensus.cc:2393] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 12: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
W20260709 13:14:16.630898  4724 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:14:16.630628  4700 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:16.627420   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:16.631224   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:16.631850  4707 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:14:16.627172  1171 pending_rounds.cc:85] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Aborting all ops after (but not including) 9
I20260709 13:14:16.632313  1171 pending_rounds.cc:107] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:14:16.632627  1171 raft_consensus.cc:2889] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:16.632869  4700 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:16.633407  4726 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.632012   557 raft_consensus.cc:2393] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 9: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:16.633916  4726 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.634814   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:16.635481   558 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:16.606053  4714 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 13:14:16.630107  4713 log.cc:927] Time spent T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:14:16.637159   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1925) took 1145 ms. Trace:
I20260709 13:14:16.659683   479 rpcz_store.cc:276] 0709 13:14:15.491755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:15.635626 (+143871us) service_pool.cc:224] Handling call
0709 13:14:16.636969 (+1001343us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54002b25d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:16.637087 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769725312}
I20260709 13:14:16.641599   597 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:16.661165  4365 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:16.642603  4588 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:14:16.644644   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1869) took 1433 ms. Trace:
I20260709 13:14:16.661784  4365 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.647666  4687 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:16.639968   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:16.662990  4687 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:16.637228  4587 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:16.663446   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:16.650868  4609 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:16.618324  4629 consensus_queue.cc:237] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.661895   627 rpcz_store.cc:276] 0709 13:14:15.212173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:15.271860 (+ 59687us) service_pool.cc:224] Handling call
0709 13:14:15.272223 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:16.199640 (+927417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:16.644411 (+444771us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b5400123754. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:16.644569 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2130671488}
I20260709 13:14:16.650786  4659 leader_election.cc:290] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:16.649354  4141 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:16.638520   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:16.647482  4701 raft_consensus.cc:697] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:16.668316  4701 consensus_queue.cc:237] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.630210   553 raft_consensus.cc:2376] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12. Re-sending same reply.
I20260709 13:14:16.660941  4585 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.671304   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:16.671974   481 raft_consensus.cc:1240] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:16.675707   479 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:16.661531   597 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:16.638652  4726 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:16.663552  4687 raft_consensus.cc:697] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:16.679977  4704 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:16.681139  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:16.682092  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:16.697706  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:16.677410  4714 consensus_queue.cc:1059] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:14:16.680486  4704 raft_consensus.cc:697] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:16.701395  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:14:16.701498  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:16.699860   597 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:16.704399   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:16.704639  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:16.703404   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:16.702626   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:16.705724   475 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:16.706085   554 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:16.706569   483 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:14:16.642539  4343 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:16.708364   597 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:16.641805  4712 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:14:16.754151   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 45865.5us
I20260709 13:14:16.756757  4698 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:16.757123  4365 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:16.758478   597 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:16.703420  4141 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:16.768047  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:16.769245   597 leader_election.cc:400] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11.
I20260709 13:14:16.769768   597 leader_election.cc:403] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:14:16.773904   475 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 13.
I20260709 13:14:16.701297  4597 consensus_queue.cc:1059] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 13:14:16.777063  4719 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:14:16.709620  4635 consensus_queue.cc:1059] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:14:16.781452   597 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:16.785343  1168 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:16.778972  4348 raft_consensus.cc:3055] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:16.787829  4348 raft_consensus.cc:740] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:16.789095  4695 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:16.789553  4695 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:16.789919  4695 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:16.680498  4687 consensus_queue.cc:237] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.755092  4588 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:16.788710  4348 consensus_queue.cc:260] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.769753  4712 raft_consensus.cc:697] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:16.800112  4348 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:16.800716  4712 consensus_queue.cc:237] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.801918  1171 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:14:16.803894  4704 consensus_queue.cc:237] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.810738  4588 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:16.813345   597 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:16.817451   479 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
W20260709 13:14:16.820163  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 98810.1us
I20260709 13:14:16.822863   597 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:16.821118  1141 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:16.829785  4635 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:16.829998  1141 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:16.830232  4635 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.830587  4635 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:16.830862  1141 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:16.831496  4714 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:16.832039  4192 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:16.832167  4714 raft_consensus.cc:697] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:16.803386  4415 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11.
I20260709 13:14:16.806839  4705 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:16.837162   597 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:16.819075  4588 raft_consensus.cc:2749] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:16.775725  4141 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.844116  4597 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:16.862022   522 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:16.869557   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:16.870178   626 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:16.866937  4247 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:16.867355  4365 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:16.867414  4588 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:16.868184   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:16.857509  4415 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:16.883711   626 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 13.
I20260709 13:14:16.833144  4629 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:14:16.859493  4585 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:16.874512   522 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:16.897205   522 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:16.869100  4686 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.885826  4343 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:16.908155   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:16.909113   626 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:16.918983   626 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:16.894212  4365 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.905808  4626 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.920884   522 leader_election.cc:304] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:16.889938  4247 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.904386  4581 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:16.905618  4698 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.906877  4415 raft_consensus.cc:697] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:16.907723  4726 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:14:16.948612  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 86021.9us
I20260709 13:14:16.894894  4588 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.952255   626 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:16.860766  4714 consensus_queue.cc:237] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:16.909675  4587 consensus_queue.cc:1059] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 13:14:16.959157  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:16.946975  4343 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:16.913936  4686 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.948282  4626 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.969548   554 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:16.967377  4726 raft_consensus.cc:697] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:16.977123  4141 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:16.977464  4726 consensus_queue.cc:237] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:16.984967  4700 consensus_queue.cc:1059] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:16.986424  4700 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:16.988749  4588 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:16.988965  4649 raft_consensus.cc:3055] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:16.989564  4649 raft_consensus.cc:740] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:16.948428  4192 raft_consensus.cc:697] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:16.995065   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:16.989485  4343 raft_consensus.cc:697] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:16.950553  4698 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:17.036429  4365 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:17.038252  4247 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:17.040922  4626 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:17.042039  4192 consensus_queue.cc:237] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:17.051515   478 raft_consensus.cc:1240] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:16.987080  4700 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:17.066612   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:17.067597   554 raft_consensus.cc:2410] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:14:17.069661  4733 log.cc:927] Time spent T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:14:17.078074   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:17.048424  4649 consensus_queue.cc:260] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:17.047323  4415 consensus_queue.cc:237] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:17.077332  4343 consensus_queue.cc:237] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:17.093412   525 leader_election.cc:336] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.634s (SENT)
I20260709 13:14:17.075469  4741 consensus_queue.cc:1059] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:14:17.096485   478 raft_consensus.cc:1240] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:17.099721   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:17.100482   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:17.100850   554 raft_consensus.cc:2410] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:14:17.101351   550 raft_consensus.cc:2410] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:17.102384   550 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:17.109935   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 2067) took 1596 ms. Trace:
I20260709 13:14:17.110355   484 rpcz_store.cc:276] 0709 13:14:15.513961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:16.096837 (+582876us) service_pool.cc:224] Handling call
0709 13:14:16.097149 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:16.178452 (+ 81303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:17.109703 (+931251us) spinlock_profiling.cc:243] Waited 80.7 ms on lock 0x7b54001419d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:17.109874 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185673600}
I20260709 13:14:17.112015   448 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:17.112936   448 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:17.114058   448 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:17.102329   554 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:17.117237   525 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:17.117620   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:17.118320   525 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:17.118799   448 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:17.119591   525 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:17.126137   550 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:14:17.126655   550 pending_rounds.cc:85] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 7
I20260709 13:14:17.126945   550 pending_rounds.cc:107] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:14:17.127305   550 raft_consensus.cc:2889] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:17.132144   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:17.134093  4586 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:17.136976  4745 log.cc:927] Time spent T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:14:17.136873  4586 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:17.129257  4601 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:17.125108  4694 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:17.141824  4698 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:17.143180  4686 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:17.125943  4626 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:17.151561  4586 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:17.152381   484 raft_consensus.cc:2368] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13.
I20260709 13:14:17.153599   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:17.159646   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:17.161105   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:17.154964   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:17.162755   478 raft_consensus.cc:2393] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 11: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:17.163722   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:17.162494   484 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:17.165033   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:17.166401   478 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:17.168202   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:14:17.168599  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 60443.7us
I20260709 13:14:17.169075   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:17.169777   484 raft_consensus.cc:2393] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:17.170956   484 raft_consensus.cc:1240] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:14:17.123689  4649 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:17.124742  4581 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:17.181844   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:17.183116  4741 consensus_queue.cc:1059] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:17.129585  4141 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:17.187546   554 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:17.165768  4587 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:14:17.193747  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:17.196688  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 60401.6us
I20260709 13:14:17.197069  4587 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:17.208158   478 raft_consensus.cc:2410] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:14:17.211238   554 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
W20260709 13:14:17.211966  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:17.214558   554 raft_consensus.cc:1240] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:17.218904  4744 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.219472  4744 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:17.221000  4750 log.cc:927] Time spent T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:14:17.221567  4744 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:17.222110  4636 raft_consensus.cc:3055] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:17.197751  4635 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:17.223045  1139 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:17.222482  4636 raft_consensus.cc:740] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:17.226577  4636 consensus_queue.cc:260] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:17.213737  4587 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:17.229776  1139 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:17.230765  4762 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:17.232165  1139 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:17.236651  4744 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:17.238955  4762 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:17.242311  4695 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:17.244729  4695 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:17.244904  4534 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:17.224475  4759 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.257053  4703 raft_consensus.cc:3055] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:17.257524  4703 raft_consensus.cc:740] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:17.258369  4703 consensus_queue.cc:260] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:17.261284   559 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:17.262953  4613 raft_consensus.cc:3055] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:17.263394  4613 raft_consensus.cc:740] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:17.264478  4613 consensus_queue.cc:260] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:17.266008  4613 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:17.269604  4635 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:17.269976  4667 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:17.275720  4464 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:17.279776   477 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1919) took 1817 ms (client timeout 1858 ms). Trace:
I20260709 13:14:17.280151   525 leader_election.cc:400] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13.
I20260709 13:14:17.280546   525 leader_election.cc:403] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:14:17.280397   477 rpcz_store.cc:269] 0709 13:14:15.462191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:15.923163 (+460972us) service_pool.cc:224] Handling call
0709 13:14:17.279517 (+1356354us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b54000d6bd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:17.279663 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70006528}
I20260709 13:14:17.281387   525 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:17.282215  4723 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.283849   525 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:17.284684  4649 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:17.285032   525 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:17.282681  4723 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:17.291919   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:17.292554   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:17.293289   481 raft_consensus.cc:2393] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 8: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:17.293565   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:17.294802   525 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:17.295475   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:17.302953   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:17.303033   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:17.304580  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 68352.1us
I20260709 13:14:17.287880  4723 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:17.305815  4581 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:17.308656   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:17.307440   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:17.309877   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:17.310701   481 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:17.308872   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:17.311784   525 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:17.312266   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:17.311497   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:17.314299   477 raft_consensus.cc:2410] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:14:17.314424   478 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:17.316253   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:17.316843   481 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:17.303143  4681 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:17.300802  4464 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:17.303838  4703 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:17.268049  4759 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:17.303416  4667 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:17.334373  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:17.339815  4628 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:17.335381  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:17.341049  4759 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:17.336098  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:17.344056  4649 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13.
I20260709 13:14:17.336726  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:17.346544  1169 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
W20260709 13:14:17.346908  4732 log.cc:927] Time spent T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.562s	user 0.001s	sys 0.000s
I20260709 13:14:17.345772  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:17.347507  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:14:17.345227  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:17.348397  4649 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.349210  4618 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:17.348879  4649 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:17.336578   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 1957) took 1403 ms. Trace:
I20260709 13:14:17.349526  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:17.350051   624 rpcz_store.cc:276] 0709 13:14:15.933318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:15.941052 (+  7734us) service_pool.cc:224] Handling call
0709 13:14:17.336388 (+1395336us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b5400051ed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:17.336525 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":545280384}
I20260709 13:14:17.350549  4592 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:17.349228  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:17.350688  1170 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:14:17.315644  4723 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:17.351209  4649 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:17.354414   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2111) took 1382 ms. Trace:
I20260709 13:14:17.355010   481 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 13.
I20260709 13:14:17.354943   597 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:17.364435   556 rpcz_store.cc:276] 0709 13:14:15.972476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:16.014076 (+ 41600us) service_pool.cc:224] Handling call
0709 13:14:16.014400 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:16.146179 (+131779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:17.354191 (+1208012us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540031a6d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:17.354360 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301294464}
I20260709 13:14:17.365850   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:17.366413   556 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:17.367002  4415 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:17.367450  4415 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:17.367789  4415 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:17.351469  4689 raft_consensus.cc:3055] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:17.371838  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:17.372510  1171 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:14:17.372596  1141 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:17.372123  4689 raft_consensus.cc:740] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:17.373855  4162 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:17.374400  4162 raft_consensus.cc:697] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:17.375196  4162 consensus_queue.cc:237] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:17.375703   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 544) took 1017 ms. Trace:
I20260709 13:14:17.376210  4689 consensus_queue.cc:260] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:17.376129   554 rpcz_store.cc:276] 0709 13:14:16.358572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:17.215494 (+856922us) service_pool.cc:224] Handling call
0709 13:14:17.215712 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:17.267306 (+ 51594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:17.267337 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:17.267380 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:17.267399 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:17.375431 (+108032us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b54000ebd54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:17.375482 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:17.375637 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118228736}
I20260709 13:14:17.377516  4536 raft_consensus.cc:3055] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:17.377749   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:17.377948  4536 raft_consensus.cc:740] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:17.378382   554 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:17.332926  4141 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.378865  4536 consensus_queue.cc:260] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:17.379544  4141 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:17.379916  4536 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:17.380887   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:17.380808   597 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:17.388789   481 raft_consensus.cc:2410] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:14:17.388896   597 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:17.383524   556 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:17.383584   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:17.351917  4592 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:17.381899  4689 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:17.390758   478 raft_consensus.cc:2410] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:14:17.388645   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:17.391093   597 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:17.392607   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:17.354235  4739 consensus_queue.cc:1059] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 13:14:17.385279  4701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.004s	sys 0.009s
I20260709 13:14:17.354266  4618 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:17.396142   481 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:17.396823   554 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:17.364360  4723 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:17.416167   552 raft_consensus.cc:2393] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 13: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:17.416985   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:17.429723   556 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:14:17.425803  4587 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:17.417846  4701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.006s	sys 0.011s
I20260709 13:14:17.392809  4508 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:17.438349  1139 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:17.439754  4399 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:17.439895  4508 raft_consensus.cc:697] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:17.440217  4399 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.440688  4399 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:17.441219  4508 consensus_queue.cc:237] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:17.431593  4723 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:17.449731  4399 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:17.430086   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:17.456907   552 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:17.458746   597 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:17.392187  4267 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:14:17.463441  4769 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:14:17.464227  4725 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.889s	user 0.000s	sys 0.002s
I20260709 13:14:17.432360  4618 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:17.469903  4618 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:17.436545  4695 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:17.433447   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:17.477530   553 raft_consensus.cc:1240] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:17.474849   597 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:17.484546  4686 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:17.485113  4686 raft_consensus.cc:697] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:17.485968  4686 consensus_queue.cc:237] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:17.474009  4670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.515s	user 0.014s	sys 0.022s
I20260709 13:14:17.483906   597 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:17.488919   481 raft_consensus.cc:1275] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:17.473677  4393 raft_consensus.cc:2764] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 LEADER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:14:17.478022  4631 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:17.500551   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:17.451459  4765 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:14:17.490012  4670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.533s	user 0.015s	sys 0.022s
W20260709 13:14:17.509750  1174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 621) took 1719 ms (client timeout 2052 ms). Trace:
W20260709 13:14:17.510298  1174 rpcz_store.cc:269] 0709 13:14:15.790422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:15.791983 (+  1561us) service_pool.cc:224] Handling call
0709 13:14:17.509434 (+1717451us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54006a0ed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:17.509634 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515307904}
I20260709 13:14:17.508929  4729 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:17.514598  4660 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:17.495048  4690 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:14:17.519127   447 leader_election.cc:336] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 2.224s (SENT)
I20260709 13:14:17.503432  4247 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:17.489064  4723 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:17.499289  4739 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:14:17.511853  4373 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:17.512791  4631 raft_consensus.cc:697] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:17.514964  4450 raft_consensus.cc:3055] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:17.562178   475 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:17.522545  4690 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.524214  4247 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:17.572803   480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 2064) took 2268 ms (client timeout 1729 ms). Trace:
I20260709 13:14:17.573988   552 raft_consensus.cc:1240] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 9. Current term is 10. Ops: []
W20260709 13:14:17.575580  4772 log.cc:927] Time spent T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:14:17.577313   480 rpcz_store.cc:269] 0709 13:14:15.293007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:15.299814 (+  6807us) service_pool.cc:224] Handling call
0709 13:14:17.558860 (+2259046us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b5400184054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:17.561703 (+  2843us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1824769920}
I20260709 13:14:17.556421  4660 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:17.514837  4729 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:17.594580  4747 log.cc:927] Time spent T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.513s	user 0.003s	sys 0.000s
I20260709 13:14:17.595213   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:17.596081   556 raft_consensus.cc:2393] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 12: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:17.573217  4450 raft_consensus.cc:740] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:17.576609  4627 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:17.576800  4690 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:17.595606  4613 raft_consensus.cc:3055] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:17.615989   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:17.605221  4508 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.611811  4613 raft_consensus.cc:740] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:17.588274  4660 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:17.632781   554 raft_consensus.cc:1275] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:14:17.635003   554 raft_consensus.cc:1275] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:17.628151  4631 consensus_queue.cc:237] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:17.638109  4587 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:17.646760  4247 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:17.648015  4613 consensus_queue.cc:260] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:17.650045  4613 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:17.630472  4630 consensus_queue.cc:260] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:17.630769  4508 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:17.652351  4415 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:17.653477  4508 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:17.653959  4660 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:17.658190   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 2076) took 1468 ms. Trace:
W20260709 13:14:17.659885  4775 log.cc:927] Time spent T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:14:17.658615   482 rpcz_store.cc:276] 0709 13:14:16.189382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:16.531410 (+342028us) service_pool.cc:224] Handling call
0709 13:14:16.531772 (+   362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:16.532153 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:16.532195 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:16.532845 (+   650us) log.cc:844] Serialized 52 byte log entry
0709 13:14:16.709475 (+176630us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:16.765375 (+ 55900us) log.cc:844] Serialized 14 byte log entry
0709 13:14:16.765603 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:16.765682 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:17.485964 (+720282us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b18002f8ea0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b652fa2a6 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6532c3f3 00007f4b6532e7c1
0709 13:14:17.655639 (+169675us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b18002f8ea0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6532c3f3 00007f4b6532e7c1 00007f4b6532e779 00007f4b6532e709 00007f4b6532e6d1 00007f4b6532d9cd 000000000038f354 000000000038f199 00007f4b6530f83a
0709 13:14:17.657904 (+  2265us) raft_consensus.cc:1685] finished
0709 13:14:17.657925 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:17.658125 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":55774,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":3694,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":12138,"spinlock_wait_cycles":48367616,"thread_start_us":176197,"threads_started":1,"wal-append.queue_time_us":243870}
W20260709 13:14:17.661659  4770 log.cc:927] Time spent T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:14:17.684360  4729 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:17.639580  4450 consensus_queue.cc:260] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:17.686794  4450 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:17.691887  4723 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:17.701637   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:17.717291   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:17.743394  4592 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:17.753429  4373 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:17.763891  4415 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:17.702834  4695 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:17.771077   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:17.784428   625 raft_consensus.cc:2393] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 12: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:17.774365   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:17.776078   627 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:17.777402   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:17.779860   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:17.787621   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:17.778841   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:17.779969   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:17.795045   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:17.786157   630 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:17.798277   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:17.799010   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:17.799887   630 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:17.802696   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:17.805045   556 raft_consensus.cc:1240] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: []
W20260709 13:14:17.808815  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:17.807639  4521 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.813659  4521 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:17.816916  4521 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:17.829002  4690 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:17.831295   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 200900us
I20260709 13:14:17.832290   624 raft_consensus.cc:1240] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:14:17.833303  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:17.834080  1166 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:17.834676   633 raft_consensus.cc:2393] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 12: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:17.835610   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:17.836325  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:17.836655   599 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:17.801234  4536 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:17.838690  1172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 763) took 1238 ms. Trace:
I20260709 13:14:17.845377   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:17.839794  1172 rpcz_store.cc:276] 0709 13:14:16.600370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:16.601687 (+  1317us) service_pool.cc:224] Handling call
0709 13:14:16.615178 (+ 13491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:16.623271 (+  8093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:16.623317 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:16.623840 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:14:16.763599 (+139759us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:16.854674 (+ 91075us) log.cc:844] Serialized 14 byte log entry
0709 13:14:17.831267 (+976593us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b5400444e20. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68394733 00007f4b68419dbf 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c
0709 13:14:17.831322 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:17.831399 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:17.831441 (+    42us) raft_consensus.cc:1685] finished
0709 13:14:17.838498 (+  7057us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:17.838634 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1557,"prepare.queue_time_us":140441,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2838,"raft.queue_time_us":67917,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":22582,"spinlock_wait_cycles":6095104,"thread_start_us":145961,"threads_started":3,"wal-append.queue_time_us":166114}
I20260709 13:14:17.851356   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:17.857893   626 raft_consensus.cc:1240] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:17.860114  1166 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:14:17.842583  4695 raft_consensus.cc:2764] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
W20260709 13:14:17.864274   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:17.869544  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:17.869619  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:17.864826   522 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:17.865434   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:17.872864   627 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:14:17.875663  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:17.876499  1172 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:17.877516  1138 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:17.882517   522 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:17.883924  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:17.844012  4536 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:17.885499   522 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:17.881289  4521 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:17.889070  4689 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:17.889611  4587 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:17.898054  4521 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.907922  4587 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.898631  4660 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:17.908413  4587 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:17.908560  4660 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.908950  4660 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:17.899857   522 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:17.904610  4592 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:17.905332  4690 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:17.908012  4521 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:17.901340   523 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:17.880098  4415 consensus_queue.cc:1048] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:14:17.869513  4723 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:14:17.918639   522 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:17.917243  4649 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:17.896556  4695 consensus_queue.cc:1048] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:14:17.930428   522 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:17.920576  4689 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:14:17.937317   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:17.942495   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 177458us
I20260709 13:14:17.916523  4618 consensus_queue.cc:1059] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:14:17.927644  4592 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:17.939770  4723 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:14:17.956722   476 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 2066) took 2654 ms (client timeout 2112 ms). Trace:
W20260709 13:14:17.957296   476 rpcz_store.cc:269] 0709 13:14:15.302377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:15.303360 (+   983us) service_pool.cc:224] Handling call
0709 13:14:17.956463 (+2653103us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54002dcb54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:17.956625 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3928412032}
I20260709 13:14:17.960557  4450 consensus_queue.cc:1059] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:17.961256  4536 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:17.961776  4450 raft_consensus.cc:3055] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:17.962255  4450 raft_consensus.cc:740] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:17.971071  4450 consensus_queue.cc:260] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:17.972548  4450 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:17.974990  4737 log.cc:927] Time spent T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 1.005s	user 0.002s	sys 0.005s
I20260709 13:14:17.960608  4691 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:14:17.979293  4321 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:17.980494   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:17.980636  4630 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:17.982590   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 142543us
W20260709 13:14:17.986023   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:17.986616   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:18.000710   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 99456.8us
I20260709 13:14:18.001912   523 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:18.003677   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 163545us
I20260709 13:14:18.004597   599 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:18.005654   523 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:18.006944   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 76639.1us
I20260709 13:14:18.007620   523 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:18.005348  4723 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:18.014098   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:18.006783  4592 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:18.009774   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:18.015986   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:18.010499   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:18.012486  4649 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:18.009579   523 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:18.015574   628 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:18.016861   626 raft_consensus.cc:2368] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12.
I20260709 13:14:18.016708   629 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:14:18.017478   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:18.020090   624 raft_consensus.cc:2393] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 10: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:18.020007   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:18.008016  4786 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:18.021637   628 raft_consensus.cc:2393] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 13: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:18.022473   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:18.025311   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:18.025882   626 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:18.026016   523 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:18.024513  4521 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:18.028716   625 raft_consensus.cc:1275] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:18.027011  4723 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:18.021425  4649 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:18.030041  4649 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:18.030520  4521 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:18.030741  4591 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.031392  4591 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:18.032308   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:18.032661   551 raft_consensus.cc:2410] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:14:18.034032   629 raft_consensus.cc:1240] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:14:18.034576   559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2000) took 1807 ms (client timeout 1900 ms). Trace:
I20260709 13:14:18.034837   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:18.035048   559 rpcz_store.cc:269] 0709 13:14:16.227344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:16.516201 (+288857us) service_pool.cc:224] Handling call
0709 13:14:18.034380 (+1518179us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b540002a8d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:18.034492 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1596332928}
I20260709 13:14:18.035571   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:18.036203   629 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:18.036473   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:18.037443   559 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:14:18.038470  4649 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:18.042640   629 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:18.042959   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:18.043630   481 raft_consensus.cc:2393] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 13: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:18.045943   480 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:14:18.047022   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:18.047205  1139 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:18.047582   481 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:18.048097   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:18.051494  4723 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:14:18.054736   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 436495us
I20260709 13:14:18.056830   523 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:18.058257   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:18.061051   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:18.061645   480 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:18.061558   478 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:18.063090   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:18.063935   480 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:18.061506   483 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:14:18.066435   483 pending_rounds.cc:85] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 5
I20260709 13:14:18.066741   483 pending_rounds.cc:107] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:14:18.067024   483 raft_consensus.cc:2889] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:18.038551   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:18.081962  4759 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:14:18.082508  4746 log.cc:927] Time spent T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 1.123s	user 0.005s	sys 0.002s
I20260709 13:14:18.082948  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:18.083652  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:18.082471  4759 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:14:18.098413   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:18.100646   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:14:18.103806   555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2006) took 1801 ms (client timeout 1753 ms). Trace:
I20260709 13:14:18.104090   626 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:18.107666   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:18.107784  1169 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:14:18.108541  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:18.104182   555 rpcz_store.cc:269] 0709 13:14:16.302468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:16.478985 (+176517us) service_pool.cc:224] Handling call
0709 13:14:18.103623 (+1624638us) spinlock_profiling.cc:243] Waited 61.5 ms on lock 0x7b54001d7754. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:18.103746 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141440256}
I20260709 13:14:18.110240   525 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:18.111049   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:18.115451   551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 2092) took 3463 ms (client timeout 2104 ms). Trace:
I20260709 13:14:18.116155  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:14:18.115908   551 rpcz_store.cc:269] 0709 13:14:14.651993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:14.652096 (+   103us) service_pool.cc:224] Handling call
0709 13:14:18.115200 (+3463104us) spinlock_profiling.cc:243] Waited 3.37 s on lock 0x7b5400388954. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:18.115354 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7758176000}
I20260709 13:14:18.116751  1172 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:18.117216   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:18.117903   551 raft_consensus.cc:2393] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:18.118858   481 raft_consensus.cc:2410] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:14:18.123751   627 raft_consensus.cc:2393] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 12: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:18.127012   480 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:18.128465  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:18.128746   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:18.129908   551 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:18.075251  4321 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:18.139978   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:18.140605   559 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:14:18.141395   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:18.142014   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:18.142562   555 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:14:18.143332   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:18.143632  1139 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:18.143978   555 raft_consensus.cc:2393] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 11: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:18.149070   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54754 (request call id 565) took 1282 ms. Trace:
I20260709 13:14:18.149487   631 rpcz_store.cc:276] 0709 13:14:16.866749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:16.867896 (+  1147us) service_pool.cc:224] Handling call
0709 13:14:18.144551 (+1276655us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54001ae0d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:18.149011 (+  4460us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968742656}
I20260709 13:14:18.149986   448 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:18.109762  4759 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:18.151433   551 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:18.151173   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:18.152138   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:18.157713   559 raft_consensus.cc:2368] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12.
I20260709 13:14:18.158682   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:18.157754   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:18.132722  4788 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.158862   597 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:18.171612  4788 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.138329  4689 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:18.172958  4689 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:18.173280  4781 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:18.173519  4689 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:18.173947  4781 raft_consensus.cc:697] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:18.174118  4788 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:18.174703  4788 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:18.162653   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:18.166337  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:18.158351  4393 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:18.168268   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:18.144651  4321 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.201443   624 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:18.168913   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:18.169672   628 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:18.201738   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:18.128540  4450 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.176412  4649 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:18.174935  4781 consensus_queue.cc:237] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.180400   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:18.180814  4415 consensus_queue.cc:1059] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:18.181883   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:18.222088   556 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:18.222604   557 raft_consensus.cc:2393] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 10: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:18.186359  4690 raft_consensus.cc:3055] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:18.186036  4660 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.190455   448 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:18.201128  4393 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.191901   626 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:18.191784   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:18.192293  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:18.192631  4723 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.193414  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:18.238802  1169 raft_consensus.cc:2393] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 12: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:18.241797   556 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:18.242292   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:18.198542   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:18.199107   447 leader_election.cc:400] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12.
I20260709 13:14:18.169708   551 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:18.242941   554 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:18.243156   447 leader_election.cc:403] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:14:18.243091   556 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:18.205154   631 raft_consensus.cc:1240] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:18.205633  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:18.217213  1172 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:18.218755   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:18.246055   624 raft_consensus.cc:2410] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:14:18.219409   629 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:18.190980  4587 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.227416   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:18.201751  4521 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:14:18.232133   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:18.191558  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:18.202096  4321 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:18.235631  1175 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:18.221073  4450 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.236934  1174 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:18.237331   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:18.204818   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:18.251190   551 raft_consensus.cc:1240] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:18.228121  4690 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:14:18.230623   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 113236us
I20260709 13:14:18.202863  4691 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:14:18.262014   555 raft_consensus.cc:2393] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 10: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:18.256628   557 raft_consensus.cc:1275] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:18.239893  4393 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:18.267958   525 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:18.271656   557 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:18.275103  4450 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:18.274729  4789 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:18.277225  4691 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:18.287011   555 raft_consensus.cc:1240] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:18.281154   554 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:18.247661  4744 raft_consensus.cc:2764] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:14:18.252571   556 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:18.284700   525 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:18.288942   557 raft_consensus.cc:1240] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:18.291441   554 raft_consensus.cc:1240] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:18.294448   554 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:18.270948  4678 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:18.247797  4723 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.292449   557 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 12. Ops: []
I20260709 13:14:18.298359   554 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:14:18.299433   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:18.308079   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:18.308840   484 raft_consensus.cc:2393] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 9: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:18.309684   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:18.310263   484 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:18.311553   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:18.312170   476 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:18.312994   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:18.313740   476 raft_consensus.cc:2410] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:14:18.314616   476 raft_consensus.cc:3055] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:18.314910   476 raft_consensus.cc:740] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:18.315536   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:18.317036   482 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:14:18.318949   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:18.300221  4415 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:14:18.319581   478 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:18.311028   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:18.321446   484 raft_consensus.cc:2393] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 8: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:18.323378   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:18.323951   478 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:18.328575  4399 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:18.329136  4794 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:18.329698   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:18.330408   477 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:18.331490  4678 raft_consensus.cc:697] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:18.332393  4678 consensus_queue.cc:237] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:18.333539   476 consensus_queue.cc:260] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.334496   476 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:18.340047  4591 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:18.341305  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:18.342006  1171 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:18.341555   484 raft_consensus.cc:1240] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:18.294240   556 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:18.301573  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:18.289458  4649 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:18.363365   557 raft_consensus.cc:1240] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:14:18.363873   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 173475us
I20260709 13:14:18.364989   557 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:18.366915   476 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:14:18.367300   476 pending_rounds.cc:85] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 7
I20260709 13:14:18.367121   478 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:18.368832   448 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:18.374289   476 pending_rounds.cc:107] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:14:18.374214   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:18.375972   476 raft_consensus.cc:2889] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:18.377017   448 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:18.329752  4794 raft_consensus.cc:697] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:18.362442   370 maintenance_manager.cc:419] P 958aa06b858546888f102fe85618915c: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033391
I20260709 13:14:18.380496  4794 consensus_queue.cc:237] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.381461  4450 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:18.384172   554 raft_consensus.cc:1240] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:14:18.404597   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 196825us
I20260709 13:14:18.357676  4521 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:18.414126   484 raft_consensus.cc:3055] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:18.414126   476 raft_consensus.cc:3055] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:18.420049   476 raft_consensus.cc:740] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:18.414866   599 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:18.414762   478 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:18.420749   551 raft_consensus.cc:1275] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:18.419973   484 raft_consensus.cc:740] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:18.422094   551 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:14:18.423991   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 225063us
I20260709 13:14:18.303032  4345 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 13:14:18.470337   476 consensus_queue.cc:260] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.471823   476 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:18.470536   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 55734.8us
I20260709 13:14:18.421842   484 consensus_queue.cc:260] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.473752   484 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:18.479902  4678 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:18.480976  4678 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:18.481483  4678 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.481961  4678 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:18.486550   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:18.491963   476 raft_consensus.cc:1275] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:18.375433  4373 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 13:14:18.509374   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:18.513504  4321 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:18.514194  4141 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:18.503468  4780 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:18.362787  4690 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.517204  1174 raft_consensus.cc:1240] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:18.518278  4723 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:18.503727  4508 consensus_queue.cc:1048] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
W20260709 13:14:18.542166   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 158483us
I20260709 13:14:18.500435  4686 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.519500  4660 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:18.553073   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:18.497845  4591 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:14:18.554234   559 raft_consensus.cc:2393] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 11: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:18.470693  4521 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:18.547972  4759 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:18.549597  4141 consensus_queue.cc:1059] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:14:18.561275  4759 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:18.562768  4321 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:18.563637   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:18.572633  4321 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.573155  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:18.573350  4321 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.547881  4592 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.573859  1174 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:18.575554  4592 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.576815   550 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
W20260709 13:14:18.562813   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:18.582445   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:18.556821   448 leader_election.cc:400] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12.
I20260709 13:14:18.583067   550 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
W20260709 13:14:18.580262  4801 log.cc:927] Time spent T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:14:18.558221  4780 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.587932   448 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:18.578727  4690 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:18.586421   484 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
W20260709 13:14:18.553519  4267 consensus_queue.cc:1175] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" responder_term: 12 status { last_received { term: 12 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 12 index: 7 } }
I20260709 13:14:18.561287  4521 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:18.592592   484 pending_rounds.cc:85] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 6
I20260709 13:14:18.597155   484 pending_rounds.cc:107] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:14:18.603889   484 raft_consensus.cc:2889] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:18.579949  4781 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.583940  4587 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:18.612926   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 139215us
I20260709 13:14:18.613914   599 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:18.604912  1174 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:18.582860  4805 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.554170  4686 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:18.587212  4141 consensus_queue.cc:1243] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 6e6df7e8ed204f1db5c371536b5b0683 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:14:18.593531  4592 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:18.585891   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:18.614822   448 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:18.618084   599 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:18.620472   448 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:18.620795   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:18.623139   448 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:18.622083   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:18.623324   476 raft_consensus.cc:2410] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:14:18.625900   447 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:18.626019   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:18.627256   447 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:18.594333  4780 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.632673   599 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:18.618989  4508 raft_consensus.cc:2749] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:18.618350  4321 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:18.615098  4808 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:18.624850  4450 raft_consensus.cc:697] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:18.628984  4141 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:18.630353  4345 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:18.610862  4781 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.649255   599 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:18.632027  4415 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:14:18.657114   447 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:18.622303  4805 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:18.645606  4345 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:18.650147  4808 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:18.649600  4141 raft_consensus.cc:697] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:18.663376   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 546) took 2304 ms. Trace:
I20260709 13:14:18.648849  4703 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:18.645036  4809 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:14:18.703511   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 52138.5us
I20260709 13:14:18.648751  4807 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:18.710350   597 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:18.706430   553 rpcz_store.cc:276] 0709 13:14:16.359073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:17.234254 (+875181us) service_pool.cc:224] Handling call
0709 13:14:17.239270 (+  5016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:17.478100 (+238830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:18.663035 (+1184935us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54000eb854. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:18.663298 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543766400}
I20260709 13:14:18.714243   597 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:18.715437   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:18.702183  4345 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:18.668155  4814 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:18.726198   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 77801.5us
I20260709 13:14:18.714974  4812 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:18.714745  4703 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:18.727494  4373 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:18.741189  4703 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:18.741274  4373 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:18.741887  4373 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:18.746418  4813 log.cc:927] Time spent T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:14:18.737190  4812 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:18.747819  4812 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:18.748183  4804 log.cc:927] Time spent T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:14:18.749936  4689 consensus_meta.cc:287] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.000s
I20260709 13:14:18.750284  4780 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:18.750377  4689 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.751351  4415 consensus_queue.cc:1059] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:18.751556  4820 consensus_queue.cc:1059] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:18.728082  4536 raft_consensus.cc:3055] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:18.756059   632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 567) took 1884 ms. Trace:
W20260709 13:14:18.734831  4806 log.cc:927] Time spent T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:14:18.725488  4816 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:14:18.785758   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 70235.3us
I20260709 13:14:18.775807   632 rpcz_store.cc:276] 0709 13:14:16.871382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:16.871554 (+   172us) service_pool.cc:224] Handling call
0709 13:14:16.895481 (+ 23927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:16.923695 (+ 28214us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:14:17.056929 (+133234us) log.cc:844] Serialized 14 byte log entry
0709 13:14:17.075265 (+ 18336us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:17.075315 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:17.075358 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:17.227903 (+152545us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b18003d31e0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6532c522 00007f4b6532e7c1 00007f4b6532e779 00007f4b6532e709 00007f4b6532e6d1 00007f4b6532d9cd 000000000038f354 000000000038f199 00007f4b6530f83a
0709 13:14:18.755850 (+1527947us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b54000519d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:18.755896 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:18.755998 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":119951,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":93,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":1362,"spinlock_wait_cycles":71301632,"thread_start_us":114047,"threads_started":2,"wal-append.queue_time_us":91881,"wal-append.run_cpu_time_us":1264,"wal-append.run_wall_time_us":1007232}
W20260709 13:14:18.747828  4811 log.cc:927] Time spent T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:14:18.788323   597 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:18.760870  4267 raft_consensus.cc:3055] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:18.762148  4636 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:18.739173  4809 raft_consensus.cc:697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:18.728627  4821 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:18.756485  4686 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:18.757352  4781 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:18.813433  4726 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:18.759086  4615 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:14:18.814230  4726 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:18.785104  4744 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:14:18.793005  4739 consensus_queue.cc:1059] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:14:18.820794  4739 raft_consensus.cc:3055] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:18.821261  4739 raft_consensus.cc:740] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:18.823827   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 550) took 1707 ms. Trace:
I20260709 13:14:18.824409   552 rpcz_store.cc:276] 0709 13:14:17.116059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:17.476522 (+360463us) service_pool.cc:224] Handling call
0709 13:14:17.476787 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:17.577440 (+100653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:18.823515 (+1246075us) spinlock_profiling.cc:243] Waited 97 ms on lock 0x7b5400387554. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:18.823750 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223156480}
I20260709 13:14:18.752166  4805 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:18.795456   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:18.777721  4536 raft_consensus.cc:740] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:18.782403  4321 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:18.785655  4592 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:18.723989  4450 consensus_queue.cc:237] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:18.803623  4812 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.805998  4373 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:18.752408  4415 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:14:18.809052  4689 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:18.812897  4691 consensus_meta.cc:287] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.000s
I20260709 13:14:18.793936  4267 raft_consensus.cc:740] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:18.760041  4807 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:18.788074  4816 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:18.759352  4678 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:18.832506   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:18.833693   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 176692us
I20260709 13:14:18.740038  4808 consensus_queue.cc:1059] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:14:18.836352   597 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:14:18.838985   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 121304us
W20260709 13:14:18.841302   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 103414us
I20260709 13:14:18.836191  4615 consensus_queue.cc:1059] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:14:18.827535  4821 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:14:18.834261  4765 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.000s	sys 0.009s
W20260709 13:14:18.841841  4393 consensus_meta.cc:287] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.000s
I20260709 13:14:18.801425  4819 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:18.849306   447 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:18.790484  4141 consensus_queue.cc:237] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.884085   479 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:14:18.886096   448 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:18.929735   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:18.991272   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 142013us
I20260709 13:14:18.849972  4700 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:18.850853  4782 log.cc:927] Time spent T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.874s	user 0.005s	sys 0.000s
I20260709 13:14:18.851054  4812 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:18.851548  4786 consensus_queue.cc:1048] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.195s
I20260709 13:14:18.852675  4415 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.926949   523 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:14:18.883726  4765 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.001s	sys 0.009s
I20260709 13:14:18.851416  4821 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:18.822741  4739 consensus_queue.cc:260] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:18.994529   447 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:18.932796   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:19.046576   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 192948us
I20260709 13:14:18.843689  4691 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12.
I20260709 13:14:18.848959  4816 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:18.838550  4321 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:19.003501   557 raft_consensus.cc:1240] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 10. Current term is 11. Ops: []
W20260709 13:14:19.086862   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 160003us
I20260709 13:14:19.193342   523 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:18.995376  4794 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.914332  4819 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.200078  4819 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:19.204380   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 209922us
I20260709 13:14:19.205639   447 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:18.850069  4536 consensus_queue.cc:260] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.838872  4592 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:18.925494  4829 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.194623   559 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:14:18.851342  4686 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.250s
I20260709 13:14:19.041772  4809 consensus_queue.cc:237] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:18.851694  4828 consensus_queue.cc:1059] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.347s
I20260709 13:14:19.197959  4700 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:18.996173  4805 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.196s
I20260709 13:14:19.197973  4691 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:18.913429  4814 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.285s
I20260709 13:14:18.996018  4807 raft_consensus.cc:3055] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:19.047217  4373 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:18.914077  4780 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.285s
I20260709 13:14:19.199067  4794 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:19.252035  4660 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:19.253960  4788 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.480540  4450 raft_consensus.cc:3055] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:19.481178  4450 raft_consensus.cc:740] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:19.480904  4788 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:19.482303  4450 consensus_queue.cc:260] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:19.255827  4321 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:19.263329  4824 log.cc:927] Time spent T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.350s	user 0.001s	sys 0.000s
I20260709 13:14:19.280231  4744 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.484639   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 721) took 1137 ms. Trace:
I20260709 13:14:19.484798  4744 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:19.485073   477 rpcz_store.cc:276] 0709 13:14:18.347653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:18.348035 (+   382us) service_pool.cc:224] Handling call
0709 13:14:18.384294 (+ 36259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:18.638387 (+254093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:18.638424 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:18.640884 (+  2460us) log.cc:844] Serialized 26 byte log entry
0709 13:14:18.791748 (+150864us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:18.791802 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:18.791897 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:19.484384 (+692487us) raft_consensus.cc:1685] finished
0709 13:14:19.484407 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:19.484573 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21649,"raft.queue_time_us":163503,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":4423,"thread_start_us":384172,"threads_started":2,"wal-append.queue_time_us":187336}
I20260709 13:14:19.108320  4415 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:19.131438  4648 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:18.923403  4393 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:19.293452  4345 consensus_meta.cc:287] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.000s
W20260709 13:14:19.210347  4690 consensus_meta.cc:287] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.614s	user 0.011s	sys 0.000s
I20260709 13:14:19.333952   630 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:19.343398   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:19.305703  4808 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:19.303164  4781 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:19.307723  4726 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:19.306737  4678 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:19.319118  4825 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:19.337164  4831 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.332880  4823 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:19.211735   447 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:19.381443  4247 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.851720  4267 consensus_queue.cc:260] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:19.543037   450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.038s	sys 0.116s
W20260709 13:14:19.543434   450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.038s	sys 0.116s
W20260709 13:14:19.388437   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 535058us
I20260709 13:14:19.389689  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:19.390040  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:19.379315  4830 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:18.850929  4615 raft_consensus.cc:3055] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:19.390980  4521 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:19.049152  4826 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:19.506973  4648 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.514708   522 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:19.541522   475 raft_consensus.cc:1240] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:19.514874   629 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:19.398820  4807 raft_consensus.cc:740] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:19.520741   552 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:19.522614   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1888) took 1748 ms. Trace:
W20260709 13:14:19.523341  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:19.472725  4828 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:14:19.542084   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 330440us
I20260709 13:14:19.358656  4816 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:19.544226   448 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:19.083114  4703 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:19.545132   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:19.397504  4700 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:19.393270  4829 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:19.553301   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 1971) took 1539 ms. Trace:
I20260709 13:14:19.603368   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:19.603572   625 rpcz_store.cc:276] 0709 13:14:18.014051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:18.014332 (+   281us) service_pool.cc:224] Handling call
0709 13:14:18.014634 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:18.029097 (+ 14463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:19.549046 (+1519949us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5400160dd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:19.553247 (+  4201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31663488}
I20260709 13:14:19.546998  4615 raft_consensus.cc:740] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:19.558305   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:19.625145   626 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:19.560467   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2121) took 3060 ms. Trace:
I20260709 13:14:19.629861   558 rpcz_store.cc:276] 0709 13:14:16.499632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:17.285955 (+786323us) service_pool.cc:224] Handling call
0709 13:14:18.103758 (+817803us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:18.103936 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:18.103961 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:18.103999 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:18.104054 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:18.104121 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:19.560251 (+1456130us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54001d7750. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:19.560395 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1880044800}
I20260709 13:14:19.561934  1170 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:14:19.634147   626 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:19.480548  4660 raft_consensus.cc:697] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:19.569444   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:19.715718   627 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:19.526635  4618 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:19.512326  4321 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.596722   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:19.718495   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:19.719079   628 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:19.719849   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:19.557303   633 rpcz_store.cc:276] 0709 13:14:17.773931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:17.774055 (+   124us) service_pool.cc:224] Handling call
0709 13:14:19.522423 (+1748368us) spinlock_profiling.cc:243] Waited 46.4 ms on lock 0x7b54001accd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:19.522563 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106761088}
I20260709 13:14:19.720913   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:19.721444   633 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:14:19.722136   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:19.617492   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:19.657817   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:19.526990  4689 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:14:19.546236  4678 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:19.605641   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:19.556025  4830 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:19.589013  4686 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:19.605136  4450 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:19.519167  4808 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.570873  1139 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:14:19.802603  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 231788us
W20260709 13:14:19.803548   522 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 2.504s (SENT) [suppressed 25 similar messages]
I20260709 13:14:19.803920  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:19.562655   447 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:19.805958  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:19.527274  4781 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:19.550603  4247 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:19.519456  4345 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:19.675866  4592 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:19.646921  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:19.634824   552 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 13.
I20260709 13:14:19.602028  4805 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:19.554486  4648 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:19.697293   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:19.652808   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:19.560876  4726 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:19.550601  4823 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:19.729070   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:19.540515  4744 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:19.560563  4838 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:19.596359  4788 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:19.563339  4826 raft_consensus.cc:697] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:19.507320  4536 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:19.691449  4837 log.cc:927] Time spent T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.300s	user 0.001s	sys 0.001s
I20260709 13:14:19.551731  4690 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:19.855419  4830 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:19.855792  4690 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:19.856781  4819 consensus_meta.cc:287] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.002s
I20260709 13:14:19.798445   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:19.650189  4825 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:19.807616   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 245025us
I20260709 13:14:19.554932  4521 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:19.689209  4393 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:19.691291  4829 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:19.845839  4744 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.850776  4816 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:19.652740  4841 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:19.892643  4841 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:19.690208  4703 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:19.636258  4814 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:19.895891  4814 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:19.897495  4744 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:19.718083  4844 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.899618  4744 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:14:19.732833  4689 consensus_queue.cc:1243] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:14:19.898622  4814 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:19.900627  4854 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.648907  4141 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:19.901142  4854 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:19.901369  4141 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:19.903348  4521 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:19.903663  4839 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.904165  4839 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:19.906158  4839 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:19.819797  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:19.730755  4786 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.909422  4786 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:19.560477  4832 consensus_queue.cc:1175] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6e6df7e8ed204f1db5c371536b5b0683" responder_term: 13 status { last_received { term: 13 index: 12 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:19.654872  4845 consensus_queue.cc:1059] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.186s
I20260709 13:14:19.913130  4845 raft_consensus.cc:3055] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:19.913581  4845 raft_consensus.cc:740] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:19.812891  4849 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.915584  4849 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:19.918311  4849 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:19.919435   625 raft_consensus.cc:2393] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 12: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:14:19.921271  4636 consensus_meta.cc:287] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 1.122s	user 0.011s	sys 0.000s
I20260709 13:14:19.922369  4854 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:19.922937  1168 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:14:19.923588  4841 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:19.837514   629 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:14:19.838105   631 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:19.810489  4678 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:19.810313  4808 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:19.817530  4765 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:19.733074  4618 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:19.734087  4321 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:19.824764  4848 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.824105  4805 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.824313  4592 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.824883  4850 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.854455  4788 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:19.973176   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:19.854784  4826 consensus_queue.cc:237] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:19.857438   476 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:14:19.833073  4794 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:19.808462  4686 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:19.860562   447 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:19.861809   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 58306.6us
I20260709 13:14:19.638686  4415 leader_election.cc:290] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:19.844041  4726 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.980362   522 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:19.981117  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:19.546317  4831 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:19.838753  4834 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:20.012391  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:20.013046   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.013707   476 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
W20260709 13:14:19.884940  4842 log.cc:927] Time spent T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:14:19.884744   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.016079   448 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:20.016501   550 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:20.017391   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:19.885763  4690 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:19.886556  4843 log.cc:927] Time spent T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:14:19.657457  4807 consensus_queue.cc:260] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:19.888244  4781 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:19.890477  4823 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:19.845767  4838 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.035877   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:20.036803   557 raft_consensus.cc:2393] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 10: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:19.861627  4819 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.038389   633 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:14:20.037752   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:20.017947  4821 consensus_meta.cc:287] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.796s	user 0.011s	sys 0.001s
I20260709 13:14:19.899086  4844 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:19.832994   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:20.050212   558 raft_consensus.cc:2393] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 7: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:19.924945  1168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 778) took 2575 ms. Trace:
W20260709 13:14:19.928056   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 113589us
I20260709 13:14:19.861001  4742 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.931066  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:19.922869  4854 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.054401  1166 raft_consensus.cc:2393] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 13: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:19.956614   626 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:19.929351  4613 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.944957   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:20.060261   625 raft_consensus.cc:2393] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 12: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:19.903373  4141 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:19.851152  4615 consensus_queue.cc:260] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:19.936858  4841 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:19.914628  4845 consensus_queue.cc:260] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:19.978127   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 117647us
I20260709 13:14:20.078657   447 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:19.978616  4820 raft_consensus.cc:2764] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:14:19.982086  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:19.944108  4765 raft_consensus.cc:697] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:19.981941   522 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:19.958679  4592 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:19.860373  4660 consensus_queue.cc:237] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:19.958113  4805 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:20.018330  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:20.097055  1172 raft_consensus.cc:2393] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 11: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:20.018707   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.018139   550 raft_consensus.cc:2393] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 12: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:20.026643   627 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:19.956071  4814 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.029657  4618 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:20.027155  4833 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:20.011862  4415 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.863463  4825 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.017740  4630 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:20.084882  4816 raft_consensus.cc:2749] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:20.011730  4794 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:19.977900  4788 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.050654  1168 rpcz_store.cc:276] 0709 13:14:17.349479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:17.350035 (+   556us) service_pool.cc:224] Handling call
0709 13:14:17.350320 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:19.923451 (+2573131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:19.924659 (+  1208us) spinlock_profiling.cc:243] Waited 2.57 s on lock 0x7b54005eea54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:19.924873 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5915380608}
I20260709 13:14:20.051731   597 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:20.132318   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 80656.5us
I20260709 13:14:20.037699  4838 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:20.024849  4587 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:20.027508  4659 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.064204   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.064718  4141 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.065294  4615 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:20.071926  4851 log.cc:927] Time spent T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:14:20.072182  4321 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:20.072378  4829 consensus_queue.cc:1175] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" responder_term: 9 status { last_received { term: 9 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 9 index: 10 } }
I20260709 13:14:20.073531  4831 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:19.957697  4848 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.011488  4726 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.134053  4794 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:20.082067   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 100182us
I20260709 13:14:20.083081  1171 raft_consensus.cc:2393] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:19.976998  4345 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:20.085449   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.090673  4393 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:20.019371  4834 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.100364   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.061956  4786 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:20.103526  4814 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:20.107976  4840 log.cc:927] Time spent T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.420s	user 0.002s	sys 0.001s
I20260709 13:14:20.053718  4821 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:19.978134  4850 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.062220  4742 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.094758  4689 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:20.076365  4854 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.133452   597 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:20.138774   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 726) took 1311 ms. Trace:
I20260709 13:14:20.173388   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.127575  4833 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.075980  4613 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.108810  4845 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:20.082031  4841 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.127957  4618 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:20.108120  4765 consensus_queue.cc:237] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.146205  4856 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:20.071100  4648 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.201159  4648 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:20.148995  4866 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.149310  4592 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:20.145952  4659 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.153095   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.209295   625 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:20.210196   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.152689   522 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:20.108556  4415 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.116763  4820 consensus_queue.cc:1059] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:14:20.163700   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.212598   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.164304   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:20.164322   557 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:20.214071   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.152683  4321 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:20.212667   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.216575   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.094926  4787 raft_consensus.cc:3055] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:20.153842  4794 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:20.173623   479 rpcz_store.cc:276] 0709 13:14:18.827162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:18.827397 (+   235us) service_pool.cc:224] Handling call
0709 13:14:18.827842 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:18.916165 (+ 88323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:20.138540 (+1222375us) spinlock_profiling.cc:243] Waited 55.7 ms on lock 0x7b5400187c54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:20.138718 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128101248}
I20260709 13:14:20.173988   480 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:20.328774   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.141323   476 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:14:20.144546  4587 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.172894  4450 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.146057  4141 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.178931   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:20.179836   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:20.180565  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:20.331974   483 raft_consensus.cc:2393] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 11: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:20.180660  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:20.181246   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.180569  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:20.332820   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:20.333352   483 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:20.214852  4321 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.183610   628 raft_consensus.cc:1240] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:20.187808  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:20.190476   597 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:20.192081   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2009) took 2323 ms. Trace:
I20260709 13:14:20.196017  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:20.196616  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:20.173250  4689 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.206707  1175 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:20.188889  4786 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:14:20.211174   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 58546.6us
I20260709 13:14:20.343998  4689 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:20.348335  4141 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:20.348984  4592 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.349498  4592 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.351032   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2146) took 2365 ms. Trace:
I20260709 13:14:20.351403  4820 consensus_queue.cc:1243] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:20.351949   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 559) took 1429 ms. Trace:
I20260709 13:14:20.352221  4825 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:20.351413   556 rpcz_store.cc:276] 0709 13:14:17.985324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:18.349243 (+363919us) service_pool.cc:224] Handling call
0709 13:14:18.349579 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:18.349992 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:18.350021 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:18.350404 (+   383us) log.cc:844] Serialized 26 byte log entry
0709 13:14:18.658210 (+307806us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b1800407560. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb90d1 00007f4b683d4a0f
0709 13:14:20.350629 (+1692419us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b54001b0e20. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68383090 00007f4b683906b8 00007f4b6841992b 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c
0709 13:14:20.350694 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:20.350739 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:20.350808 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:20.350847 (+    39us) raft_consensus.cc:1685] finished
0709 13:14:20.350860 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:20.350980 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31260,"raft.queue_time_us":2398,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":5215,"spinlock_wait_cycles":106773120,"thread_start_us":74491,"threads_started":1,"wal-append.queue_time_us":353191,"wal-append.run_cpu_time_us":1977,"wal-append.run_wall_time_us":1058603}
I20260709 13:14:20.353953  4805 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.355484   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.355634  4587 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:20.355822  4788 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:20.336474  4870 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.324801  4817 raft_consensus.cc:3055] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:20.207295  4618 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.178865  4686 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:20.228319  4819 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:20.229079  4848 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:20.191299  4838 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:14:20.235162  4844 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:20.202579  4856 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.201946  4866 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.312155   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.238708   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 2094) took 1934 ms. Trace:
I20260709 13:14:20.343631  4814 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:20.374321   475 rpcz_store.cc:276] 0709 13:14:18.304324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:18.307316 (+  2992us) service_pool.cc:224] Handling call
0709 13:14:18.307620 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:19.551308 (+1243688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:20.238364 (+687056us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540027bad4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:20.238615 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2837266304}
I20260709 13:14:20.376854  4834 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:20.324971   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:20.325929  1138 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:20.229882   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:20.331001   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.332049   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:20.183573   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.340265  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:20.337255   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 146868us
I20260709 13:14:20.337383   555 rpcz_store.cc:276] 0709 13:14:17.868149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:18.272552 (+404403us) service_pool.cc:224] Handling call
0709 13:14:18.283953 (+ 11401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:18.287748 (+  3795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:20.191829 (+1904081us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b54002003d0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:20.191996 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25310464}
I20260709 13:14:20.339562   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 563) took 1389 ms. Trace:
I20260709 13:14:20.342525  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:20.355131   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:20.358740  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:20.352334   554 rpcz_store.cc:276] 0709 13:14:18.923004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:18.924923 (+  1919us) service_pool.cc:224] Handling call
0709 13:14:18.925281 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:19.204288 (+279007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:19.204315 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:19.204351 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:19.204381 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:20.351743 (+1147362us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54000ec254. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:20.351790 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:20.351893 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":641230080}
I20260709 13:14:20.226783  4648 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:20.405611  4833 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:20.404703   553 rpcz_store.cc:276] 0709 13:14:18.950356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:18.950843 (+   487us) service_pool.cc:224] Handling call
0709 13:14:19.041238 (+ 90395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:19.041590 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:19.041624 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:19.082561 (+ 40937us) log.cc:844] Serialized 26 byte log entry
0709 13:14:19.388442 (+305881us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:19.388503 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:19.388603 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:20.107332 (+718729us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:20.331079 (+223747us) raft_consensus.cc:1685] finished
0709 13:14:20.331101 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:20.339501 (+  8400us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15484,"raft.queue_time_us":1400,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":81928,"spinlock_wait_cycles":9859968,"thread_start_us":183873,"threads_started":1,"wal-append.queue_time_us":445148}
I20260709 13:14:20.369199   483 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:20.406883   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.407598   555 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 13.
I20260709 13:14:20.321623  4345 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:20.408492   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.408718  4345 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.379603   550 raft_consensus.cc:2410] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:14:20.409806  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:20.410316   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.410415  1169 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:20.410879  4345 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:20.403590   556 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:20.411523   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.411772   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:20.412060   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.412496   554 raft_consensus.cc:2393] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 11: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:20.412820   556 raft_consensus.cc:2393] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 11: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:20.409174   555 raft_consensus.cc:2393] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 13: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:20.328284  4787 raft_consensus.cc:740] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:14:20.410964   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:20.369675  4868 log.cc:927] Time spent T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.172s	user 0.004s	sys 0.002s
I20260709 13:14:20.343861  4695 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:20.421552   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.414471   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.422850  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:20.367316  4817 raft_consensus.cc:740] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:20.423482  1173 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:14:20.374629  4856 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:20.415259   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:20.338765  4450 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:20.416826  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 90967.3us
I20260709 13:14:20.406960   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.402022   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.422346   555 raft_consensus.cc:2393] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 12: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:20.412539   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.425873   483 raft_consensus.cc:2368] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11.
I20260709 13:14:20.424068   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.416141  4834 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:20.426422   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.372406  4853 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:20.372382  4786 raft_consensus.cc:697] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:14:20.432821  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:20.415019  4393 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.431264   554 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:20.435038  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:20.435940  1173 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:14:20.436771  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:14:20.437254  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:20.437445  1169 raft_consensus.cc:2393] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 12: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:20.419610  4648 raft_consensus.cc:697] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:20.423075  4869 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.357481  4870 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.415288  4141 raft_consensus.cc:476] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 LEADER]: Not starting pre-election -- already a leader
I20260709 13:14:20.432204   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:20.479138   482 raft_consensus.cc:2393] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 9: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:20.427966  4871 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:20.430370   556 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:20.430766   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.484144   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.484859   483 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:20.485877   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.422288   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:20.441594   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.488848   554 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:20.430343   625 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:14:20.491091   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:20.491792   625 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:20.442999  4841 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:20.430339   448 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:20.430449   480 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:20.430318   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.473181   599 leader_election.cc:400] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11.
W20260709 13:14:20.475764  4874 log.cc:927] Time spent T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:14:20.480216   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:20.429426   553 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:20.512501   550 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 9: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:20.438911  4742 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:20.513168   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 188893us
I20260709 13:14:20.500281   599 leader_election.cc:403] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:14:20.474530  4854 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:20.522899   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 100666us
W20260709 13:14:20.523892   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 50884.6us
I20260709 13:14:20.442754  4247 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:20.480533  4592 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:20.529620   599 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:20.532253   553 raft_consensus.cc:1240] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:20.533699   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:20.533897   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 109424us
I20260709 13:14:20.483589  4850 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:20.483697  4805 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:20.510193   625 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:20.540601   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.540980   599 leader_election.cc:304] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:20.438275  4393 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.542884   597 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:20.480916  4536 consensus_queue.cc:1059] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:14:20.548254   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.548772  4536 consensus_queue.cc:1243] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:14:20.549434   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.550750   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.551013  4848 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:20.553426  4321 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:20.554956   597 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:20.556708  4870 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:20.557171  4659 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:20.542235   480 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:20.531701  4838 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:20.522529  4820 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:20.530936  4831 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:20.544679   448 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:20.434665  4853 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.557891  4508 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:20.538058  4609 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:20.479887  4869 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.606879  4820 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.543788  4247 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:14:20.582772  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:20.609169   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.607065   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:20.609536  1166 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:20.546984  4393 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:20.609772   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 65165.7us
I20260709 13:14:20.670444   448 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:20.543861  4826 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:20.500973  4871 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.622602  4415 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:20.627946  4866 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:20.628450  4618 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:20.615890  4609 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:20.615504  4841 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:20.563344  4805 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.576531  4838 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:20.582300  4808 consensus_meta.cc:287] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.637s	user 0.009s	sys 0.003s
I20260709 13:14:20.635624  4247 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.483356  4817 consensus_queue.cc:260] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.576056  4648 consensus_queue.cc:237] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:20.647943   552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43548 (request call id 561) took 1719 ms (client timeout 1856 ms). Trace:
I20260709 13:14:20.698796   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1918) took 1099 ms. Trace:
W20260709 13:14:20.698522   552 rpcz_store.cc:269] 0709 13:14:18.928807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:18.932515 (+  3708us) service_pool.cc:224] Handling call
0709 13:14:20.647714 (+1715199us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b540034d354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:20.647866 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893088640}
I20260709 13:14:20.699365   626 rpcz_store.cc:276] 0709 13:14:19.598884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.736240 (+137356us) service_pool.cc:224] Handling call
0709 13:14:19.736485 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:20.054753 (+318268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:20.698572 (+643819us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54001e3054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:20.698743 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505480064}
I20260709 13:14:20.700280   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.701046   552 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:20.559900  4695 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:20.648957   551 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:14:20.682626   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.703749   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.536756  4786 consensus_queue.cc:237] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.695513   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1914) took 1136 ms. Trace:
I20260709 13:14:20.696110   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.709427   627 rpcz_store.cc:276] 0709 13:14:19.559030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.716439 (+157409us) service_pool.cc:224] Handling call
0709 13:14:20.695354 (+978915us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54002bcad4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:20.695458 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":446281600}
I20260709 13:14:20.704479   625 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:20.705610   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.708328   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.712278   477 raft_consensus.cc:2410] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 12 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:14:20.712065   552 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:20.705355   597 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:20.579792  4848 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:14:20.692826  4609 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:20.693063  4841 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.723263   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.723765   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:20.723963   553 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:20.724329   552 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:20.697461  4838 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:20.730651   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.701676  4247 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:20.732581  1175 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:20.732388  4816 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:20.734748  4816 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.736956  4816 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:20.741686  4831 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11.
I20260709 13:14:20.745425   552 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:20.746621   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.748801   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.750785   552 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:20.752115   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.754415   552 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:20.756801   552 raft_consensus.cc:1240] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:20.759101   552 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:20.761473   552 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:20.768658   447 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:20.686157  4872 consensus_queue.cc:1059] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:14:20.691970  4856 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.776052   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.776804   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.780045   553 raft_consensus.cc:2410] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:14:20.725124  4799 raft_consensus.cc:3055] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:20.726554  4841 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:20.696784  4805 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.718493  4826 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:20.777453   447 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:20.794984   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.795713   626 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:20.701903  4808 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.786831   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:20.791882   633 raft_consensus.cc:2393] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 12: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:20.791846   553 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:20.732671  4825 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:20.772692  4678 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:20.824153   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:20.828689  4739 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:20.830556   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1907) took 1274 ms. Trace:
I20260709 13:14:20.830941   629 rpcz_store.cc:276] 0709 13:14:19.555993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.556106 (+   113us) service_pool.cc:224] Handling call
0709 13:14:19.599634 (+ 43528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:19.925998 (+326364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:20.830316 (+904318us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54002bb6d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:20.830490 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546031488}
I20260709 13:14:20.831723   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:20.798249   447 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:20.832233   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.805836  1171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36724 (request call id 589) took 1001 ms. Trace:
I20260709 13:14:20.835421  1171 rpcz_store.cc:276] 0709 13:14:19.804126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.804263 (+   137us) service_pool.cc:224] Handling call
0709 13:14:20.805608 (+1001345us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54005d02d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:20.805769 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398805888}
I20260709 13:14:20.807750  4808 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:20.807972  4882 log.cc:927] Time spent T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:14:20.812251  4820 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:20.813009  1167 raft_consensus.cc:1275] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:14:20.813542   481 raft_consensus.cc:2393] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:20.813385   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.786250  4872 consensus_queue.cc:1243] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 6e6df7e8ed204f1db5c371536b5b0683 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:14:20.814782  4871 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:20.814602  4689 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.795207  4826 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.794661  4536 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:14:20.784212  4799 raft_consensus.cc:740] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:20.817054  4825 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:20.824057  4781 consensus_queue.cc:1059] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:14:20.893721  4825 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:20.894769  4659 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:20.895463  4659 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.785117  4807 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:20.897347  4895 raft_consensus.cc:3055] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:20.897771  4895 raft_consensus.cc:740] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:20.897868  4659 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:20.898880   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:20.898579  4895 consensus_queue.cc:260] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.900872  4819 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.901371  4819 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.837116   477 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:20.841082   553 raft_consensus.cc:1275] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:14:20.903928   525 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:20.832968  4678 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:20.882778   626 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:20.886153   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.908800   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:20.909006   482 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:20.909297   626 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:20.804152  4828 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:20.909993  4828 raft_consensus.cc:697] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:20.890964   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.911504   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.912189   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:20.822921   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:20.904948   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:20.915616   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.917104   626 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:20.917922   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.920403   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.906872   525 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:20.907253   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 71629.5us
I20260709 13:14:20.907465  4686 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.803632  4695 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:14:20.923058   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.937765   629 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:20.938921   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.940238   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:20.922344   525 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:20.927783  4321 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:20.916764  4659 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:20.884479  4609 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.928380   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.948640   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.890439  4826 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:20.890969  4648 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:20.877691  4618 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:14:20.946697   629 raft_consensus.cc:2393] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 12: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:20.906826  4819 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:20.843588  4823 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:14:20.845588  4794 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.954896   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.956598   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54754 (request call id 586) took 1132 ms. Trace:
I20260709 13:14:20.929244  4689 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:20.962752   629 rpcz_store.cc:276] 0709 13:14:19.824388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.939973 (+1115585us) service_pool.cc:224] Handling call
0709 13:14:20.956522 (+ 16549us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:20.963405   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:20.910862  4828 consensus_queue.cc:237] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:20.966539  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:20.947697  4870 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:20.967785  4805 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:20.969614  4609 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:20.957157  4247 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.936298  4799 consensus_queue.cc:260] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.983530  4799 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:20.971560  4825 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:20.945884  4686 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:20.974864  4826 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:21.000859  4825 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:21.004024  4853 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:21.004925  4760 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.005949  4760 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:21.009447  4760 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:20.975963  4838 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:21.019446  4660 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.006s	sys 0.006s
I20260709 13:14:20.981622  4870 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:21.013154  4794 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:20.996312  4826 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:21.022570  4870 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:21.049837  4841 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:21.052412  4841 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:20.923415   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:21.132969   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.134727   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.943113   525 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:21.138285   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.132680   477 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
W20260709 13:14:21.138852   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 195678us
I20260709 13:14:21.139458   482 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:21.140671   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.141252   525 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:21.142541   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:21.144604   525 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:21.151743   525 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:21.141193   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.171274   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:21.153148   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.154560   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.155761   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.172822   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.173513   479 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:21.174584   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.161716   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:21.176020   475 raft_consensus.cc:2410] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:14:21.177028   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.164222   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.168282   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 736) took 1150 ms. Trace:
I20260709 13:14:21.172705   481 raft_consensus.cc:2393] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 13: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:21.174917   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.178427   476 rpcz_store.cc:276] 0709 13:14:20.017952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.018492 (+   540us) service_pool.cc:224] Handling call
0709 13:14:21.167880 (+1149388us) spinlock_profiling.cc:243] Waited 43.4 ms on lock 0x7b54002dc654. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:21.168065 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99784576}
I20260709 13:14:21.179397   484 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:14:21.179901   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:20.942775   553 raft_consensus.cc:1240] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:21.180619   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:21.180792   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:21.181529   484 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:21.181736   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.182129   476 raft_consensus.cc:2393] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:21.179351   480 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:20.977142   626 raft_consensus.cc:2410] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:14:21.180553   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.192633   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:21.195727   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 273478us
I20260709 13:14:20.958266  4648 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:21.207625  4592 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:21.208484   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2153) took 1332 ms. Trace:
I20260709 13:14:21.208793   479 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:21.209028   556 rpcz_store.cc:276] 0709 13:14:19.877016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.482931 (+605915us) service_pool.cc:224] Handling call
0709 13:14:20.513150 (+ 30219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:20.513370 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:20.513405 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:20.513461 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:20.513511 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:20.513582 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:21.207997 (+694415us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b54001d6d50. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:21.208241 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68728192}
I20260709 13:14:21.210309   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:21.207968  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.215852  4659 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:21.216410   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 580) took 1616 ms. Trace:
I20260709 13:14:21.216821  4659 raft_consensus.cc:697] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:21.216958   629 rpcz_store.cc:276] 0709 13:14:19.599566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.199785 (+1600219us) service_pool.cc:224] Handling call
0709 13:14:21.215073 (+ 15288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:21.215664 (+   591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:21.215713 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:21.215807 (+    94us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:14:21.215853 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.215953 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:21.216135 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:21.220430  4831 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:21.221391  4831 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:21.225135   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.226171   475 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:21.227548   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.228262   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1909) took 1671 ms. Trace:
I20260709 13:14:21.228556   475 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:21.228808   624 rpcz_store.cc:276] 0709 13:14:19.556788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.556915 (+   127us) service_pool.cc:224] Handling call
0709 13:14:19.598131 (+ 41216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:19.818501 (+220370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:19.818547 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:19.818605 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:19.818681 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.227516 (+1408835us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54001621d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:21.227614 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:21.228027 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506273024}
I20260709 13:14:21.229847   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:14:21.020037  4660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.006s	sys 0.006s
I20260709 13:14:21.218964   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:21.247421   555 raft_consensus.cc:2393] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 10: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:21.249274  4831 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:21.250820  4321 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:21.251948  4247 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:21.218786  4659 consensus_queue.cc:237] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:21.257788   631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1911) took 1700 ms (client timeout 2041 ms). Trace:
W20260709 13:14:21.258343   631 rpcz_store.cc:269] 0709 13:14:19.557619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.557723 (+   104us) service_pool.cc:224] Handling call
0709 13:14:21.257255 (+1699532us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54001626d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:21.257517 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251724160}
I20260709 13:14:21.261603   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.263245   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:21.270396   482 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:21.271078   627 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:21.271968   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.272411   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:21.273993  1170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 785) took 1540 ms. Trace:
I20260709 13:14:21.274101   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:21.270177   628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1916) took 1708 ms. Trace:
I20260709 13:14:21.274940   627 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
W20260709 13:14:21.281876   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 104359us
I20260709 13:14:21.288692   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:21.290221   631 raft_consensus.cc:2393] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 13: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:21.290510   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:21.291703   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.291800   624 raft_consensus.cc:2393] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 14: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:21.293330   480 raft_consensus.cc:2393] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 9: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:21.294533   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 583) took 1493 ms. Trace:
I20260709 13:14:21.295177   624 rpcz_store.cc:276] 0709 13:14:19.801146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.292954 (+1491808us) service_pool.cc:224] Handling call
0709 13:14:21.293486 (+   532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:21.293992 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:21.294041 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:21.294141 (+   100us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:21.294198 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.294293 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:21.294435 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:21.299103  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:21.299470  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:14:21.302593   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 401913us
I20260709 13:14:21.316059  1172 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:14:21.316534  1171 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:21.316150   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 584) took 1502 ms. Trace:
I20260709 13:14:21.333678   624 rpcz_store.cc:276] 0709 13:14:19.813534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.296949 (+1483415us) service_pool.cc:224] Handling call
0709 13:14:21.297608 (+   659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:21.315700 (+ 18092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:21.315732 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:21.315798 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:21.315829 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.315922 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:21.316059 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:21.341410  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:21.275934   628 rpcz_store.cc:276] 0709 13:14:19.559490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.734320 (+174830us) service_pool.cc:224] Handling call
0709 13:14:19.734568 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:20.339776 (+605208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.262842 (+923066us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54001e3a54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:21.268094 (+  5252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1032193280}
I20260709 13:14:21.348021   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.339052   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.349161   479 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:14:21.356501  4807 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:21.357260  4807 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:21.359867   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2176) took 1144 ms. Trace:
I20260709 13:14:21.361035  4686 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:21.360324   554 rpcz_store.cc:276] 0709 13:14:20.214892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.809872 (+594980us) service_pool.cc:224] Handling call
0709 13:14:20.810159 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:20.810345 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:20.918836 (+108491us) log.cc:844] Serialized 14 byte log entry
0709 13:14:21.359103 (+440267us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:21.359218 (+   115us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:21.359373 (+   155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.359488 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:21.359689 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99831,"prepare.queue_time_us":157122,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"thread_start_us":430547,"threads_started":2,"wal-append.queue_time_us":388784}
I20260709 13:14:21.361769  4613 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:21.274511  1170 rpcz_store.cc:276] 0709 13:14:19.732934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.733253 (+   319us) service_pool.cc:224] Handling call
0709 13:14:19.733486 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:19.904063 (+170577us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:14:19.974512 (+ 70449us) log.cc:844] Serialized 14 byte log entry
0709 13:14:20.100624 (+126112us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:20.100696 (+    72us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:20.100758 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.273397 (+1172639us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54004d3354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:21.273460 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:21.273715 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4568,"prepare.queue_time_us":75142,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":40373,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":464201856,"thread_start_us":174921,"threads_started":3,"wal-append.queue_time_us":78462}
I20260709 13:14:21.361862  4648 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:21.374652   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:21.375478  4450 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:21.375862   553 raft_consensus.cc:2393] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 13: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:21.377871  4856 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:21.380970   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1921) took 1372 ms. Trace:
W20260709 13:14:21.381678  4863 log.cc:927] Time spent T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 1.273s	user 0.000s	sys 0.003s
I20260709 13:14:21.381461   626 rpcz_store.cc:276] 0709 13:14:19.981293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.963142 (+981849us) service_pool.cc:224] Handling call
0709 13:14:21.346844 (+383702us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:21.363934   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 587) took 1524 ms. Trace:
I20260709 13:14:21.365291  4726 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:21.364054   525 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:21.371063  4817 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:21.388866   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:21.390385   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:21.372866  4821 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:21.391566  4726 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:21.368444   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:21.392081  4869 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:21.394616  4865 log.cc:927] Time spent T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 1.258s	user 0.000s	sys 0.005s
I20260709 13:14:21.394680   628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 588) took 1535 ms. Trace:
I20260709 13:14:21.352504   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:21.369585   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 585) took 1549 ms. Trace:
I20260709 13:14:21.391160   626 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:21.417711   477 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:21.395394   628 rpcz_store.cc:276] 0709 13:14:19.859481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.393033 (+1533552us) service_pool.cc:224] Handling call
0709 13:14:21.393480 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:21.394005 (+   525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:21.394036 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:21.394121 (+    85us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:21.394163 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.394248 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:21.394620 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:21.416818   627 rpcz_store.cc:276] 0709 13:14:19.819961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.343216 (+1523255us) service_pool.cc:224] Handling call
0709 13:14:21.368833 (+ 25617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:21.369113 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:21.369147 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:21.369217 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:21.369258 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.369337 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:21.369471 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:21.362537  1171 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:21.387327   624 rpcz_store.cc:276] 0709 13:14:19.839394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.341267 (+1501873us) service_pool.cc:224] Handling call
0709 13:14:21.363124 (+ 21857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:21.363545 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:21.363577 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:21.363646 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:21.363678 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.363740 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:21.363866 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:21.432622   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.390950   525 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:21.362340  4794 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:21.392120  4726 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:21.438179   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:21.445147   477 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:14:21.435490  4820 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.447971   475 raft_consensus.cc:2410] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260709 13:14:21.448385  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.448125  4820 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:21.449361   478 raft_consensus.cc:2410] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:14:21.449747   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:21.450616   554 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:14:21.451936  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:21.452736  1169 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:21.372705  4765 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.462731   484 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:21.444406  4726 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:21.441694  4794 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:21.471891   628 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:14:21.472736   628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 591) took 1595 ms. Trace:
I20260709 13:14:21.473133   628 rpcz_store.cc:276] 0709 13:14:19.877188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.427186 (+1549998us) service_pool.cc:224] Handling call
0709 13:14:21.471277 (+ 44091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:21.472433 (+  1156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.472669 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:21.474534   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:21.478363  1169 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:14:21.480784   631 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:21.481698   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 581) took 1881 ms. Trace:
I20260709 13:14:21.482102   631 rpcz_store.cc:276] 0709 13:14:19.599797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.290988 (+1691191us) service_pool.cc:224] Handling call
0709 13:14:21.426053 (+135065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:21.481389 (+ 55336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.481632 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:21.438055  4659 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:21.486101  4659 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:21.367827  4787 consensus_queue.cc:260] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:21.493065  4787 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:21.493443  4659 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:21.498365   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 107563us
I20260709 13:14:21.456310  4820 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:21.507504  4809 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:21.508618  4809 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:21.512746   522 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:21.512866  4869 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:21.515733  4869 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:21.518106  4869 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:21.519266  4700 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:21.513712  4853 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.520246  4853 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:21.521809  4618 raft_consensus.cc:3055] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:21.514446  4587 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.522220  4618 raft_consensus.cc:740] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:21.522790  4587 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:21.527525   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.561753   626 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:14:21.564950   625 raft_consensus.cc:1217] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Deduplicated request from leader. Original: 8.5->[11.6-11.6]   Dedup: 11.6->[]
I20260709 13:14:21.567937   482 raft_consensus.cc:1240] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:21.568238   625 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:14:21.568293   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:21.569032   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.569248   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 2008) took 1040 ms. Trace:
I20260709 13:14:21.569885   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:21.572436  1138 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:21.573762  4853 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:21.573868  4873 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:21.574580  4809 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:21.575567   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 63144.9us
I20260709 13:14:21.577924  4660 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:21.578099  4853 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:21.578635  4660 raft_consensus.cc:697] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:21.519328  4659 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:21.579924  4660 consensus_queue.cc:237] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:21.580649  4659 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:21.580796  4587 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:21.569777   625 rpcz_store.cc:276] 0709 13:14:20.528864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.564057 (+1035193us) service_pool.cc:224] Handling call
0709 13:14:21.564508 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:21.568906 (+  4398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.569146 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:21.570760   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.567030   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:21.533407   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1925) took 1173 ms. Trace:
W20260709 13:14:21.548552   632 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54754 (request call id 593) took 1617 ms (client timeout 2118 ms). Trace:
I20260709 13:14:21.569651   482 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:21.529232   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 2158) took 1650 ms. Trace:
I20260709 13:14:21.570993   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:21.577916   522 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:21.496676  4794 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:21.587630   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 1968) took 1387 ms. Trace:
I20260709 13:14:21.588578   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:21.591202   628 raft_consensus.cc:2393] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:21.529415   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:21.582899   632 rpcz_store.cc:269] 0709 13:14:19.930965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.213820 (+282855us) service_pool.cc:224] Handling call
0709 13:14:21.548198 (+1334378us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400010c54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:21.548371 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2688872704}
I20260709 13:14:21.582463   633 rpcz_store.cc:276] 0709 13:14:20.359402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.550518 (+191116us) service_pool.cc:224] Handling call
0709 13:14:21.532964 (+982446us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54000be5d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:21.533193 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552974208}
I20260709 13:14:21.586963   557 rpcz_store.cc:276] 0709 13:14:19.878328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.062213 (+183885us) service_pool.cc:224] Handling call
0709 13:14:21.528920 (+1466707us) spinlock_profiling.cc:243] Waited 8.82 ms on lock 0x7b540002add4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:21.529047 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20288896}
I20260709 13:14:21.545588  1141 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:21.451944  4870 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:21.581061  4659 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:21.523406  4841 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.592868   478 rpcz_store.cc:276] 0709 13:14:20.174435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.174546 (+   111us) service_pool.cc:224] Handling call
0709 13:14:21.547106 (+1372560us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b54002b2ad4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:21.560469 (+ 13363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2066100480}
I20260709 13:14:21.530138  4807 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:21.547026  4726 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:21.632472   554 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
W20260709 13:14:21.633734  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 134067us
I20260709 13:14:21.525133  4895 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:21.563824  4267 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:21.615173   553 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:21.641467   625 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 12. Current term is 14. Ops: []
I20260709 13:14:21.649204   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 597) took 1088 ms. Trace:
I20260709 13:14:21.641772   558 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:21.649622   625 rpcz_store.cc:276] 0709 13:14:20.560358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.589899 (+1029541us) service_pool.cc:224] Handling call
0709 13:14:21.615129 (+ 25230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:21.648967 (+ 33838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.649151 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:21.648993   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:21.650648   484 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:21.652511   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.652635   447 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:21.657608   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:21.609288  4618 consensus_queue.cc:260] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:21.632867  4809 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:21.641156  4587 raft_consensus.cc:2764] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:14:21.662058   525 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:21.666242   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 58335us
I20260709 13:14:21.667285   555 raft_consensus.cc:2393] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 12: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:21.671072   554 raft_consensus.cc:2393] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 12: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:21.672709   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:21.672814   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:21.679863   624 raft_consensus.cc:1275] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:21.616391  4841 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:21.675863   478 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:21.687811  1167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 638) took 1703 ms. Trace:
I20260709 13:14:21.682417   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 2001) took 1591 ms. Trace:
I20260709 13:14:21.689055   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:21.689211   624 rpcz_store.cc:276] 0709 13:14:20.090781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.458054 (+1367273us) service_pool.cc:224] Handling call
0709 13:14:21.604414 (+146360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:21.680439 (+ 76025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.682325 (+  1886us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:21.692020   477 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:21.630156  4765 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:21.693653  4807 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:21.688275  1167 rpcz_store.cc:276] 0709 13:14:19.984421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.984557 (+   136us) service_pool.cc:224] Handling call
0709 13:14:20.812664 (+828107us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:20.879932 (+ 67268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.678990 (+799058us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54005d02d0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:21.687625 (+  8635us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1903687040}
W20260709 13:14:21.728700   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 135011us
W20260709 13:14:21.694865   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 117064us
I20260709 13:14:21.701289   447 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:21.695791  1141 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:21.696420   557 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:21.697304  4870 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:21.699330   633 raft_consensus.cc:1275] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:21.699409  4809 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:21.700721  4726 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:21.701280   556 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:21.738559   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:21.702644   483 raft_consensus.cc:1275] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:21.705580  4838 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:21.705667  1166 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 793) took 1509 ms (client timeout 1966 ms). Trace:
I20260709 13:14:21.707055   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:21.708320  1172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 788) took 1528 ms. Trace:
I20260709 13:14:21.708737   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 2170) took 1529 ms. Trace:
I20260709 13:14:21.709422   597 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:21.712082  4799 consensus_meta.cc:287] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.728s	user 0.005s	sys 0.013s
I20260709 13:14:21.712704  4841 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:21.713600   554 raft_consensus.cc:1275] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:14:21.713717   559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2036) took 2111 ms (client timeout 1880 ms). Trace:
I20260709 13:14:21.718676   599 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:21.719687   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:21.681797  4613 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:21.723356   477 raft_consensus.cc:1240] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:14:21.750466   482 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:21.724398   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2180) took 1195 ms. Trace:
W20260709 13:14:21.725662  4910 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:14:21.756234   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2052) took 1070 ms. Trace:
I20260709 13:14:21.696036   553 raft_consensus.cc:2410] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:14:21.735509   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.728077   629 pending_rounds.cc:85] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 4
I20260709 13:14:21.702073   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2037) took 2099 ms. Trace:
I20260709 13:14:21.697911  4618 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:21.752758   558 rpcz_store.cc:276] 0709 13:14:20.528625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.656817 (+1128192us) service_pool.cc:224] Handling call
0709 13:14:21.723563 (+ 66746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:21.723984 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:21.724018 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:21.724069 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:21.724117 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.724187 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:21.724306 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:21.744575   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:21.763433  1171 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:21.763643   476 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:21.742475   550 rpcz_store.cc:276] 0709 13:14:20.205006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.412301 (+207295us) service_pool.cc:224] Handling call
0709 13:14:21.708347 (+1296046us) spinlock_profiling.cc:243] Waited 82.3 ms on lock 0x7b54000eb854. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:21.708541 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189374848}
I20260709 13:14:21.746325   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:21.741793  1172 rpcz_store.cc:276] 0709 13:14:20.179953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.188579 (+  8626us) service_pool.cc:224] Handling call
0709 13:14:21.708038 (+1519459us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b5400720e54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:21.708246 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1962725248}
W20260709 13:14:21.752873  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:21.740947  1166 rpcz_store.cc:269] 0709 13:14:20.196248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.342291 (+146043us) service_pool.cc:224] Handling call
0709 13:14:21.705323 (+1363032us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54005ed154. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:21.705469 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":459742080}
W20260709 13:14:21.765558   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 241258us
I20260709 13:14:21.766005   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:21.737761  4450 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:21.758644   522 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:21.757140   554 rpcz_store.cc:276] 0709 13:14:20.679408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.712461 (+1033053us) service_pool.cc:224] Handling call
0709 13:14:21.713070 (+   609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:21.749798 (+ 36728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.750022 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:21.749866   559 rpcz_store.cc:269] 0709 13:14:19.602405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.603129 (+   724us) service_pool.cc:224] Handling call
0709 13:14:21.713301 (+2110172us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b5400386b54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:21.713482 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4093358848}
W20260709 13:14:21.767935   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 58633.8us
W20260709 13:14:21.760103  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 64454us
I20260709 13:14:21.758615   551 rpcz_store.cc:276] 0709 13:14:19.602687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.627799 (+ 25112us) service_pool.cc:224] Handling call
0709 13:14:20.648632 (+1020833us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:20.702477 (+ 53845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.699191 (+996714us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540034d350. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:21.701829 (+  2638us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2346551040}
I20260709 13:14:21.773052   481 raft_consensus.cc:2410] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:14:21.766806   633 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:21.775539   525 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:21.772063   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:21.758301   629 pending_rounds.cc:107] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:14:21.745908  4807 raft_consensus.cc:697] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:21.753208  4613 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:21.778370   629 raft_consensus.cc:2889] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:21.796480  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.796368   447 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:14:21.804966   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.799995   628 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
W20260709 13:14:21.806964   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 45572.3us
W20260709 13:14:21.807426   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 49617.6us
I20260709 13:14:21.810472   558 raft_consensus.cc:1240] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:21.785722  4613 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:21.812430   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1923) took 1453 ms. Trace:
I20260709 13:14:21.812844   626 rpcz_store.cc:276] 0709 13:14:20.358678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.562638 (+1203960us) service_pool.cc:224] Handling call
0709 13:14:21.562991 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:21.590050 (+ 27059us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:21.644955 (+ 54905us) log.cc:844] Serialized 14 byte log entry
0709 13:14:21.812097 (+167142us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:21.812147 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:21.812194 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.812257 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:21.812377 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":943,"prepare.queue_time_us":40424,"prepare.run_wall_time_us":6743,"spinlock_wait_cycles":20580224,"thread_start_us":106276,"threads_started":1}
W20260709 13:14:21.814393   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:21.814870   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.783113  4321 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:21.788308  4799 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:21.815610  4829 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:21.874642   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 2128) took 1114 ms. Trace:
I20260709 13:14:21.802373  4450 raft_consensus.cc:697] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:21.816102  4841 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:21.851769  4835 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.852960   597 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:21.858415  4788 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:21.859402  4415 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:21.861265  4765 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:21.862927  4823 raft_consensus.cc:2749] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:14:21.913802   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.863368  1175 raft_consensus.cc:1240] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:14:21.868571   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 2114) took 1490 ms. Trace:
I20260709 13:14:21.869184   553 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: []
W20260709 13:14:21.878548   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 54185.4us
W20260709 13:14:21.881641  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 121986us
I20260709 13:14:21.875458   480 rpcz_store.cc:276] 0709 13:14:20.760032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.336224 (+576192us) service_pool.cc:224] Handling call
0709 13:14:21.432221 (+ 95997us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:21.504203 (+ 71982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:21.504243 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:21.504769 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:14:21.736331 (+231562us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:21.736386 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.736473 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:21.874338 (+137865us) raft_consensus.cc:1685] finished
0709 13:14:21.874371 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:21.874563 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19575,"raft.queue_time_us":24149,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":86,"thread_start_us":231123,"threads_started":1,"wal-append.queue_time_us":346529}
I20260709 13:14:21.881136  4829 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:21.873142 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:21.915411   483 rpcz_store.cc:276] 0709 13:14:20.378472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.494996 (+116524us) service_pool.cc:224] Handling call
0709 13:14:20.495330 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:21.747382 (+1252052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.868241 (+120859us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002dcb54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:21.868486 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2729338240}
I20260709 13:14:21.903627  4799 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:21.886082   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 143556us
I20260709 13:14:21.901891  4659 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:21.902958  4828 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:21.904867  4819 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:14:21.908290   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 59403.2us
I20260709 13:14:21.820323  4321 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:21.904105   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 51285.2us
W20260709 13:14:21.926151   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 207608us
W20260709 13:14:21.924762  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 134378us
I20260709 13:14:21.880594  4841 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:21.920352  4829 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:21.923987  4415 raft_consensus.cc:697] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:21.936514  4841 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:21.954676   555 raft_consensus.cc:1217] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[11.6-11.6]   Dedup: 11.6->[]
I20260709 13:14:21.933316  4321 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:21.964798   555 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:14:21.960366   481 raft_consensus.cc:1240] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:21.940400  4819 raft_consensus.cc:697] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:21.979453  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:21.985679   522 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:21.988487   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 163691us
I20260709 13:14:21.991791  4744 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
W20260709 13:14:22.004348   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.005024  4833 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:22.005692  4833 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:22.004137  4415 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:21.983273   599 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:21.931798  4835 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:22.016645   525 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:22.021636   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 2002) took 1619 ms. Trace:
I20260709 13:14:22.022555  4833 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:21.971190  4828 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:22.025571  4828 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:22.031837  4780 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.032508  4780 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:22.034152  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 62666.7us
I20260709 13:14:22.034273  4613 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:22.036639  1139 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:22.023453   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2178) took 1518 ms. Trace:
I20260709 13:14:22.043926   484 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
W20260709 13:14:22.044476  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 53359us
I20260709 13:14:22.046857   476 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:22.030917  4838 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:21.969789  4587 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:14:22.022059   630 rpcz_store.cc:276] 0709 13:14:20.324522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.533244 (+1208722us) service_pool.cc:224] Handling call
0709 13:14:21.533708 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:21.534200 (+   492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:21.534232 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:21.534858 (+   626us) log.cc:844] Serialized 26 byte log entry
0709 13:14:21.781491 (+246633us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:21.935208 (+153717us) log.cc:844] Serialized 14 byte log entry
0709 13:14:21.943616 (+  8408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.943862 (+   246us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:21.943915 (+    53us) raft_consensus.cc:1685] finished
0709 13:14:21.943932 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:21.944078 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7943,"raft.queue_time_us":9345,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":22817,"thread_start_us":355667,"threads_started":2,"wal-append.queue_time_us":321073}
I20260709 13:14:22.041294  4613 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:22.068755   556 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:22.038429   552 rpcz_store.cc:276] 0709 13:14:20.417174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.929366 (+512192us) service_pool.cc:224] Handling call
0709 13:14:20.929650 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:20.929844 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:21.443029 (+513185us) log.cc:844] Serialized 14 byte log entry
0709 13:14:21.836092 (+393063us) log.cc:844] Serialized 14 byte log entry
0709 13:14:21.880063 (+ 43971us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:21.886928 (+  6865us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:21.920712 (+ 33784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.927485 (+  6773us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:21.935756 (+  8271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88821,"prepare.queue_time_us":80783,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":31227,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":22046,"thread_start_us":675822,"threads_started":2,"wal-append.queue_time_us":386207}
I20260709 13:14:21.984968  4807 consensus_queue.cc:237] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:22.069612  4660 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.078594  4726 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:22.121457  4726 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:22.122076  4726 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:22.123420   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 152081us
W20260709 13:14:22.130522   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 171397us
I20260709 13:14:22.132289  4660 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:22.134393  4780 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:22.134963   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2057) took 1393 ms. Trace:
I20260709 13:14:22.135381   555 rpcz_store.cc:276] 0709 13:14:20.741190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.721210 (+980020us) service_pool.cc:224] Handling call
0709 13:14:21.938230 (+217020us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:21.969200 (+ 30970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:22.134772 (+165572us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b5400387a50. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:22.134903 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492415232}
W20260709 13:14:22.105479  4913 log.cc:927] Time spent T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.156s	user 0.001s	sys 0.002s
I20260709 13:14:22.109050  4809 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:22.156549  4659 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:22.111608   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 73632.3us
I20260709 13:14:22.157572   448 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:22.113420  4819 consensus_queue.cc:237] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:22.159272  4794 consensus_meta.cc:287] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.000s
I20260709 13:14:22.159825  4794 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:22.063436  4450 consensus_queue.cc:237] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:22.115476  4739 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:22.165361   553 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:22.166527   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 2149) took 1019 ms. Trace:
I20260709 13:14:22.078014  4838 raft_consensus.cc:697] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:22.166913   477 rpcz_store.cc:276] 0709 13:14:21.146833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.750992 (+604159us) service_pool.cc:224] Handling call
0709 13:14:21.751421 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:21.751869 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:21.751900 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:21.752330 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:14:21.933945 (+181615us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:21.933983 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.934053 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:22.149597 (+215544us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:22.166230 (+ 16633us) raft_consensus.cc:1685] finished
0709 13:14:22.166251 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:22.166446 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":112,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":47802752,"thread_start_us":181270,"threads_started":1,"wal-append.queue_time_us":363540}
I20260709 13:14:22.168421  4838 consensus_queue.cc:237] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:22.170667   377 catalog_manager.cc:5697] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:22.116345  4321 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:22.175904  4321 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:22.117861  1141 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:22.177883  4744 raft_consensus.cc:2764] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:14:22.177979  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 60242.7us
I20260709 13:14:22.151779   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 2129) took 1391 ms. Trace:
W20260709 13:14:22.118705   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 56165.5us
I20260709 13:14:22.178962   479 rpcz_store.cc:276] 0709 13:14:20.760325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.379350 (+619025us) service_pool.cc:224] Handling call
0709 13:14:21.379769 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:21.383865 (+  4096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:21.383896 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:21.440178 (+ 56282us) log.cc:844] Serialized 26 byte log entry
0709 13:14:21.662838 (+222660us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:21.662881 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.662959 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:22.151492 (+488533us) raft_consensus.cc:1685] finished
0709 13:14:22.151522 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:22.151704 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3280,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":249,"thread_start_us":183215,"threads_started":1,"wal-append.queue_time_us":333208}
I20260709 13:14:22.180136   525 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:22.143761  4923 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:14:22.147651   599 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:22.151785  4799 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:22.118995   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:22.155431   522 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:22.155845  4835 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:22.159401   380 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46024 (request call id 252) took 20078 ms (client timeout 15000 ms). Trace:
I20260709 13:14:22.135150  4660 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:22.159219   448 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:22.199702   557 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:14:22.193768  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 202297us
W20260709 13:14:22.206378   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 87442us
W20260709 13:14:22.147169  4267 consensus_meta.cc:287] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.000s
W20260709 13:14:22.208560   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.194348  4853 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:22.194829  4809 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:22.192936   377 catalog_manager.cc:5697] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 7 to 10, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 10 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:22.211160  4780 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:22.223031  4508 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.223142   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:22.224027  4660 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:22.211913  4799 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.216552  4828 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:22.218801  4794 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:22.230423  4660 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:22.218173  4853 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:22.218776  4835 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:22.234795   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:22.236173   479 raft_consensus.cc:2393] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 10: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:22.227787   377 catalog_manager.cc:5697] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 5 to 7, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 7 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:22.221232  4809 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:22.225605  4817 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.246383  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:22.229017  4780 raft_consensus.cc:697] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:14:22.248497   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 89451.2us
I20260709 13:14:22.249495   597 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:22.254423   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 115537us
I20260709 13:14:22.238181  4508 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:22.256428  1175 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:14:22.256475  4817 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:22.245052  4835 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:22.257726   484 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:22.258113  4835 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:22.258867  4817 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:22.241798  4660 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:22.236011  4873 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:14:22.238770  4828 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:22.230569  4267 consensus_queue.cc:1059] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 13:14:22.193193   380 rpcz_store.cc:269] 0709 13:14:02.080806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.081012 (+   206us) service_pool.cc:224] Handling call
0709 13:14:22.159132 (+20078120us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:16.517983 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:16.518604 (+   621us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:16.518654 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:14:16.518672 (+    18us) tablet.cc:662] Decoding operations
0709 13:14:16.520562 (+  1890us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:16.520638 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:16.520666 (+    28us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:14:16.643613 (+122947us) tablet.cc:701] Row locks acquired
0709 13:14:16.643680 (+    67us) write_op.cc:260] PREPARE: finished
0709 13:14:16.643882 (+   202us) write_op.cc:270] Start()
0709 13:14:16.644066 (+   184us) write_op.cc:276] Timestamp: P: 1783602856643805 usec, L: 0
0709 13:14:16.644105 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:14:16.787404 (+143299us) log.cc:844] Serialized 9480 byte log entry
0709 13:14:17.159415 (+372011us) op_driver.cc:464] REPLICATION: finished
0709 13:14:17.225903 (+ 66488us) write_op.cc:301] APPLY: starting
0709 13:14:17.226036 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:17.226495 (+   459us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:17.226619 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:17.231007 (+  4388us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:17.231330 (+   323us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=24
0709 13:14:17.231376 (+    46us) write_op.cc:312] APPLY: finished
0709 13:14:17.248632 (+ 17256us) log.cc:844] Serialized 164 byte log entry
0709 13:14:17.248820 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:17.249008 (+   188us) write_op.cc:454] Released schema lock
0709 13:14:17.249066 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:17.971359 (+722293us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b54000fbed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68414e28 00007f4b6be4f581 00007f4b6be4ed58 00007f4b6be539f1 00007f4b6be539a9 00007f4b6be53939 00007f4b6be53901 00007f4b6be52b2d 000000000038f354 000000000038f199
0709 13:14:17.971606 (+   247us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:17.971637 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3291391,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":59093,"apply.run_cpu_time_us":5233,"apply.run_wall_time_us":26731,"num_ops":24,"prepare.queue_time_us":498084,"prepare.run_cpu_time_us":41419,"prepare.run_wall_time_us":1453565,"raft.queue_time_us":115745,"raft.run_cpu_time_us":21777,"raft.run_wall_time_us":112132,"replication_time_us":481252,"spinlock_wait_cycles":65879808,"thread_start_us":511902,"threads_started":4,"wal-append.queue_time_us":121019,"wal-append.run_cpu_time_us":20954,"wal-append.run_wall_time_us":1333335}]]}
I20260709 13:14:22.267758   484 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
I20260709 13:14:22.275759   627 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:14:22.276127   627 pending_rounds.cc:85] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 11
I20260709 13:14:22.269763   448 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:22.276381   627 pending_rounds.cc:107] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:14:22.276644   627 raft_consensus.cc:2889] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:22.270032   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 2130) took 1509 ms. Trace:
I20260709 13:14:22.247107  4853 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:22.272431   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:22.281106   481 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
W20260709 13:14:22.279668   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 132179us
I20260709 13:14:22.249354  4809 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:22.278698  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:22.285601  1141 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:22.286823  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:22.290002   525 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:22.278625   377 catalog_manager.cc:5697] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 6 to 9, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 9 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:14:22.269940  4895 consensus_meta.cc:287] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.612s	user 0.008s	sys 0.000s
I20260709 13:14:22.270833  4267 raft_consensus.cc:3055] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:22.307384   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 592) took 2423 ms. Trace:
W20260709 13:14:22.307808   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 52490.9us
I20260709 13:14:22.309269   627 rpcz_store.cc:276] 0709 13:14:19.882237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.427008 (+1544771us) service_pool.cc:224] Handling call
0709 13:14:21.480138 (+ 53130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:22.283561 (+803423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:22.303324 (+ 19763us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b54001ae0d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:22.305711 (+  2387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1820158720}
I20260709 13:14:22.310134   522 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:22.307832   631 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:22.248975  4799 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:22.251621  4765 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:14:22.282651  4415 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:22.259182  4508 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:22.277300   475 rpcz_store.cc:276] 0709 13:14:20.760583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.448659 (+688076us) service_pool.cc:224] Handling call
0709 13:14:21.449040 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:21.500879 (+ 51839us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:14:21.765508 (+264629us) log.cc:844] Serialized 14 byte log entry
0709 13:14:21.887649 (+122141us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:21.949398 (+ 61749us) log.cc:844] Serialized 26 byte log entry
0709 13:14:21.949730 (+   332us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:21.949775 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.949865 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:22.269831 (+319966us) raft_consensus.cc:1685] finished
0709 13:14:22.269852 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:22.269976 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49762,"prepare.queue_time_us":366329,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":73281,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":239,"thread_start_us":373637,"threads_started":2,"wal-append.queue_time_us":290585}
I20260709 13:14:22.273351  4794 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:14:22.305091  4817 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.308998  4267 raft_consensus.cc:740] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:22.313424  4659 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:22.270009  4828 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:22.269178  4829 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:22.313127  4873 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:14:22.317094  4833 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:22.319617   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:22.320727   599 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:22.360181  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:22.329211   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 59536.8us
W20260709 13:14:22.345079   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 103430us
I20260709 13:14:22.325744   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:22.319186   377 catalog_manager.cc:5697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:22.362385   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2191) took 1046 ms. Trace:
W20260709 13:14:22.390365   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:22.397470   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 87457.1us
I20260709 13:14:22.325196  4788 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:22.320819  4587 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:22.408847   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:22.332892  4744 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:22.321734  4415 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:22.387988  4870 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:22.409523   557 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:22.390041   551 rpcz_store.cc:276] 0709 13:14:21.315514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.777454 (+461940us) service_pool.cc:224] Handling call
0709 13:14:21.801134 (+ 23680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:21.859467 (+ 58333us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:21.859827 (+   360us) log.cc:844] Serialized 14 byte log entry
0709 13:14:22.362067 (+502240us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:22.362117 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:22.362156 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:22.362221 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:22.362331 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":158,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":14513,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":501714,"threads_started":2,"wal-append.queue_time_us":365949}
I20260709 13:14:22.417815   448 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:22.386767  4833 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:22.418511   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:22.420097   553 raft_consensus.cc:2410] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:22.423552   522 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:22.403434  4618 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:22.330308  4817 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:22.319731  4925 consensus_queue.cc:1059] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.106s
W20260709 13:14:22.422469  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 385928us
I20260709 13:14:22.414486  4415 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:22.435595   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 122733us
I20260709 13:14:22.422335  4833 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:22.450088   377 catalog_manager.cc:5697] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 6 to 9, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 9 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:22.432757  4794 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:22.449772  4823 consensus_queue.cc:1059] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:14:22.479833  4823 raft_consensus.cc:3055] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:22.480245  4823 raft_consensus.cc:740] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:22.481119  4823 consensus_queue.cc:260] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:22.482426  4823 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:22.403439  4780 consensus_queue.cc:237] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:22.483057   377 catalog_manager.cc:5697] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:22.490296  1139 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:14:22.500918   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 96610.5us
I20260709 13:14:22.502890   555 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:14:22.504017   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:22.508472  4817 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:22.509078  4817 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.509523  4817 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:22.513096  4835 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:22.514317   631 raft_consensus.cc:1240] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:14:22.515228   448 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:22.515326  4794 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:22.516810   448 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:22.499730  4739 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:22.519448  4835 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:22.520852  4726 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:22.493119  4450 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:22.523907  4928 log.cc:927] Time spent T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:14:22.523955  4450 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:22.525439   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1920) took 2544 ms. Trace:
I20260709 13:14:22.526270  4450 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:22.526540  4799 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:22.526822  4450 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:22.517571  4794 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:22.527124  4799 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:22.527942  4799 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:22.528331  4799 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:22.528689  4799 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:22.527904  4829 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:22.523191  4726 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:22.538550  4799 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:22.548647  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 152849us
I20260709 13:14:22.492525  4873 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:14:22.550197  1141 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:22.478506  4807 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:22.496186  4937 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:22.596655  4937 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:22.597151  4937 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:22.525797   629 rpcz_store.cc:276] 0709 13:14:19.981039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.427141 (+1446102us) service_pool.cc:224] Handling call
0709 13:14:21.647411 (+220270us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:21.842131 (+194720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:21.842171 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:21.845835 (+  3664us) log.cc:844] Serialized 52 byte log entry
0709 13:14:22.072373 (+226538us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:22.072427 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:22.072516 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:22.525225 (+452709us) raft_consensus.cc:1685] finished
0709 13:14:22.525246 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:22.525377 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16369,"raft.queue_time_us":31773,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":222054,"threads_started":1,"wal-append.queue_time_us":498551}
W20260709 13:14:22.555833   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 87575.1us
I20260709 13:14:22.450336  4267 consensus_queue.cc:260] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:22.498327  4930 log.cc:927] Time spent T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.072s	user 0.001s	sys 0.001s
W20260709 13:14:22.553304  4933 log.cc:927] Time spent T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:14:22.569743   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:22.613579   484 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:22.573555   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 147671us
W20260709 13:14:22.580817  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 118619us
I20260709 13:14:22.571512  1141 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:22.581904  4794 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.582424  4726 consensus_queue.cc:1059] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:14:22.625543  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 54228.4us
W20260709 13:14:22.588235  4841 consensus_meta.cc:287] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.000s
I20260709 13:14:22.557315  4829 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:14:22.621845   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 105117us
W20260709 13:14:22.630756  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 61703.4us
I20260709 13:14:22.608834  4739 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:22.580277  4807 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:22.559309  4450 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:22.679512   597 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:22.668848   448 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:22.651467  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:22.660531  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:22.717289  1171 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
W20260709 13:14:22.713940   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 249892us
I20260709 13:14:22.666828   599 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:22.664535  4934 log.cc:927] Time spent T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
W20260709 13:14:22.663873  4940 log.cc:927] Time spent T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:14:22.660068  4931 log.cc:927] Time spent T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 13:14:22.665524  4938 log.cc:927] Time spent T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:14:22.636073  4935 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:14:22.741962   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:22.743738   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.714398  4807 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:22.625072  4787 consensus_queue.cc:1059] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:14:22.725733  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:22.650122  4817 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:22.755621   522 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:22.775605   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:22.776795   522 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:22.725806  4895 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:22.674606  4829 raft_consensus.cc:697] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
W20260709 13:14:22.764806   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 129166us
W20260709 13:14:22.785638   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.767875  4373 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:22.769264  4450 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:22.771346   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:22.776942   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:22.644022  4841 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:22.649767  4321 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.666175  4833 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:22.788358   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:22.788991   476 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:22.799352   484 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 14.
I20260709 13:14:22.803228   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:22.803364   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:22.765863  4951 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.764039  4935 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:22.763109  4739 raft_consensus.cc:697] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:22.717923  4794 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:22.804361   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:22.801038   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:22.807950   482 raft_consensus.cc:2393] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 13: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:22.786222  4895 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:22.821774   522 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:22.822991   484 raft_consensus.cc:1275] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:14:22.823482   484 pending_rounds.cc:85] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 6
I20260709 13:14:22.823777   484 pending_rounds.cc:107] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:14:22.824075   484 raft_consensus.cc:2889] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:22.829957   480 raft_consensus.cc:2393] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 12: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:22.806871  4726 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:22.806828  4321 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:22.830740  4952 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:22.831209  4952 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:22.831604  4952 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:22.832340  4321 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:22.831720  4829 consensus_queue.cc:237] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:22.833269   481 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: []
W20260709 13:14:22.834816   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 166065us
I20260709 13:14:22.836344   448 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:22.837216  4450 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:22.837592  4450 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:22.837702   448 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:22.837997  4450 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:22.838543  4944 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:22.839577  4739 consensus_queue.cc:237] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:22.845008   483 raft_consensus.cc:2393] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 14: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:22.819821  4935 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:22.818127  4744 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:22.797894  4415 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:22.827126  4895 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:22.878705   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 76482.9us
W20260709 13:14:22.878911   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 57276.5us
I20260709 13:14:22.795778  4807 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:22.887738   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2190) took 1570 ms. Trace:
I20260709 13:14:22.885320   599 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:22.888139   554 rpcz_store.cc:276] 0709 13:14:21.314274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.776425 (+462151us) service_pool.cc:224] Handling call
0709 13:14:21.791580 (+ 15155us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:21.875385 (+ 83805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:21.875432 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:21.912969 (+ 37537us) log.cc:844] Serialized 26 byte log entry
0709 13:14:22.323896 (+410927us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:22.323940 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:22.324054 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:22.884159 (+560105us) raft_consensus.cc:1685] finished
0709 13:14:22.884183 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:22.884310 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45154,"raft.queue_time_us":38220,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":31660,"thread_start_us":367031,"threads_started":1,"wal-append.queue_time_us":532097}
I20260709 13:14:22.891477  1167 raft_consensus.cc:1240] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:22.871136  4788 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:14:22.893925   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 54890us
W20260709 13:14:22.895025  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 247929us
I20260709 13:14:22.895215   476 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
W20260709 13:14:22.884526   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 118592us
I20260709 13:14:22.898825   478 raft_consensus.cc:2393] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
W20260709 13:14:22.900123  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.895884   522 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:22.819693  4951 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:22.911126  4953 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:22.911921  4953 raft_consensus.cc:697] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:22.913038  4953 consensus_queue.cc:237] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:22.916440   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:22.917882   480 pending_rounds.cc:85] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 10
I20260709 13:14:22.918136   480 pending_rounds.cc:107] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 9.11
I20260709 13:14:22.918375   480 raft_consensus.cc:2889] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:22.919526  4587 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:22.920362  4587 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:22.920904  4587 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:22.921929   481 raft_consensus.cc:1275] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:22.922576  4267 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:22.934310  4951 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:22.919620   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 48261.9us
I20260709 13:14:22.896373  4799 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:22.898190  4833 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:22.906679  4819 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:22.894351  4744 consensus_queue.cc:1059] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:14:22.958592  1141 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:14:22.980423   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 80533.4us
W20260709 13:14:22.981887   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 86085.6us
I20260709 13:14:22.935190  4951 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 13:14:22.988637  4959 log.cc:927] Time spent T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:14:22.991433  4950 consensus_queue.cc:1059] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:14:23.000968  4794 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:23.001755   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:23.002244  4841 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:23.004537   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 48760.2us
I20260709 13:14:23.005434  4944 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:23.006233  4807 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:23.024979   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:23.024067  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:23.024359   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:23.025768   633 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:23.024712  4944 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.027125   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:23.024132   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:23.027714   632 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:23.024128   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:23.028316  4944 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:23.028541   628 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:23.031608   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:23.036360  4948 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.036911  4948 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:22.985565  4925 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:23.038805  4794 raft_consensus.cc:3055] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:23.039357  4794 raft_consensus.cc:740] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:23.039582  4948 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:23.040520  4794 consensus_queue.cc:260] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.042151  4794 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:23.044310   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:23.044945   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:23.045136   628 raft_consensus.cc:2393] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 12: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:23.046635  4873 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.046764   628 raft_consensus.cc:1275] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:23.056262  4955 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:22.950893  4937 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.059365  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:22.977205   630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:14:23.061240   630 raft_consensus.cc:606] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:23.061388   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:23.055331  4873 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.060547   599 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:23.061596   630 raft_consensus.cc:614] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:23.063454   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:23.091987   633 raft_consensus.cc:2410] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:14:23.067665  1166 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:23.075497   599 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:23.074607   632 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:23.085023  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:23.085995  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:23.094858  1171 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:23.086354  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:23.087291  1169 raft_consensus.cc:1240] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:23.087515  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:23.068096  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 49970.5us
I20260709 13:14:23.085332  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:23.102829  1172 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:23.088521  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:23.106420   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:23.063207  4828 consensus_meta.cc:287] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.000s
W20260709 13:14:23.065507  4853 consensus_meta.cc:287] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.757s	user 0.005s	sys 0.006s
W20260709 13:14:23.064566  4660 consensus_meta.cc:287] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.801s	user 0.010s	sys 0.000s
I20260709 13:14:23.122733   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:23.162827   632 raft_consensus.cc:2410] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:14:23.073040  4937 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:23.088912  4932 log.cc:927] Time spent T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.623s	user 0.002s	sys 0.001s
W20260709 13:14:23.160804   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 85399.1us
I20260709 13:14:23.088879  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:23.167996   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 59823.3us
I20260709 13:14:23.064904  4415 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:23.075681  4948 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:23.074958  4925 raft_consensus.cc:697] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
W20260709 13:14:23.144605  4809 consensus_meta.cc:287] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.814s	user 0.010s	sys 0.002s
W20260709 13:14:23.173653   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 118687us
I20260709 13:14:23.107124  4870 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:23.120280  4788 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:23.181295   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:23.183851   633 raft_consensus.cc:2393] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 13: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:23.122339  4823 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:23.143566  4841 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:23.073091  4450 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.202934   625 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:23.071094  4952 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.164942  4947 raft_consensus.cc:3055] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:23.057049  4955 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.092355  4935 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.081041  4587 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.203902   599 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:23.142887  4828 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.165354  4853 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.167486  4660 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.170670  4895 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.204972   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:23.320559   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 136198us
I20260709 13:14:23.181010  4870 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:23.321260   554 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 7.
I20260709 13:14:23.321784  1173 raft_consensus.cc:2393] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 11: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:23.321862   448 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:23.322969   448 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:23.247990   551 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 12. Current term is 14. Ops: []
I20260709 13:14:23.323794  4935 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:23.264350  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:23.257642   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:23.275012   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:23.199764  4823 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:23.246685  1168 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:14:23.296167   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:23.301754  1166 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
W20260709 13:14:23.269416   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:23.327965   555 raft_consensus.cc:1275] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:23.211530  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:23.335441   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:23.332293   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:23.339530  4807 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:23.339883  4873 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:23.340035  4807 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:23.340652  4807 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:23.339565  4925 consensus_queue.cc:237] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.347263  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:23.348567  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:23.348829  4450 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:23.349472  1171 raft_consensus.cc:2410] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 14 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:14:23.350926   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:23.351843   550 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:14:23.350368  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:23.353376  1171 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:23.333765  4948 raft_consensus.cc:2749] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:23.355552  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:23.356344  1169 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:23.336525  4944 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:23.357504  4944 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.357910  4944 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:23.363626  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:14:23.365273   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 94355us
I20260709 13:14:23.366726   522 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:23.368714   523 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:23.368794   522 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:23.387388  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:23.387646   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:23.388458   480 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:14:23.388777   624 raft_consensus.cc:2393] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 13: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:23.375131  4726 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:23.390807  4726 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.391203  4726 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:23.395812  1170 raft_consensus.cc:2393] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:23.395989   626 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:23.396901  4828 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:23.336308  4951 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:23.397666  4951 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:23.398106  4951 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:23.338950  4823 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:23.325014  4947 raft_consensus.cc:740] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:23.403600   522 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:23.182529  4809 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.442338  1171 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:23.445345  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:23.445566  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:23.447081  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 69581.2us
I20260709 13:14:23.447702  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:23.449168   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 264257us
I20260709 13:14:23.209653  4841 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.455551  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:23.454263  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:23.456791  1171 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
W20260709 13:14:23.461333   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 274284us
I20260709 13:14:23.424892  4937 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:23.431973  4321 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:23.211864  4788 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.481639  1139 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:23.482344   599 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:23.453852  4853 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:23.458190  4942 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:23.486078   448 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:23.464452  4937 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.496701  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:23.471999  4828 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.445297  4450 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:14:23.409974  4807 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.445910  4953 consensus_queue.cc:1048] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:14:23.503974   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:23.509666  1139 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:23.514681   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 62884.6us
I20260709 13:14:23.504701  4937 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:23.504390  4613 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:14:23.522208   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 58103.8us
I20260709 13:14:23.505300  4942 raft_consensus.cc:697] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:23.456910  4968 consensus_queue.cc:1048] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:14:23.506052  4267 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:23.516376   523 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:23.527065   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:23.544130  4974 log.cc:927] Time spent T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:14:23.545787  4947 consensus_queue.cc:260] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.538488   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:23.551832   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:23.551873   550 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:14:23.508703  4744 consensus_queue.cc:1059] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:14:23.556546  4841 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:23.557224  4944 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.559973  4853 consensus_queue.cc:1059] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:14:23.561426  4788 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:23.564165  4450 raft_consensus.cc:2764] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:14:23.566074  4947 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:23.571750   523 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:23.535737  4613 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.577421  4613 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:23.578007  4944 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:23.579531  4660 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:23.581264   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:23.582674  4765 raft_consensus.cc:3055] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:23.583045  4765 raft_consensus.cc:740] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:23.584031  4955 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:23.584106  4765 consensus_queue.cc:260] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.589998   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:23.588908   599 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:23.526309  4828 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.595340   477 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:14:23.595340   475 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:14:23.551069  4267 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:23.592401  4765 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:14:23.599408   550 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:23.604225   482 raft_consensus.cc:3055] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:23.604707   482 raft_consensus.cc:740] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:23.598404  4267 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:23.613286  4960 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:23.613777  4960 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.614048  4807 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:23.614269  4960 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:23.612428  4739 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:23.596302  4952 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:23.594053  4955 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:23.639947   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:23.671584   479 raft_consensus.cc:2393] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 9: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
W20260709 13:14:23.674037   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 188053us
I20260709 13:14:23.598677  4587 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:23.616680  4948 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:23.633946  4794 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.634213  4895 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:23.638499  4953 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:23.674818  4955 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.690672   448 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:23.603524  4613 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.688410   482 consensus_queue.cc:260] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.661523  4829 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.028s
W20260709 13:14:23.695271   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 124034us
I20260709 13:14:23.697829   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:23.705008   482 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:23.705845   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:23.692325  4788 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:23.692505  4991 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.694322  4955 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:23.688220  4952 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:14:23.695711  4809 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:23.712596  4998 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:14:23.715732  4828 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:23.708315  4968 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:23.694280  4953 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.659962  4942 consensus_queue.cc:237] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:23.719796  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 210229us
I20260709 13:14:23.691716  4794 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.721326   448 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:23.698225  4829 consensus_queue.cc:1243] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:14:23.733901   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:23.747051   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:23.719750  4991 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.737697  4794 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:23.741634  4937 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.748481   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:23.749294  4991 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:23.731127  4995 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:23.749600   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:23.750240   481 raft_consensus.cc:1217] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 7.9->[10.10-13.12]   Dedup: 10.10->[11.11-13.12]
I20260709 13:14:23.738703   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:23.750809   481 pending_rounds.cc:85] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 10
I20260709 13:14:23.751091   481 pending_rounds.cc:107] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:14:23.751169   475 raft_consensus.cc:2393] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 13: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:23.751358   481 raft_consensus.cc:2889] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:23.742396   480 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:14:23.744498  4613 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:23.760160   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:23.752723  1141 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:23.742826  4968 raft_consensus.cc:697] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:23.761715  4953 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:23.761986  4968 consensus_queue.cc:237] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.750358  4937 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:23.736722  4870 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.750629   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:23.766103   558 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:23.767204  4870 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:23.749630   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:23.743777   599 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:23.769346   599 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:23.771087  4895 raft_consensus.cc:2764] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:14:23.771754  4895 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:23.772215  4895 raft_consensus.cc:697] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:23.772687   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:23.773003   558 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:23.773334   557 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 13.
I20260709 13:14:23.773053  4951 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.774047   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:23.760816   480 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:23.775293   599 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:23.775651   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:23.773017  4895 consensus_queue.cc:237] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.776559  4267 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.695317  4726 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.778795   550 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:14:23.776930   558 raft_consensus.cc:1240] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:23.774130   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:23.780556   525 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:23.744447  4823 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.790875   482 raft_consensus.cc:1275] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:14:23.792673   550 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:23.794130  4951 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:23.795490   482 pending_rounds.cc:85] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 4
I20260709 13:14:23.796265  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:23.796418  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:23.791854  4948 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:23.792018  4765 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:14:23.802143   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:23.798254   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:23.802865   475 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:14:23.798916   599 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:23.799206   482 pending_rounds.cc:107] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:14:23.797410  4873 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:14:23.800622   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:23.798223   525 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:23.804426   482 raft_consensus.cc:2889] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:23.783975  4828 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:23.823436   477 raft_consensus.cc:2393] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 12: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:23.807847   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:23.826083   550 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:14:23.798691  4950 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:14:23.833647   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:23.801517  4948 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:23.836938   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:23.800173  4613 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:23.840173  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:23.840277   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:23.824697  4828 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.841442   550 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:23.841488   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:23.826987  4267 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:23.844201   558 raft_consensus.cc:2368] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12.
I20260709 13:14:23.805598  4953 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:14:23.800205  4870 consensus_queue.cc:1048] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:14:23.839579  4948 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:23.849453   525 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:23.850870  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:23.851022   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 52185.7us
I20260709 13:14:23.840946  4942 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:23.852214   557 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 13.
I20260709 13:14:23.731559   369 maintenance_manager.cc:643] P 958aa06b858546888f102fe85618915c: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 5.316s	user 0.171s	sys 0.038s Metrics: {"bytes_written":29384,"cfile_init":1,"dirs.queue_time_us":250508,"dirs.run_cpu_time_us":588,"dirs.run_wall_time_us":63998,"drs_written":1,"lbm_read_time_us":429,"lbm_reads_lt_1ms":4,"lbm_write_time_us":196158,"lbm_writes_10-100_ms":7,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":63,"thread_start_us":32813,"threads_started":1}
I20260709 13:14:23.844411  4828 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:23.856307   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:14:23.863129   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:23.863157   478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 2009) took 1097 ms. Trace:
I20260709 13:14:23.864239   478 rpcz_store.cc:276] 0709 13:14:22.766059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:22.785756 (+ 19697us) service_pool.cc:224] Handling call
0709 13:14:23.862966 (+1077210us) spinlock_profiling.cc:243] Waited 93.2 ms on lock 0x7b540020e4d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:23.863097 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214381440}
I20260709 13:14:23.863157   550 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:14:23.865330   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:23.866369   558 raft_consensus.cc:2393] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 10: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:23.866210   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:23.854900  4991 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:23.867422  4991 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.867417   550 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:23.867937  4991 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:23.868695   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:23.868929   370 maintenance_manager.cc:419] P 958aa06b858546888f102fe85618915c: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9399 bytes on disk
I20260709 13:14:23.852829  4415 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:23.875759  4415 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:23.875887   550 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:23.876217  4415 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:23.877060   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:23.878275   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:23.847539  4613 raft_consensus.cc:697] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
W20260709 13:14:23.881186   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:23.883037   448 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:23.880450  4613 consensus_queue.cc:237] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.884519  4951 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:23.889200   448 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:23.894917  4823 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:23.850119  4960 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.890111  4726 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:23.897475  1170 raft_consensus.cc:2368] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10.
I20260709 13:14:23.898573  4960 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:23.898969  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:23.901665   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:23.904079   448 leader_election.cc:400] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10.
I20260709 13:14:23.904407   448 leader_election.cc:403] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:23.904695   522 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:23.904968  4817 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:23.900130  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:23.862274  4942 consensus_queue.cc:1048] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:14:23.908001  1170 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:23.908058   448 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:23.909698   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:23.909835   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:23.913234   624 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:23.911478   628 raft_consensus.cc:1275] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:23.913269   479 raft_consensus.cc:2393] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 10: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:23.916496   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:23.917061   625 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:23.917160  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:23.918272  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:23.919651   633 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 12. Current term is 14. Ops: []
I20260709 13:14:23.920452   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:23.921113   631 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:14:23.921734   480 raft_consensus.cc:1240] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:23.889092  4819 consensus_queue.cc:1048] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:14:23.923599  1175 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:23.925886  1173 raft_consensus.cc:1240] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:14:23.930781   629 raft_consensus.cc:1275] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:23.927673   522 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:23.928953   448 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:23.933516   523 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:23.933693   624 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:23.934764   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:23.935906   448 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:23.936347   630 raft_consensus.cc:3055] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:23.936894   599 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:23.936066   523 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:23.939008   630 raft_consensus.cc:740] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:23.942572   369 maintenance_manager.cc:643] P 958aa06b858546888f102fe85618915c: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.045s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":343,"lbm_reads_lt_1ms":4}
I20260709 13:14:23.942983   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:23.943748   624 raft_consensus.cc:2393] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 12: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:23.939325   522 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:23.930781  4819 consensus_queue.cc:1243] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:23.948544   624 raft_consensus.cc:1240] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:14:23.934341  4870 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:23.932304  4969 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:23.948813   522 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:23.932796  4726 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:23.938405  4950 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:23.938663  4841 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:23.950948   630 consensus_queue.cc:260] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.960568   558 raft_consensus.cc:2393] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 12: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:23.943634  4968 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:23.942405  4953 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:23.963387   629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:14:23.963986   629 raft_consensus.cc:606] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:23.966899   629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:14:23.962126  4841 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:23.967519   629 raft_consensus.cc:606] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:23.967720  4841 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:23.967896   629 raft_consensus.cc:614] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:23.947306  4955 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:23.931124  4946 consensus_queue.cc:1059] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:14:23.969473  4946 raft_consensus.cc:3055] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:23.969842  4946 raft_consensus.cc:740] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:23.946527  4587 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:23.971807  1173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67e346d318734aba97a45543ff4ad474"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:57004
I20260709 13:14:23.972363  1173 raft_consensus.cc:606] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:23.972668  1173 raft_consensus.cc:614] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:23.975435   629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:14:23.976054   629 raft_consensus.cc:606] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:23.934981  4951 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:14:23.969902  4955 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:23.978772   625 raft_consensus.cc:2468] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:23.962131   523 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:23.954615  4660 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:23.980023 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:23.981861 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:23.937664  4937 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
W20260709 13:14:23.982710  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:23.945236  4998 consensus_queue.cc:1059] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:14:23.983742   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:23.984576   554 raft_consensus.cc:2393] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 14: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:23.953164  4267 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:23.985090  4267 raft_consensus.cc:697] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:23.985352   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:23.986446   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:23.986284  4267 consensus_queue.cc:237] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:23.977929  4870 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:23.991607   630 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:23.997608  4841 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:24.001247  4953 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:24.005664   523 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:24.006630   523 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:23.987154   554 raft_consensus.cc:2368] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10.
I20260709 13:14:24.012259   550 raft_consensus.cc:2393] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 13: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:24.021288  4937 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:24.021564   483 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:23.962550  4969 raft_consensus.cc:697] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:24.022946  4969 consensus_queue.cc:237] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:24.023736  4926 consensus_queue.cc:1059] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:23.951463  5004 consensus_queue.cc:1059] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:14:24.038586   630 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:14:24.044050   630 pending_rounds.cc:85] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 9
I20260709 13:14:24.044333   630 pending_rounds.cc:107] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:14:24.044550   630 raft_consensus.cc:2889] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:24.044909   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:24.041121  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:24.045612   554 raft_consensus.cc:2393] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 11: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:24.004519  4870 consensus_queue.cc:1048] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:14:24.012898  4953 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:24.061671   475 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:24.055190   448 leader_election.cc:400] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10.
I20260709 13:14:24.058835  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:24.005980  4968 raft_consensus.cc:697] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:24.062954  1170 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:24.045610   522 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:23.970781  4946 consensus_queue.cc:260] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:24.012562  4794 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:14:24.052284  4952 raft_consensus.cc:3055] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:24.013010  4726 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:24.013758  4948 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:24.099275   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:24.105794   554 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:24.071723  4853 raft_consensus.cc:2804] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:24.064821  4817 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10.
I20260709 13:14:24.055382  4955 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:14:24.105700  4373 raft_consensus.cc:3055] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:24.113991  4991 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:24.114356  4373 raft_consensus.cc:740] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:24.115480  4841 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:24.101879  4952 raft_consensus.cc:740] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:24.115607  4373 consensus_queue.cc:260] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:24.117082  4373 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:24.116825  4952 consensus_queue.cc:260] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:24.118182  4952 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:24.072964  4953 raft_consensus.cc:697] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:14:24.122273   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:24.122836   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:24.037207  4415 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:24.111534  4968 consensus_queue.cc:237] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:24.127713  4949 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.197s	user 0.025s	sys 0.050s
I20260709 13:14:24.134110   552 raft_consensus.cc:1240] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:24.119940  4953 consensus_queue.cc:237] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:24.136999   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 200163us
I20260709 13:14:24.128176  4853 raft_consensus.cc:697] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:24.154826   554 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:24.156065   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:24.161609   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:24.162572   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:24.163159   556 raft_consensus.cc:2376] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11. Re-sending same reply.
W20260709 13:14:24.162688  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:24.135658  4949 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.205s	user 0.025s	sys 0.051s
I20260709 13:14:24.168824   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:24.108089  4828 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:24.218189   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:24.260607  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:24.261332   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:24.264041   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 93898us
I20260709 13:14:24.303125   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:24.370963   553 raft_consensus.cc:2410] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:14:24.371083   554 raft_consensus.cc:2410] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:14:24.157181  4955 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:24.220867   556 raft_consensus.cc:2393] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 12: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:24.219648  4794 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:24.394731   554 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:24.438963   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:24.439821   475 raft_consensus.cc:2393] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 13: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:24.380000  4942 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:24.445523   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:24.384320  4955 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:24.448017   553 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:24.446213   478 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:24.453397  5014 log.cc:927] Time spent T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:14:24.453310   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:24.455438   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:24.455790   475 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: []
W20260709 13:14:24.455171  5010 log.cc:927] Time spent T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:14:24.459470  4853 consensus_queue.cc:237] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:24.462873  4415 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:24.449836  4726 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:24.471732  4948 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:24.472203  5006 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.363s	user 0.000s	sys 0.001s
I20260709 13:14:24.441682  4794 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:24.442052  4991 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:24.501160   552 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:24.499702  1170 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:24.524829  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:24.525524  1168 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:24.535708   553 raft_consensus.cc:1240] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:14:24.450598  4942 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:24.526695  4613 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:24.500922  4828 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:24.552438   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 584) took 1283 ms. Trace:
I20260709 13:14:24.555919   481 raft_consensus.cc:1240] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:24.563802   559 rpcz_store.cc:276] 0709 13:14:23.269403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:23.339550 (+ 70147us) service_pool.cc:224] Handling call
0709 13:14:23.339934 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:23.377739 (+ 37805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:23.377770 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:23.377810 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:23.377846 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:24.551706 (+1173860us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b54000ebd54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:24.551820 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:24.552336 (+   516us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86544256}
I20260709 13:14:24.568921  4991 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:24.569458  4991 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:24.572346   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:24.574653   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:24.577109   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:24.580199   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:24.581928   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:24.584612   479 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:24.583670   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:24.587595   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:24.587952   481 raft_consensus.cc:2368] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10.
I20260709 13:14:24.590175  4345 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.590709  4345 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:24.593277  4948 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.593783  4948 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:24.595752  4794 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:24.595835  4948 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:24.592816  4345 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:24.647693   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.649907   630 raft_consensus.cc:1240] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:24.651921   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.652657   630 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:24.653625   625 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:24.655181   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.656390   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.656953   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.657616   630 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:24.666180   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.666375   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.666927   629 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:24.667536   478 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 15.
I20260709 13:14:24.668356   483 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:24.668979   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:24.669994   478 raft_consensus.cc:2393] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 12: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:24.670989   559 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:14:24.543385  4613 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:24.672266   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.674326   626 raft_consensus.cc:1275] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:24.675101   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:24.685925   629 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:24.686762   628 raft_consensus.cc:2393] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 11: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:24.675187  4955 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:24.675498   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.676298   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:24.688846   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.689208   625 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:24.676718   627 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:24.690459   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:24.677331   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:24.683784   480 raft_consensus.cc:1240] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:24.684177   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.684828   481 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:14:24.691613   624 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:24.684207   477 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:24.690476   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:24.600179  4969 consensus_queue.cc:1048] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 13:14:24.692421   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.684851   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:24.689468   630 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:24.699754   632 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:24.701162   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:24.705363   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.706459   624 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 9: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:24.707504   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:24.708348   630 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:24.708799   599 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:24.712028   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.712807   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:24.713747   478 raft_consensus.cc:2368] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13.
I20260709 13:14:24.716913   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.717131   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:24.720111   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:24.721259   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:24.702435  4969 consensus_queue.cc:1243] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:14:24.728966   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:24.725486   599 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:24.729954   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.730731   624 raft_consensus.cc:2410] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:14:24.732044   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:24.721050  4823 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:24.741598   478 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:24.728969  4952 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.750408   626 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:24.721213  4828 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:14:24.740033  4841 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.753412   599 leader_election.cc:400] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10.
W20260709 13:14:24.753201  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:24.737036  4415 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:24.754400   630 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:24.761628   599 leader_election.cc:403] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:14:24.735572  4345 consensus_queue.cc:1059] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:14:24.764724  4942 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:24.761103  4828 consensus_queue.cc:1243] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:14:24.752329  4952 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:24.768585  4948 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:24.774340  4373 consensus_meta.cc:287] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.657s	user 0.007s	sys 0.007s
I20260709 13:14:24.760210  4823 consensus_queue.cc:1059] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:14:24.789048   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:24.794242   633 raft_consensus.cc:2410] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:14:24.801831   630 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:24.808666   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.809749   624 raft_consensus.cc:2393] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 13: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:24.765756  4841 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:24.813817   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:24.815212   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:14:24.815901   447 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 2.139s (SENT) [suppressed 30 similar messages]
I20260709 13:14:24.817224   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:24.817531   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.818020   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.818336   624 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:24.819407   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:24.820207   624 raft_consensus.cc:2393] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 13: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:24.821049   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.822523   624 raft_consensus.cc:1240] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:24.816906   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:24.828047  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:24.828619  1174 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:24.827796   630 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:24.829789   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.830412   555 raft_consensus.cc:1275] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:24.813154  4942 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:14:24.842144   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:24.842811   522 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:24.850921   522 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:24.852381   522 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:24.817487  4962 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.855775   522 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:14:24.861148   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 92577.8us
I20260709 13:14:24.861340   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.862255   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:24.863044   480 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:14:24.825402  4373 consensus_queue.cc:1059] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:14:24.883893  5019 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:14:24.860956  4794 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:24.886927   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.888630  4841 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:24.857158  4947 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:24.876966  4953 consensus_queue.cc:1059] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:14:24.890915  4953 raft_consensus.cc:3055] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:24.891294  4953 raft_consensus.cc:740] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:24.849455  4613 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:24.893996   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 767) took 1180 ms. Trace:
I20260709 13:14:24.879312  4968 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:24.879598  5023 log.cc:927] Time spent T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260709 13:14:24.880435  5022 log.cc:927] Time spent T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:14:24.879343  5024 log.cc:927] Time spent T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:14:24.868134  4962 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:24.860956  4955 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:24.894121   475 raft_consensus.cc:1240] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:24.867940  4660 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:24.894438   476 rpcz_store.cc:276] 0709 13:14:23.713528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:23.713668 (+   140us) service_pool.cc:224] Handling call
0709 13:14:23.719605 (+  5937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:23.731140 (+ 11535us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:14:24.664720 (+933580us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b18003afa20. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b65329455 00007f4b6be113c7 00007f4b684239a7 00007f4b684330bf 00007f4b68433038
0709 13:14:24.775046 (+110326us) log.cc:844] Serialized 14 byte log entry
0709 13:14:24.869726 (+ 94680us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:24.876100 (+  6374us) log.cc:844] Serialized 26 byte log entry
0709 13:14:24.876228 (+   128us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:24.876263 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:24.876345 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:24.892701 (+ 16356us) raft_consensus.cc:1685] finished
0709 13:14:24.893759 (+  1058us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:24.893936 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2247,"prepare.queue_time_us":26775,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":4308,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":7415,"spinlock_wait_cycles":12427008,"thread_start_us":145829,"threads_started":2,"wal-append.queue_time_us":65660}
I20260709 13:14:24.866034  4942 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:24.904793  5034 consensus_queue.cc:1059] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:24.912240  1174 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:24.893337   630 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
W20260709 13:14:24.874502  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 86682.3us
I20260709 13:14:24.913532   448 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:24.915027   522 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:24.915472  1139 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:24.915938  4955 raft_consensus.cc:697] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:24.918828  5012 raft_consensus.cc:3055] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:24.908100  4660 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:24.919288  5012 raft_consensus.cc:740] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:24.919173  4955 consensus_queue.cc:237] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:24.920362  5012 consensus_queue.cc:260] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:24.922385   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2093) took 1041 ms. Trace:
I20260709 13:14:24.923316  5035 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:24.923868  5035 raft_consensus.cc:697] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:24.924017  4952 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:24.924744  5035 consensus_queue.cc:237] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:24.897416  4968 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:24.926972  4968 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:24.927304  4788 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:24.927820  4788 raft_consensus.cc:697] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:24.922762   559 rpcz_store.cc:276] 0709 13:14:23.881413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.672984 (+791571us) service_pool.cc:224] Handling call
0709 13:14:24.676013 (+  3029us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:24.676230 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:24.676254 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:24.676687 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:14:24.815513 (+138826us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:24.816645 (+  1132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:24.816725 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:24.922166 (+105441us) raft_consensus.cc:1685] finished
0709 13:14:24.922186 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:24.922331 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":138459,"threads_started":1,"wal-append.queue_time_us":233279}
I20260709 13:14:24.928771  4942 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:24.928659  4788 consensus_queue.cc:237] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:24.892203  4953 consensus_queue.cc:260] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:24.932677   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 70874.6us
I20260709 13:14:24.932749  4948 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10.
I20260709 13:14:24.933305  5041 raft_consensus.cc:2764] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:14:24.931633  4660 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:24.947000  4953 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:24.951175  1139 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:24.954890   632 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:24.957852   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:24.960533   599 leader_election.cc:400] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13.
I20260709 13:14:24.960906   599 leader_election.cc:403] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:14:24.965140  5041 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:24.965319  5043 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13.
I20260709 13:14:24.965723  5041 raft_consensus.cc:697] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:24.966672  5043 consensus_queue.cc:1059] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:24.966704  5041 consensus_queue.cc:237] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:24.971150   625 raft_consensus.cc:1275] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:14:24.971731  4841 consensus_queue.cc:1048] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:24.972332  4968 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:24.972879   447 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:24.973397  4962 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:24.964149  5038 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:14:24.974512  5040 raft_consensus.cc:3055] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:25.023514  5040 raft_consensus.cc:740] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:24.979692  4415 raft_consensus.cc:3055] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:25.024394  5040 consensus_queue.cc:260] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:25.025161  4415 raft_consensus.cc:740] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:25.025460  5040 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:25.026053  4415 consensus_queue.cc:260] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:25.022616   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 49820.1us
I20260709 13:14:25.028282   447 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:25.029838   447 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:25.058008  5001 log.cc:927] Time spent T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 1.182s	user 0.001s	sys 0.004s
I20260709 13:14:25.061518   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:25.077369   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 47642.3us
I20260709 13:14:25.022723  4823 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:25.036384  4952 raft_consensus.cc:2764] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:14:25.031469  4995 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:25.094440   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 583) took 1825 ms. Trace:
I20260709 13:14:25.096099   551 rpcz_store.cc:276] 0709 13:14:23.269087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:23.324416 (+ 55329us) service_pool.cc:224] Handling call
0709 13:14:23.327598 (+  3182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:23.506420 (+178822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:23.506450 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:23.511289 (+  4839us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:23.511343 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:25.094122 (+1582779us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54000ec254. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:25.094189 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:25.094355 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":402936704}
I20260709 13:14:25.078526   447 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:25.021934  4942 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:14:25.027228  4415 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:25.080279  4969 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:14:25.122344   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.111038  4345 raft_consensus.cc:3055] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:25.113919  4995 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:25.093767  4823 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:25.139882  1167 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36724 (request call id 591) took 2119 ms (client timeout 2289 ms). Trace:
W20260709 13:14:25.140358  1167 rpcz_store.cc:269] 0709 13:14:23.019317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:23.019556 (+   239us) service_pool.cc:224] Handling call
0709 13:14:25.138174 (+2118618us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b540069f5d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:25.138359 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":978328320}
I20260709 13:14:25.119169  4841 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:25.122853  4968 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:25.152117  4968 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:25.122473  4969 raft_consensus.cc:697] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:25.157096  4969 consensus_queue.cc:237] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:25.166841   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.154922  4968 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:25.180605   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:25.134800  4345 raft_consensus.cc:740] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:25.186825   476 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:25.187932   480 raft_consensus.cc:1275] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:14:25.191413   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.191208   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:25.197214  4823 leader_election.cc:290] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:25.198508  4345 consensus_queue.cc:260] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:25.199898  4345 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:25.200227  4958 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.200721  4958 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:25.202773  4958 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:14:25.204399   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:25.205163   481 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:25.205821  4948 consensus_queue.cc:1059] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:25.206580  4948 consensus_queue.cc:1243] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:14:25.207325  4948 raft_consensus.cc:3055] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:25.173950  4660 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:25.207659  4948 raft_consensus.cc:740] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:25.208146   599 leader_election.cc:304] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:25.208436  4948 consensus_queue.cc:260] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:25.209713   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:25.213680  1138 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:25.209245  5051 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:14:25.216825   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 138457us
I20260709 13:14:25.218518  5051 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:25.221807  5051 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:25.224995   447 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:25.218086  4948 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:25.230726  5037 consensus_queue.cc:1059] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:25.161404  4995 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:25.231923  4267 raft_consensus.cc:993] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:14:25.232404  4267 raft_consensus.cc:1081] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:14:25.233435  4995 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:25.217474  4962 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:25.241365  4946 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:25.242281  4267 raft_consensus.cc:3055] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:25.242678  4267 raft_consensus.cc:740] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:25.244146  4267 consensus_queue.cc:260] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:25.245030   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:25.246353  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:25.252614   447 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:25.258605   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:25.264743  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 48478.2us
I20260709 13:14:25.264572  5038 consensus_queue.cc:1059] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:25.265847   480 pending_rounds.cc:85] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 5
I20260709 13:14:25.266157   480 pending_rounds.cc:107] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:14:25.266376  5038 raft_consensus.cc:3055] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:25.266665   483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:14:25.267298   483 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.267649   483 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:25.245093  4267 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:25.266803  5038 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:25.272069  5038 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:25.273243  5038 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:25.266399   480 raft_consensus.cc:2889] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:25.280594   557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43548 (request call id 589) took 1488 ms (client timeout 1599 ms). Trace:
W20260709 13:14:25.281203   557 rpcz_store.cc:269] 0709 13:14:23.791866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:23.807144 (+ 15278us) service_pool.cc:224] Handling call
0709 13:14:25.280354 (+1473210us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b5400151dd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:25.280515 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30954880}
I20260709 13:14:25.294440  1138 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:25.294600   447 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:25.262225  4995 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:25.297415   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:25.298171  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:25.298878  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:25.301584  1175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 607) took 1955 ms. Trace:
I20260709 13:14:25.305073  1172 raft_consensus.cc:2393] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 13: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:25.305594  1167 raft_consensus.cc:2368] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12.
I20260709 13:14:25.303062  1175 rpcz_store.cc:276] 0709 13:14:23.346145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:23.364656 (+ 18511us) service_pool.cc:224] Handling call
0709 13:14:23.923304 (+558648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:23.926422 (+  3118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:25.301332 (+1374910us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b540048d350. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:25.301506 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1283937664}
I20260709 13:14:25.306686   447 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:25.278400  5035 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:25.262382  4823 consensus_queue.cc:1048] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:14:25.313719   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 2218) took 1490 ms. Trace:
I20260709 13:14:25.314126   550 rpcz_store.cc:276] 0709 13:14:23.823799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:23.878055 (+ 54256us) service_pool.cc:224] Handling call
0709 13:14:25.313416 (+1435361us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b5400387f54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:25.313562 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306412416}
I20260709 13:14:25.309046  1169 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:14:25.312806   447 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:25.302136  4613 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:25.320647   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:25.323457   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:25.324033   628 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:25.325008   629 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:14:25.325348   629 pending_rounds.cc:85] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 6
I20260709 13:14:25.325554   629 pending_rounds.cc:107] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:14:25.325769   629 raft_consensus.cc:2889] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:25.327123   624 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:14:25.304881  4819 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:25.292135  5041 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:14:25.313367  4968 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:25.337906   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:25.321815   483 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:25.619926   483 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:25.301817  5051 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:25.622568  5051 leader_election.cc:290] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:25.349463  4415 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.623358  4415 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:25.625483  4415 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:25.315964  4948 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.626902  4948 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:25.629132  4948 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:25.340976  4968 raft_consensus.cc:697] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:25.630384  4968 consensus_queue.cc:237] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:25.317698  4995 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:25.632371  4995 raft_consensus.cc:697] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:25.329881  5035 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:25.341075  4819 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:25.387758  1139 leader_election.cc:336] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Timed out: RequestConsensusVote RPC to 127.31.17.130:41159 timed out after 1.599s (SENT)
I20260709 13:14:25.388535   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2082) took 1551 ms. Trace:
I20260709 13:14:25.396200  1173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 620) took 1355 ms. Trace:
I20260709 13:14:25.481377  4838 raft_consensus.cc:3055] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:14:25.504132  5009 log.cc:927] Time spent T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 1.116s	user 0.003s	sys 0.000s
I20260709 13:14:25.529379  4991 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:25.547681  5012 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:25.640601   552 rpcz_store.cc:276] 0709 13:14:23.837356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.139582 (+302226us) service_pool.cc:224] Handling call
0709 13:14:25.388293 (+1248711us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400105754. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:25.388456 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":756902144}
I20260709 13:14:25.641520  1139 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:25.641744  4819 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:25.642413  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 254697us
I20260709 13:14:25.553711   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:25.644179   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:25.644876   630 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:25.645664   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:25.646201   630 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
W20260709 13:14:25.568156   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.582486  4926 raft_consensus.cc:3055] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:25.640043  4952 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.648486  4926 raft_consensus.cc:740] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:25.648770  4952 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:25.649405  4926 consensus_queue.cc:260] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:25.650512  4926 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:25.644234  5033 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:25.651446  4838 raft_consensus.cc:740] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:25.652746  1166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36742 (request call id 660) took 1853 ms. Trace:
I20260709 13:14:25.652634  4838 consensus_queue.cc:260] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:25.653949  4838 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:25.653156  1166 rpcz_store.cc:276] 0709 13:14:23.799594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:23.921703 (+122109us) service_pool.cc:224] Handling call
0709 13:14:23.922022 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:23.922374 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:23.922401 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:23.922790 (+   389us) log.cc:844] Serialized 26 byte log entry
0709 13:14:24.046821 (+124031us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:24.046874 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:24.046962 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:25.503676 (+1456714us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:25.652476 (+148800us) raft_consensus.cc:1685] finished
0709 13:14:25.652497 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:25.652690 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1054,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":9689,"spinlock_wait_cycles":5500160,"thread_start_us":123656,"threads_started":1,"wal-append.queue_time_us":210145}
I20260709 13:14:25.655906  4995 consensus_queue.cc:237] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:25.656677  4819 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:25.657244  4819 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:25.666445   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.646967   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:25.670090   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:25.671164   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:25.648089   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.673067   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:25.673516   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:25.674302   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:25.674449   630 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:25.675700  4819 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:25.676244  1173 rpcz_store.cc:276] 0709 13:14:24.040666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.058658 (+ 17992us) service_pool.cc:224] Handling call
0709 13:14:24.058956 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:24.105282 (+ 46326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:24.105328 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:24.108621 (+  3293us) log.cc:844] Serialized 26 byte log entry
0709 13:14:25.224675 (+1116054us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b1800050260. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb90d1 00007f4b683d4a0f
0709 13:14:25.332273 (+107598us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:25.394701 (+ 62428us) log.cc:844] Serialized 14 byte log entry
0709 13:14:25.395088 (+   387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:25.395417 (+   329us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:25.395464 (+    47us) raft_consensus.cc:1685] finished
0709 13:14:25.396011 (+   547us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:25.396141 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":224,"prepare.queue_time_us":65140,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":7184,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":3962,"spinlock_wait_cycles":18569600,"thread_start_us":169229,"threads_started":2,"wal-append.queue_time_us":1249085}
I20260709 13:14:25.678120  5056 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:25.678709  5056 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:25.681375  5056 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:25.682073  5056 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:25.684610  4926 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.562280   628 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:25.685653   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:25.688170  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:25.673262   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:25.689688   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:25.667073   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.695729   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:25.696043   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:25.696523   477 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
I20260709 13:14:25.699295   631 raft_consensus.cc:2410] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:14:25.685134  4926 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:25.650991  4952 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:25.702688   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:25.711825   625 raft_consensus.cc:2393] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 14: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:25.698230  4415 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:25.689013  4969 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.712713  4969 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:25.708174   483 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:25.708742   477 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:14:25.682660  5056 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:25.709430   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:25.701154   629 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:14:25.714793   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.716431  4415 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:25.721853  4969 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:25.716885  4926 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:25.722666  4415 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:25.738003   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 2052) took 1057 ms. Trace:
I20260709 13:14:25.740291   627 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:14:25.740799   627 pending_rounds.cc:85] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 7
I20260709 13:14:25.741071   627 pending_rounds.cc:107] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:14:25.741355   627 raft_consensus.cc:2889] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:25.752427   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:25.755686   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.763586  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:25.756652  5053 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.738590   633 rpcz_store.cc:276] 0709 13:14:24.680832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.719857 (+ 39025us) service_pool.cc:224] Handling call
0709 13:14:25.737690 (+1017833us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b54001bb554. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:25.737915 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168454016}
I20260709 13:14:25.759588  5060 raft_consensus.cc:3055] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:25.761963  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:25.763449   624 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:14:25.762912  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:25.768314  1138 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:25.777256   481 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:25.777652   624 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:25.787843  5056 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:25.766624  5060 raft_consensus.cc:740] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:25.336040   626 pending_rounds.cc:85] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 6
I20260709 13:14:25.789441   626 pending_rounds.cc:107] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:14:25.789798   626 raft_consensus.cc:2889] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:25.788996  5060 consensus_queue.cc:260] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:25.792583  5060 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:25.769173  5053 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:25.795334  5053 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:25.778978  4926 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:25.795974  4926 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.796305  4926 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:25.765913  4947 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.803625  4947 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:25.804147   558 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2091) took 1923 ms (client timeout 1530 ms). Trace:
W20260709 13:14:25.804556   558 rpcz_store.cc:269] 0709 13:14:23.880912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:23.912777 (+ 31865us) service_pool.cc:224] Handling call
0709 13:14:25.803945 (+1891168us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b54001d6854. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:25.804078 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57345920}
I20260709 13:14:25.805765  4947 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:25.812776   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.817226   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2088) took 1937 ms. Trace:
I20260709 13:14:25.782490  1141 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:25.821105  1141 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:25.821841  4949 raft_consensus.cc:2804] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:25.822211  4949 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:25.822551  4949 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:25.823591  4660 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:25.826473  5021 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:25.826932  5021 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.827358  5021 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:25.840822   597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.009s	sys 0.003s
W20260709 13:14:25.841212   597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.010s	sys 0.003s
I20260709 13:14:25.842185   597 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:25.842028  4926 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:25.843530  5034 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:25.845429   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.845496  4991 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.846122  4955 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:25.846498   447 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:25.846616  4955 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:25.818226   553 rpcz_store.cc:276] 0709 13:14:23.880139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.540152 (+660013us) service_pool.cc:224] Handling call
0709 13:14:25.282539 (+742387us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:25.283077 (+   538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:25.283135 (+    58us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:25.305228 (+ 22093us) log.cc:844] Serialized 52 byte log entry
0709 13:14:25.815346 (+510118us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:25.815383 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:25.815446 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:25.815484 (+    38us) raft_consensus.cc:1685] finished
0709 13:14:25.815494 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:25.816979 (+  1485us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b5400151dd0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:25.817165 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":131,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":6158,"spinlock_wait_cycles":1690900352,"thread_start_us":499427,"threads_started":1,"wal-append.queue_time_us":84083}
I20260709 13:14:25.848688  4955 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:25.849079   525 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:25.850706   525 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:25.850973  4995 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:25.846092  4991 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:25.854105  5021 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:25.855448  4991 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:25.856791  4788 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:25.857143   447 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:25.858176   478 raft_consensus.cc:1275] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:14:25.858237   447 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:25.858656   478 pending_rounds.cc:85] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 8
I20260709 13:14:25.858937   478 pending_rounds.cc:107] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:14:25.859411  4968 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:25.860705  4968 consensus_queue.cc:1059] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:25.859158   478 raft_consensus.cc:2889] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:25.861344  4968 consensus_queue.cc:1243] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:14:25.862015  4952 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:25.862694  4952 raft_consensus.cc:3055] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:25.863036  4952 raft_consensus.cc:740] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:25.863885   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2216) took 2063 ms. Trace:
I20260709 13:14:25.863790  4952 consensus_queue.cc:260] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:25.864243   554 rpcz_store.cc:276] 0709 13:14:23.800970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.445227 (+644257us) service_pool.cc:224] Handling call
0709 13:14:25.862918 (+1417691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:25.863083 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:25.863117 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:25.863161 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:25.863192 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:25.863266 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:25.863730 (+   464us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400105750. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:25.863829 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3196486528}
I20260709 13:14:25.864962  4952 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:25.869522  4828 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:25.870116  4828 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:25.875602  5035 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:25.876315  5035 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:25.866990   525 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:25.883908   447 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:25.885375   597 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:25.885695   624 raft_consensus.cc:1240] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:14:25.889986   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:25.855453  4947 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:25.947753   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:26.186259   479 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:25.948231   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 53816.4us
I20260709 13:14:26.193362   597 leader_election.cc:400] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12.
I20260709 13:14:26.193650   597 leader_election.cc:403] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:14:25.949231   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:26.198804  4415 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12.
I20260709 13:14:26.199501  4415 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:25.950826   552 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:14:25.956315   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:26.203466   553 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 10: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:25.956593  5068 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:25.958274   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:26.022876   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 155931us
I20260709 13:14:26.206372   525 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:26.032896   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 149107us
I20260709 13:14:26.209103   447 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:26.037179  5083 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:26.211464  5090 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:14:26.084148   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:26.068133  5086 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:26.087978   555 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:14:26.212980   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:26.211985  5083 raft_consensus.cc:697] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:26.214942  5083 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:26.091146  5071 log.cc:927] Time spent T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
I20260709 13:14:26.096352  4926 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:26.036695  5084 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:26.219216  4726 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:26.154363   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 2047) took 1475 ms. Trace:
I20260709 13:14:26.221135   631 rpcz_store.cc:276] 0709 13:14:24.679166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.244726 (+565560us) service_pool.cc:224] Handling call
0709 13:14:26.154176 (+909450us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b54001accd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:26.154304 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023458560}
I20260709 13:14:26.212006  5090 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:26.222419  5090 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:26.212834  5086 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.224031  5086 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:26.218894  5084 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:26.169023  4968 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:26.234025   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2097) took 2351 ms. Trace:
I20260709 13:14:26.234400   555 rpcz_store.cc:276] 0709 13:14:23.882491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.848447 (+965956us) service_pool.cc:224] Handling call
0709 13:14:24.871702 (+ 23255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:26.213217 (+1341515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:26.233798 (+ 20581us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400049cd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:26.233964 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2796726016}
I20260709 13:14:26.235654  4947 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.236186  4947 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:26.211004   447 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:26.237089  5089 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.244833  5089 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:26.237197  5086 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:26.246338  4947 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:26.249750  4838 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.237964   597 leader_election.cc:400] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12.
I20260709 13:14:26.250308  4838 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:26.251183   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 56048.2us
I20260709 13:14:26.248243   447 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:26.250531   553 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:26.252535   550 raft_consensus.cc:1275] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:14:26.253851   447 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:26.256458  4838 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:26.256886   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:26.257053   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:26.258117  4969 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.000s	sys 0.013s
W20260709 13:14:26.258483  4969 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.000s	sys 0.013s
I20260709 13:14:26.261468  4726 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:26.261499  1139 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:26.262305  4828 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:26.263005  5060 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:26.264429  5060 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:26.267184   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:26.268414  5084 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:26.271252  4926 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:26.274382   597 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:26.276456   479 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:26.277046   597 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:26.278915   599 leader_election.cc:304] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:26.280053  4819 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:26.280073  5084 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:26.280169  5065 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:26.282369  4819 raft_consensus.cc:697] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:26.282702  5084 raft_consensus.cc:2749] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:26.277483  4838 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:26.277040  4828 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:26.283354  4819 consensus_queue.cc:237] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:26.285681   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:26.279222  5060 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:14:26.286430   554 raft_consensus.cc:2393] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 11: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:25.104686 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:26.294787   555 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:14:26.296959   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:26.297861   552 raft_consensus.cc:2368] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10.
I20260709 13:14:26.312776  4948 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:26.313517  4948 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:26.320636  4948 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:26.333869   555 raft_consensus.cc:1240] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:26.338622   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:26.339586   479 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:26.343904   555 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:26.331413  4948 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:26.359771   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:26.359902   599 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:26.360581   558 raft_consensus.cc:2368] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13.
I20260709 13:14:26.361748   552 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:14:26.371927   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 118152us
I20260709 13:14:26.372331   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:26.372779   447 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:26.374264   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.373936   447 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:26.376452   550 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:26.377449   447 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:26.382905   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.383250   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.363265  4788 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:14:26.386332   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:26.389107   556 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:26.390683   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:26.374938  4838 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:26.375703  5084 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:26.392558   597 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:26.358843  4948 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:26.395057   597 leader_election.cc:400] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10.
I20260709 13:14:26.386464  4828 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:26.400542  4415 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:26.363086  5090 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:26.418087   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.386060  5065 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:26.412586  5089 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:26.392438  4838 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:26.460018   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.403301  4828 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:26.416210  4948 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:26.409529   632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 1969) took 1619 ms. Trace:
I20260709 13:14:26.462486   632 rpcz_store.cc:276] 0709 13:14:24.789953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.791339 (+  1386us) service_pool.cc:224] Handling call
0709 13:14:26.409345 (+1618006us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54001617d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:26.409467 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276913408}
I20260709 13:14:26.419250   557 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:14:26.453951   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.420181   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:26.459789   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.464965   479 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:26.403375  5097 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:26.467098   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.467383  4415 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.467881  4415 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:26.468950   597 leader_election.cc:400] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13.
W20260709 13:14:26.469879  5098 log.cc:927] Time spent T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:14:26.470063  4415 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:26.470573  4415 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:26.471654  5021 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:26.469872   597 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:26.474936  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:26.482897  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:26.475617  5083 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.490331   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.490203  5083 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:26.491381  4828 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:26.492770  5083 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:26.489420   523 connection.cc:256] RPC call timeout handler was delayed by -1.7055378490001658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
W20260709 13:14:26.494042   523 connection.cc:256] RPC call timeout handler was delayed by -1.4938372710000749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
W20260709 13:14:26.494401   523 connection.cc:256] RPC call timeout handler was delayed by -1.3426372710000578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
I20260709 13:14:26.494992  4968 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.404012  4969 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:14:26.495558  4968 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:26.497064  1166 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:14:26.461726  4838 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:26.497781  4968 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:26.498742  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:26.499542  1166 raft_consensus.cc:2368] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10.
I20260709 13:14:26.500303  5086 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:26.464782  5084 consensus_queue.cc:1059] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:14:26.464946  5065 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:26.501835  1166 raft_consensus.cc:1240] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:14:26.464066   551 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:26.466001   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.485716  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:26.486454  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:26.486960  5080 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.489482  4415 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:26.484074   597 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:26.495903   523 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:26.507886   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:26.504278   448 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:26.512064   479 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
W20260709 13:14:26.484985  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 663881us
I20260709 13:14:26.508430  1169 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:26.478242  5097 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:26.505865   599 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:26.397222  5038 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:26.460613   552 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:26.517416  1141 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:26.514542   523 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:26.538180   599 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:26.515444  5083 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:26.533744  4415 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:26.534148  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:26.540779  1175 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
I20260709 13:14:26.502836  5084 raft_consensus.cc:3055] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:26.534936   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:26.538977  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:26.504908  5065 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:26.512775   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 130262us
I20260709 13:14:26.539407   523 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:26.548554  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:26.536860  4968 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:26.547263   484 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:26.538991  5068 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:26.515858  4948 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:26.551518   599 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:26.540421  4788 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:26.547866  5038 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:26.570257  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:26.570065   523 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:26.546948  5084 raft_consensus.cc:740] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:26.536338  5021 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:14:26.553269  5037 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:26.556648  5083 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:26.553606  5068 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:26.591648  5102 consensus_queue.cc:1059] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:26.595943  5037 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:26.570917  5065 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:26.575322  5038 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.603585   523 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:26.578510  4948 raft_consensus.cc:697] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:26.515530  5080 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:26.612715  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 60516.7us
I20260709 13:14:26.613250  5108 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.613830  5108 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:26.616895  5108 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:26.621110   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.621889   553 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:26.622089   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.603191  5068 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:26.574513  5086 consensus_queue.cc:1048] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:14:26.625221   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.627523   551 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:14:26.622996   555 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:26.624192  5090 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:26.629470   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.630609   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:26.608428  5065 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:26.612061  5102 consensus_queue.cc:1243] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 6ba2a9c02b534120bbf26e56a1e920ca log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:14:26.611524  5038 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:26.609553  4788 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:26.635977   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.641918   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:26.724264  5035 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:26.649058  5065 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:26.721856  5051 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:26.760612  4788 raft_consensus.cc:697] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:26.730019   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:26.727979  5052 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.016s	sys 0.005s
I20260709 13:14:26.730607   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 2057) took 1406 ms. Trace:
I20260709 13:14:26.716028   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.767717   627 rpcz_store.cc:276] 0709 13:14:25.323773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.323894 (+   121us) service_pool.cc:224] Handling call
0709 13:14:25.739753 (+415859us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:25.741921 (+  2168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:26.730307 (+988386us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54001bb550. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:26.730528 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914626432}
I20260709 13:14:26.716675   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:26.769835   553 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:26.714605   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:26.637053   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 87264.9us
I20260709 13:14:26.716531   448 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:26.718333  5012 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:14:26.727392  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 113198us
I20260709 13:14:26.775192   551 raft_consensus.cc:2393] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 12: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:26.629863  5108 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:14:26.747216   554 raft_consensus.cc:2393] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 11: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:26.746248   555 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:14:26.717307   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.756233   523 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:26.621114  4955 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:14:26.778741   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:26.789026   479 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:26.779556   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:26.789649   632 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:26.780309   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:26.780586   629 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:14:26.782308   633 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:14:26.800832   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 84425.5us
I20260709 13:14:26.801826   630 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:26.764851  5086 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.807251   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:26.789561   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.806715   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:26.814149   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:26.816399   624 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 8.
I20260709 13:14:26.784057  5083 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:14:26.800132  5052 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.017s	sys 0.006s
I20260709 13:14:26.836458   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.815960   448 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:26.855512   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:26.862169   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:26.862867   627 raft_consensus.cc:2410] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:14:26.800467  4853 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:26.765383  5051 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:26.862834   624 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:26.863283   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 47411.1us
I20260709 13:14:26.803728  5037 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.814770  4947 raft_consensus.cc:2764] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:14:26.868846   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:26.869736   480 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:26.875200   632 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:26.821022  4969 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:26.887594  4969 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:26.868016   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:26.785378  5012 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:26.888172   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:26.888932   632 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:26.890303  5012 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:26.878361   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:26.888180  4969 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:26.890991  5012 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.895560  5103 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:26.895824  5012 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:26.898615  5012 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:26.872937   448 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:26.901866   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:26.767585  4948 consensus_queue.cc:237] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:26.838984  5086 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:26.880744   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:26.884650   654 debug-util.cc:398] Leaking SignalData structure 0x7b080014f720 after lost signal to thread 31817
I20260709 13:14:26.913002   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:26.913300   552 raft_consensus.cc:2376] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13. Re-sending same reply.
I20260709 13:14:26.881318   478 raft_consensus.cc:2393] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 13: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:26.882308   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:26.914104   654 debug-util.cc:398] Leaking SignalData structure 0x7b08000d9f40 after lost signal to thread 415
I20260709 13:14:26.882210   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:26.914829   475 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:26.874378  4853 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.874845  4968 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:26.886142   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:26.922387   627 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:26.922556   484 raft_consensus.cc:1275] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:14:26.915946   654 debug-util.cc:398] Leaking SignalData structure 0x7b08001c64e0 after lost signal to thread 508
I20260709 13:14:26.764331  4788 consensus_queue.cc:237] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:26.921692   481 raft_consensus.cc:2393] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 13: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:26.911384   631 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:14:26.923542  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:26.923822   654 debug-util.cc:398] Leaking SignalData structure 0x7b080014cb80 after lost signal to thread 509
I20260709 13:14:26.924377   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.861783  5083 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:26.925184   448 leader_election.cc:336] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Timed out: RequestConsensusVote RPC to 127.31.17.130:41159 timed out after 1.530s (SENT)
I20260709 13:14:26.930383   475 raft_consensus.cc:1240] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13. Ops: []
W20260709 13:14:26.932534   654 debug-util.cc:398] Leaking SignalData structure 0x7b08002a1d20 after lost signal to thread 583
I20260709 13:14:26.932476   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:26.879339   479 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
W20260709 13:14:26.945498   654 debug-util.cc:398] Leaking SignalData structure 0x7b08000da080 after lost signal to thread 657
W20260709 13:14:26.945904   654 debug-util.cc:398] Leaking SignalData structure 0x7b08000389e0 after lost signal to thread 658
I20260709 13:14:26.949240   624 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:26.951074   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:26.944625   477 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:14:26.925966  4968 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:26.922003  4853 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:26.933110  5106 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:26.960497  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:26.954496  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:26.987876  1174 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:26.959064   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:26.986388   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:26.986606  1166 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:26.986748  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:26.989449  1170 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:26.986848   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.990568   552 raft_consensus.cc:2393] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 13: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:26.991892  1168 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:14:26.878785  5037 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:26.992937   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:26.994076  5037 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:26.994103   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:26.994902   552 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:26.996048   552 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:26.996593   448 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:26.959393  5114 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:26.955801  5123 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.001261   552 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:27.011636  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:27.012602   557 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:26.998061  1141 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:26.983943  4968 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:26.982827  5080 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:27.018615   481 raft_consensus.cc:1240] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:27.022392   557 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:27.026394  5119 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:14:27.027567  5051 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:27.003273  5090 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:27.010402  4415 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.052233   552 raft_consensus.cc:1240] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:26.987854  4838 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:27.067059  5113 log.cc:927] Time spent T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:14:27.068414  5111 log.cc:927] Time spent T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:14:27.072827  5021 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:27.058506  4415 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:27.073395  5021 raft_consensus.cc:697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:27.074381  5021 consensus_queue.cc:237] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:27.075996  4949 consensus_meta.cc:287] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 1.253s	user 0.011s	sys 0.004s
I20260709 13:14:27.076460  4949 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:27.079428  1175 raft_consensus.cc:1240] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:14:27.061543  5105 log.cc:927] Time spent T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 13:14:27.080019  5037 consensus_queue.cc:1059] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:27.081435  5037 raft_consensus.cc:3055] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:14:27.081730  4828 consensus_meta.cc:287] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.590s	user 0.002s	sys 0.007s
I20260709 13:14:27.081959  5037 raft_consensus.cc:740] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:27.082330  4828 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:27.084654   554 raft_consensus.cc:1240] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:27.045173  5090 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:27.091542  5090 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:27.092340   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:27.082978  5037 consensus_queue.cc:260] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:27.102594  5037 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:27.106437   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:27.107542   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:27.078964  4949 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:27.147814   476 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:27.148298   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:27.150570   484 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:27.020762  5106 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.122s
I20260709 13:14:27.164186   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:27.141901  5035 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:27.170033   558 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
W20260709 13:14:27.171118  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 295200us
I20260709 13:14:27.180033   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:27.016335  5123 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:27.202986   555 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:27.248714   553 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:27.250541  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:27.251514  1172 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
W20260709 13:14:27.246357  5126 log.cc:927] Time spent T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.094s	user 0.005s	sys 0.005s
I20260709 13:14:27.178923  5035 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:27.278625   627 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:27.280100   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:27.280705   627 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:27.282279   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:27.282886   624 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:27.267120  5038 consensus_meta.cc:287] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.001s
I20260709 13:14:27.288611   627 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 13.
I20260709 13:14:27.290982   624 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
W20260709 13:14:27.274813  5068 consensus_meta.cc:287] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.001s
I20260709 13:14:27.296777   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:27.295656   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:27.303781  4838 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:27.306134  4952 consensus_meta.cc:287] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 1.441s	user 0.009s	sys 0.006s
I20260709 13:14:27.297194  5038 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:27.284642  5051 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.307590  5051 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:27.307834  5084 consensus_queue.cc:260] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:27.308653  5038 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:27.308883  5084 raft_consensus.cc:3060] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:27.310034  5051 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:27.310768  4853 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:27.312088  5132 log.cc:927] Time spent T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:14:27.312899  4853 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:27.319970  5130 log.cc:927] Time spent T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:14:27.296103  5112 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.323966  5112 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:27.326232  5112 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:27.285187  5103 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.284468  5012 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:27.340049   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:27.348762  5103 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:27.354599   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:27.355894   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:27.356446   632 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 13.
I20260709 13:14:27.357929   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:27.359464   630 raft_consensus.cc:1240] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:27.360179   624 raft_consensus.cc:1240] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:14:27.360522   630 raft_consensus.cc:1240] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:27.361552   624 raft_consensus.cc:1275] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:27.361725   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2220) took 1080 ms. Trace:
I20260709 13:14:27.362102   550 rpcz_store.cc:276] 0709 13:14:26.280980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.281123 (+   143us) service_pool.cc:224] Handling call
0709 13:14:26.281412 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:26.376849 (+ 95437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:27.361505 (+984656us) spinlock_profiling.cc:243] Waited 94.8 ms on lock 0x7b540034d854. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:27.361667 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218137984}
I20260709 13:14:27.362751   624 raft_consensus.cc:1240] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:27.364663   522 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:27.367491  5110 log.cc:927] Time spent T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.491s	user 0.002s	sys 0.000s
I20260709 13:14:27.368032   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:27.368216  5131 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:27.369573  5116 log.cc:927] Time spent T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.496s	user 0.001s	sys 0.000s
I20260709 13:14:27.412388  5131 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:27.413151  4828 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:27.414716  5131 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:27.371105  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:27.377005   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 863663us
I20260709 13:14:27.416857   597 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:27.418401   597 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:27.385943  5147 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:27.347048  5083 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:27.400915   624 raft_consensus.cc:1275] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:14:27.405479   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:27.388737  5012 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:27.296947  4968 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:27.431986   448 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:27.433319   448 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:27.428378   597 leader_election.cc:400] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 election: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10.
I20260709 13:14:27.437777   597 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:27.441039   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:27.441659   476 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:14:27.441563   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:27.444377   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:27.444837   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:27.446097   554 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:27.446497  1141 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:27.448024   597 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:27.448937   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:27.450749   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:27.454859  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:27.434757   448 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:27.458210  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:27.462782   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:27.463686   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:27.464529   481 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 14.
I20260709 13:14:27.468153   597 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:27.470149   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:27.470693   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:27.471315   558 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:27.396137  4969 consensus_meta.cc:287] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.503s	user 0.012s	sys 0.000s
I20260709 13:14:27.474964  4969 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:27.425717  5112 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:27.476240  5112 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:27.477195  4969 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:27.479447   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:27.481381   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:27.482074   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:27.472760  1141 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:27.483935   448 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:27.498128   556 raft_consensus.cc:1240] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:14:27.500536   559 raft_consensus.cc:1275] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:27.502441   448 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:27.504313  5119 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:27.504827  5119 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:27.505229  5119 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:27.513095  5106 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:27.514607  5106 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:27.303198  5068 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:27.517339   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:27.522969   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:27.517735   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:27.521323   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:27.465387  5084 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:27.420890  5122 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:27.428014  5103 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:27.419893  5147 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:27.527069  5144 log.cc:927] Time spent T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.111s	user 0.003s	sys 0.000s
I20260709 13:14:27.429778  4968 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:27.427772  4948 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.421195  4415 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:27.422416  5123 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:27.419384  4853 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:27.424041  5004 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:27.524374   554 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:27.473544  5037 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:27.473780  5051 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:27.515973  5106 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:14:27.462220  5034 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:27.535750   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:27.602347   556 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:27.544806  5122 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:27.633658   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:27.635458   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:27.636261   476 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:27.638655   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:27.564078  5037 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:27.473441  5131 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.478906  5056 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:27.651675   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:27.472707  4838 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:27.472390  5097 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:27.427906  5038 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 13:14:27.522645  4952 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:27.664234  5118 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:27.664507  4952 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:27.664930  5118 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:27.665414  5118 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:27.665936  4952 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:27.557377   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:27.667096   554 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:14:27.561183   631 raft_consensus.cc:1240] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13. Ops: []
W20260709 13:14:27.549556  5065 consensus_meta.cc:287] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.768s	user 0.008s	sys 0.002s
I20260709 13:14:27.419185  5090 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:27.551060  4828 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:27.648571  5135 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:27.564289  5084 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.652817   476 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:27.602806  5051 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:27.620283  5052 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:27.556787  5004 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:27.618800  4853 raft_consensus.cc:697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:27.628841  5122 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:27.659829   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:27.554773  4948 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:27.634562  4660 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.560184  5103 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:14:27.662714   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:27.697799   477 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 9.
W20260709 13:14:27.543512   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 75421.6us
I20260709 13:14:27.645432  5108 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.541668   558 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:27.649241  4415 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.652014  5037 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:27.650502  5012 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:27.670817   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:27.656159  5128 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.663532  5112 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:27.695698   480 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:27.695911   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:27.650779  4968 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:14:27.684139  5135 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:27.741091  5135 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:27.741652  5127 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:27.744239   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:27.721535  5106 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.731005   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:27.686865  5051 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:27.660012  5131 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:27.732527   633 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:27.733235   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:27.661207  4838 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:27.734766   478 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:27.734676   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:27.698643  5004 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:27.669595  5097 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:27.735618  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 451356us
I20260709 13:14:27.679489  5065 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:27.735680  5108 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:27.835949  5118 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:27.837496  5108 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:27.837836  4828 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:27.838405  4828 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:27.840407  5142 log.cc:927] Time spent T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.434s	user 0.002s	sys 0.000s
I20260709 13:14:27.845443  5068 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:27.732856  4660 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:27.846768  4828 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:27.848923  4660 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:27.740113  5128 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:27.851958  4948 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:27.852095  5128 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:27.853940  5097 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:27.854398  5065 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:27.855160  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:27.856062   627 raft_consensus.cc:1240] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:27.858331   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:27.859987   628 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:14:27.860479   628 pending_rounds.cc:85] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 7
I20260709 13:14:27.860764   628 pending_rounds.cc:107] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:14:27.861056   628 raft_consensus.cc:2889] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:27.861248  4853 consensus_queue.cc:237] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:27.864213  5119 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:27.865798  5090 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:27.777491  5106 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:27.744889   483 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:27.724417   597 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:27.868312   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 144007us
I20260709 13:14:27.689834  5084 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:27.870942  1138 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:27.872895  5084 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:27.873489   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:27.874066   484 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:27.698853  5052 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:27.873054  1138 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:27.735343  4415 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:27.876139  5106 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:27.876959  5147 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:27.877456  4415 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:27.878445   632 raft_consensus.cc:2410] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:14:27.874094  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:27.880259  5122 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:27.883057  5052 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:27.778349   481 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:27.874382  4926 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:27.884529  5131 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:27.884857  4926 raft_consensus.cc:697] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:27.872901   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:27.884531   481 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:27.883894  5122 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:27.891794  1138 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:27.892467  5136 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:27.894183   478 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:27.868352   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:27.914259   483 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 14.
I20260709 13:14:27.915510   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:27.916323   483 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 15.
I20260709 13:14:27.917403   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:27.918663   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:27.885872  4926 consensus_queue.cc:237] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:27.895541   597 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:27.896709  5131 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:27.896974  1138 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:27.900512   477 raft_consensus.cc:1240] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:27.899922   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2125) took 1095 ms. Trace:
W20260709 13:14:27.945127   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 49672us
W20260709 13:14:27.944897  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 48087us
I20260709 13:14:27.947249   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:27.949198   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:14:27.946645   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 431097us
W20260709 13:14:27.966034   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 338971us
I20260709 13:14:27.967116   447 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:27.969283   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:27.970722   448 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:27.971937   447 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:27.975360  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:27.975841   478 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:27.977825   448 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:27.978482   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:27.979107   633 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 14.
W20260709 13:14:27.980862   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 432466us
I20260709 13:14:27.945371   557 rpcz_store.cc:276] 0709 13:14:26.804250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:27.024172 (+219922us) service_pool.cc:224] Handling call
0709 13:14:27.024494 (+   322us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:27.024955 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:27.024982 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:27.048122 (+ 23140us) log.cc:844] Serialized 52 byte log entry
0709 13:14:27.259154 (+211032us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:27.285780 (+ 26626us) log.cc:844] Serialized 14 byte log entry
0709 13:14:27.293323 (+  7543us) log.cc:844] Serialized 14 byte log entry
0709 13:14:27.293590 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:27.293690 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:27.839675 (+545985us) spinlock_profiling.cc:243] Waited 55.2 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:27.899654 (+ 59979us) raft_consensus.cc:1685] finished
0709 13:14:27.899700 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:27.899849 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69,"prepare.queue_time_us":58433,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":3236,"raft.queue_time_us":20176,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":9053,"spinlock_wait_cycles":134339712,"thread_start_us":109186,"threads_started":1,"wal-append.queue_time_us":342616}
I20260709 13:14:27.986689   483 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:27.991905   448 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:27.994235   447 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:27.993021   448 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:27.907980  5162 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:28.037211   477 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:28.056821  1138 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:14:28.058324   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 65399.9us
I20260709 13:14:28.119083   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:27.981384  5090 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:28.119891   633 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 13.
I20260709 13:14:28.126834   477 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:28.127152   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:27.944172  5131 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:27.848938  4828 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:28.035614  5087 raft_consensus.cc:2764] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:14:27.986383  4968 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:28.056439  5056 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:28.136677   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 2060) took 2801 ms. Trace:
I20260709 13:14:27.981566  4948 consensus_queue.cc:1048] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.143s
I20260709 13:14:27.976337  5084 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.148s
W20260709 13:14:28.141971   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 58416.3us
I20260709 13:14:28.131449  5090 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:27.981743  5068 consensus_queue.cc:1059] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.149s
I20260709 13:14:28.119342  5128 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:28.161396   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:27.982156  5097 consensus_queue.cc:1059] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.161s
W20260709 13:14:28.185200   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:28.141304  5131 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:28.155114   626 rpcz_store.cc:276] 0709 13:14:25.325157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.326580 (+  1423us) service_pool.cc:224] Handling call
0709 13:14:25.335816 (+  9236us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:25.790483 (+454667us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:25.790514 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:27.523727 (+1733213us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b2c00072b18. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b66d12a11 00007f4b66d22372 00007f4b68454a01 00007f4b6841943a 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2
0709 13:14:27.527591 (+  3864us) log.cc:844] Serialized 52 byte log entry
0709 13:14:27.666805 (+139214us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:28.091865 (+425060us) log.cc:844] Serialized 14 byte log entry
0709 13:14:28.092114 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:28.092212 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:28.092279 (+    67us) raft_consensus.cc:1685] finished
0709 13:14:28.126698 (+ 34419us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:28.126845 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":74531,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":1554,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":8330,"spinlock_wait_cycles":61842304,"thread_start_us":535431,"threads_started":2,"wal-append.queue_time_us":315745}
I20260709 13:14:28.146809  1138 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:28.178120   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:28.179363   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:28.233248   557 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:28.181332  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:28.234697  5135 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:28.152383  5056 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:28.182139  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:28.182953  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:28.237496  1166 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:28.183941   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:28.239344   629 raft_consensus.cc:2410] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 14 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:14:28.205494   633 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:27.981946  5065 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:28.123792  4660 consensus_queue.cc:1048] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:14:28.119172  5052 consensus_queue.cc:1059] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:14:28.169479  4828 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:28.209285  5133 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:14:28.209751  5156 log.cc:927] Time spent T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.100s	user 0.000s	sys 0.003s
W20260709 13:14:28.212536  5151 log.cc:927] Time spent T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:14:28.215480   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:28.122982  4788 consensus_queue.cc:1059] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:14:28.219466  5082 consensus_queue.cc:1059] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.137s
W20260709 13:14:28.224344  5140 log.cc:927] Time spent T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.795s	user 0.001s	sys 0.008s
I20260709 13:14:28.144399  5106 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:28.229302  5051 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:28.240583  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 93868.8us
W20260709 13:14:28.256361   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 136676us
W20260709 13:14:28.202833  5158 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:14:28.236029  5056 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:28.281479  1166 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:28.183974  5087 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:28.146488  4853 consensus_queue.cc:1048] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:14:28.285032   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:28.362881   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 54311us
I20260709 13:14:28.363255   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:28.313691   448 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:14:28.364538   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 50958.9us
I20260709 13:14:28.084206  5162 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:28.302984   626 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:28.257966  5065 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:28.285544  5153 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:28.310616  4415 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:28.287001  5133 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:28.363844   556 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:28.207882  5090 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:28.366549   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:28.231781  5128 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:28.232100  5004 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:28.366212  4853 consensus_queue.cc:1243] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:14:28.389034   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 2082) took 1608 ms. Trace:
I20260709 13:14:28.368455  4838 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:28.373200  5052 raft_consensus.cc:3055] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:28.370827  4828 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:28.377887  5133 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:28.373401  5065 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:28.412238   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 2061) took 1328 ms. Trace:
I20260709 13:14:28.412626   480 rpcz_store.cc:276] 0709 13:14:27.084250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:27.084373 (+   123us) service_pool.cc:224] Handling call
0709 13:14:27.084680 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:27.737534 (+652854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:28.411995 (+674461us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54002b25d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:28.412159 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404637568}
I20260709 13:14:28.373262  5153 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:28.416431  5153 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:28.420034  4828 raft_consensus.cc:697] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:28.420996  4828 consensus_queue.cc:237] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:28.373587  5087 raft_consensus.cc:697] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:14:28.423782   654 debug-util.cc:398] Leaking SignalData structure 0x7b08003d7c80 after lost signal to thread 1199
W20260709 13:14:28.424753  5139 log.cc:927] Time spent T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 1.152s	user 0.004s	sys 0.006s
W20260709 13:14:28.424144   654 debug-util.cc:398] Leaking SignalData structure 0x7b08003bc400 after lost signal to thread 1200
I20260709 13:14:28.427712  5065 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:28.430182   525 connection.cc:256] RPC call timeout handler was delayed by -1.1214344079999137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
I20260709 13:14:28.430914  5153 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:28.432664  4853 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:28.433174  4853 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:28.430119  5065 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:28.434247  5153 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:28.434442  4968 raft_consensus.cc:3055] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:28.434836  4968 raft_consensus.cc:740] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:28.395009  5176 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:28.396077   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 611) took 1008 ms. Trace:
W20260709 13:14:28.399362  5174 log.cc:927] Time spent T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:14:28.400878  5178 consensus_queue.cc:1059] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:28.405004  5160 raft_consensus.cc:3055] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:28.437230  5034 raft_consensus.cc:3055] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:28.423815  5004 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:28.436354  5135 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:28.445322  5060 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:28.389482   625 rpcz_store.cc:276] 0709 13:14:26.780171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.780963 (+   792us) service_pool.cc:224] Handling call
0709 13:14:26.781275 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:26.884033 (+102758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:26.884058 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:26.884480 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:14:27.274591 (+390111us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:27.274627 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:27.274706 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:27.897606 (+622900us) spinlock_profiling.cc:243] Waited 50.4 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:28.382014 (+484408us) raft_consensus.cc:1685] finished
0709 13:14:28.382045 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:28.388964 (+  6919us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12605,"raft.queue_time_us":213293,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":14771,"spinlock_wait_cycles":115842432,"thread_start_us":492061,"threads_started":2,"wal-append.queue_time_us":526876}
I20260709 13:14:28.443756   525 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:28.414978  1175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 820) took 1796 ms. Trace:
I20260709 13:14:28.444813   553 rpcz_store.cc:276] 0709 13:14:27.388060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:27.390944 (+  2884us) service_pool.cc:224] Handling call
0709 13:14:27.391223 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:27.402688 (+ 11465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:27.402803 (+   115us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:27.462369 (+ 59566us) log.cc:844] Serialized 26 byte log entry
0709 13:14:27.977093 (+514724us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:27.977134 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:27.977191 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:28.395805 (+418614us) raft_consensus.cc:1685] finished
0709 13:14:28.395831 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:28.396002 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10718,"raft.queue_time_us":11025,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":498753,"threads_started":1,"wal-append.queue_time_us":723688}
I20260709 13:14:28.408239  5051 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:28.460115  1167 raft_consensus.cc:1240] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:28.392072  5052 raft_consensus.cc:740] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:28.424099  5087 consensus_queue.cc:237] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:28.436518  5147 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:28.465477  5178 consensus_queue.cc:1243] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:14:28.464617  5034 raft_consensus.cc:740] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:28.469686  1175 rpcz_store.cc:276] 0709 13:14:26.618339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.618458 (+   119us) service_pool.cc:224] Handling call
0709 13:14:26.626538 (+  8080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:27.079861 (+453323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:28.414754 (+1334893us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b5400444654. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:28.414921 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1041063168}
I20260709 13:14:28.435154  4853 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:28.430094   557 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
W20260709 13:14:28.479496   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 48230.1us
I20260709 13:14:28.485519   525 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:28.451594  5160 raft_consensus.cc:740] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:28.487720   525 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:28.448977  5176 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:28.437718  5162 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:28.480996  5083 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:28.500617   525 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:28.490588  5037 consensus_meta.cc:287] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.751s	user 0.005s	sys 0.005s
I20260709 13:14:28.508105   525 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:28.477180  5060 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:28.502436  5179 log.cc:927] Time spent T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:14:28.483932  4660 consensus_queue.cc:1059] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:14:28.499943  4853 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:28.501694  5181 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:28.526925   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 163320us
I20260709 13:14:28.527200   525 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:28.502385  4788 consensus_queue.cc:1048] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:14:28.527967  5083 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:28.485818  4968 consensus_queue.cc:260] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:28.523066  4853 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:28.513024  5037 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:28.522521  5186 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:28.554231   525 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:28.571713  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:28.554704  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:28.509965  5052 consensus_queue.cc:260] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:28.552783   522 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:28.538836  4788 consensus_queue.cc:1243] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:14:28.570011  5185 log.cc:927] Time spent T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:14:28.585278  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:28.570053   365 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 227b93e1b31e4b058d5ec1fc69bd6849 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 50f7c2247be24f3685d7fbca7b6c71e3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:28.604220   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:28.589890  5135 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:28.592264  5176 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:28.528919  5160 consensus_queue.cc:260] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:28.520082  5034 consensus_queue.cc:260] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:28.578279  4995 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:28.598589  5090 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:28.583675  4968 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:28.622123  5135 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:28.552963  4853 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:28.625967  5193 consensus_queue.cc:1059] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
W20260709 13:14:28.627333   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 73179.9us
I20260709 13:14:28.585999  5004 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:28.574637  5131 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:28.583595  5065 consensus_queue.cc:1059] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:14:28.613554  4788 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:28.632182   525 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:28.614315  5052 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:28.643867  4947 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:28.644660  5135 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:28.610613  5186 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:28.631453  5004 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:28.651970  5065 raft_consensus.cc:3055] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:28.658064   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:28.659020   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:28.676882   626 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:28.698675   624 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:28.699747   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:28.700358   626 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:28.698750   625 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
I20260709 13:14:28.675982  4838 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:28.706378   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 153686us
I20260709 13:14:28.652083  4853 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:28.683751  1170 raft_consensus.cc:1240] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:28.684775  5131 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:28.715520   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:28.705302  5081 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:28.719506   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:28.720144   553 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 13.
I20260709 13:14:28.686990  5035 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:28.690147   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:28.700023  5065 raft_consensus.cc:740] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:28.629739  4995 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:28.685130  5148 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:28.729149   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:28.724190   626 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 14.
W20260709 13:14:28.695129   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 63029.1us
I20260709 13:14:28.699863  5186 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:28.729868   625 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:14:28.731020  1138 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:28.731521   525 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:28.731926  1138 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:28.732838  5004 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:28.737715  5197 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:28.739568   624 raft_consensus.cc:2468] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 14.
W20260709 13:14:28.740363   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 833487us
I20260709 13:14:28.741393   599 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:28.742524   599 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:28.742892   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:28.743657  1138 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:28.745198   599 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:28.750164  4926 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:28.750640  4926 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:28.751046  4926 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:28.755033   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 2050) took 1876 ms. Trace:
I20260709 13:14:28.756045   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:28.756610   554 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:14:28.757395   599 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:28.698211  5133 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:28.755448   482 rpcz_store.cc:276] 0709 13:14:26.878438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.878568 (+   130us) service_pool.cc:224] Handling call
0709 13:14:26.912772 (+ 34204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:27.358294 (+445522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:27.358327 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:27.358393 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:27.358423 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:28.754819 (+1396396us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b5400183b54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:28.754865 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:28.754980 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7956,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":1023633792}
I20260709 13:14:28.710984  5135 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:14:28.762779   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:28.764438   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:28.765974   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:28.768496   624 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:28.769820   624 raft_consensus.cc:1240] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:14:28.710551  4838 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:28.746870  5122 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:28.729331  5060 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:28.747146  5004 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:28.754565  5197 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:28.753715  5131 raft_consensus.cc:2804] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:28.746579  5041 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:28.742563  5186 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:28.801044   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:28.727329  5081 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:28.814922   554 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 15.
I20260709 13:14:28.820099   626 pending_rounds.cc:85] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting all ops after (but not including) 4
I20260709 13:14:28.820459   626 pending_rounds.cc:107] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:14:28.820710   626 raft_consensus.cc:2889] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:28.757071  5038 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:14:28.799441  5086 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:28.826059  5131 raft_consensus.cc:697] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:28.803630  5197 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:28.834890  5081 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:28.823892  5041 raft_consensus.cc:697] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:28.821933  5127 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:28.827718  5162 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:28.845446  5194 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:14:28.845772   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:28.852458  5196 log.cc:927] Time spent T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
W20260709 13:14:28.858330   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 101023us
I20260709 13:14:28.831388  5037 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:28.864537   599 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:28.849174  5197 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:28.807534  5065 consensus_queue.cc:260] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:28.859902  5090 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:28.888073  4995 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:28.889204   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:28.891352   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:28.891476  5131 consensus_queue.cc:237] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:28.895502  5209 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:28.896024  5209 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:28.896427  5209 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:28.860301  5162 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:28.913383  5162 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:28.918617  5041 consensus_queue.cc:237] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:28.922685  5133 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:28.924140  4838 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:28.932166  4926 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:28.934001  5034 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:28.934303  4926 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:28.935402  5065 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:28.936915   632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 2008) took 1255 ms. Trace:
I20260709 13:14:28.937463   632 rpcz_store.cc:276] 0709 13:14:27.681148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:27.681363 (+   215us) service_pool.cc:224] Handling call
0709 13:14:28.936655 (+1255292us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54001adbd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:28.936837 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322512256}
I20260709 13:14:28.881853   599 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:14:28.942901   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 61142.8us
I20260709 13:14:28.945127  5090 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:28.945499  4415 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:28.946156  4415 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:28.945827  5090 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:28.947736  5083 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:28.947813  5208 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:28.948498  5208 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:28.948575  5038 consensus_queue.cc:1059] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:28.949059  5208 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:28.944319   599 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:28.952996   599 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:28.953904   599 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:28.960335  5056 consensus_meta.cc:287] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.000s
I20260709 13:14:28.960947  5056 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:28.962109  5181 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:28.967211   559 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:14:28.967624   559 pending_rounds.cc:85] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 8
I20260709 13:14:28.967852   559 pending_rounds.cc:107] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:14:28.968103   559 raft_consensus.cc:2889] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:28.975654  5133 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:28.976248  5133 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:28.978333  5133 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:28.981289  5082 raft_consensus.cc:3055] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:28.981907  5082 raft_consensus.cc:740] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:28.984534   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 644) took 1072 ms. Trace:
I20260709 13:14:28.985111   629 rpcz_store.cc:276] 0709 13:14:27.912431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:28.286864 (+374433us) service_pool.cc:224] Handling call
0709 13:14:28.305180 (+ 18316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:28.381270 (+ 76090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:28.381300 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:28.381341 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:28.381371 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:28.984167 (+602796us) spinlock_profiling.cc:243] Waited 75.8 ms on lock 0x7b54002e63d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:28.984250 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:28.984447 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174298496}
I20260709 13:14:28.990746   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 646) took 1039 ms. Trace:
I20260709 13:14:28.990397   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:29.000521   554 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:28.987176   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:29.006102   629 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:29.013731   554 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
W20260709 13:14:29.008033  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 241671us
I20260709 13:14:29.014827  1139 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:28.995819  4838 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:29.029312   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:29.030181   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:29.030777   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:29.033197  4415 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.034206   483 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:28.987479  5127 raft_consensus.cc:3055] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:29.031869   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:28.989739  5162 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:28.996054  5068 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:29.041715   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:29.042467   481 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:29.043085   477 raft_consensus.cc:2410] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:29.043919   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:29.043990   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:29.046957   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:29.041018  5122 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:14:29.052987   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:29.031553  5135 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:29.055534  4415 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:29.058475   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.059165   522 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:29.060571  5181 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:29.060976  5181 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:29.061333  5181 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:29.068302  5146 log.cc:927] Time spent T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 1.405s	user 0.015s	sys 0.000s
I20260709 13:14:29.069233  5181 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.070183   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2127) took 2145 ms. Trace:
I20260709 13:14:29.070592   448 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:29.070535   552 rpcz_store.cc:276] 0709 13:14:26.924564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:27.052997 (+128433us) service_pool.cc:224] Handling call
0709 13:14:27.053267 (+   270us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:27.053607 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:27.176395 (+122788us) log.cc:844] Serialized 14 byte log entry
0709 13:14:27.463186 (+286791us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:27.490034 (+ 26848us) log.cc:844] Serialized 52 byte log entry
0709 13:14:27.490235 (+   201us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:27.537493 (+ 47258us) log.cc:844] Serialized 14 byte log entry
0709 13:14:27.537762 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:27.537864 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:27.843943 (+306079us) spinlock_profiling.cc:243] Waited 6.89 ms on lock 0x7b18000a3240. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6532c3f3 00007f4b6532e7c1 00007f4b6532e779 00007f4b6532e709 00007f4b6532e6d1 00007f4b6532d9cd 000000000038f354 000000000038f199 00007f4b6530f83a
0709 13:14:28.406458 (+562515us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b480021c258. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6d342aa1 00007f4b6d339b37 00007f4b6d3399ca 00007f4b6d43126f 00007f4b6d430f37 00007f4b6d44555c 00007f4b6d445508 00007f4b6d445488 00007f4b6d445443 00007f4b6d4446ec 00007f4b6c36ea96
0709 13:14:29.067737 (+661279us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:29.069974 (+  2237us) raft_consensus.cc:1685] finished
0709 13:14:29.069993 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:29.070128 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66439,"prepare.queue_time_us":65763,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":6062,"raft.run_cpu_time_us":3811,"raft.run_wall_time_us":936410,"spinlock_wait_cycles":69280256,"thread_start_us":314223,"threads_started":2,"wal-append.queue_time_us":358958}
I20260709 13:14:29.072266   448 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:29.073489  5086 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:29.074508  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:29.075328  1169 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:29.076514  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:29.077260  1172 raft_consensus.cc:2368] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 14. Current term is 15.
I20260709 13:14:29.079442   448 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:29.082238  5089 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:29.082625  5089 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:29.082947  5089 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:29.041754  5004 consensus_queue.cc:1059] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:14:29.080664   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 2004) took 1554 ms. Trace:
I20260709 13:14:29.091729   523 leader_election.cc:400] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 14. Current term is 15.
I20260709 13:14:29.091856   631 rpcz_store.cc:276] 0709 13:14:27.525936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:27.526166 (+   230us) service_pool.cc:224] Handling call
0709 13:14:27.556093 (+ 29927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:27.679550 (+123457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:29.080466 (+1400916us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b54002bb6d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:29.080609 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11224320}
I20260709 13:14:29.089329   629 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 15.
I20260709 13:14:29.090835   522 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:29.092478   523 leader_election.cc:403] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:29.093596  5052 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:29.015519  5186 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.101044   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:29.045504  5162 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:29.042258  5127 raft_consensus.cc:740] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:29.097581  1139 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:29.102741   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:29.103323   632 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:29.099331   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:29.095474   448 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:29.099778   481 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:29.104982  1170 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:29.081530  1167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 621) took 2599 ms. Trace:
I20260709 13:14:28.983093  5082 consensus_queue.cc:260] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.105607  1167 rpcz_store.cc:276] 0709 13:14:26.481663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:28.123178 (+1641515us) service_pool.cc:224] Handling call
0709 13:14:28.142272 (+ 19094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:28.475911 (+333639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:29.081322 (+605411us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54005ed154. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:29.081474 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":730374912}
I20260709 13:14:29.107569   552 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:29.054265  5056 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:29.117734  1175 raft_consensus.cc:1240] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:29.085664  5135 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:29.102941  4947 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:29.119933   555 raft_consensus.cc:1240] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: []
W20260709 13:14:29.122494   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.100303  4726 consensus_queue.cc:1059] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:14:29.107513  5162 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:29.106279  4995 raft_consensus.cc:2764] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:14:29.113122  5086 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:29.106081  5181 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:29.138064   448 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:29.118389  5123 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:29.139526   632 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:14:29.106966  5206 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:29.111874  5205 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 14. Current term is 15.
I20260709 13:14:29.100448  5083 consensus_queue.cc:1059] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:14:29.120836  5135 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:29.144395   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.136003  5082 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:29.154251  5123 raft_consensus.cc:697] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:29.156062  5083 raft_consensus.cc:3055] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:29.112788  5209 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.138310  5198 raft_consensus.cc:3055] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:29.160337  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:29.163103  1170 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:29.173663   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 2199) took 1548 ms. Trace:
I20260709 13:14:29.174093   475 rpcz_store.cc:276] 0709 13:14:27.625262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:27.627333 (+  2071us) service_pool.cc:224] Handling call
0709 13:14:27.629822 (+  2489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:27.855374 (+225552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:27.855405 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:27.855447 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:27.855483 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:29.173439 (+1317956us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b540020dad4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:29.173486 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:29.173605 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518240128}
I20260709 13:14:29.176366  1170 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
W20260709 13:14:29.177003   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.179356  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:29.153662  5035 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:29.180310   597 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:29.183856   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 1996) took 1847 ms. Trace:
I20260709 13:14:29.184270   630 rpcz_store.cc:276] 0709 13:14:27.336772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:27.361210 (+ 24438us) service_pool.cc:224] Handling call
0709 13:14:27.435680 (+ 74470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:27.435936 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:27.435969 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:27.436419 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:14:27.670616 (+234197us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:27.670670 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:27.670761 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:27.829071 (+158310us) raft_consensus.cc:1685] finished
0709 13:14:27.829092 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:29.171813 (+1342721us) spinlock_profiling.cc:243] Waited 74.1 ms on lock 0x7b54002bcad0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:29.183790 (+ 11977us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170502912,"thread_start_us":233897,"threads_started":1,"wal-append.queue_time_us":331434,"wal-append.run_cpu_time_us":1642,"wal-append.run_wall_time_us":1075040}
I20260709 13:14:29.140832  5208 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.162173  5083 raft_consensus.cc:740] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:29.182672  4838 raft_consensus.cc:697] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:29.189910   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:29.190687  5149 consensus_queue.cc:1059] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:29.191609   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:29.192080   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:29.192157   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:29.192387   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:29.193069  5133 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:29.197608  5086 raft_consensus.cc:697] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:14:29.202080  5138 log.cc:927] Time spent T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 1.796s	user 0.006s	sys 0.000s
I20260709 13:14:29.252390  5163 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:29.252878  5163 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.254017   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 796) took 2258 ms. Trace:
I20260709 13:14:29.254878  5163 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:29.186401  4948 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:14:29.208042  5216 log.cc:927] Time spent T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:14:29.162475  5198 raft_consensus.cc:740] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:29.250885  5086 consensus_queue.cc:237] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.214887   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:29.215653   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:29.255081   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 58799us
I20260709 13:14:29.254362   479 rpcz_store.cc:276] 0709 13:14:26.995919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.998140 (+  2221us) service_pool.cc:224] Handling call
0709 13:14:26.998415 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:27.013827 (+ 15412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:27.013857 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:27.022218 (+  8361us) log.cc:844] Serialized 26 byte log entry
0709 13:14:27.270389 (+248171us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:27.281674 (+ 11285us) log.cc:844] Serialized 14 byte log entry
0709 13:14:27.282774 (+  1100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:27.344016 (+ 61242us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b54000d5cd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:27.344063 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:29.183025 (+1838962us) spinlock_profiling.cc:243] Waited 55.7 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:29.253807 (+ 70782us) raft_consensus.cc:1685] finished
0709 13:14:29.253828 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:29.253941 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16961,"prepare.queue_time_us":10462,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":34068,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":9617,"spinlock_wait_cycles":138017024,"thread_start_us":197571,"threads_started":1,"wal-append.queue_time_us":347265}
I20260709 13:14:29.285249   476 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:14:29.225247   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:29.225392   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:29.228484   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:29.170163  5205 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:29.187265  5204 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:14:29.234908  5214 log.cc:927] Time spent T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:14:29.234997  5223 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:29.222703  5035 raft_consensus.cc:697] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:29.238909  5208 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:29.147316  5127 consensus_queue.cc:260] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.239393  5087 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:29.240190  5217 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:29.306311   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.249054   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:29.211787   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:29.307089   481 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:29.291462   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:29.217163   599 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:29.162351  5197 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.295048   477 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 11: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
W20260709 13:14:29.308593   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 91517.5us
I20260709 13:14:29.312693   599 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:29.295150   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:29.293990   597 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.314920   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:29.315043   597 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.294629   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:29.298826   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:29.268103  5037 raft_consensus.cc:3055] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:29.299544  5181 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:29.295874  5204 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.292101  4948 raft_consensus.cc:697] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:29.247694  4838 consensus_queue.cc:237] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.313962   599 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:29.340037   599 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:29.318586   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:29.309796   448 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:29.322275   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.318089  1141 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.319211   476 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:29.341903   554 raft_consensus.cc:2393] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 14: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:29.319109   479 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:29.294502  5089 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.335958  5222 consensus_queue.cc:1059] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:29.330816  5118 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:29.308408  5087 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.323276  5065 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:29.337502  5172 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:29.321762  5037 raft_consensus.cc:740] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:29.316948   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:29.343694   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:29.379536   482 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:29.379611   554 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:29.298997  5205 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.333048  5127 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:29.354050  5004 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:29.348958  5153 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:29.303691  5223 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.309185  5186 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:29.357388   552 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:14:29.402781   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:29.357561  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:29.321946  5208 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:29.317332  5038 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:29.336908  4948 consensus_queue.cc:237] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.287865  5123 consensus_queue.cc:237] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:29.360918   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 51212.5us
I20260709 13:14:29.364830  5087 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:29.316905  5219 consensus_queue.cc:1175] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" responder_term: 13 status { last_received { term: 13 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 13 index: 7 } }
I20260709 13:14:29.367586  5222 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:29.368217  5227 raft_consensus.cc:3055] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:29.341387   481 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 15.
I20260709 13:14:29.375347   479 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:14:29.414165  1141 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:29.414336   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:29.405263  5208 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:29.344542   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:29.376951   476 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 15.
I20260709 13:14:29.388535   554 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:29.347541  5207 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:29.303785  5083 consensus_queue.cc:260] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.420329   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 2006) took 1798 ms. Trace:
I20260709 13:14:29.338851  5181 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.405220   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:29.333658  5198 consensus_queue.cc:260] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.404405  5204 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:29.359519  5035 consensus_queue.cc:237] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.417531   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:29.348837  5209 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:29.418619  1141 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:29.418092  5147 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:29.419591  5208 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:29.413527  5227 raft_consensus.cc:740] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:29.420706   627 rpcz_store.cc:276] 0709 13:14:27.622243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:27.622443 (+   200us) service_pool.cc:224] Handling call
0709 13:14:27.649422 (+ 26979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:27.856565 (+207143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:29.420106 (+1563541us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54001621d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:29.420276 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474750336}
I20260709 13:14:29.422675   552 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:14:29.428534  5162 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.311396  5217 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.436801  5162 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:29.437136  5217 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:29.438941  5181 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:29.440590  5198 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:29.441000   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.389730  5172 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.432783  5083 raft_consensus.cc:3060] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:29.444021  5172 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:29.434988   552 raft_consensus.cc:1240] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:29.445315   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:29.419260   479 raft_consensus.cc:1240] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:29.415673  5037 consensus_queue.cc:260] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.432395   554 raft_consensus.cc:3055] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:29.446413   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:29.449867   554 raft_consensus.cc:740] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:29.450091   552 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:29.451124   482 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:14:29.451992   552 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:14:29.428197  5149 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:29.456065   552 raft_consensus.cc:1240] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:14:29.438874  5135 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.458223  5089 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:29.448295  5147 raft_consensus.cc:697] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:29.433671  5197 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:29.471777  5149 raft_consensus.cc:697] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:29.473934   554 consensus_queue.cc:260] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.479126  5037 raft_consensus.cc:3060] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:29.487699   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.489678  5128 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:29.490625  5227 consensus_queue.cc:260] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.491433   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:29.492084  5227 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:29.492377   552 raft_consensus.cc:2393] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 14: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:29.480964   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:29.494680  5135 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:29.496883  5160 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:29.500420  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:29.500906  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:29.509577  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:29.518283  5193 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:29.520499   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:29.522815  5149 consensus_queue.cc:237] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.523859  5153 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:29.520598  5223 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:29.525075  1175 raft_consensus.cc:1240] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:29.476610  5131 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:29.526422  5131 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.528724  5131 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:29.529155  1175 raft_consensus.cc:1240] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:14:29.529546  5193 consensus_queue.cc:1059] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:29.533063   479 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:14:29.530467  5193 raft_consensus.cc:3055] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:14:29.555828   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 170760us
I20260709 13:14:29.535056  5227 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:29.564306   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:29.565061   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:29.565449   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:29.565712   477 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:29.566421   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:29.567044   481 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:14:29.572793  5034 consensus_meta.cc:287] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.001s
I20260709 13:14:29.556448  5193 raft_consensus.cc:740] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:29.577121  5193 consensus_queue.cc:260] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.578421  5193 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:29.581135   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:29.581980   557 raft_consensus.cc:2393] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 10: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:29.584584   628 raft_consensus.cc:2410] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:14:29.537611  5198 consensus_queue.cc:1059] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:14:29.587677  5197 raft_consensus.cc:3055] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:29.594558   483 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:29.590927   481 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 16.
I20260709 13:14:29.602463  1170 raft_consensus.cc:2468] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:29.000344   633 rpcz_store.cc:276] 0709 13:14:27.951385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:28.304746 (+353361us) service_pool.cc:224] Handling call
0709 13:14:28.369350 (+ 64604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:28.369601 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:14:28.380238 (+ 10637us) log.cc:844] Serialized 14 byte log entry
0709 13:14:28.821493 (+441255us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b1800393520. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb923a 00007f4b68423a2a
0709 13:14:28.990347 (+168854us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:28.990407 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:28.990454 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:28.990529 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:28.990675 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2168,"prepare.queue_time_us":10533,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":1986,"raft.queue_time_us":7845,"spinlock_wait_cycles":10989824,"thread_start_us":166377,"threads_started":1}
I20260709 13:14:29.587997  5206 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:29.588050  5197 raft_consensus.cc:740] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:29.568475  5227 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:29.610718   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.605669  5206 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:29.557292  5147 consensus_queue.cc:237] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:29.611694   484 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 2211) took 1946 ms (client timeout 1686 ms). Trace:
W20260709 13:14:29.615449   484 rpcz_store.cc:269] 0709 13:14:27.664920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:27.688390 (+ 23470us) service_pool.cc:224] Handling call
0709 13:14:29.611519 (+1923129us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400058cd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:29.611625 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238825216}
W20260709 13:14:29.611884  5228 log.cc:927] Time spent T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.189s	user 0.001s	sys 0.003s
I20260709 13:14:29.624408   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:29.632125  5205 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:29.634109  1141 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:29.636333  5197 consensus_queue.cc:260] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.636924  4613 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:29.638654  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:29.638899   377 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41332 (request call id 157) took 34999 ms (client timeout 15000 ms). Trace:
I20260709 13:14:29.649788  1141 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.652941  4853 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:29.655514  5208 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.658254   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:29.658785   483 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:29.659207   550 raft_consensus.cc:2410] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:14:29.662671   597 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.665055   597 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.666579   552 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:14:29.666963   552 pending_rounds.cc:85] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 10
I20260709 13:14:29.667201   552 pending_rounds.cc:107] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:14:29.667459   552 raft_consensus.cc:2889] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:29.668021   597 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:29.669027   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.670272   597 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.671173   597 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:29.676234   597 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.681917   483 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
W20260709 13:14:29.686694   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.669628  4838 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:29.670037  4613 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:29.669986  5127 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:29.690140   597 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:29.667542  5123 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:29.669885  5034 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:29.678025  4948 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:29.680843  5197 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:29.682943  5128 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:29.696858   597 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:29.700484   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 1.66371e+06us
I20260709 13:14:29.690176  5131 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:14:29.704308   447 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.705440   447 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.692567  5162 consensus_queue.cc:1059] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:14:29.700040  5209 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:29.706646  5209 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:29.707108  5209 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:29.646809   377 rpcz_store.cc:269] 0709 13:13:54.648990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.651548 (+  2558us) service_pool.cc:224] Handling call
0709 13:14:29.638752 (+34987204us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:22.894772 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:22.916215 (+ 21443us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:22.916288 (+    73us) write_op.cc:435] Acquired schema lock
0709 13:14:22.916317 (+    29us) tablet.cc:662] Decoding operations
0709 13:14:22.917427 (+  1110us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:22.917543 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:22.917590 (+    47us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:14:22.918456 (+   866us) tablet.cc:701] Row locks acquired
0709 13:14:22.918516 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:14:22.918758 (+   242us) write_op.cc:270] Start()
0709 13:14:22.918929 (+   171us) write_op.cc:276] Timestamp: P: 1783602862918656 usec, L: 0
0709 13:14:22.918959 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:14:23.059449 (+140490us) log.cc:844] Serialized 2835 byte log entry
0709 13:14:23.499618 (+440169us) op_driver.cc:464] REPLICATION: finished
0709 13:14:23.744275 (+244657us) write_op.cc:301] APPLY: starting
0709 13:14:23.744384 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:23.885232 (+140848us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:23.885349 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:23.945990 (+ 60641us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:24.037502 (+ 91512us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 13:14:24.051325 (+ 13823us) write_op.cc:312] APPLY: finished
0709 13:14:24.111130 (+ 59805us) log.cc:844] Serialized 73 byte log entry
0709 13:14:24.129954 (+ 18824us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:24.133158 (+  3204us) write_op.cc:454] Released schema lock
0709 13:14:24.147762 (+ 14604us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:24.381063 (+233301us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:24.384709 (+  3646us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3622891,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":218462,"apply.run_cpu_time_us":16054,"apply.run_wall_time_us":476397,"cfile_cache_hit":26,"cfile_cache_hit_bytes":27196,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6219,"cfile_init":1,"lbm_read_time_us":40121,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":6,"num_ops":7,"prepare.queue_time_us":282754,"prepare.run_cpu_time_us":13892,"prepare.run_wall_time_us":290486,"raft.queue_time_us":227276,"raft.run_cpu_time_us":67012,"raft.run_wall_time_us":287030,"replication_time_us":534021,"thread_start_us":452087,"threads_started":4,"wal-append.queue_time_us":107216,"wal-append.run_cpu_time_us":4764,"wal-append.run_wall_time_us":2090067}]]}
I20260709 13:14:29.688024  5217 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:29.709270   447 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:29.721647   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:29.703370  5208 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:29.724222  5068 raft_consensus.cc:3055] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:29.700109  5038 consensus_queue.cc:1059] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:14:29.726737   599 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.713322  4948 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:29.712229  5123 raft_consensus.cc:697] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:29.717346  5035 raft_consensus.cc:2764] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:14:29.712883  5103 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:29.724634  5068 raft_consensus.cc:740] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:29.717012  5163 raft_consensus.cc:2764] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:14:29.736476  5119 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:29.731809   599 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:29.742131   599 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.742306  1138 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.744573  5135 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:14:29.746729   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.746732  5082 consensus_queue.cc:1059] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:29.748140  5198 consensus_queue.cc:1059] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:29.749496  5198 raft_consensus.cc:3055] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:29.749409  5123 consensus_queue.cc:237] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.750438  5172 raft_consensus.cc:3055] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:29.749992  5198 raft_consensus.cc:740] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:29.721413  5127 raft_consensus.cc:3055] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:29.753458   599 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.763927  4415 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:29.720463  5128 raft_consensus.cc:697] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:29.764652   599 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.764638  4415 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.768558   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:29.729923  5162 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:29.750825  5172 raft_consensus.cc:740] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:29.771879   482 raft_consensus.cc:1275] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:14:29.775522   482 pending_rounds.cc:85] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 5
I20260709 13:14:29.775831   482 pending_rounds.cc:107] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:14:29.779597   482 raft_consensus.cc:2889] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:29.777465  5128 consensus_queue.cc:237] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.764022  5207 raft_consensus.cc:2749] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:14:29.782518  5245 log.cc:927] Time spent T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:14:29.766608  4952 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:29.783185  4952 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.785367  4952 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:29.775200  5208 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:29.786051  5208 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.770040  5227 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:29.779162   480 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:29.766952  5118 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:29.789444  4415 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:29.790707   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:29.787312  5186 consensus_queue.cc:1059] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:29.764179  4948 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:29.793694   599 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.793751  4948 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.791309  4613 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:29.796257  5217 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:29.796375  4613 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.797039  5217 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:29.797560  5217 raft_consensus.cc:697] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:29.798519  4613 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:14:29.798381  5217 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.772486  5065 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:29.799721   599 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.803083   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:29.804490   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:29.807267  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.808101   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:29.763736  5127 raft_consensus.cc:740] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:29.808885   476 raft_consensus.cc:2393] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 9: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:29.772042  5004 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:29.810067   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:29.811842   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:29.811964  4415 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:29.816305  4415 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.809198   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:29.817523   482 raft_consensus.cc:2368] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 14. Current term is 15.
I20260709 13:14:29.818246   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:29.818677   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:29.818926   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:29.819351   484 raft_consensus.cc:1240] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:29.808272   480 pending_rounds.cc:85] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 3
I20260709 13:14:29.813143   525 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:29.820614   480 pending_rounds.cc:107] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:14:29.820899   480 raft_consensus.cc:2889] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:29.814761   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:29.821161   557 raft_consensus.cc:1240] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:14:29.821694   633 raft_consensus.cc:2393] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 14: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:29.822161   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:29.822736   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:29.823305   625 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:29.823067   483 raft_consensus.cc:1240] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:29.827433   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:29.828979   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:29.830035   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:29.830358   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:29.831337   479 raft_consensus.cc:2393] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 14: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:29.831892  4415 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:29.834851   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:29.835547   632 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:29.834864   525 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:29.815578  5118 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:29.815765   626 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:14:29.814953   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.842826   630 raft_consensus.cc:1240] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:29.843228  5181 consensus_queue.cc:1059] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:29.833201  5083 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:29.844142   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:29.844353  5041 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:29.822192  5004 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:29.846974   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:29.811280  5065 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:29.848889   631 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:29.855854   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:29.858955   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:29.859225   627 raft_consensus.cc:1240] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14. Ops: [10.10-13.11]
I20260709 13:14:29.808976  5162 consensus_queue.cc:1059] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:14:29.860842   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:29.861115   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:29.861524   631 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:29.867617   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:29.868396   630 raft_consensus.cc:2393] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 13: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:29.869801   625 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:29.879420   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:29.880306   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:29.880908   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:29.882076   627 raft_consensus.cc:2393] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 12: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:29.881111   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:29.886567   447 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:29.888290   599 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.876559  5162 consensus_queue.cc:1243] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:14:29.860317  5004 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:29.903630   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:29.825168  5198 consensus_queue.cc:260] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.908057   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:29.911104   481 raft_consensus.cc:2393] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 10: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:29.846302  5186 consensus_queue.cc:1048] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:14:29.911146   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:29.877009  5160 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:29.912038   627 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:29.863128  5118 raft_consensus.cc:697] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:29.915535   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:29.916316   630 raft_consensus.cc:2393] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 12: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:29.917136   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:29.918184   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:29.920224  5186 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:29.920759  5186 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.922840  5186 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:29.924063  4948 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:29.924216   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:29.925046   630 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:29.926234  5206 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.927002  5068 consensus_queue.cc:260] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.910523  5163 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:14:29.928347  5068 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:29.855773  5172 consensus_queue.cc:260] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.930178  5172 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:29.910297  5103 raft_consensus.cc:2804] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:29.931860  5103 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:29.932294  5103 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:29.933060  5193 raft_consensus.cc:3055] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:29.933490  5193 raft_consensus.cc:740] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:29.934317  5193 consensus_queue.cc:260] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:29.936060  5216 log.cc:927] Time spent T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:14:29.935949  5209 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:29.938717  5246 log.cc:927] Time spent T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:14:29.941052  5065 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:29.943933  5209 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:29.944984  5118 consensus_queue.cc:237] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:29.946604   523 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:14:29.947623   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.950812  5090 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:29.946681   378 catalog_manager.cc:5697] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 9 to 11, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 11 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:29.951507  5206 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:29.951974   378 catalog_manager.cc:5697] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 5 to 6, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 6 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:29.955189   630 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:29.956585  1138 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.957218   631 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:29.958114   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:29.964037   627 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:29.965209   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:29.966275   559 raft_consensus.cc:2393] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 13: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:29.966351   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:29.967196   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:29.967746   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:14:29.964627   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 54548.4us
I20260709 13:14:29.983783  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:29.987931   552 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:14:29.988786   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:29.989843  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:29.994117   448 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:29.992980  1168 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:14:29.993372   630 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:29.973788  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:29.973963  4926 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:30.019214   378 catalog_manager.cc:5697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.024195   378 catalog_manager.cc:5697] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 6 to 9, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 9 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:29.976660  5090 consensus_queue.cc:1059] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:14:29.958138   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:29.978847   447 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:30.018710   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:30.020511  1170 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:29.972431   625 raft_consensus.cc:1240] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:14:29.974821  5205 raft_consensus.cc:2804] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:29.964586  5207 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:29.992372   633 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:30.027436   631 raft_consensus.cc:2393] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 14: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:30.082249  5205 raft_consensus.cc:697] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:30.083518  5205 consensus_queue.cc:237] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:30.084280   631 raft_consensus.cc:1240] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:30.086781   631 raft_consensus.cc:1240] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:30.031388   378 catalog_manager.cc:5697] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 6 to 10, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 10 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:30.028700  4995 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:30.091595  5228 log.cc:927] Time spent T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:14:30.093662  5146 log.cc:927] Time spent T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:14:30.037536  5086 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:30.097602  5193 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:30.089093   378 catalog_manager.cc:5697] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 9 to 11, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 11 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.099838   378 catalog_manager.cc:5697] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 6 to 7, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 7 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.057739   629 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 11: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:29.978466   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:30.102835   559 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:30.041393   630 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:14:30.112633   630 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:30.114218   631 raft_consensus.cc:1240] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: []
W20260709 13:14:30.124998   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 146211us
I20260709 13:14:30.125977   447 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:30.133973   378 catalog_manager.cc:5697] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 8 to 9, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 9 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:30.137413   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 302598us
I20260709 13:14:30.138257   559 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:30.142549   630 raft_consensus.cc:1240] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:30.138995   525 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:30.149217   525 leader_election.cc:400] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 14. Current term is 15.
I20260709 13:14:30.153628   378 catalog_manager.cc:5697] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 9 to 12, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 12 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:30.123276  4952 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:30.162856   633 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:14:30.162946   447 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:30.165463   378 catalog_manager.cc:5697] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 7 to 10, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 10 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.169306   522 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:30.176364  5083 consensus_queue.cc:1059] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:30.177547  5083 raft_consensus.cc:3055] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:30.177939  5083 raft_consensus.cc:740] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:30.180179   447 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:30.187427   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.167766  5086 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:30.189399   522 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:30.192389   447 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:30.185846  5035 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:30.208503   378 catalog_manager.cc:5697] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 5 to 10, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 10 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.214725   378 catalog_manager.cc:5697] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 5 to 8, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 8 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.194820   447 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:30.197916   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 633) took 1100 ms. Trace:
I20260709 13:14:30.216264   555 rpcz_store.cc:276] 0709 13:14:29.097957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:29.098499 (+   542us) service_pool.cc:224] Handling call
0709 13:14:29.098822 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:29.120613 (+ 21791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:30.197672 (+1077059us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b54001caf54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:30.197845 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45118336}
I20260709 13:14:30.220474   624 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:30.222484   522 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:30.225106   522 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:30.181985  5083 consensus_queue.cc:260] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.194103  4788 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:30.195434  5223 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:30.250334   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 432673us
I20260709 13:14:30.230928   378 catalog_manager.cc:5697] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 7 to 11, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 11 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.239441  5257 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:30.198292  5086 raft_consensus.cc:697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:30.221662  5090 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:30.241612  5186 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:30.228647   522 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:30.226274  5255 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:30.197330  4968 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:30.272347   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:30.264495   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:30.217617  5103 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:30.268919  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:30.261791  5083 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:30.269222   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:30.268919   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:30.278182   559 raft_consensus.cc:1275] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:14:30.275599  4788 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:30.272491   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 43945.1us
I20260709 13:14:30.273471   555 raft_consensus.cc:2393] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 13: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:30.273753  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:30.279803   522 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:30.265481   378 catalog_manager.cc:5697] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 6 to 10, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 10 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:30.274381   551 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:30.283507  5253 log.cc:927] Time spent T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:14:30.287621   378 catalog_manager.cc:5697] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 9 to 10, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 10 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.289635   378 catalog_manager.cc:5697] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 9 to 10, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 10 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.291913   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:30.294420  5103 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:30.294821  4788 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:30.299808  1168 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:14:30.300472   559 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: []
W20260709 13:14:30.307042   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.303026   378 catalog_manager.cc:5697] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 1 to 10, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 10 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:30.273332  5090 raft_consensus.cc:697] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:30.263285  5004 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.317932  5089 raft_consensus.cc:3055] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:14:30.318305   522 leader_election.cc:336] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 1.545s (SENT)
I20260709 13:14:30.279793  4968 raft_consensus.cc:697] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:30.310743   378 catalog_manager.cc:5697] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 8 to 9, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 9 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.328301   378 catalog_manager.cc:5697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 5 to 8, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 8 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:30.302886  5052 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:30.343036  4968 consensus_queue.cc:237] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.325879  5089 raft_consensus.cc:740] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:30.351315  5089 consensus_queue.cc:260] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.357478   552 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:14:30.357205  5089 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:30.358901  4788 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.359299   557 raft_consensus.cc:1275] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:30.359669  4788 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.362669  4788 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:30.367477  5086 consensus_queue.cc:237] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.370633  5004 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:30.371682  5090 consensus_queue.cc:237] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.381264   556 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:30.324569  5181 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:30.338599  4995 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:30.394037   552 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:14:30.395900   481 raft_consensus.cc:1240] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:30.414335  4952 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:30.417896   554 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:30.428737   554 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:30.429490   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2267) took 1235 ms. Trace:
I20260709 13:14:30.428964   378 catalog_manager.cc:5697] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 5 to 8, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 8 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.429941   554 rpcz_store.cc:276] 0709 13:14:29.194073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:29.425629 (+231556us) service_pool.cc:224] Handling call
0709 13:14:29.432256 (+  6627us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:29.945362 (+513106us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b180021ea60. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68454646 00007f4b6838e58e 00007f4b6840ff9e 00007f4b684117de 00007f4b6841bb49 00007f4b6841c416 00007f4b68418d8f 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4
0709 13:14:30.417636 (+472274us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b58004664d0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b683750aa 00007f4b683f7447 00007f4b6840ffe7 00007f4b684117de 00007f4b6841bb49 00007f4b6841c416 00007f4b68418d8f 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4
0709 13:14:30.429195 (+ 11559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:30.429435 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":853839360}
W20260709 13:14:30.430943  5183 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 13:14:30.442198  5250 log.cc:927] Time spent T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.558s	user 0.004s	sys 0.000s
I20260709 13:14:30.434458  4926 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:30.440598  5208 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:30.448066  5186 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:30.450739   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 2276) took 1250 ms. Trace:
I20260709 13:14:30.451259   550 rpcz_store.cc:276] 0709 13:14:29.200053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:29.248770 (+ 48717us) service_pool.cc:224] Handling call
0709 13:14:30.450480 (+1201710us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b540034ce54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:30.450669 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809745664}
I20260709 13:14:30.453497  5197 raft_consensus.cc:3055] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:30.453943  5197 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:30.454818  5197 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.455912  5197 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:30.462978   624 raft_consensus.cc:1240] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:30.465821   551 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:30.487154   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:30.487929   477 raft_consensus.cc:2393] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 14: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:30.488989   482 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:30.490302   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:30.490875   482 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:30.492324   482 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:14:30.494406   525 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:30.500174   378 catalog_manager.cc:5697] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 7 to 9, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 9 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:30.504300   447 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:30.508111   447 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:30.511132   447 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:30.502341   378 catalog_manager.cc:5697] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:30.505963  5183 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:30.534899  5198 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:30.537415   628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 2016) took 1772 ms (client timeout 1545 ms). Trace:
W20260709 13:14:30.537894   628 rpcz_store.cc:269] 0709 13:14:28.764921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:28.765691 (+   770us) service_pool.cc:224] Handling call
0709 13:14:30.537208 (+1771517us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b54001e3a54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:30.537340 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1880564096}
I20260709 13:14:30.537576   378 catalog_manager.cc:5697] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 7 to 9, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 9 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:30.516847  5103 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:30.517794  5163 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:30.526857  5119 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:30.547456   378 catalog_manager.cc:5697] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 7 to 8, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 8 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.532382  5183 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:30.517064  5223 consensus_queue.cc:1059] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:14:30.549320   378 catalog_manager.cc:5697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 7 to 8, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 8 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.531546  4995 consensus_queue.cc:1059] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:14:30.556195   378 catalog_manager.cc:5697] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 6 to 9, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 9 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.542460  5103 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:30.551789  5119 raft_consensus.cc:697] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:30.555899  5183 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:30.562379  5103 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:30.571373   378 catalog_manager.cc:5697] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.564190  5223 raft_consensus.cc:3055] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:30.576399   378 catalog_manager.cc:5697] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 10 to 11, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 11 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.578320  5223 raft_consensus.cc:740] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:30.552234  4952 consensus_queue.cc:1059] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:14:30.589885  5205 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.010s	sys 0.003s
W20260709 13:14:30.590524  5205 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.010s	sys 0.003s
I20260709 13:14:30.584434  5223 consensus_queue.cc:260] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.609391  5223 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:30.621786  5119 consensus_queue.cc:237] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.636135  5127 consensus_queue.cc:260] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.637428  5127 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:30.640338   448 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:30.643314   477 raft_consensus.cc:1275] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:30.651422   476 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:30.661741   476 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:14:30.667104   483 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:14:30.667723  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:30.668453  1168 raft_consensus.cc:2393] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 9: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:30.709398   626 raft_consensus.cc:2410] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 13:14:30.670235   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.684926  1168 raft_consensus.cc:1240] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:30.670485  5123 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.714037  5183 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.738675  5123 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:30.751849  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 67666.9us
I20260709 13:14:30.758739   475 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:30.758939  5211 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:30.670276  5284 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:30.761677  5123 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:30.762574  4926 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:30.769317  5183 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:30.769896  5258 log.cc:927] Time spent T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.504s	user 0.000s	sys 0.002s
I20260709 13:14:30.772413   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:14:30.772821  5282 log.cc:927] Time spent T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:14:30.773082   480 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:30.774034  5259 log.cc:927] Time spent T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.512s	user 0.002s	sys 0.000s
I20260709 13:14:30.765872  5103 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.787789   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:30.788429   556 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:30.789878  5103 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:30.791548   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:30.791307   552 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:30.792168   551 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:30.793045   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:30.794277   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:30.790583   554 raft_consensus.cc:1275] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:30.797881   448 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:30.799176   559 raft_consensus.cc:1240] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:30.796881  5227 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:14:30.800465  5052 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.798619  5256 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:30.798525  5082 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.801729  5256 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.801980  5082 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.803380  5119 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:30.803774  5119 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:30.803807  5082 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:30.804262  5119 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:30.800942  5052 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:30.805552  5183 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.806187  5052 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:30.806034  5183 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:30.807063   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:30.807576   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:30.808120  5183 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:30.808511   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:30.809059   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.808167   483 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:30.813382   480 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 15.
I20260709 13:14:30.811929   448 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:30.814797   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:30.814810   525 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:30.815932   525 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:30.818004  4853 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:30.818186  5082 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:30.818666  4853 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:30.819033  5082 raft_consensus.cc:697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:30.820254  5082 consensus_queue.cc:237] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.819262  4853 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:30.825595  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 59268.5us
I20260709 13:14:30.815548   475 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 15.
I20260709 13:14:30.793300  5103 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:30.808784  5183 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.767122  5284 raft_consensus.cc:697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:30.832950   525 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:30.837330   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:30.843003   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.839943  5041 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:14:30.839829  4926 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:14:30.839682  5186 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:30.847802  4995 raft_consensus.cc:3055] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:30.848342  5186 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:30.848558  4995 raft_consensus.cc:740] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:30.848809  5186 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:30.849782  4995 consensus_queue.cc:260] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.837213  5223 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:30.852842  5223 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:30.853235  5223 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:30.840534  5227 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
W20260709 13:14:30.856797  5279 log.cc:927] Time spent T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.284s	user 0.002s	sys 0.000s
I20260709 13:14:30.858541   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:30.859148   481 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:14:30.803781  5256 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:30.864197  4995 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:30.888017  1141 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:30.874948  5163 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:30.837028  5103 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.882767  5284 consensus_queue.cc:237] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:30.839507  5183 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:30.921186  5118 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.048s	sys 0.019s
I20260709 13:14:30.913887  5060 raft_consensus.cc:2804] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:30.943946  5119 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.946130  5119 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:30.948745   522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.948939   632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 2113) took 1107 ms. Trace:
I20260709 13:14:30.952745  5217 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.951839   632 rpcz_store.cc:276] 0709 13:14:29.841131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.104760 (+263629us) service_pool.cc:224] Handling call
0709 13:14:30.105165 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:30.105588 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:30.105912 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 13:14:30.265232 (+159320us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:30.269467 (+  4235us) log.cc:844] Serialized 26 byte log entry
0709 13:14:30.269626 (+   159us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:30.270127 (+   501us) log.cc:844] Serialized 14 byte log entry
0709 13:14:30.557546 (+287419us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b480024e358. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6d342aa1 00007f4b6d339b37 00007f4b6d3399ca 00007f4b6d43126f 00007f4b6d430f37 00007f4b6d44555c 00007f4b6d445508 00007f4b6d445488 00007f4b6d445443 00007f4b6d4446ec 00007f4b6c36ea96
0709 13:14:30.948392 (+390846us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b1800280660. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b652a6c0a 00007f4b6e9e6219 00007f4b6532ea40 00007f4b653294e4 00007f4b65329455 00007f4b68411060 00007f4b68423716 00007f4b68434287 00007f4b68434208
0709 13:14:30.948597 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:30.948678 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:30.948727 (+    49us) raft_consensus.cc:1685] finished
0709 13:14:30.948744 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:30.948876 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2214,"prepare.queue_time_us":4446,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":71,"raft.queue_time_us":686495,"raft.run_cpu_time_us":3042,"raft.run_wall_time_us":294008,"spinlock_wait_cycles":7748352,"thread_start_us":158885,"threads_started":1,"wal-append.queue_time_us":216174}
I20260709 13:14:30.953222  5217 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:30.950563  5176 raft_consensus.cc:3055] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:30.954267  5176 raft_consensus.cc:740] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:30.955094  5176 consensus_queue.cc:260] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:30.956221  5176 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:30.956671   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 112933us
W20260709 13:14:30.951022   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:30.925216  5118 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.048s	sys 0.019s
I20260709 13:14:30.967841   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 2120) took 1098 ms. Trace:
I20260709 13:14:30.973491   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 2036) took 1018 ms. Trace:
I20260709 13:14:30.973830   627 rpcz_store.cc:276] 0709 13:14:29.954921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.465603 (+510682us) service_pool.cc:224] Handling call
0709 13:14:30.465951 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:30.466199 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:14:30.466464 (+   265us) log.cc:844] Serialized 14 byte log entry
0709 13:14:30.856260 (+389796us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:30.973201 (+116941us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:30.973252 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:30.973296 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:30.973358 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:30.973448 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":421841,"prepare.queue_time_us":12290,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"spinlock_wait_cycles":12805888,"thread_start_us":80235,"threads_started":1,"wal-append.queue_time_us":106148}
I20260709 13:14:30.936272  5060 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:30.961973  5256 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.978765   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:30.961710  5217 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:30.979657   624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 2035) took 1069 ms. Trace:
I20260709 13:14:30.981465   624 rpcz_store.cc:276] 0709 13:14:29.909981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.463791 (+553810us) service_pool.cc:224] Handling call
0709 13:14:30.464042 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:30.464294 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:14:30.465329 (+  1035us) log.cc:844] Serialized 14 byte log entry
0709 13:14:30.979142 (+513813us) log.cc:844] Serialized 14 byte log entry
0709 13:14:30.979346 (+   204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:30.979395 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:30.979435 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:30.979501 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:30.979606 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":415035,"prepare.queue_time_us":642,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":30,"raft.queue_time_us":416064,"thread_start_us":98227,"threads_started":1,"wal-append.queue_time_us":120315}
I20260709 13:14:30.969375  5052 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.988269   554 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:30.977177  5082 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.992985   522 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:30.995630  5103 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:30.997349  5273 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.457s	user 0.002s	sys 0.000s
I20260709 13:14:30.998055  5051 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.998560  5051 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:30.990888  5052 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.995275  5223 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:30.979411  5060 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:31.005230   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:31.024744  5065 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:31.025399  5065 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:31.001555  5052 leader_election.cc:290] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:30.971024  5119 consensus_queue.cc:1048] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:14:31.007002   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:31.031392   477 raft_consensus.cc:2368] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15.
I20260709 13:14:31.017014   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:30.983852  5163 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.005570   448 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:30.984135  5256 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:31.036203  5035 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:31.036736  5035 raft_consensus.cc:697] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:31.037014  5256 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:30.988889  5082 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:31.037652  5035 consensus_queue.cc:237] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:31.028317  5083 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:31.028595  5186 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:31.045892   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:31.016292  5198 consensus_queue.cc:1059] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:14:31.048022   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:31.048425  5198 raft_consensus.cc:3055] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:31.048825  5198 raft_consensus.cc:740] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:31.049615  5198 consensus_queue.cc:260] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:31.050606  4853 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:31.053175   597 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:31.053623  5206 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.054324  5217 consensus_queue.cc:1048] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:31.056650   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:31.056979  5163 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:31.036442  5183 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:31.016631  5090 consensus_queue.cc:1059] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:14:31.088239   597 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:31.126363   624 raft_consensus.cc:1240] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:31.065940  5004 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:31.061146  5065 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:31.128376   475 raft_consensus.cc:1275] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:14:31.132907   631 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:14:31.131637   625 raft_consensus.cc:1275] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:14:31.128276  5197 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.135264   631 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:14:31.122540  5256 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.135923  5256 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:31.147950  5051 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:31.148563  5051 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:31.149037  5051 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:31.150180  5299 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.212s	user 0.008s	sys 0.000s
I20260709 13:14:31.117646  5128 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:14:31.151566  5051 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:31.152189  5051 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:31.152375  5128 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.152712  5051 raft_consensus.cc:697] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:31.152977  5128 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:31.153916  5186 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:31.153652  5051 consensus_queue.cc:237] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:31.156956  5277 log.cc:927] Time spent T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.590s	user 0.000s	sys 0.003s
I20260709 13:14:31.158886   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.159510   625 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:14:31.161373   625 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:31.163028   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.165671   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.166302   626 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
W20260709 13:14:31.165697  5294 log.cc:927] Time spent T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.227s	user 0.004s	sys 0.000s
I20260709 13:14:31.170372   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:31.170933   626 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:31.170969   483 raft_consensus.cc:1240] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:31.172715  5186 consensus_queue.cc:1059] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:31.173861  5204 raft_consensus.cc:3055] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:31.174016  5082 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:31.174248  5204 raft_consensus.cc:740] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:31.175158  5198 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:31.175041  5204 consensus_queue.cc:260] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:31.176014  5204 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:31.176523  5163 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:31.177287   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.177978   632 raft_consensus.cc:2393] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 10: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:31.178491   626 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 15.
I20260709 13:14:31.122671  5068 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:14:31.182507  5223 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:30.968384   630 rpcz_store.cc:276] 0709 13:14:29.878594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.264071 (+385477us) service_pool.cc:224] Handling call
0709 13:14:30.277379 (+ 13308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:30.277651 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:30.298474 (+ 20823us) log.cc:844] Serialized 14 byte log entry
0709 13:14:30.967377 (+668903us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:30.967448 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:30.967510 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:30.967613 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:30.967758 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":460759,"prepare.queue_time_us":25294,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":462186,"thread_start_us":207546,"threads_started":1,"wal-append.queue_time_us":232344}
I20260709 13:14:31.078712  5267 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:31.183758  5267 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:31.115937  5183 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:31.067656  5127 consensus_queue.cc:1059] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:14:31.185904  5267 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:31.186457  5267 raft_consensus.cc:3055] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:14:31.186692  5285 log.cc:927] Time spent T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:14:31.186807  5267 raft_consensus.cc:740] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:31.070708  5206 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:31.189314   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.182844  5060 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:31.192916   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.193639   630 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:31.185911  5183 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:31.197942   559 raft_consensus.cc:1240] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:31.198247  5206 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:31.199183  5183 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:31.199054  5267 consensus_queue.cc:260] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:31.200312  5267 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:31.201167   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:31.155038  5128 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:31.209085  4853 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:31.210057   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:31.210829   480 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:31.228176   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.229005   631 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:31.233383   480 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:31.238798   525 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:31.243132   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.244009   631 raft_consensus.cc:2410] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:14:31.135634  5197 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:31.280845   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.282258   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.276618  4853 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:31.292471   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.293180   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.293635   631 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
W20260709 13:14:31.293605   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 205451us
I20260709 13:14:31.295665   597 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:31.298363   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:31.299029   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:31.301645   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:31.302265   559 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:31.305938   555 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:31.306530   559 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:31.308429  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:31.309180  1170 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:31.311998   522 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:31.313855   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:31.316022   522 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:31.318543   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:31.320727   522 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:31.307543   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:31.322184   555 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
W20260709 13:14:31.324604   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.319147   631 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:31.326803   625 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:31.340167   557 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:14:31.330803   522 leader_election.cc:304] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:31.342648   557 pending_rounds.cc:85] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 7
I20260709 13:14:31.342486   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:31.343003   557 pending_rounds.cc:107] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:14:31.343416   557 raft_consensus.cc:2889] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:31.343343   479 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:31.348621   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:31.290568  5083 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:31.354151  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:31.309165  5118 raft_consensus.cc:2764] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:14:31.307531  5211 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:14:31.360980   599 leader_election.cc:400] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15.
I20260709 13:14:31.362444   597 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:31.384562   599 leader_election.cc:403] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:14:31.363962  5065 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:31.376809   631 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:31.353706  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:31.326503  5082 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:14:31.385001   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 54348.1us
I20260709 13:14:31.366562  5083 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:31.325238  4853 raft_consensus.cc:697] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:31.401686  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:31.303696  5125 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:14:31.403424   522 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:31.408607  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:31.351517  5217 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:31.411659   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 49336.1us
I20260709 13:14:31.388409  5127 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:31.417356  4853 consensus_queue.cc:237] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:31.417711  5041 consensus_queue.cc:1059] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:31.423666   525 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:31.424549   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 79295.2us
W20260709 13:14:31.457566   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.389266  4995 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:31.463874   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 51440.2us
I20260709 13:14:31.465090   597 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:31.467046   597 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:31.402356  5082 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:14:31.467736   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 106888us
I20260709 13:14:31.448879  5128 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:31.462258  5052 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:31.449563  5256 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:31.499567   597 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:31.500473   626 raft_consensus.cc:1240] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:31.517680   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:31.502622   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.504565   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:31.505926   633 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:31.521502   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.522877   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.524641   633 raft_consensus.cc:1275] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:31.506680   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:31.419049  5041 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:14:31.404950  5065 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:31.492967  5082 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:31.493016  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 213466us
I20260709 13:14:31.461498  5291 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:14:31.531965   629 raft_consensus.cc:1275] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:31.495991  5118 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15.
I20260709 13:14:31.535665   630 raft_consensus.cc:2368] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 12. Current term is 13.
I20260709 13:14:31.489835  4926 raft_consensus.cc:3055] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:31.536351   633 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:14:31.508947  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 191004us
I20260709 13:14:31.495805  5209 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:31.492790  5176 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:14:31.538820  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 125334us
I20260709 13:14:31.420920  5217 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:31.457653  5211 consensus_queue.cc:1048] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:14:31.517963  5206 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:31.518869  5052 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:31.538332  5060 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:31.550664  5301 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260709 13:14:31.515763  5068 consensus_queue.cc:1048] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:14:31.496236  5310 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:14:31.550369  5209 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:31.532620  5208 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:14:31.548033  5305 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.548491  5186 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:31.552129  5256 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:31.562541  5267 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:31.621086  5256 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:31.620489  5267 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:31.623574  5267 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:31.577785  5305 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:31.637537  5305 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:31.672381 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:31.678257   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:31.675549   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:31.677016   476 raft_consensus.cc:1275] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:14:31.684774   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:31.686417   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:31.685930   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:31.687942   481 raft_consensus.cc:2393] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 13: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
W20260709 13:14:31.685782   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 282250us
I20260709 13:14:31.685254   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:31.689479   479 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:31.692364   481 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:14:31.698695   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:31.703017   626 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 11: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:31.539088   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:31.493479  4995 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:31.720402  4995 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:31.722487  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 175856us
I20260709 13:14:31.726413  5041 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.547071  4926 raft_consensus.cc:740] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:31.566933  5052 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:31.732548  5083 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:31.739845  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 190475us
I20260709 13:14:31.746933   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:31.747893   476 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:31.561162  5176 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:31.750126   448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.007s	sys 0.026s
W20260709 13:14:31.750582   448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.007s	sys 0.026s
I20260709 13:14:31.756583  4926 consensus_queue.cc:260] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:31.576822  5186 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:31.759519  5186 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:31.722652  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 171331us
I20260709 13:14:31.574847  5209 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:31.769920  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:31.792711  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 69053.6us
W20260709 13:14:31.751042   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 746097us
I20260709 13:14:31.815807  5205 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:31.816521  5181 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:31.818518  5217 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:31.819443  5103 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.820312  5103 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:31.825619  5197 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:31.827696  5176 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:31.799494  5041 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:31.830883  5256 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:31.839535   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:31.850344  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 82495.9us
I20260709 13:14:31.844566  5211 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.818992  5205 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:31.859753  5328 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.845939  5103 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:31.869009  4926 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:31.871733  5004 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:31.866968   481 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:31.883476   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.888885  5211 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:31.889878  5205 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:31.895699   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:31.896160  5342 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.896523   479 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:31.896947  5342 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:31.897698  5205 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:31.900657  5198 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:31.894929  5176 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:14:31.895471   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:31.915534  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 143680us
I20260709 13:14:31.916277   476 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
I20260709 13:14:31.872941  5004 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:31.918241   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.919036  5176 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:31.920157   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:31.908692  5198 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:31.920467  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 58400.1us
I20260709 13:14:31.921036  5041 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:31.921303  5291 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:31.923607   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.953651   633 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:31.923974   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.924230   525 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:31.911443  5328 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:31.917058  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 123358us
I20260709 13:14:31.934944  1138 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:31.938496  5198 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:31.940811   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.943589  4853 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.943296  5186 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:31.944272  5331 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:31.946079  5176 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:31.947885  5211 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:31.950737  5004 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:31.951457  5298 raft_consensus.cc:3055] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:31.943447   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:31.985128   625 raft_consensus.cc:2393] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 11: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:31.992321  5128 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:31.993320  5204 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:31.999485  4853 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:32.001935  4853 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:32.002535  4853 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.002990   551 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:32.004009  5342 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:32.004541   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:32.006085   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:32.008080  5052 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.010582  5052 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:32.011346   632 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:32.011721   626 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:14:31.985935  5298 raft_consensus.cc:740] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:32.020262  5298 consensus_queue.cc:260] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:32.021306  5298 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:32.023779  5089 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.024358  5089 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.026407  5267 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.027130  5089 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:32.027475  5331 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:32.028249  5313 log.cc:927] Time spent T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.448s	user 0.003s	sys 0.000s
I20260709 13:14:32.033969  5186 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:32.038331  5065 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:32.045010  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 110228us
I20260709 13:14:32.047608  5317 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:32.055049  5328 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:32.057219   629 raft_consensus.cc:1275] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:32.003146  4853 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:32.067648   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 155852us
I20260709 13:14:32.022397  5209 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:32.071355  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 43542.2us
I20260709 13:14:32.073913   630 raft_consensus.cc:2393] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 14: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:32.071100  5181 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:32.018839  5082 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:32.080302  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 97000.1us
I20260709 13:14:32.078977  5181 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:32.083374   628 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:32.084107   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:32.088618   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:32.081818   525 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:32.074604  5186 consensus_queue.cc:1048] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:14:32.087177  5181 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:32.096592  5127 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.096985  5307 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.097609  5307 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.097476  5127 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.071653  5328 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:14:32.100839   522 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:32.108139   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:32.098680  5331 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:32.110441   625 raft_consensus.cc:2410] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:14:32.110777   554 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:32.110891  5052 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:32.111545   558 raft_consensus.cc:1275] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:32.112727  5037 consensus_queue.cc:1059] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:32.105988  5205 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:32.119665  5052 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:14:32.106448   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 480438us
I20260709 13:14:32.125505  5052 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:32.123941   629 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:32.126968   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 52124.1us
I20260709 13:14:32.128975   525 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:32.114715  5065 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.122537  5205 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:32.138659   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:32.140529   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:14:32.142938   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.141908   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:32.143016  5332 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.146883  5332 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.149333  5332 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:32.139614  5205 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:32.140452  1141 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:32.141487   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:32.135735  5331 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:32.155884   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:32.152015   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:32.162945   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:32.157424  5065 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.164129  5267 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:32.163575   625 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:32.138800  4995 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:32.168663   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:32.169260   479 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:32.170921   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:32.171061   553 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:14:32.174001   554 raft_consensus.cc:2393] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 14: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:32.183735   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:32.184072   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:32.168381  5328 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.175841   522 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:32.171566   553 pending_rounds.cc:85] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 7
I20260709 13:14:32.176688  5329 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.190802   556 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:32.189082   525 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:32.199628  4995 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.200146   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:32.201720  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:32.202064  4995 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:32.202925  5198 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:32.203634  5307 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:32.204273  1175 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:32.204380  5328 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.206187  1168 raft_consensus.cc:1240] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:32.174095  5209 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:32.210322  5127 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:32.210621  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:32.210801  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:32.211472  1172 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:32.211516  5082 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:32.214290   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:32.214941   555 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:32.190732   553 pending_rounds.cc:107] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:14:32.215600   553 raft_consensus.cc:2889] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:32.215997   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:32.216666   555 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:32.217650   555 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:32.217717  5065 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:32.222066  1168 raft_consensus.cc:1275] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:14:32.196273  4926 raft_consensus.cc:2804] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:32.224501  4926 raft_consensus.cc:697] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:32.225521  4926 consensus_queue.cc:237] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:32.235713  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:32.206990  5328 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:32.243768  1175 raft_consensus.cc:2410] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:14:32.243566   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:32.232295  5186 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:32.244587  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:32.252449  5186 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.256801  5186 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:32.257160  5149 raft_consensus.cc:3055] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:32.257601  5149 raft_consensus.cc:740] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:32.259485   557 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:32.259334  5329 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.262205  5347 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:32.262411   551 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:32.262930  5347 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:32.267220  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:32.272807   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:32.274145   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:32.274782   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:32.274861   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:32.275827   551 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
W20260709 13:14:32.279656  5312 log.cc:927] Time spent T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.721s	user 0.000s	sys 0.004s
I20260709 13:14:32.281136  5333 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.281260  5181 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.281774  5333 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:32.282593  5186 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.283981   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:32.284650   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:32.287972   629 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 15.
W20260709 13:14:32.290297   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 46482.2us
I20260709 13:14:32.258641  5149 consensus_queue.cc:260] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:32.294983  4853 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:32.305569  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:32.306367  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:32.326102  1169 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:32.306573   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:32.318799   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:32.325356  1170 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:32.324028   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:32.332921  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:32.238672  5307 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:14:32.333572   525 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:32.333611  1172 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:32.334739  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:32.318550  4995 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:14:32.339349  4995 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:32.340090   448 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:32.279052  5052 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.345348  5052 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:32.349110   558 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:32.351024   551 raft_consensus.cc:2393] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 15: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:32.337232   522 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:32.357311   479 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:32.361268   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:32.361882   630 raft_consensus.cc:3060] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:32.363092   552 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:32.358817   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:32.365445   557 raft_consensus.cc:2410] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:14:32.322434  5347 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:32.368415   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:32.375376  5035 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:32.375869  5035 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.376223  5035 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:32.377130  5348 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:14:32.375422   448 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:32.336210  5181 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:32.380573  5328 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:32.381155  5328 raft_consensus.cc:697] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:32.382156  5328 consensus_queue.cc:237] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.380044  5183 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:32.383299  4968 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.395213   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:32.394547  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:32.397406   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:32.350660  4853 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:32.401144   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:32.390897  5306 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:32.403672   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:32.383888  5082 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.364216  4995 consensus_queue.cc:1048] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:14:32.434165   483 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 16.
I20260709 13:14:32.360587  5103 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:14:32.406356  5306 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.443779   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:32.463367   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:32.391023  5176 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:14:32.400907  4968 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:32.468362   484 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:32.483206   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:32.476083   555 raft_consensus.cc:2393] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 14: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:32.444608  5317 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:32.463291  5333 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:32.470469  5306 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:32.506515   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 122806us
I20260709 13:14:32.521466   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:32.521258   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:32.521252   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:32.483615  4853 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:32.486977  5082 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.508774  5307 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:32.512084  5329 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:32.548599   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:32.587771   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:32.588364   523 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:32.553824   477 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:14:32.590866  5307 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:32.593910  5307 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:32.597476  4853 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:32.546314   447 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:32.551759   484 raft_consensus.cc:1275] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:14:32.598868   484 pending_rounds.cc:85] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 7
I20260709 13:14:32.553365   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:32.554687  5089 consensus_queue.cc:1059] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:32.560986  5004 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.562296   597 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:14:32.563910  5301 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:14:32.565253   448 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:32.573608   555 raft_consensus.cc:1240] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:14:32.575556  5176 consensus_queue.cc:1059] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:14:32.614154   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 51918.5us
I20260709 13:14:32.606547  1169 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:32.609341   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:32.597950  4968 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:32.614035   550 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:32.617340  5183 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.625331  5183 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.626155  5082 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:32.627414  5051 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.628006   484 pending_rounds.cc:107] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:14:32.628360   484 raft_consensus.cc:2889] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:32.628223   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 63066.6us
I20260709 13:14:32.628293   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:32.522789  5205 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.629467   476 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:32.549583  5186 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:32.630750   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:32.644950   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:32.648867   448 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:32.657279   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 130365us
I20260709 13:14:32.658506  1139 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:32.629233  5065 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:32.667461  1139 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:32.619946  5329 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:32.676388   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:32.684113   447 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:32.666464  5183 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:32.677263   626 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
W20260709 13:14:32.676156  5298 consensus_meta.cc:287] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.652s	user 0.006s	sys 0.007s
I20260709 13:14:32.668263  5181 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:32.691433   633 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:32.692978  1139 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:32.669245  5065 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.650921  5004 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.706751   552 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
W20260709 13:14:32.705595  5354 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:14:32.666805  5089 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:14:32.708386   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:32.718065   626 raft_consensus.cc:2393] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 11: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:32.699216   478 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:32.683322  4926 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:32.709465   630 raft_consensus.cc:2468] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 10.
I20260709 13:14:32.705658  5284 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:32.712474  5322 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:32.713068   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 178646us
I20260709 13:14:32.723918   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:32.725237   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:32.708256  5065 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:32.732667   633 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:32.709494  5347 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:32.701781  5181 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:32.769341  5181 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:32.769969  5004 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:32.771826  5035 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.748471  5068 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.748922  5364 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:32.754660   599 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:32.755455  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:32.713272  5127 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:14:32.704499  5037 consensus_queue.cc:1059] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 13:14:32.780994   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 103211us
I20260709 13:14:32.783990  5035 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:32.774734  5320 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:32.786525  5068 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.744217  5322 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:32.789976   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 120002us
I20260709 13:14:32.791657  5037 raft_consensus.cc:3055] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:32.743266  5176 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.704275  5051 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:32.779260  5354 log.cc:927] Time spent T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:14:32.811868   523 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:32.801172   477 raft_consensus.cc:1275] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:32.837875   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:32.838706   626 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:32.838860  5322 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:32.841048   599 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:32.804991  5052 consensus_queue.cc:1048] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:14:32.844964  5068 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:32.845821  5068 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:32.808079  5176 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.843122   599 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:32.848614  5176 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:32.846692  5068 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:14:32.803557  5037 raft_consensus.cc:740] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:32.852227  5068 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:32.853214  5037 consensus_queue.cc:260] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:32.853152   599 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:32.740535  5329 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:32.865026  4995 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:32.876257   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:32.861251  5306 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:32.882035  5183 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:32.868502  5052 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:14:32.897387   630 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:32.864563  5176 consensus_queue.cc:1048] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:14:32.894429   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:32.902323   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 90589.4us
I20260709 13:14:32.878873  4968 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:32.883972  5068 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:32.886314  5037 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:14:32.981458   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 132218us
I20260709 13:14:32.983925   633 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:32.991694   523 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:32.980681  5358 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:14:33.002969   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:33.001134   447 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:33.035360  5035 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:33.001844  5052 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:33.040292   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 316622us
W20260709 13:14:33.043387  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 230536us
I20260709 13:14:33.045053   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:33.045781   476 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 14.
W20260709 13:14:33.045271   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 302849us
I20260709 13:14:33.052322   630 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
W20260709 13:14:33.051184  5360 log.cc:927] Time spent T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 13:14:33.062741   522 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:33.067358  5082 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:33.066226   522 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:33.059156   626 raft_consensus.cc:2468] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 15.
W20260709 13:14:33.075695   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 57130us
I20260709 13:14:33.070042   522 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:33.090204   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 105097us
I20260709 13:14:33.012940  5183 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:33.084621  5186 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:33.087327  5211 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:33.093849  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:33.097821  1175 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:33.098151  5208 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:33.098845  5208 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:33.098789  5211 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:33.100399  5186 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.100934  5186 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:33.101802  5211 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:33.102546   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 2122) took 1603 ms. Trace:
I20260709 13:14:33.102937   627 rpcz_store.cc:276] 0709 13:14:31.499007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:31.502272 (+  3265us) service_pool.cc:224] Handling call
0709 13:14:31.541843 (+ 39571us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:31.905224 (+363381us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:32.089325 (+184101us) log.cc:844] Serialized 14 byte log entry
0709 13:14:32.360093 (+270768us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:32.443077 (+ 82984us) log.cc:844] Serialized 26 byte log entry
0709 13:14:32.443742 (+   665us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:32.733363 (+289621us) log.cc:844] Serialized 14 byte log entry
0709 13:14:33.074506 (+341143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:33.084909 (+ 10403us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:33.084970 (+    61us) raft_consensus.cc:1685] finished
0709 13:14:33.084985 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:33.102358 (+ 17373us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":331074,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":1977,"raft.queue_time_us":50876,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":4212,"thread_start_us":1370089,"threads_started":5,"wal-append.queue_time_us":344552}
I20260709 13:14:33.109495  5186 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:33.115923  5186 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:33.118348  5205 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:33.122362  5329 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:33.124171   597 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:33.067903  5082 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.129549  5149 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:33.130934  5368 log.cc:927] Time spent T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:14:33.106976  5355 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.493s	user 0.000s	sys 0.002s
W20260709 13:14:33.132436   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 230356us
I20260709 13:14:33.079883  4853 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:33.133245  5068 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:33.155706  5068 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:33.156977  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:33.157630  1168 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:33.096261  5051 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:33.139456  5360 log.cc:927] Time spent T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:14:33.150362  5082 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:33.185521  1141 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:33.187808   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:33.161507  4853 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.184062  5103 raft_consensus.cc:3055] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:14:33.199224   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 121414us
I20260709 13:14:33.202981   447 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:33.200383   522 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:33.206183   522 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:33.207545  5205 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:33.208016  5205 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:33.208422  5205 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:33.219587  5183 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:33.195273  5103 raft_consensus.cc:740] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:33.221074  5103 consensus_queue.cc:260] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:33.222302  5103 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:33.231961  5068 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:33.234259  5068 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:33.184983  5051 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:33.235708  5051 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:33.237536   522 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:33.238072  5051 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:33.238435   522 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:33.190419  5065 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:33.240849  5065 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:33.241050  5329 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:33.241444  5329 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.241770  5211 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:33.195626  4853 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:33.242237  5211 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.242597  5211 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:33.243716  5186 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:33.244123  5186 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.244449  5186 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:33.247310  5364 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:33.247694  5123 consensus_queue.cc:1048] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:14:33.247913  5364 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:33.248378  4995 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:33.248809  4995 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:33.185719  5306 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:33.241848  5329 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:33.238687  5051 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:14:33.283522  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:33.285351   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 120889us
I20260709 13:14:33.286216   523 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:33.287544   523 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:14:33.294059  5181 consensus_meta.cc:287] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.003s
I20260709 13:14:33.294520  5181 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:33.273303  5183 raft_consensus.cc:2804] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:33.274881  5377 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:33.314920   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:33.314333   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:33.321679  5361 log.cc:927] Time spent T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.439s	user 0.001s	sys 0.000s
I20260709 13:14:33.326381  4853 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:33.317590  5363 log.cc:927] Time spent T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.423s	user 0.005s	sys 0.000s
I20260709 13:14:33.328732  5181 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:33.280473  5328 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.282883  5205 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:33.340658  5364 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:33.348786   551 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 14.
I20260709 13:14:33.373589  4995 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:33.375486  5392 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:33.375828  5082 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:33.376693  5298 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:33.377731  5329 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:33.380089   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 194762us
W20260709 13:14:33.380505   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 93066.3us
I20260709 13:14:33.470578   523 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:33.384931  5186 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:33.385890  5307 raft_consensus.cc:3055] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:33.400678  5052 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:33.371451  5127 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:33.462954  5298 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:33.465317   559 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:33.465399  4995 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:33.431989  5328 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:33.456660  5211 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:33.505412  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:33.468257  1167 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:33.494208  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:33.495005  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:33.516294   556 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:33.476609  4853 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:33.523420   632 raft_consensus.cc:1275] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:33.524878   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:33.525907   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:33.526525   625 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:33.487926  5307 raft_consensus.cc:740] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:33.492342  5052 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.530755   557 raft_consensus.cc:1240] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:14:33.531917   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:33.531947   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:33.533775   627 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:33.537922   633 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:33.540555   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:33.518548  5386 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:33.545014   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 394311us
I20260709 13:14:33.550096   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:33.550797   558 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:33.552182   557 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:14:33.553323   552 raft_consensus.cc:1275] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:14:33.553922   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 429912us
I20260709 13:14:33.553423   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:33.554958   632 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:33.539414  5052 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:33.532994  5183 raft_consensus.cc:697] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:33.548663   448 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:33.558189   448 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:33.561965   447 leader_election.cc:400] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 12. Current term is 13.
I20260709 13:14:33.561800   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:33.562372   447 leader_election.cc:403] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:14:33.562750   557 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:33.519460  5364 consensus_queue.cc:1048] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:14:33.568361   599 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:33.570398   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:33.575009   631 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:33.577879   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 680) took 1246 ms. Trace:
I20260709 13:14:33.572784   448 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:33.588161   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:33.564191  4995 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:33.578245   629 rpcz_store.cc:276] 0709 13:14:32.331616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.331743 (+   127us) service_pool.cc:224] Handling call
0709 13:14:32.336438 (+  4695us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:32.380783 (+ 44345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:32.380813 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:32.381407 (+   594us) log.cc:844] Serialized 52 byte log entry
0709 13:14:32.632060 (+250653us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:14:32.654891 (+ 22831us) log.cc:844] Serialized 14 byte log entry
0709 13:14:32.895565 (+240674us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b180024a060. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b652a6c0a 00007f4b6e9e6219 00007f4b6532ea40 00007f4b653294e4 00007f4b65329455 00007f4b6be113c7 00007f4b684239a7 00007f4b684330bf 00007f4b68433038
0709 13:14:32.895818 (+   253us) log.cc:844] Serialized 14 byte log entry
0709 13:14:32.896097 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:32.896207 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:33.289946 (+393739us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b180024a060. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b652fa2a6 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b651b29c4 00007f4b651b0acb 00007f4b6536bdc9
0709 13:14:33.291149 (+  1203us) spinlock_profiling.cc:243] Waited 6.79 ms on lock 0x7b24001ddf38. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b651b29c4 00007f4b651b0acb 00007f4b6536bdc9 00007f4b6536ba55 00007f4b6536b09d 00007f4b67f9d10e 00007f4b67fb488c 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221
0709 13:14:33.577673 (+286524us) raft_consensus.cc:1685] finished
0709 13:14:33.577694 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:33.577824 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":249620,"prepare.queue_time_us":357480,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":82,"raft.queue_time_us":114770,"raft.run_cpu_time_us":447,"raft.run_wall_time_us":31535,"spinlock_wait_cycles":76120448,"thread_start_us":250214,"threads_started":1,"wal-append.queue_time_us":495636}
I20260709 13:14:33.592000   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:14:33.594318   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 57731.6us
I20260709 13:14:33.544618  5379 consensus_queue.cc:1048] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:14:33.582326  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:33.570868  5089 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:14:33.606451  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 68033.1us
I20260709 13:14:33.577124  5377 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 12. Current term is 13.
I20260709 13:14:33.601706  1166 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:33.621628   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:33.620024   632 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:33.622357   629 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:33.591002  4995 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:33.605264  5306 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:33.607223  5089 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:33.641479   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:33.571547  5386 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:33.647313   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:33.648213   478 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:33.645860   522 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:33.631731  4995 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:33.635143  5306 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.605069  5395 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:14:33.621011  4968 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
W20260709 13:14:33.675452   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 47483.1us
I20260709 13:14:33.595755  5307 consensus_queue.cc:260] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:33.643534  5089 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:33.678714   629 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:33.663434  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:33.676250  5306 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:33.675819  5332 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:33.719959  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:33.865536  1173 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:33.676108  5298 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:33.734997   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 109840us
W20260709 13:14:33.756784  5391 log.cc:927] Time spent T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:14:33.738711  5328 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:33.717715  5211 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:33.765298  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 132495us
I20260709 13:14:33.720661  5377 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:33.856194   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 78242.9us
I20260709 13:14:33.655212  5183 consensus_queue.cc:237] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:33.641989  5103 consensus_queue.cc:1059] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:14:33.861706  4968 consensus_queue.cc:1059] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:33.645931  5392 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:33.869282   557 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:33.879840   552 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:33.869680   627 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:33.871166   625 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:33.883652  5307 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:33.880323   478 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 15.
I20260709 13:14:33.890322   631 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
W20260709 13:14:33.895046   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 340152us
I20260709 13:14:33.899602   447 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:33.895130   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 301360us
I20260709 13:14:33.910468   597 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:33.894865   525 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.513s (SENT) [suppressed 11 similar messages]
I20260709 13:14:33.901678  5333 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:33.899430  5385 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:33.944135  1167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36724 (request call id 646) took 1375 ms. Trace:
I20260709 13:14:33.886740  5396 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:33.917336  1174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:57004
I20260709 13:14:33.914543  1141 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:33.944523  1167 rpcz_store.cc:276] 0709 13:14:32.536875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.549803 (+ 12928us) service_pool.cc:224] Handling call
0709 13:14:33.911716 (+1361913us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b54004583d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:33.911788 (+    72us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1589790976}
W20260709 13:14:33.919404  5394 log.cc:927] Time spent T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.266s	user 0.000s	sys 0.009s
I20260709 13:14:33.930419  5004 consensus_queue.cc:1048] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:33.934906   625 raft_consensus.cc:1275] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:33.901015  5328 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:33.904323  5298 consensus_queue.cc:1048] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:14:33.936084   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:33.937418   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:33.938215   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:33.961606   624 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:33.934788   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:33.944136   558 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:33.948446  5404 consensus_queue.cc:1059] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:14:33.900808  5332 raft_consensus.cc:697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:14:33.908668  5393 log.cc:927] Time spent T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c: Append to log took a long time: real 0.265s	user 0.005s	sys 0.003s
I20260709 13:14:33.943398   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 664) took 1397 ms. Trace:
I20260709 13:14:33.952021  1174 raft_consensus.cc:606] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
W20260709 13:14:33.959735   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 49356.2us
I20260709 13:14:33.968839  1174 raft_consensus.cc:614] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:33.972084   629 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:33.976197   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:33.943832  5385 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.977522   480 raft_consensus.cc:2410] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:14:33.976271  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 61838.1us
I20260709 13:14:33.979265   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:33.984388   625 raft_consensus.cc:2368] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11.
I20260709 13:14:33.969354   597 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:33.970767   522 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:33.982388   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:33.988293   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:33.900744  5377 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:33.951534  5068 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:33.996376   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:33.997984   478 raft_consensus.cc:2393] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 14: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:33.999670   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:33.999732   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 99000.1us
I20260709 13:14:34.000414   476 raft_consensus.cc:2393] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 13: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:33.999610   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:34.000581   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:34.003459   633 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:14:33.968709   554 rpcz_store.cc:276] 0709 13:14:32.535637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.535871 (+   234us) service_pool.cc:224] Handling call
0709 13:14:32.571812 (+ 35941us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:32.668743 (+ 96931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:32.668778 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:32.920750 (+251972us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b1800479da0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b652fa2a6 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b66d12a11 00007f4b66d22372 00007f4b68454a01 00007f4b6841943a
0709 13:14:33.296798 (+376048us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b2c00070ee8. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b66d12a11 00007f4b66d22372 00007f4b68454a01 00007f4b6841943a 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2
0709 13:14:33.297352 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:14:33.550963 (+253611us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:33.636918 (+ 85955us) log.cc:844] Serialized 14 byte log entry
0709 13:14:33.645334 (+  8416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:33.645413 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:33.932808 (+287395us) raft_consensus.cc:1685] finished
0709 13:14:33.932829 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:33.932950 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104629,"prepare.queue_time_us":36568,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":5160,"raft.queue_time_us":109557,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":14263,"spinlock_wait_cycles":22754432,"thread_start_us":306392,"threads_started":2,"wal-append.queue_time_us":356290}
I20260709 13:14:33.960844  5388 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:34.016371   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:34.023192   448 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:33.987607  5385 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:33.987121  5037 raft_consensus.cc:2804] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:34.034762   629 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:34.036393   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:34.025746   597 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:34.028815   624 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:33.951530  5333 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.023116  5404 raft_consensus.cc:2764] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:14:34.019001   522 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:34.030025  4968 raft_consensus.cc:3055] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:34.042980   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:34.042192   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:34.006186  5386 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:34.065132   597 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:34.065824   625 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:34.068545   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:33.982952  5328 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:33.967881  5396 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:34.073611   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 54728.2us
W20260709 13:14:34.079907   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 180430us
W20260709 13:14:34.091521   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 196675us
I20260709 13:14:34.043427  4968 raft_consensus.cc:740] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:34.093066   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:34.095625   625 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:34.069314  5209 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:34.096308   624 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:34.092988   522 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:34.063035  5037 raft_consensus.cc:697] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:34.035521  5068 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:34.041015  5306 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:34.110877   477 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:34.079392  5103 raft_consensus.cc:3055] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:14:34.111675   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.079480  5386 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:34.112756   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:34.094847  5004 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:34.119989   625 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:34.098560  5209 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.075807  4995 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:34.117092   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 51998.4us
I20260709 13:14:34.130210  5409 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:14:34.118532   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 70150us
I20260709 13:14:34.131906   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:34.139513   624 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:34.136916   475 raft_consensus.cc:2393] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 11: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:34.101835  5408 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:34.138015   597 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:34.140894   448 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:34.113976  5103 raft_consensus.cc:740] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:34.135035  5209 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:34.171770   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 78849.2us
I20260709 13:14:34.147696  5376 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:34.082564  5332 consensus_queue.cc:237] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.181597   522 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:34.154997  5417 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:34.193751   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.174130  5388 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:34.197106   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:34.197875   552 raft_consensus.cc:2393] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 16: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:34.198493   625 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:34.199456   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:34.200378   625 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:34.200755  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:34.201380   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:34.186800  5037 consensus_queue.cc:237] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:34.179095  5384 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:34.207459  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:34.209678  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:34.208423  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:34.212459  1172 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:34.212613  1167 raft_consensus.cc:2410] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:14:34.180224  5298 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:34.216809   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:34.218571   625 raft_consensus.cc:2368] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14.
I20260709 13:14:34.182680  5410 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:34.153877  5409 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.226130   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:14:34.207123  5413 log.cc:927] Time spent T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:14:34.157481  5408 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:34.199186  5386 raft_consensus.cc:697] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:34.168481  4968 consensus_queue.cc:260] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.209308  5377 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:34.215695  5376 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.201865  5416 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:34.207525  5422 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:34.221091  5388 raft_consensus.cc:697] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:14:34.232044  5052 consensus_meta.cc:287] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.003s
I20260709 13:14:34.255961   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:34.260700  5306 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:34.261178  5379 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.228206  5414 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:34.253202  5411 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:34.200462  5417 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:34.226635  5298 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.219732  5103 consensus_queue.cc:260] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.263366  5333 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:34.297055  1173 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:34.266389  5422 raft_consensus.cc:697] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:14:34.298614   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 51381.4us
I20260709 13:14:34.299084   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:34.301151   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:34.302304   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:34.302904   627 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:34.229801  5384 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.282052  4968 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:34.309355  5068 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:34.310067  5068 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.310564  5384 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:34.310932   627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:14:34.311669   627 raft_consensus.cc:606] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:34.312080   627 raft_consensus.cc:614] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:34.315650   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:34.282649  5428 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:34.318516   624 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:34.289927  5414 raft_consensus.cc:697] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:34.293527  5429 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:34.263849  5376 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.298578  5333 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:34.275554  5052 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:34.330158  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:34.329212   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:34.331125   483 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:34.305786  4995 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:34.308794  5396 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:34.336110   447 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:34.336465   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:34.337239   552 raft_consensus.cc:1275] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:34.337395  5425 raft_consensus.cc:2804] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:34.339444   553 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:34.339838  5440 consensus_queue.cc:1048] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:34.340790  5414 consensus_queue.cc:237] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.342060  5422 consensus_queue.cc:237] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.342770   631 raft_consensus.cc:1240] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:14:34.343895  5420 log.cc:927] Time spent T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:14:34.337260  5430 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:34.389853   556 raft_consensus.cc:1240] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:14:34.279105  5379 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:34.347800  5306 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:34.332640  5429 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.348821   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:34.414093   480 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:34.349506  5298 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:34.319751  5386 consensus_queue.cc:237] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.423835   631 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:14:34.424690   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:34.426178  5409 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:34.427871  5052 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:34.414767  5306 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.428840  5379 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:34.349762  5388 consensus_queue.cc:237] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:34.350739  5392 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:34.351593  5408 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:34.264647  5416 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:34.355278   633 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 16.
I20260709 13:14:34.345878  5417 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:34.395573   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 59575.3us
I20260709 13:14:34.395660   525 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:34.327422  5428 raft_consensus.cc:697] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:34.410279   555 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:14:34.310619  5068 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.298162  5411 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.412218   483 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:34.414655   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:34.415052   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:34.448062   552 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 6.
I20260709 13:14:34.417575   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:34.449450   553 raft_consensus.cc:2393] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 13: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:34.419130  1173 raft_consensus.cc:1240] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:34.421561  5209 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.353438  5404 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:34.433292   480 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 16.
W20260709 13:14:34.438589   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.438973  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:34.444442   597 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:34.445979   447 leader_election.cc:400] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11.
I20260709 13:14:34.482635   632 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:14:34.335358  5333 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:34.451607   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 56032.7us
I20260709 13:14:34.482029   522 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:34.451668  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:34.413751  5425 raft_consensus.cc:697] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:34.429451  5430 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.480413  1169 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:34.480216   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:34.479875   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:34.481652   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:34.485677   525 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:34.487313  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:34.486373  1174 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 16.
I20260709 13:14:34.491142   483 raft_consensus.cc:2376] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11. Re-sending same reply.
I20260709 13:14:34.500455   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:34.501245  5411 leader_election.cc:290] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:34.501744  5068 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:34.503372  5439 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:34.504138  5423 consensus_queue.cc:1048] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:14:34.507491   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:34.507644   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:34.508087  5089 consensus_meta.cc:287] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.781s	user 0.011s	sys 0.000s
I20260709 13:14:34.508561  5089 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:34.509658  5416 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:34.509756   484 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:34.510857  5089 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:34.509063  5428 consensus_queue.cc:237] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.508495   552 raft_consensus.cc:2393] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 11: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:34.524199   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:34.480640  5417 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:34.524770   552 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:34.525462  5417 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:34.524776  1172 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:34.527246  5425 consensus_queue.cc:237] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:34.526523   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:34.528837   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:34.482448  5408 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:34.516542  5209 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:34.517614   525 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:34.530488  5183 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:34.530854  5183 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:34.518164  5306 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:34.504002  5376 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:34.531303  5183 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:34.530959   525 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:34.504046  5431 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:34.487865  5404 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.443456  5392 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:34.534574   477 raft_consensus.cc:2410] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:14:34.520586   484 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:34.535043  1169 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:34.529124  5417 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:34.529966  5408 raft_consensus.cc:697] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:34.533401  5431 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:34.539026  5329 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:34.539592  5386 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:34.542080  5205 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:34.545078   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:34.545392  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:34.545791   631 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:34.547168   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:34.539630  5429 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:34.524868  5333 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:34.526593  5430 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:34.554268  5445 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:34.548300   483 raft_consensus.cc:2376] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 16. Re-sending same reply.
I20260709 13:14:34.568420   447 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
W20260709 13:14:34.574098   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 74746.3us
I20260709 13:14:34.545078  5416 consensus_queue.cc:1059] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:14:34.586884   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2205) took 1057 ms. Trace:
I20260709 13:14:34.587337   556 rpcz_store.cc:276] 0709 13:14:33.529786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.529909 (+   123us) service_pool.cc:224] Handling call
0709 13:14:33.540433 (+ 10524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:34.390287 (+849854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:34.586648 (+196361us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b54000eb854. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:34.586828 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1951468928}
I20260709 13:14:34.552593  5440 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:14:34.588431   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:34.588841  5307 consensus_meta.cc:287] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.676s	user 0.005s	sys 0.005s
I20260709 13:14:34.589401   478 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:34.574887   522 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:34.543359  5385 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.583606  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:34.583765   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:34.585198  5392 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:34.586163  5431 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:34.595925   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:34.596477  1169 raft_consensus.cc:2368] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14.
I20260709 13:14:34.600145   447 leader_election.cc:400] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14.
I20260709 13:14:34.601642   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:34.602098   447 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:34.602533   476 raft_consensus.cc:2410] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:14:34.591715   631 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:34.605899   626 raft_consensus.cc:2368] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 14. Current term is 15.
I20260709 13:14:34.604827   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:34.609567   448 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:34.611765  5385 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:34.628537   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:34.612293  4968 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:34.631071  4968 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:34.632725   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:34.633315   477 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:14:34.633931  4968 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:34.610076  5408 consensus_queue.cc:237] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.611871  5208 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:34.614813  5440 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:34.635587  5440 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:34.636482   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:34.637759  5440 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:34.638063   475 raft_consensus.cc:1275] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:34.596848  5450 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:34.638717  5450 raft_consensus.cc:697] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:34.639933  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:34.639722  5450 consensus_queue.cc:237] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.641803   476 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:14:34.642545  5328 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:34.618643   447 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:34.644893  4968 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:34.646312  5404 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:34.648804   523 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:34.603679  5448 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:34.619206  5429 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:34.619940   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:34.621294  5089 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:34.621706  5417 consensus_queue.cc:1059] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:34.622231  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:34.623713  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:34.624577  5082 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:34.676596  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:34.626170   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2217) took 1001 ms. Trace:
I20260709 13:14:34.626258  5183 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.679356   557 rpcz_store.cc:276] 0709 13:14:33.624771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.909558 (+284787us) service_pool.cc:224] Handling call
0709 13:14:33.909845 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:34.078552 (+168707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:34.078597 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:34.078655 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:34.078700 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:34.625919 (+547219us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540031abd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:34.625970 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:34.626091 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387399552}
I20260709 13:14:34.680711   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:34.681372   557 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:34.682463   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:34.630245   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:34.683588   556 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:34.630312   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:34.573509  5306 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:14:34.617437  5431 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:34.655133   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:34.656793   523 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:34.680838  5183 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:34.627444  5307 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.688647   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:34.691069   631 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:34.694725   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:34.695228   523 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:34.700652   550 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:14:34.701164   557 raft_consensus.cc:2393] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 12: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
W20260709 13:14:34.697410   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 163040us
I20260709 13:14:34.705353   525 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:34.675109  5328 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:34.657275  5448 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:34.715325   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:34.716048   550 raft_consensus.cc:3060] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:14:34.688763  5089 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:34.714243   448 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:34.674908  4968 consensus_queue.cc:1059] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:14:34.719292   525 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:34.714658  5425 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:34.714190  5396 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:34.752568   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:34.760510   557 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:34.761430   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:34.762535   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:34.763818   557 pending_rounds.cc:85] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 5
I20260709 13:14:34.764073   557 pending_rounds.cc:107] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:14:34.764298   557 raft_consensus.cc:2889] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:34.753284   631 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:34.715766  5428 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:34.719967  5089 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:34.717993  5448 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:34.776736   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 66747.3us
I20260709 13:14:34.810200  5428 raft_consensus.cc:697] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:34.811375  5428 consensus_queue.cc:237] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.814218   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:34.814384   477 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 15.
I20260709 13:14:34.814970   558 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 16.
I20260709 13:14:34.815726  5457 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 13:14:34.817281  5462 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:34.817780  5462 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:34.818172  5462 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:34.775015  5425 raft_consensus.cc:697] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:34.820124  5425 consensus_queue.cc:237] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:34.699267  5431 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:34.712447  5307 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.735157  5404 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:34.826964   556 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 15.
I20260709 13:14:34.823122  5386 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:14:34.839720   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:34.844452   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.851073   448 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:34.852236   448 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:34.765260  5298 raft_consensus.cc:3055] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:34.855922   448 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:34.735803  5183 consensus_queue.cc:1048] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 13:14:34.786892  5328 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:34.859225   448 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:34.864111  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:34.865082  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:34.870854  1169 raft_consensus.cc:2468] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:34.870998  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:34.871810  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:34.873049  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:34.872198  1139 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:34.952234  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:14:34.953145  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 81046.1us
I20260709 13:14:34.952234   448 leader_election.cc:400] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14.
I20260709 13:14:34.954213   448 leader_election.cc:403] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:14:34.849825  5404 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:34.854604  5416 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:34.957069   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:34.956872  5123 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:34.857193  5430 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:34.858871  5450 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:34.957841  5404 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:34.860047  4968 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:34.856911  5380 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:34.959062   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:34.857957  5298 raft_consensus.cc:740] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:34.958360  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:34.988775  1139 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:34.967857  5422 raft_consensus.cc:2749] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14.
I20260709 13:14:35.037472   552 raft_consensus.cc:1240] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: []
W20260709 13:14:34.963354  5466 log.cc:927] Time spent T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:14:34.975193  5464 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:14:35.040558   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:34.961354  5446 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:34.963447  5443 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:34.973238  5431 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:34.961259  5123 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:34.984593  4968 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:34.993253  5379 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:34.975577  5450 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:34.971625  5430 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.038836  5209 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:35.051685   558 raft_consensus.cc:1240] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:34.993278  5465 consensus_queue.cc:1059] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:14:35.048772  5123 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:35.071534   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:35.075750   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:35.076534   630 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 6.
I20260709 13:14:35.049335  4968 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:35.082034   597 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:35.054613  5379 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.063453  5385 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:35.100075   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:35.104070   628 raft_consensus.cc:2368] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14.
I20260709 13:14:35.061321  5446 raft_consensus.cc:697] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:35.045567  5448 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.107160   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:35.117986  5463 log.cc:927] Time spent T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:14:35.118347  5467 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:35.119413  5385 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:35.048617  5298 consensus_queue.cc:260] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:35.067842  5209 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:34.992092  5380 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.157902   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:35.146920   475 raft_consensus.cc:1240] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 14. Current term is 15. Ops: []
W20260709 13:14:35.160297   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 284929us
I20260709 13:14:35.161708   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:35.122216  5434 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:35.162366   628 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:14:35.099500  5379 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:14:35.176529  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 125339us
I20260709 13:14:35.128161  5307 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:35.162689   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:35.086742  5127 consensus_queue.cc:1059] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:14:35.158977   630 raft_consensus.cc:2368] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11.
I20260709 13:14:35.182129  1172 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:35.189162   550 raft_consensus.cc:2468] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 15.
I20260709 13:14:35.194132   628 raft_consensus.cc:1240] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:14:35.160442  5446 consensus_queue.cc:237] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.196197   630 raft_consensus.cc:1240] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:14:35.182474  5298 raft_consensus.cc:3060] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:35.185159  5307 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:35.204586  5380 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:35.208216  5385 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:35.182945  5382 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.228467  5382 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.230772  5382 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:35.210640   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 107803us
I20260709 13:14:35.232110  5209 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:35.221163  5390 log.cc:927] Time spent T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 1.596s	user 0.016s	sys 0.004s
W20260709 13:14:35.200425  5470 log.cc:927] Time spent T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:14:35.199498  5480 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:35.131014  5467 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.235859  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:35.244498  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:35.250489  5467 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:35.253703  5462 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.257043  5089 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:35.260351  5089 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:35.264166   550 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:35.277884   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2207) took 1746 ms. Trace:
I20260709 13:14:35.278264   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:35.346455   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:35.347363   556 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:35.348562   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:35.352414  5448 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:35.354085  5476 log.cc:927] Time spent T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:14:35.359515   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2325) took 1024 ms. Trace:
I20260709 13:14:35.359943   557 rpcz_store.cc:276] 0709 13:14:34.335103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.763368 (+428265us) service_pool.cc:224] Handling call
0709 13:14:34.763645 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:34.765051 (+  1406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:34.765077 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:34.765531 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:14:34.980061 (+214530us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:34.980095 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:34.980164 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:35.359281 (+379117us) raft_consensus.cc:1685] finished
0709 13:14:35.359303 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:35.359457 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":214245,"threads_started":1,"wal-append.queue_time_us":283937}
I20260709 13:14:35.279277  5450 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:35.278271   555 rpcz_store.cc:276] 0709 13:14:33.531355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.531483 (+   128us) service_pool.cc:224] Handling call
0709 13:14:33.543379 (+ 11896us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:34.440692 (+897313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:35.277673 (+836981us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b54001531d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:35.277825 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1992326528}
I20260709 13:14:35.374135  5430 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:35.376080  5089 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.376726  5089 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:35.388752  5404 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.392727  5089 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:35.241113  5434 raft_consensus.cc:697] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:35.445533  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:35.490291   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 888) took 2005 ms. Trace:
W20260709 13:14:35.493953   477 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.025s	sys 0.086s
W20260709 13:14:35.497588   477 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.026s	sys 0.086s
I20260709 13:14:35.490928   479 rpcz_store.cc:276] 0709 13:14:33.412143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.412345 (+   202us) service_pool.cc:224] Handling call
0709 13:14:33.460648 (+ 48303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:33.517622 (+ 56974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:33.517667 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:33.517720 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:33.517764 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:35.417231 (+1899467us) spinlock_profiling.cc:243] Waited 56.8 ms on lock 0x7b540027c9d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:35.417286 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:35.417425 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130528000}
I20260709 13:14:35.554491   484 raft_consensus.cc:1240] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 14. Current term is 15. Ops: []
W20260709 13:14:35.560359   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:35.487633  5209 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:35.568910  5209 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.572348  5434 consensus_queue.cc:237] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.576438   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 2146) took 1637 ms. Trace:
I20260709 13:14:35.576885   629 rpcz_store.cc:276] 0709 13:14:33.938566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.043805 (+105239us) service_pool.cc:224] Handling call
0709 13:14:34.044072 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:34.309414 (+265342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:34.309445 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:34.309486 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:34.309518 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:35.576208 (+1266690us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54001612d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:35.576259 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:35.576381 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609757952}
I20260709 13:14:35.564654  5123 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.580931  5123 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:35.565567  5364 raft_consensus.cc:3055] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:35.581887  5364 raft_consensus.cc:740] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:35.582252  5379 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.242970  5480 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.582851  5364 consensus_queue.cc:260] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:35.583112   627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 2161) took 1452 ms. Trace:
I20260709 13:14:35.566588  5478 raft_consensus.cc:3055] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:35.583942  5364 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:35.584306  5478 raft_consensus.cc:740] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:35.585569  5480 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:35.585297  5478 consensus_queue.cc:260] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.586694  5462 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:35.586640  5478 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:35.562319  5485 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:35.588630  5485 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.568043  5186 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:35.549518  5127 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:35.595409  5480 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:35.571201  5209 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:35.583942   627 rpcz_store.cc:276] 0709 13:14:34.130638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.347493 (+216855us) service_pool.cc:224] Handling call
0709 13:14:34.347778 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:34.412840 (+ 65062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:34.412872 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:34.446925 (+ 34053us) log.cc:844] Serialized 26 byte log entry
0709 13:14:34.571470 (+124545us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:34.753342 (+181872us) log.cc:844] Serialized 14 byte log entry
0709 13:14:34.753565 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:35.582546 (+828981us) spinlock_profiling.cc:243] Waited 7.25 ms on lock 0x7b54000be5d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:35.582617 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:35.582690 (+    73us) raft_consensus.cc:1685] finished
0709 13:14:35.582805 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:35.583035 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35368,"prepare.queue_time_us":216433,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":2628,"raft.queue_time_us":57593,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":27395,"spinlock_wait_cycles":18539520,"thread_start_us":294808,"threads_started":2,"wal-append.queue_time_us":265876}
I20260709 13:14:35.596705  5480 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.598480  5298 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:14:35.610636  5399 log.cc:927] Time spent T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 1.933s	user 0.003s	sys 0.006s
I20260709 13:14:35.598246  5127 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.617970  5379 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 17 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:35.611850  5298 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:35.609941  5485 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:35.622562  5446 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:35.628677   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2327) took 1293 ms. Trace:
I20260709 13:14:35.629024   558 rpcz_store.cc:276] 0709 13:14:34.335781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.815753 (+479972us) service_pool.cc:224] Handling call
0709 13:14:34.816041 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:35.067291 (+251250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:35.628444 (+561153us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400388954. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:35.628617 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541520128}
I20260709 13:14:35.630491   558 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:14:35.624850  4968 consensus_meta.cc:287] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.004s
I20260709 13:14:35.635202  5480 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:35.635610   626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 2139) took 1701 ms (client timeout 2190 ms). Trace:
I20260709 13:14:35.635799  5404 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:35.636792  5481 log.cc:927] Time spent T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:14:35.637301  5127 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:35.637895  4968 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.640640   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2334) took 1102 ms. Trace:
I20260709 13:14:35.642386   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:35.642575   483 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 16.
W20260709 13:14:35.636026   626 rpcz_store.cc:269] 0709 13:14:33.934454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.934564 (+   110us) service_pool.cc:224] Handling call
0709 13:14:35.635419 (+1700855us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b54001e3054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:35.635539 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1478818176}
I20260709 13:14:35.643071   558 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:35.643499  4968 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:35.641991   552 rpcz_store.cc:276] 0709 13:14:34.537889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.083789 (+545900us) service_pool.cc:224] Handling call
0709 13:14:35.084113 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:35.090881 (+  6768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:35.090933 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:35.105401 (+ 14468us) log.cc:844] Serialized 26 byte log entry
0709 13:14:35.241133 (+135732us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:35.241179 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:35.241242 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:35.640434 (+399192us) raft_consensus.cc:1685] finished
0709 13:14:35.640454 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:35.640587 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3843,"raft.queue_time_us":94,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":10452,"thread_start_us":68010,"threads_started":1,"wal-append.queue_time_us":177281}
I20260709 13:14:35.644275   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:35.654374   558 raft_consensus.cc:2393] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 11: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
W20260709 13:14:35.644932  5427 log.cc:927] Time spent T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 1.411s	user 0.013s	sys 0.009s
I20260709 13:14:35.641459  5298 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:35.663352   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:35.627506  5446 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:35.667505  5446 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:35.667680  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:35.668576   626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:14:35.669158   626 raft_consensus.cc:606] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:35.669498   626 raft_consensus.cc:614] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:35.671662  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:35.672410  1175 raft_consensus.cc:2368] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 16. Current term is 17.
I20260709 13:14:35.674182   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:35.678725   448 leader_election.cc:400] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 election: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 16. Current term is 17.
I20260709 13:14:35.732111   448 leader_election.cc:403] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:14:35.732596   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 54083.1us
I20260709 13:14:35.733767   448 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:35.734576  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:35.680953  5389 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.683672  4995 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:35.684345   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 2281) took 1687 ms. Trace:
I20260709 13:14:35.688467   551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2202) took 2191 ms. Trace:
I20260709 13:14:35.693569   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2337) took 1106 ms. Trace:
I20260709 13:14:35.696072   632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 2150) took 1609 ms. Trace:
I20260709 13:14:35.696472   599 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:35.703748   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:35.705536   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:35.706525  5488 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:35.738132   632 rpcz_store.cc:276] 0709 13:14:34.086791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.341216 (+254425us) service_pool.cc:224] Handling call
0709 13:14:34.341486 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:34.483159 (+141673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:35.695811 (+1212652us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54001aefd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:35.696006 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323924736}
I20260709 13:14:35.707145  5404 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:35.750545  5404 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:35.707772  5417 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.751123  5103 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:35.751485  5417 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:35.752748   447 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:35.707721   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2219) took 1519 ms. Trace:
I20260709 13:14:35.753532   554 rpcz_store.cc:276] 0709 13:14:34.184007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.184690 (+   683us) service_pool.cc:224] Handling call
0709 13:14:34.198658 (+ 13968us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:34.260534 (+ 61876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:34.260580 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:34.260638 (+    58us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:14:34.260673 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:35.703039 (+1442366us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b5400386b54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:35.703085 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:35.703206 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141733632}
I20260709 13:14:35.754463   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:35.754904   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:35.755676   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:35.755967   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:35.756362   482 raft_consensus.cc:2368] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 14. Current term is 15.
I20260709 13:14:35.756485   554 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:14:35.709532   478 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 2292) took 1370 ms (client timeout 1642 ms). Trace:
I20260709 13:14:35.712458  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:35.757565   478 rpcz_store.cc:269] 0709 13:14:34.339436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.424432 (+ 84996us) service_pool.cc:224] Handling call
0709 13:14:35.709346 (+1284914us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54002b2354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:35.709455 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377378176}
I20260709 13:14:35.713569  1173 raft_consensus.cc:1240] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:35.757102   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:35.714385  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:35.715905  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:35.716373  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:35.716814  5384 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.763566  5417 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:35.763464  5384 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:35.765435  5404 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:35.765821  5384 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:35.737994   551 rpcz_store.cc:276] 0709 13:14:33.496968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.497143 (+   175us) service_pool.cc:224] Handling call
0709 13:14:33.518623 (+ 21480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:33.907959 (+389336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:33.907990 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:33.982573 (+ 74583us) log.cc:844] Serialized 26 byte log entry
0709 13:14:34.077049 (+ 94476us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:34.077083 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:35.688043 (+1610960us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b540002add4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:35.688101 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:35.688148 (+    47us) raft_consensus.cc:1685] finished
0709 13:14:35.688161 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:35.688389 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100900,"raft.queue_time_us":212384,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":6657,"spinlock_wait_cycles":363397888,"thread_start_us":74633,"threads_started":2,"wal-append.queue_time_us":190917,"wal-append.run_cpu_time_us":4898,"wal-append.run_wall_time_us":1353277}
I20260709 13:14:35.767164   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:35.768430   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:35.770013   480 raft_consensus.cc:2410] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:14:35.770403  5446 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.770905  5446 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:35.769503   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:35.718571  5433 log.cc:927] Time spent T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 1.440s	user 0.007s	sys 0.008s
I20260709 13:14:35.718497  5457 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:35.774780  5457 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.777181  5457 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:35.719798  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:35.722039   553 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:35.779345   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:35.780361   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:35.780788   554 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 17.
I20260709 13:14:35.781030   553 raft_consensus.cc:2393] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 15: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:35.782241   553 raft_consensus.cc:1275] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:35.782519   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:35.723603   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:35.724540   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:35.726593   523 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:35.790027   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 63602.1us
I20260709 13:14:35.791374   523 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:35.792876  5425 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:35.793099  5440 raft_consensus.cc:3055] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:35.793295  5425 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:35.793632  5440 raft_consensus.cc:740] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:35.793843  5425 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:35.799365   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:35.800086   482 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 10.
I20260709 13:14:35.801069   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:35.728263  5396 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:35.809254  5396 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:35.809434  5448 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:35.729463  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:35.735976   558 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:14:35.738062   550 rpcz_store.cc:276] 0709 13:14:34.586955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.202989 (+616034us) service_pool.cc:224] Handling call
0709 13:14:35.223523 (+ 20534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:35.264767 (+ 41244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:35.693316 (+428549us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b5400387054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:35.693509 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92867840}
I20260709 13:14:35.741196   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:35.744904   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:35.745187  5395 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:35.737159  5389 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:35.745612   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:35.810971   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 58295.2us
I20260709 13:14:35.737891   481 rpcz_store.cc:276] 0709 13:14:33.997449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.997565 (+   116us) service_pool.cc:224] Handling call
0709 13:14:34.015617 (+ 18052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:34.032756 (+ 17139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:34.032786 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:34.041715 (+  8929us) log.cc:844] Serialized 26 byte log entry
0709 13:14:35.552012 (+1510297us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b180031f0c0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b652fa2a6 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9
0709 13:14:35.643848 (+ 91836us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b180031f0c0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb90d1 00007f4b683d4a0f
0709 13:14:35.683448 (+ 39600us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:35.683496 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:35.684050 (+   554us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:35.684115 (+    65us) raft_consensus.cc:1685] finished
0709 13:14:35.684135 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:35.684284 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14250,"raft.queue_time_us":49430,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":6430,"spinlock_wait_cycles":34940544,"thread_start_us":39411,"threads_started":1,"wal-append.queue_time_us":1609289}
I20260709 13:14:35.811853   476 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:35.823745   447 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:35.824735   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:35.824867   447 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:35.737426  5364 raft_consensus.cc:3060] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:35.746502   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:35.746830   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:35.740267  5298 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:35.747478  5478 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:35.749325  5488 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:35.759761   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:35.714248  1172 raft_consensus.cc:3060] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:35.760749   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:35.761349   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:35.842397   477 raft_consensus.cc:2410] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:14:35.842698   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 82656.7us
I20260709 13:14:35.843508   447 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:35.845330   447 leader_election.cc:400] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14.
I20260709 13:14:35.846303   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:35.846488   447 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:35.762830  5469 raft_consensus.cc:3055] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:35.851177   478 raft_consensus.cc:2393] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 15: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:35.801568  5446 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:35.794646  5440 consensus_queue.cc:260] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.805262   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:35.807389   553 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:35.807533   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:35.856828   448 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:35.857340   475 raft_consensus.cc:2410] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 15 because replica has last-logged OpId of term: 14 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:14:35.857223   599 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:35.727448   597 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:35.745929  5307 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.827405   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:35.829362   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:35.856796   447 leader_election.cc:400] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11.
I20260709 13:14:35.847045   627 raft_consensus.cc:2368] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 14. Current term is 15.
I20260709 13:14:35.848584   629 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:35.860221   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:35.848937   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:35.852283  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:35.861135   625 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:35.862039   626 raft_consensus.cc:1240] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:14:35.852224   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:35.863832   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:35.864248   624 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 10.
I20260709 13:14:35.852334   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:35.864758   630 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:35.865283   477 raft_consensus.cc:2393] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 12: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:35.865803   599 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:35.859216   447 leader_election.cc:403] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:14:35.860440   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:35.870638   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:35.872213  1141 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:35.872959   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 145563us
I20260709 13:14:35.831645  5404 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:35.937546  1172 raft_consensus.cc:1275] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:35.878289   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:35.867558   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:35.830600  5395 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:35.869985  5307 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:35.850495  5469 raft_consensus.cc:740] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:35.862839  5457 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:35.825502  5425 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:35.930801   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 65066us
W20260709 13:14:35.931514   480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 2138) took 1754 ms (client timeout 2100 ms). Trace:
W20260709 13:14:35.931821  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 59688.9us
I20260709 13:14:35.959259   599 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:35.959681  1141 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:35.854657  1139 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:14:35.960435  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 105859us
I20260709 13:14:35.960987  4926 raft_consensus.cc:2804] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:35.961484  4926 raft_consensus.cc:697] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:35.962162   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:35.962296  4926 consensus_queue.cc:237] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:35.932142   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 75485.4us
I20260709 13:14:35.898789  5419 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:35.880149  5037 consensus_queue.cc:1059] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:14:35.964327  5037 raft_consensus.cc:3055] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:35.964708  5037 raft_consensus.cc:740] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:35.964938  5446 consensus_queue.cc:1059] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:35.965616  5037 consensus_queue.cc:260] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.966461  5446 raft_consensus.cc:3055] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:35.966893  5446 raft_consensus.cc:740] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:35.936081   478 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:14:35.987653   478 pending_rounds.cc:85] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 8
I20260709 13:14:35.988010   478 pending_rounds.cc:107] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:14:35.988318   478 raft_consensus.cc:2889] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:35.862092  5448 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:35.869338  5417 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:35.855125  5103 raft_consensus.cc:2804] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:35.830404  5298 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:35.897027  5429 consensus_queue.cc:1048] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:35.895390  5438 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:35.939383   479 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:36.017082   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:36.017387  5298 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:36.018400   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:36.019532   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:36.020546   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:36.021590   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:36.021793   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:36.023031   627 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:14:36.017414   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:35.967149  5037 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:36.024893   624 raft_consensus.cc:1275] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:14:35.967911   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 100456us
W20260709 13:14:35.943653  5410 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.666s	user 0.030s	sys 0.041s
I20260709 13:14:35.967936  5469 consensus_queue.cc:260] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:35.869818  5377 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:36.047832  5377 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:36.048302  5377 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:36.048704   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:36.049166   381 catalog_manager.cc:5697] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:35.971361   597 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:35.976907  1139 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:35.977468  5389 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:36.068065   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:36.069402  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 92580.5us
I20260709 13:14:35.977586  5307 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:35.978144  5133 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:35.978569   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:35.952527  5478 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:35.952514  5434 consensus_queue.cc:1059] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:14:35.937346  5379 consensus_queue.cc:1059] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:14:35.937613  5176 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 10. Current term is 11.
W20260709 13:14:35.958938   480 rpcz_store.cc:269] 0709 13:14:34.176706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.460706 (+284000us) service_pool.cc:224] Handling call
0709 13:14:35.899424 (+1438718us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400184054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:35.931444 (+ 32020us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2940967168}
I20260709 13:14:35.993024   599 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:35.941032  5385 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:36.000156  5425 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:36.000739  5480 consensus_queue.cc:1059] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:36.002254  5208 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:36.005669   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:36.108150   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:36.108904   626 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:36.006871   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:36.007540   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:36.023387   630 raft_consensus.cc:1275] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:14:35.968428  5414 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:36.032310   556 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:36.003309  5103 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:36.032708   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:36.032910   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:36.034252   378 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46008 (request call id 262) took 22213 ms (client timeout 15000 ms). Trace:
I20260709 13:14:36.037223  5488 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:36.052891   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 81643.6us
I20260709 13:14:36.054687   627 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:14:36.068005  5438 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:36.068171  5440 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:36.071254   625 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
W20260709 13:14:36.073262   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 214926us
I20260709 13:14:36.037223  5448 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:36.046381  5410 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.780s	user 0.030s	sys 0.041s
I20260709 13:14:36.082113   523 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:36.088514   522 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:36.078974  5317 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:36.105798   478 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:14:36.105638  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:36.115670   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:36.139834   479 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 10.
I20260709 13:14:36.141435   479 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:14:36.115991   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 123037us
I20260709 13:14:36.120003   626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:14:36.144050   626 raft_consensus.cc:606] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:36.144531   626 raft_consensus.cc:614] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:36.121032   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.127305  1138 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:36.134851   625 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:36.146908   625 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:14:36.148376   625 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:14:36.151927   625 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:36.136524   476 raft_consensus.cc:1275] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:14:36.137106   597 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:36.134984   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 52984us
W20260709 13:14:36.135015   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 46619us
I20260709 13:14:36.089740  5291 consensus_queue.cc:1059] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:14:36.119972  5103 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:36.167941   599 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:36.165572   628 raft_consensus.cc:1275] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:36.172864   478 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:14:36.178584   522 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:36.179020   478 pending_rounds.cc:85] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 8
I20260709 13:14:36.179308   478 pending_rounds.cc:107] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:14:36.179586   478 raft_consensus.cc:2889] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:36.179512   525 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:36.182549   599 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:36.184027   599 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:36.118762  5385 raft_consensus.cc:697] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:14:36.190222  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 47314us
I20260709 13:14:36.128319  5438 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:36.128559  5489 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:14:36.192147  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 64937.7us
I20260709 13:14:36.196497   525 leader_election.cc:400] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 14. Current term is 15.
I20260709 13:14:36.138334  5410 raft_consensus.cc:697] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:36.160216  5127 raft_consensus.cc:3055] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:36.138070  5317 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.196115   522 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:36.185882  5451 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:36.135478  5322 raft_consensus.cc:3055] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:36.160897  5425 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:36.202845   525 leader_election.cc:403] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:36.185432  5082 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:14:36.165796  5434 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:14:36.200400  5496 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:36.207437  5379 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:36.216178   478 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:36.170825  5328 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:36.239559   633 raft_consensus.cc:1240] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:36.185905  5388 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:36.193413  5208 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:36.188707  5364 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 16. Current term is 17.
I20260709 13:14:36.201396   558 raft_consensus.cc:1275] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:36.202517  5438 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:36.259624  5410 consensus_queue.cc:237] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:36.164906  4853 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:14:36.203389  5347 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:14:36.243453  5317 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:36.224107  5127 raft_consensus.cc:740] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:36.255031  5322 raft_consensus.cc:740] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:36.287014  5425 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:36.262342  5211 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.263463  5478 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:36.203655  5457 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:14:36.287449  5082 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 14. Current term is 15.
I20260709 13:14:36.191427  5448 consensus_queue.cc:1059] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 13:14:36.314429   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 130485us
W20260709 13:14:36.330895   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 134481us
I20260709 13:14:36.280228  5298 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:36.117623   378 rpcz_store.cc:269] 0709 13:14:13.821343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:13.822730 (+  1387us) service_pool.cc:224] Handling call
0709 13:14:36.034034 (+22211304us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:30.761101 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:30.770524 (+  9423us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:30.770558 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:14:30.770576 (+    18us) tablet.cc:662] Decoding operations
0709 13:14:30.773412 (+  2836us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:30.773499 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:30.773525 (+    26us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:14:30.916579 (+143054us) tablet.cc:701] Row locks acquired
0709 13:14:30.916599 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:14:30.916748 (+   149us) write_op.cc:270] Start()
0709 13:14:30.916862 (+   114us) write_op.cc:276] Timestamp: P: 1783602870916701 usec, L: 0
0709 13:14:30.916885 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:14:30.917888 (+  1003us) log.cc:844] Serialized 11099 byte log entry
0709 13:14:31.624438 (+706550us) op_driver.cc:464] REPLICATION: finished
0709 13:14:31.634026 (+  9588us) write_op.cc:301] APPLY: starting
0709 13:14:31.634089 (+    63us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:32.016659 (+382570us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:32.016839 (+   180us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:33.292202 (+1275363us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:33.292615 (+   413us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=0,mrs_lookups=0
0709 13:14:33.292671 (+    56us) write_op.cc:312] APPLY: finished
0709 13:14:33.293332 (+   661us) log.cc:844] Serialized 244 byte log entry
0709 13:14:33.518175 (+224843us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:33.914111 (+395936us) write_op.cc:454] Released schema lock
0709 13:14:33.939351 (+ 25240us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:33.939858 (+   507us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:33.939888 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":68793,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":9348,"apply.run_cpu_time_us":88064,"apply.run_wall_time_us":2305764,"cfile_cache_hit":114,"cfile_cache_hit_bytes":121279,"num_ops":28,"prepare.queue_time_us":74440,"prepare.run_cpu_time_us":64786,"prepare.run_wall_time_us":384630,"raft.queue_time_us":231785,"raft.run_cpu_time_us":8165,"raft.run_wall_time_us":9673,"replication_time_us":707365,"thread_start_us":625351,"threads_started":5,"wal-append.queue_time_us":649650,"wal-append.run_cpu_time_us":59245,"wal-append.run_wall_time_us":2799667}]]}
I20260709 13:14:36.315294  5480 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:36.353470   599 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:36.355051   525 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:36.356397   483 raft_consensus.cc:2468] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 17.
I20260709 13:14:36.357606   525 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:36.342108  5425 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:36.346763  5211 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:36.360733  5211 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:36.358980  5425 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:36.366411   599 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:36.368288   525 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:36.370304  5384 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:36.369779   599 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:36.371984   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 234954us
I20260709 13:14:36.375197   525 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:36.372004  5478 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:36.378568   599 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:36.380910   599 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:36.364351  5480 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:36.396667   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:36.341502  5377 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:36.367648  5328 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:36.377096  5457 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:36.405755   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:36.408407   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 212348us
I20260709 13:14:36.419646   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:36.372500  5082 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:36.381639  5208 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:14:36.453785   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 78648.6us
I20260709 13:14:36.452101   556 raft_consensus.cc:1275] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:14:36.451391   558 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:36.337131  5385 consensus_queue.cc:237] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:36.421146   478 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:36.462235   525 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:36.464020   476 raft_consensus.cc:1240] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:36.400173  5480 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:36.377315  5485 consensus_queue.cc:1059] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:14:36.467998   525 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:36.459856  5396 consensus_meta.cc:287] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.650s	user 0.010s	sys 0.001s
I20260709 13:14:36.451659  5478 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:36.423964  5388 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:36.424189  5384 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:36.459533  5364 consensus_queue.cc:1048] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:14:36.482813  1172 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:14:36.485435   478 raft_consensus.cc:1240] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:36.479851  5396 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:36.525115   478 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:36.526047   550 raft_consensus.cc:2393] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 17: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:36.529680   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:36.531050  5396 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 17 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:36.532323  5396 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.479368  5388 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:36.467710  5328 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:36.460224  4853 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:14:36.463299  5519 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:36.470873  5513 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.476236  5478 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:36.451577  5082 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:36.477084  5208 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:36.470706  5451 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:14:36.390755  5127 consensus_queue.cc:260] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:36.422065  5322 consensus_queue.cc:260] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:36.543531  5388 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:36.543808  5396 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:36.592908   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:36.562573  5510 log.cc:927] Time spent T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:14:36.558765  5513 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:36.563356   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:36.567862  5512 log.cc:927] Time spent T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:14:36.474929  5089 consensus_queue.cc:1059] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 13:14:36.555104  5478 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:36.581681  5517 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:36.539366  5382 consensus_queue.cc:1048] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:14:36.583923  5446 consensus_queue.cc:260] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:36.558964  5082 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:36.518236  5384 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:36.558699  5208 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:36.587602  5127 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:36.589808  5469 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:36.590509  5503 log.cc:927] Time spent T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 13:14:36.594543   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:36.545336  5514 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.611788   554 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:36.613570   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:36.557902  5496 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:14:36.626050  5515 log.cc:927] Time spent T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:14:36.626399  5513 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:36.612331  5417 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.627550  5298 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:36.644236  5396 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:36.644430  5448 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:36.644158  5496 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:36.677351   447 leader_election.cc:400] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 14. Current term is 15.
I20260709 13:14:36.677810   447 leader_election.cc:403] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:36.680368   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:36.674336   525 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:36.695729   522 leader_election.cc:304] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:36.660765  5377 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:36.716581   554 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:14:36.647406  5514 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:36.723021   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.677006  5347 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.674793  5496 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:36.655299  5417 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:36.733707   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:36.734292   625 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:36.684118  5517 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:36.732116   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:36.733022   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:36.736758   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:36.737336   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:36.762758   627 raft_consensus.cc:1275] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:36.738399   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:36.762658   599 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:36.765674   628 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:36.714071  5396 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:14:36.729400  5451 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:36.722734  5424 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 14. Current term is 15.
I20260709 13:14:36.673811  5448 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:36.776129   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 95880.8us
I20260709 13:14:36.795022   597 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:36.777561   599 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:36.779685  5523 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:36.780435  5522 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:14:36.775437  5485 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.686776  5526 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:14:36.724905  4853 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:14:36.765235   625 raft_consensus.cc:1275] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:36.793361   628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:14:36.727563   447 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:36.735889  5347 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:36.824302   628 raft_consensus.cc:606] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:36.825016   628 raft_consensus.cc:614] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:36.825801   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 98409.4us
I20260709 13:14:36.827268   447 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:36.829131   447 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:36.767055  5410 consensus_queue.cc:1048] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:14:36.788846  5528 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:36.833352   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:36.835115   447 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:36.820883  5440 consensus_meta.cc:287] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.002s
I20260709 13:14:36.840307   447 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:36.800098  5385 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:36.821516  5527 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:36.846520   482 raft_consensus.cc:2410] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:14:36.851912   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 48537.8us
I20260709 13:14:36.825027  5089 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.792228  5517 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:14:36.836216  5377 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:36.869405   447 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:36.837246  5424 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:36.836654  5539 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:36.844770  5298 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:36.820580  5516 consensus_queue.cc:1059] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:14:36.853828  5527 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.879877   484 raft_consensus.cc:1240] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:36.831033  5485 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:36.884014   628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:14:36.873422  5424 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.884817   628 raft_consensus.cc:606] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:36.867458  5384 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:36.830847  5533 consensus_queue.cc:1059] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:14:36.870098  5528 consensus_queue.cc:1059] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:14:36.890246  5530 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.876148  5539 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.873812  5440 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:36.883193  5052 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.892848 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:36.871301  5089 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:36.884521  5527 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:36.922164 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:14:36.896651   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 172387us
W20260709 13:14:36.927836  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.886987  5424 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:36.902868   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 102101us
I20260709 13:14:36.892385  5396 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:36.930143   597 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:36.892617  5516 raft_consensus.cc:3055] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:36.894881  5540 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:36.937937  1172 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:14:36.938812   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 211306us
I20260709 13:14:36.939334   597 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:36.914171  5377 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.933676   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:36.895156  5539 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:36.925804  5052 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:36.953884  5417 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:36.895152  5530 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:36.957427  5089 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:36.958122  5052 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:36.958614  5425 consensus_meta.cc:287] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.002s
I20260709 13:14:36.958796  5530 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:36.956220  5448 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:36.961926  5547 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:14:36.959802  5538 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:36.941905  5549 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:36.960749  5410 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:14:36.946175  5377 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:36.959066  5425 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:36.967406  5518 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:14:36.969595  5377 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:36.969595  5425 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:36.975980  5537 log.cc:927] Time spent T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:14:36.980024   484 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:36.938539  5516 raft_consensus.cc:740] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:36.982347  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:36.963464  5526 consensus_queue.cc:1048] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 13:14:36.953527   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 80485.7us
I20260709 13:14:36.953758  5444 raft_consensus.cc:3055] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:36.954679  5514 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:36.942062  5534 consensus_queue.cc:1059] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:14:36.986428  5444 raft_consensus.cc:740] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:36.987983  5444 consensus_queue.cc:260] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:36.988992  5444 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:36.992916  5526 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.993436  5526 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:36.988251  5395 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:37.002215  5506 log.cc:927] Time spent T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.687s	user 0.002s	sys 0.000s
I20260709 13:14:36.982993  5516 consensus_queue.cc:260] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.004473  5525 raft_consensus.cc:3055] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:37.005002  5525 raft_consensus.cc:740] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:37.005929  5525 consensus_queue.cc:260] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:37.007354  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.008244  5525 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:36.967469  5457 consensus_meta.cc:287] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.544s	user 0.005s	sys 0.006s
I20260709 13:14:37.009912  5457 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:14:37.011478   552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2239) took 1287 ms (client timeout 1517 ms). Trace:
W20260709 13:14:37.009280  5505 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.706s	user 0.002s	sys 0.000s
I20260709 13:14:37.032660   557 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:37.044085   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 2147) took 1296 ms. Trace:
W20260709 13:14:37.066112   552 rpcz_store.cc:269] 0709 13:14:35.723804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.746276 (+ 22472us) service_pool.cc:224] Handling call
0709 13:14:37.011186 (+1264910us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b54002008d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:37.011386 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2102781184}
I20260709 13:14:37.039965   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:37.069619   480 raft_consensus.cc:1275] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:14:37.024578   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:37.070783   550 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:37.020109   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 915) took 1244 ms. Trace:
I20260709 13:14:37.068064   482 rpcz_store.cc:276] 0709 13:14:35.747645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.800804 (+ 53159us) service_pool.cc:224] Handling call
0709 13:14:37.043806 (+1243002us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000d57d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:37.044008 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2384577408}
I20260709 13:14:37.040007   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:37.073314   448 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:37.006611  5317 consensus_meta.cc:287] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.663s	user 0.005s	sys 0.002s
W20260709 13:14:37.025527  5103 consensus_meta.cc:287] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.832s	user 0.002s	sys 0.007s
I20260709 13:14:36.978228  5485 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:37.071435   476 rpcz_store.cc:276] 0709 13:14:35.775669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.161254 (+385585us) service_pool.cc:224] Handling call
0709 13:14:36.196812 (+ 35558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:36.468079 (+271267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.019859 (+551780us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400187c54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:37.020047 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609941376}
I20260709 13:14:37.072312   630 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 14.
I20260709 13:14:37.085624   556 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:37.081593   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:36.994421  5208 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.015159  5451 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:37.071863  5438 consensus_meta.cc:287] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.747s	user 0.011s	sys 0.000s
I20260709 13:14:37.034446  5389 raft_consensus.cc:3055] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:14:37.075757  5542 log.cc:927] Time spent T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:14:37.024251  5384 raft_consensus.cc:3055] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:14:37.076452  5480 consensus_meta.cc:287] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.005s
I20260709 13:14:37.026660  5347 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:37.042050  5082 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.076210  5489 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.076732  5523 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:37.094451   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:37.099784   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 112449us
I20260709 13:14:37.099397   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:37.025843  5541 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:14:37.103168   447 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:37.126528   447 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:37.100566  1138 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:37.127270   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:37.109030  5539 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.110358   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:37.111685  5526 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:37.112401  5082 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:37.101099  5429 raft_consensus.cc:2804] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:37.132756   482 raft_consensus.cc:1240] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:37.101339  5480 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.099181  5384 raft_consensus.cc:740] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:37.097651  5389 raft_consensus.cc:740] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:37.116503  5208 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:37.122270   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:37.123523   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 2152) took 1374 ms. Trace:
I20260709 13:14:37.127802   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:37.129230   447 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:37.099010  5438 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.112901   558 raft_consensus.cc:1240] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:37.133960   629 raft_consensus.cc:1240] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:37.080328  5388 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.140848   481 rpcz_store.cc:276] 0709 13:14:35.748829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.850093 (+101264us) service_pool.cc:224] Handling call
0709 13:14:35.878352 (+ 28259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:35.878809 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:35.878854 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:35.923977 (+ 45123us) log.cc:844] Serialized 26 byte log entry
0709 13:14:36.118769 (+194792us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:36.295984 (+177215us) log.cc:844] Serialized 14 byte log entry
0709 13:14:36.297992 (+  2008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.298063 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:36.993240 (+695177us) spinlock_profiling.cc:243] Waited 8.18 ms on lock 0x7b1800378100. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6532c3f3 00007f4b6532e7c1 00007f4b6532e779 00007f4b6532e709 00007f4b6532e6d1 00007f4b6532d9cd 000000000038f354 000000000038f199 00007f4b6530f83a
0709 13:14:37.008567 (+ 15327us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:37.123306 (+114739us) raft_consensus.cc:1685] finished
0709 13:14:37.123330 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:37.123461 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128747,"prepare.queue_time_us":184112,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":6947,"raft.queue_time_us":15711,"raft.run_cpu_time_us":5427,"raft.run_wall_time_us":52809,"spinlock_wait_cycles":110036352,"thread_start_us":261582,"threads_started":2,"wal-append.queue_time_us":227732}
I20260709 13:14:37.077431  5540 raft_consensus.cc:697] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:37.147145   551 raft_consensus.cc:1240] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:37.147418  5384 consensus_queue.cc:260] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.147835  5496 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.136166  5377 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:37.167582   553 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:37.168399   476 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:37.161698  5488 consensus_queue.cc:1048] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:14:37.150159   550 raft_consensus.cc:1240] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:37.171135   555 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:37.171367   550 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:37.150074  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:37.150502  5480 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:37.172541   550 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:14:37.168220  5501 log.cc:927] Time spent T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.875s	user 0.000s	sys 0.001s
I20260709 13:14:37.153482   552 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:37.147162   482 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:37.089255  5103 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.156342   447 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:37.152565   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 192314us
I20260709 13:14:37.131943  5417 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:37.127460  5489 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.165071  5388 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:37.167069  5496 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:37.148939  5438 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:37.168275  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:37.150411  5539 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:37.085289  5317 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.154583  5382 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.148878  5429 raft_consensus.cc:697] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:36.930851  5396 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:37.162300  5478 consensus_meta.cc:287] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.000s
I20260709 13:14:37.093537  5548 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:14:37.192140   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:37.193121   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:37.159013  4995 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:37.183472   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 110265us
I20260709 13:14:37.201200   448 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:37.197095   632 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:14:37.187569   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:37.194205   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:37.195050   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:37.203660   627 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:37.195302   479 raft_consensus.cc:1240] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:37.193935   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:37.205863   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:37.206578   631 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:37.208160  1167 raft_consensus.cc:1240] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:37.213361   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:37.214901   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:37.216499   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:37.217245  5540 consensus_queue.cc:237] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.216817   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 2155) took 1467 ms. Trace:
I20260709 13:14:37.219225   631 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 11.
I20260709 13:14:37.218468   477 rpcz_store.cc:276] 0709 13:14:35.749814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.911347 (+161533us) service_pool.cc:224] Handling call
0709 13:14:35.936073 (+ 24726us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:35.966879 (+ 30806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:35.966928 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:35.967397 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:14:36.153756 (+186359us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:36.328260 (+174504us) log.cc:844] Serialized 14 byte log entry
0709 13:14:36.328733 (+   473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.328818 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:37.167635 (+838817us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:37.191003 (+ 23368us) raft_consensus.cc:1685] finished
0709 13:14:37.216627 (+ 25624us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:37.216762 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17146,"prepare.queue_time_us":189934,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":21808,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":8940,"spinlock_wait_cycles":109034368,"thread_start_us":314155,"threads_started":2,"wal-append.queue_time_us":236045}
I20260709 13:14:37.221721   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:37.216229   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:37.223809   476 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:37.226943  4995 consensus_queue.cc:1059] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:37.228327  5557 raft_consensus.cc:3055] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:37.228792  5557 raft_consensus.cc:740] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:37.229832  5557 consensus_queue.cc:260] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.231794  5557 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:37.233047  5396 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:37.233970  5089 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:37.239470  5176 consensus_queue.cc:1059] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:37.191356  5382 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.245909  5382 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:14:37.247071   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:37.248837  5489 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:37.249959  5429 consensus_queue.cc:237] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.151119  5389 consensus_queue.cc:260] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:37.254568   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.254828  5389 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:37.255275  5322 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:37.261253  5103 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:37.261606  4926 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:37.262228  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:37.262148  4926 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.205724  5539 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:37.263820  1173 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:14:37.263671  5539 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.264878  4926 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:37.265664  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:37.266709   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 911) took 1492 ms. Trace:
I20260709 13:14:37.182200  5417 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.292743  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:37.281903  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:37.201604   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.270663   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:37.184708  5384 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:37.183269  5448 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:37.293918   448 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:37.267421   483 rpcz_store.cc:276] 0709 13:14:35.774288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.824512 (+ 50224us) service_pool.cc:224] Handling call
0709 13:14:37.266528 (+1442016us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54002ddf54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:37.266643 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140866944}
I20260709 13:14:37.280503   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:37.301877   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 361259us
I20260709 13:14:37.305033  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:37.265733  5539 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:37.208036  5469 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:14:37.311403   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.205587  5440 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.263049  5317 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:37.310125   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:37.293341  5417 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:37.296680   553 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:37.194922  5488 consensus_queue.cc:1048] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 13:14:37.300936  5448 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:37.395113   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 79122.5us
W20260709 13:14:37.423024  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.454067   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:37.184907  5424 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.205780  5478 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:37.458614   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:37.517861   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.460420   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:37.519429   550 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 12: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:37.308248  5176 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:37.520663   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:37.563797   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 231870us
I20260709 13:14:37.565205   525 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:37.565279   447 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:37.566862   447 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:37.574313   447 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:37.578150   481 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:37.456255  5448 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:37.582958   525 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:37.517218  4926 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.460457  5434 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:37.333138  5103 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.257s
I20260709 13:14:37.331847  5440 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:37.591564   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.589323   447 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:37.563740  5037 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:37.590657   525 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:37.580394  5429 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:14:37.597978   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.584631  5377 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:37.590165  5451 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:37.570660  5176 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.597002  5526 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:37.592044  4926 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:37.612193   448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.596884  5429 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.597543  5546 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:37.598165  5543 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:14:37.626626   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.596951  5037 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.632236  5037 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:37.632460  4926 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:37.632933  5550 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:37.633306   480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 2161) took 1881 ms. Trace:
I20260709 13:14:37.633670   480 rpcz_store.cc:276] 0709 13:14:35.751455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.091382 (+339927us) service_pool.cc:224] Handling call
0709 13:14:36.091738 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.070087 (+978349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.633076 (+562989us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b540027bad4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:37.633248 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2190408576}
I20260709 13:14:37.592252  5434 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.592996  5539 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:14:37.634902   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:37.615583  5526 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.646024  5526 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:37.616173  5565 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:37.628526  5429 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:37.639487  5546 raft_consensus.cc:697] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:37.666867   480 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:37.672183   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:37.660247  5565 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.677394  5478 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:37.677654   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:37.678751   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:37.681381   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:37.711906  5499 log.cc:927] Time spent T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 1.398s	user 0.003s	sys 0.005s
W20260709 13:14:37.718214  5559 log.cc:927] Time spent T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.132s	user 0.003s	sys 0.000s
I20260709 13:14:37.722707   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 2156) took 1972 ms. Trace:
I20260709 13:14:37.723296   475 rpcz_store.cc:276] 0709 13:14:35.750088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.883043 (+132955us) service_pool.cc:224] Handling call
0709 13:14:35.953066 (+ 70023us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:35.990756 (+ 37690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:35.990819 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:35.996461 (+  5642us) log.cc:844] Serialized 26 byte log entry
0709 13:14:36.152706 (+156245us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:36.152756 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.722137 (+1569381us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b54002de454. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:37.722203 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:37.722268 (+    65us) raft_consensus.cc:1685] finished
0709 13:14:37.722288 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:37.722622 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9390,"raft.queue_time_us":10310,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":7286,"spinlock_wait_cycles":63940864,"thread_start_us":155891,"threads_started":1,"wal-append.queue_time_us":307213}
I20260709 13:14:37.726166  5565 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:37.725917   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:37.737479   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.699481  5478 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:37.739946   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:37.742761   475 raft_consensus.cc:2410] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:14:37.701264  5424 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:37.736734  5552 log.cc:927] Time spent T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:14:37.744552   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:37.751693  5564 log.cc:927] Time spent T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:14:37.751906  5535 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.651s	user 0.004s	sys 0.003s
I20260709 13:14:37.752951   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:37.753772   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2347) took 1161 ms. Trace:
I20260709 13:14:37.753575   475 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:37.754109   557 rpcz_store.cc:276] 0709 13:14:36.591862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.593870 (+  2008us) service_pool.cc:224] Handling call
0709 13:14:37.032431 (+438561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.073136 (+ 40705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.753590 (+680454us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b540034d850. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:37.753719 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007706880}
I20260709 13:14:37.754779   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:37.760450   553 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:14:37.764909  5446 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:37.770354   525 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:37.771898  5451 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:37.772449   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:37.773118   625 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:14:37.773373   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:37.774360   629 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 12: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:37.774617   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:37.775504  5543 consensus_queue.cc:1048] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:37.775804   627 raft_consensus.cc:1240] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:37.777483  5543 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:37.778113  5543 raft_consensus.cc:697] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:37.782533  5389 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:37.783259  5389 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.754127   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 2126) took 1286 ms. Trace:
I20260709 13:14:37.784195   626 rpcz_store.cc:276] 0709 13:14:36.467486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.467603 (+   117us) service_pool.cc:224] Handling call
0709 13:14:36.467894 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:36.560572 (+ 92678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:36.560611 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:36.563433 (+  2822us) log.cc:844] Serialized 26 byte log entry
0709 13:14:36.685111 (+121678us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:36.685152 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.685218 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:37.751367 (+1066149us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:37.753846 (+  2479us) raft_consensus.cc:1685] finished
0709 13:14:37.753871 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:37.754068 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5990,"raft.queue_time_us":180159,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":8112,"spinlock_wait_cycles":45389184,"thread_start_us":208241,"threads_started":2,"wal-append.queue_time_us":434118}
I20260709 13:14:37.785445  5389 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:37.793097   525 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:37.733556  5434 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:37.801963  5467 consensus_queue.cc:1059] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:37.803097  5322 raft_consensus.cc:3055] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:37.803516  5322 raft_consensus.cc:740] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:37.804364  5322 consensus_queue.cc:260] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.805984  5322 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:37.740624  5412 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:37.803897  1138 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:14:37.794982  5444 consensus_meta.cc:287] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.806s	user 0.013s	sys 0.000s
I20260709 13:14:37.813454   553 raft_consensus.cc:1275] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:14:37.814203   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.821028   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:37.821842   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:37.822739   629 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:37.825201   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.798064  5507 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.824720   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:37.832163   627 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:14:37.809373  5410 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:37.830677   626 raft_consensus.cc:2393] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 12: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:37.748163  5478 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.812714  5424 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:37.813345  4995 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.835068  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:37.844934  1175 raft_consensus.cc:2410] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:14:37.809902  5440 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:37.836557   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:37.745128  5546 consensus_queue.cc:237] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.838649   554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 706) took 1160 ms. Trace:
I20260709 13:14:37.855576   554 rpcz_store.cc:276] 0709 13:14:36.678259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.717848 (+ 39589us) service_pool.cc:224] Handling call
0709 13:14:36.718312 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:36.842711 (+124399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:36.842742 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:36.856149 (+ 13407us) log.cc:844] Serialized 26 byte log entry
0709 13:14:37.157101 (+300952us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:37.157155 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.157250 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:37.838356 (+681106us) raft_consensus.cc:1685] finished
0709 13:14:37.838386 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:37.838576 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6208,"raft.queue_time_us":92199,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":196,"thread_start_us":393780,"threads_started":2,"wal-append.queue_time_us":441451}
I20260709 13:14:37.772459  5451 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.821851  5486 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:37.834301  5410 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.834337   447 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:37.851701   629 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:37.852411  5440 consensus_queue.cc:1048] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:14:37.852890  5562 log.cc:927] Time spent T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:14:37.853224  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:37.853937  4995 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.860325   447 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:37.815253  5526 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.833027  5467 consensus_queue.cc:1059] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
W20260709 13:14:37.863304  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 192450us
I20260709 13:14:37.870884  5444 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:37.871448  5444 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.871805  5444 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:37.874788  5382 consensus_queue.cc:1059] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:37.859028  5486 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.875840  5347 raft_consensus.cc:3055] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:37.875972  5486 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:37.876286  5347 raft_consensus.cc:740] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:37.877128  5347 consensus_queue.cc:260] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.878264  5347 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:37.861055  5410 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:37.835246  5507 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.881269  5507 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:37.882453  5377 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:37.884689  4995 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:37.885169  5451 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:37.816970  5543 consensus_queue.cc:237] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.892714  5526 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:37.892638   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:37.893901   627 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:14:37.895371  1138 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:37.895089  5448 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.896531   483 raft_consensus.cc:1240] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:14:37.897271  5484 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:37.897706  5448 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:37.897739  5484 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.898475  5484 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:37.901353  5527 consensus_meta.cc:287] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.968s	user 0.010s	sys 0.000s
I20260709 13:14:37.901885  5527 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.905308   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:37.906404   476 raft_consensus.cc:2410] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:14:37.907507  5438 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:37.908028  5467 raft_consensus.cc:3055] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:37.908538  5467 raft_consensus.cc:740] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:37.908082  5438 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.909570  5467 consensus_queue.cc:260] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.928574   525 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:37.940547  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:37.943997  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:37.951087   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.957477 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:37.963523  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.965953  4995 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.972179  5550 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:37.972723  5550 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.973755   551 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:14:37.974788   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:37.976469   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:37.977073   553 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 14.
I20260709 13:14:37.978669   555 raft_consensus.cc:1240] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:37.911167  5467 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:37.980381  1169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 667) took 1460 ms. Trace:
I20260709 13:14:37.980763  1169 rpcz_store.cc:276] 0709 13:14:36.520338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.520482 (+   144us) service_pool.cc:224] Handling call
0709 13:14:36.542660 (+ 22178us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:36.543086 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:36.543127 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:37.804950 (+1261823us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b2c00048488. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b66d12a11 00007f4b66d22372 00007f4b68454a01 00007f4b6841943a 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2
0709 13:14:37.805380 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:14:37.949378 (+143998us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:37.949448 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.949540 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:37.980076 (+ 30536us) raft_consensus.cc:1685] finished
0709 13:14:37.980095 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:37.980303 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2306,"raft.queue_time_us":102,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":7120,"spinlock_wait_cycles":5142784,"thread_start_us":143544,"threads_started":1,"wal-append.queue_time_us":169866}
I20260709 13:14:37.982666  5388 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:37.974821  5550 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:37.983213  5388 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.966527  4995 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.985538  5388 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:37.986044  5388 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:37.986699  4995 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:37.993889   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:37.994546   481 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 14.
I20260709 13:14:37.986521  5388 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.996096  1141 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:37.996737   559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2349) took 1404 ms. Trace:
I20260709 13:14:37.997406  5377 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:37.997509  5388 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:37.997944   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2350) took 1405 ms. Trace:
I20260709 13:14:37.970841  5410 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:37.998541   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:37.999897  5410 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:38.000694  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:38.001271  1169 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 15.
I20260709 13:14:38.002185   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:38.002372   523 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:38.002813   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:37.998294   558 rpcz_store.cc:276] 0709 13:14:36.592708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.643223 (+ 50515us) service_pool.cc:224] Handling call
0709 13:14:36.643696 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.149371 (+505675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.997741 (+848370us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b5400105754. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:37.997893 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1078582528}
I20260709 13:14:38.003938  5547 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:38.013945   627 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:38.014954   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:38.011219   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:38.019845   628 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:38.020676   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:38.002765   481 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:14:37.851343  5424 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:37.941232  5526 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:38.007534   554 raft_consensus.cc:2393] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 13: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:38.011622   551 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 11.
I20260709 13:14:37.997095   559 rpcz_store.cc:276] 0709 13:14:36.592438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.595150 (+  2712us) service_pool.cc:224] Handling call
0709 13:14:36.595510 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.040244 (+444734us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:14:37.160225 (+119981us) log.cc:844] Serialized 14 byte log entry
0709 13:14:37.564086 (+403861us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:37.564138 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:37.564176 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.717528 (+153352us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:37.996538 (+279010us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b540034ce54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:37.996582 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:37.996685 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":271118,"prepare.queue_time_us":60887,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":271515,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5593,"spinlock_wait_cycles":1024992768,"thread_start_us":251869,"threads_started":2,"wal-append.queue_time_us":295036}
I20260709 13:14:38.030860   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:38.034616   627 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 12: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:38.024801   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:38.035944   475 raft_consensus.cc:1240] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:38.036444   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:38.035004   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 216028us
I20260709 13:14:38.039286   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:38.041468   480 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:38.042063   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:14:38.042259   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.042621   482 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:38.044549   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:38.045163   627 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:38.022588  5547 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:38.047717   628 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 13:14:38.026816  5377 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:38.050736  1139 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:38.038324  5486 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:38.053555   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:38.056126   628 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:38.057158  5486 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:14:38.060496   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41384 (request call id 917) took 2248 ms. Trace:
W20260709 13:14:38.061093  1200 heartbeater.cc:646] Failed to heartbeat to 127.31.17.190:46835 (1 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.31.17.190:46835 timed out after 15.000s (SENT)
W20260709 13:14:38.062134  5384 consensus_meta.cc:287] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.757s	user 0.008s	sys 0.000s
I20260709 13:14:38.042810  5298 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.064873  5298 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:38.060895   479 rpcz_store.cc:276] 0709 13:14:35.811912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.164180 (+352268us) service_pool.cc:224] Handling call
0709 13:14:36.179284 (+ 15104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.204362 (+1025078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:38.060260 (+855898us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001879d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:38.060437 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336053504}
I20260709 13:14:38.067615   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:38.068437   479 raft_consensus.cc:2393] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 15: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:38.032094  5518 consensus_queue.cc:1059] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:14:38.072439  5518 raft_consensus.cc:3055] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:38.072528   628 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:38.072806  5518 raft_consensus.cc:740] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:38.073618  5518 consensus_queue.cc:260] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:38.074760  5518 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:38.076315   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.076511  5560 log.cc:927] Time spent T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.491s	user 0.002s	sys 0.000s
I20260709 13:14:38.075912   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:38.077507   479 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:38.077600   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:38.078310   628 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:38.082532   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.082839   482 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:38.083899  1139 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:38.084213   525 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:38.079612  5527 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:38.092365  5123 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:38.092830   482 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:38.080201  5377 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:38.093721  5424 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:38.054260  5089 consensus_meta.cc:287] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.820s	user 0.007s	sys 0.005s
I20260709 13:14:38.095685  5089 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:38.095708   628 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:38.098003  5484 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:38.099329   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:38.034389  5429 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:38.101294  1139 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:38.102587  5429 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:38.103685  5467 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:38.103480  5211 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:38.104244  5467 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.104722  5467 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:38.107781   476 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:14:38.100540  5123 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:38.109028   628 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:38.052572  5547 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:38.117776   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 67330.6us
W20260709 13:14:38.118614   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.121759   522 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:38.141467   628 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:14:38.144726   479 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:38.146231   522 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:38.146407   525 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:38.148151  1138 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:38.149140   522 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:38.095134  5377 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:38.118786  5541 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:38.161566   522 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:38.119794  5347 consensus_queue.cc:1059] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:14:38.149626  5408 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:38.147686  5526 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:38.118906  5396 consensus_queue.cc:1059] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:14:38.153770  5519 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:38.153136  5322 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:14:38.173436  5417 consensus_meta.cc:287] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.710s	user 0.009s	sys 0.003s
I20260709 13:14:38.162808  5384 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:38.166249  5541 raft_consensus.cc:697] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:38.163792  5410 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:38.188360   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:38.167595  4926 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.193106   551 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:38.189641  5457 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:38.190348  5408 raft_consensus.cc:697] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:38.217617  5543 consensus_queue.cc:1059] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:38.187455  5417 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:38.232574  5408 consensus_queue.cc:237] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:38.233731  5417 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:38.234539   477 raft_consensus.cc:2368] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12.
I20260709 13:14:38.201359  4926 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:38.236912  4926 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:38.222054  5123 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:38.192332  5384 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:38.204480  5444 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:38.243598  5582 log.cc:927] Time spent T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:14:38.244303  5384 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:38.244432  5444 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:38.231546  5484 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:38.231307  5547 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:38.246568  5547 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:38.249229  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:38.257782   551 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:14:38.260077  5444 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:38.268596   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:38.270020   479 raft_consensus.cc:2393] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 15: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:38.202669  5541 consensus_queue.cc:237] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:38.288136   628 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:14:38.296499   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:14:38.341197   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.405187  5457 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:38.405897  5457 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:38.408519  5457 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:38.439047  5457 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:38.439779  5457 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:38.264526  5516 raft_consensus.cc:3060] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:38.478060   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.281466  5536 log.cc:927] Time spent T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 1.162s	user 0.002s	sys 0.005s
I20260709 13:14:38.293675  5440 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.442468  5457 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:38.468268  5377 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:38.500267  5550 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:38.467118  5424 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:38.503526  5588 log.cc:927] Time spent T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:14:38.476071  5417 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:38.524262   447 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:38.467278  5518 consensus_queue.cc:1059] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:14:38.516842  5438 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:38.519295   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:38.484990  5569 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.507460   481 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
W20260709 13:14:38.510365   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.279407  5444 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:38.487208  5089 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:38.563278  5089 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:38.564565  5444 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:38.565125  5444 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:38.565284  5089 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:38.565595  5444 raft_consensus.cc:697] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:38.566478  5444 consensus_queue.cc:237] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:38.567821   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.568850   599 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:38.572863   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:38.559513  5514 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:38.574674  5514 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:38.575076   525 leader_election.cc:336] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 2.100s (SENT)
I20260709 13:14:38.577958   480 raft_consensus.cc:2393] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 16: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:38.576252   599 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:38.587699   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:38.589545   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:38.590960   480 raft_consensus.cc:2410] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:14:38.592331   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:38.593166   480 raft_consensus.cc:3060] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:38.593449   627 raft_consensus.cc:1240] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:38.596033  5388 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:38.596460  5388 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:38.604475  5388 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:38.604496  5451 consensus_queue.cc:1059] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:38.605896  5451 raft_consensus.cc:3055] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:14:38.606690   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.609759   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:38.490387  5440 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:38.614120   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:38.612905   599 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:38.616696   599 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:38.617265   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:38.592419  5513 raft_consensus.cc:2764] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:14:38.618073   627 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:38.619576   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:38.606279  5451 raft_consensus.cc:740] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:38.521006  5550 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:38.688764   481 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 15.
I20260709 13:14:38.689888  5550 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:38.512238  5377 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:38.666869   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:38.525055  5424 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:38.690937   627 raft_consensus.cc:2393] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 12: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:38.691918   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:38.692260  5424 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:38.692485   627 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:38.694514  5377 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:38.674474   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 57836.3us
I20260709 13:14:38.677922   480 raft_consensus.cc:2468] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
I20260709 13:14:38.560714  5417 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:38.702497   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:38.703123   482 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:38.704669   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:38.705904   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:38.707804   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:38.708496   482 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:14:38.709394   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:38.596784  5396 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.701335   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:38.622282  5540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.005s	sys 0.013s
W20260709 13:14:38.611130  5601 log.cc:927] Time spent T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.071s	user 0.000s	sys 0.006s
I20260709 13:14:38.592685  5569 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:38.713941  5590 log.cc:927] Time spent T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
I20260709 13:14:38.714540  5569 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:38.712679  5540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.005s	sys 0.013s
I20260709 13:14:38.715619   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:38.716121   480 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 15.
I20260709 13:14:38.718580   480 raft_consensus.cc:1240] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:38.718616   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 710) took 2776 ms. Trace:
I20260709 13:14:38.719224   633 rpcz_store.cc:276] 0709 13:14:35.942024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.942423 (+   399us) service_pool.cc:224] Handling call
0709 13:14:36.125435 (+183012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:36.293557 (+168122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.730694 (+1437137us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54001e3554. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:38.718404 (+987710us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54001e3550. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:38.718533 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591638016}
I20260709 13:14:38.723657  5478 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:38.725948   481 raft_consensus.cc:1275] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:14:38.622560  5438 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:14:38.738454   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.738801   627 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 16.
I20260709 13:14:38.740155   627 raft_consensus.cc:1240] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: [9.8-11.9]
I20260709 13:14:38.679977  5548 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:14:38.735899   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 211703us
I20260709 13:14:38.749185   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2346) took 2157 ms. Trace:
I20260709 13:14:38.749596   556 rpcz_store.cc:276] 0709 13:14:36.591593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.611360 (+ 19767us) service_pool.cc:224] Handling call
0709 13:14:36.611754 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.086209 (+474455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:38.748956 (+1662747us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54000eae54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:38.749129 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084109184}
I20260709 13:14:38.711828   599 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:38.747295  5438 raft_consensus.cc:697] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:38.834246  5388 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:38.834924   475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 2179) took 1524 ms. Trace:
I20260709 13:14:38.839700   475 rpcz_store.cc:276] 0709 13:14:37.311633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.755607 (+443974us) service_pool.cc:224] Handling call
0709 13:14:37.755884 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:38.039608 (+283724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:38.834693 (+795085us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b540027d3d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:38.834866 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643619712}
I20260709 13:14:38.841252   475 raft_consensus.cc:1275] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:38.835744   483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 2175) took 1646 ms. Trace:
I20260709 13:14:38.843467   483 rpcz_store.cc:276] 0709 13:14:37.189410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.299670 (+110260us) service_pool.cc:224] Handling call
0709 13:14:37.301159 (+  1489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:37.896918 (+595759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:38.835515 (+938597us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b54000aafd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:38.835688 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1368644992}
I20260709 13:14:38.844841   483 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:14:38.837806   478 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:38.835662  5438 consensus_queue.cc:237] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:38.852811  5298 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:38.855047  5595 log.cc:927] Time spent T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.376s	user 0.000s	sys 0.001s
I20260709 13:14:38.857118  5364 raft_consensus.cc:3055] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:38.857511  5364 raft_consensus.cc:740] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:38.858333  5364 consensus_queue.cc:260] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:38.810151  5513 raft_consensus.cc:2804] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:38.737397  5396 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:38.878012  5417 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:38.890306   525 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:38.881968  5176 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:38.884454  5514 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:38.885815  5440 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:38.859474  5535 log.cc:927] Time spent T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:14:38.901037   596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.886494  5562 log.cc:927] Time spent T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:14:38.909288  1167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 859) took 2533 ms. Trace:
I20260709 13:14:38.910148  5519 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.911090  5457 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:38.911603  5457 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:38.912056  5457 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:38.909883  1167 rpcz_store.cc:276] 0709 13:14:36.375607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.375760 (+   153us) service_pool.cc:224] Handling call
0709 13:14:36.387673 (+ 11913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.208720 (+821047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:38.908891 (+1700171us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b54003f9654. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:38.909180 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1886360448}
W20260709 13:14:38.883153  5467 consensus_meta.cc:287] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.778s	user 0.008s	sys 0.003s
I20260709 13:14:38.917469  5526 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:38.899358  5513 raft_consensus.cc:697] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:38.806304  5451 consensus_queue.cc:260] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:38.953573   447 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.17.131:36245 timed out after 1.762s (SENT) [suppressed 6 similar messages]
W20260709 13:14:38.958401   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 246625us
I20260709 13:14:38.917704  5519 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:38.962914   599 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:38.969244   476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 2181) took 1657 ms. Trace:
I20260709 13:14:38.969779   476 rpcz_store.cc:276] 0709 13:14:37.312243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.907116 (+594873us) service_pool.cc:224] Handling call
0709 13:14:37.915330 (+  8214us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:38.108297 (+192967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:38.968879 (+860582us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54000d66d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:38.969167 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441872640}
I20260709 13:14:38.972407   625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 731) took 1199 ms. Trace:
I20260709 13:14:38.972759   599 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:38.972934   625 rpcz_store.cc:276] 0709 13:14:37.773138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.773727 (+   589us) service_pool.cc:224] Handling call
0709 13:14:37.773987 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.857165 (+ 83178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:37.857210 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:37.857264 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:14:37.857298 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:38.972124 (+1114826us) spinlock_profiling.cc:243] Waited 82.9 ms on lock 0x7b54002bc5d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:38.972183 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:38.972340 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190729600}
I20260709 13:14:38.974102  5514 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:38.974321   599 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:38.974504  5514 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:38.975118  5514 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:38.975553  5389 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:38.975941  5389 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:38.976301  5389 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:38.977046  5434 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:38.977577  5434 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:38.978024  5434 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:14:38.984066   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.957018  5444 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.957320  5573 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:14:38.987087   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 271227us
I20260709 13:14:38.987743  5541 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:14:38.988811   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 98637.2us
I20260709 13:14:38.927148  5467 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:38.979933  5451 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:38.952975  5526 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.011718   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:39.013392   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:39.013690   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:39.014041   556 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:39.014303   552 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:39.014045   482 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:14:39.015645   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:39.017032   558 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:14:39.017222   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.017438   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.018663   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.019188   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.019455   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:39.020941   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:39.021265   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.021747   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:39.022437   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:39.015036   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:39.032088   627 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:39.027864   447 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:39.034675   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:39.035732  1175 raft_consensus.cc:2368] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 15. Current term is 16.
I20260709 13:14:39.036131   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.035772   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:39.036891   555 raft_consensus.cc:2393] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 15: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:39.038599   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.039332   554 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:39.040558  5410 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:39.041158  5410 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:39.041960  5607 log.cc:927] Time spent T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:14:39.043879  5526 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:39.045318   630 raft_consensus.cc:1275] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:39.038873  5576 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:39.029459  5513 consensus_queue.cc:237] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.047648  5396 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:39.048287  5396 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.048758  5396 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:38.983444  5385 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
W20260709 13:14:39.051986  5593 log.cc:927] Time spent T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.575s	user 0.004s	sys 0.000s
I20260709 13:14:39.047042  5576 raft_consensus.cc:697] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:39.054170  5576 consensus_queue.cc:237] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.054756  1173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 865) took 1218 ms. Trace:
I20260709 13:14:39.040223   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:39.055806   628 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:39.056327  5467 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:39.055255  1173 rpcz_store.cc:276] 0709 13:14:37.836499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.836692 (+   193us) service_pool.cc:224] Handling call
0709 13:14:37.850791 (+ 14099us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:37.860242 (+  9451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:37.860270 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:37.860743 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:14:38.727956 (+867213us) spinlock_profiling.cc:243] Waited 57.3 ms on lock 0x7b18003f8860. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb90d1 00007f4b683d4a0f
0709 13:14:38.952935 (+224979us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:14:38.952995 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:38.953106 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:39.054421 (+101315us) raft_consensus.cc:1685] finished
0709 13:14:39.054445 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:39.054694 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9083,"raft.queue_time_us":10174,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3502,"spinlock_wait_cycles":131840896,"thread_start_us":224779,"threads_started":1,"wal-append.queue_time_us":1164778}
I20260709 13:14:39.057310  5388 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:39.030424  5438 consensus_queue.cc:1059] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:14:39.059748  5519 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:39.060452  5554 raft_consensus.cc:3055] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:39.060837  5554 raft_consensus.cc:740] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:39.046192  5605 consensus_queue.cc:1059] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:14:39.063879  5410 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:39.064352   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 73854.9us
I20260709 13:14:39.095311   525 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:39.069501   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:39.074664   556 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:39.076419  5616 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:39.075403   627 raft_consensus.cc:1275] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:14:39.082196  5597 log.cc:927] Time spent T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.380s	user 0.001s	sys 0.000s
W20260709 13:14:39.086273  5516 consensus_meta.cc:287] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.000s
I20260709 13:14:39.088936   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:14:39.090682  5599 log.cc:927] Time spent T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.613s	user 0.001s	sys 0.001s
I20260709 13:14:38.991346  5444 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.075050   552 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:39.071364   447 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:39.051013  5396 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:39.099390  5526 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.099529  5389 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.106174  5554 consensus_queue.cc:260] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.107051  5526 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.108619  5389 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:39.109334   626 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:14:39.092736  5569 raft_consensus.cc:3055] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:39.110562   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:39.110867  5569 raft_consensus.cc:740] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:39.111538  5573 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:39.103317  5616 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.100332  5613 raft_consensus.cc:2804] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:39.111876  5569 consensus_queue.cc:260] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.029117  5541 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.104969   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:39.115278   628 raft_consensus.cc:2393] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 16: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:39.116160   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:39.116671   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:39.118955   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:39.119710   552 raft_consensus.cc:2393] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 15: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:39.106379  5444 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:39.122704  5615 consensus_queue.cc:1059] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:39.119536  5478 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:39.123885  5082 raft_consensus.cc:3055] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:39.124305  5082 raft_consensus.cc:740] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:39.125247  5082 consensus_queue.cc:260] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.126259  5541 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:39.126511  5082 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:39.124308  5478 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.129992  5478 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:39.112075  5573 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:39.112448  5613 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:39.130888  5613 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:39.092599  5605 consensus_queue.cc:1048] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:14:39.102183   482 raft_consensus.cc:2393] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 13: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:39.103412  5525 raft_consensus.cc:3055] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:14:39.132422   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 63311.1us
I20260709 13:14:39.132874   628 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:39.109229  5621 consensus_queue.cc:1048] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:39.149549   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:39.136432   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:39.150542   625 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 15.
I20260709 13:14:39.151355  5614 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:39.151882   625 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:14:39.151988  5614 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.153179   625 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:39.154502  5614 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:39.143814   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:39.144106   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:39.155521  5614 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.155923   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:39.156075  5614 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.156975   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:39.158595  5614 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:39.144733   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:39.146731   483 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:39.148267   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:39.114670  5554 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:39.147751   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:39.149163   479 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:39.133827   624 raft_consensus.cc:2468] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:14:39.150502   628 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
W20260709 13:14:39.142421   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.114133  5546 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:14:39.167770   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 49185.9us
I20260709 13:14:39.161458  5541 consensus_queue.cc:1059] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:14:39.136200  5525 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:39.170303   447 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:39.169835  5384 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.179622   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:39.185174  5434 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.186095   475 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 15.
I20260709 13:14:39.187362   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:39.187369  5488 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:39.164613  5514 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.137136  5516 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:14:39.193434   479 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 15.
W20260709 13:14:39.198186   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.190136  5525 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.175791  5546 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.175184  5616 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:39.209035   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:39.208278   525 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:39.169940  5417 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:14:39.192327  5384 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.210426  5410 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:39.211056   629 raft_consensus.cc:1240] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:39.212141  5434 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:39.212241  5514 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:39.213083   522 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:39.213271  5451 consensus_queue.cc:1048] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:39.195799  5541 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:39.219209  5037 raft_consensus.cc:3055] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:39.219596   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:39.220702   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:39.225601  5484 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:39.226570  1139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:39.226938  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.219623  5322 raft_consensus.cc:697] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
W20260709 13:14:39.228549  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 761094us
I20260709 13:14:39.229069  5211 consensus_queue.cc:1059] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:39.229378   597 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:39.208050   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:39.241053   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:39.273391   631 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:39.195699  5488 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.241576   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:39.245620  5616 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:39.273300   625 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 15.
I20260709 13:14:39.255457   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:39.256279   522 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:39.177182  5457 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.231432  5546 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:39.274766   626 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:39.244336   482 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:14:39.275835   477 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38134 (request call id 2170) took 2087 ms (client timeout 2100 ms). Trace:
I20260709 13:14:39.276500   484 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:14:39.281615   477 rpcz_store.cc:269] 0709 13:14:37.188026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.221438 (+ 33412us) service_pool.cc:224] Handling call
0709 13:14:39.275614 (+2054176us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400184054. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:39.275757 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2327416704}
W20260709 13:14:39.285713   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 67553.8us
I20260709 13:14:39.286444   597 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:39.203197  5613 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.264560  5543 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:39.283378  1139 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:39.266521  5037 raft_consensus.cc:740] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:39.297762   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:39.299903   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 43752.5us
I20260709 13:14:39.302908  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:39.315656   522 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:39.321344   631 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:14:39.303539   448 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:39.338256   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.308079   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:39.308771   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:39.339159  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:39.339370   481 raft_consensus.cc:2376] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 17. Re-sending same reply.
I20260709 13:14:39.309319   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:39.309434   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:39.310161   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:39.272539  5525 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:39.303049   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.340842   556 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:39.324848  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:39.325728  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:39.326303   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:39.342100  1168 raft_consensus.cc:2393] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 12: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:39.327685   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:39.277833  5616 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.259186  5573 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.343225  5616 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:39.344585  5573 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:39.335911  1172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 672) took 1345 ms. Trace:
I20260709 13:14:39.285516  5382 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.345549  5382 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.346812  1170 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 16.
I20260709 13:14:39.336572  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:39.345353  1172 rpcz_store.cc:276] 0709 13:14:37.990395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.023601 (+ 33206us) service_pool.cc:224] Handling call
0709 13:14:38.023922 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:38.024151 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:14:38.166884 (+142733us) log.cc:844] Serialized 14 byte log entry
0709 13:14:38.179483 (+ 12599us) log.cc:844] Serialized 14 byte log entry
0709 13:14:39.218838 (+1039355us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b18003a8640. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b652a6c0a 00007f4b6e9e6219 00007f4b6532ea40 00007f4b653294e4 00007f4b65329455 00007f4b68411060 00007f4b68423716 00007f4b68434287 00007f4b68434208
0709 13:14:39.335553 (+116715us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:39.335614 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:39.335661 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:39.335757 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:39.335860 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1052062,"prepare.queue_time_us":230622,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":1049047,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":4230,"spinlock_wait_cycles":8700160,"thread_start_us":246504,"threads_started":2}
I20260709 13:14:39.337710   597 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:39.339872  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:39.340262   480 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:39.279690  5488 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:39.352346   550 raft_consensus.cc:2393] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 9: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:39.353000  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:39.271329  5541 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.350579   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.290508  5434 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:39.298403  5514 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:39.352334   597 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:39.356572  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:39.357672   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.354786   555 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:39.276602  5484 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.314520  5479 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:39.325809  5615 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:39.363451  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:39.338850   522 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:39.368871   522 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:39.298272  5396 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:14:39.351044  5513 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:39.373559  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:39.374310   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:39.353874  5548 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:39.336593  5469 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:39.333189  5617 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:39.381155  1173 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 15.
I20260709 13:14:39.382237  5518 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:39.380069  5513 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.375608  5410 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:39.349834  5322 consensus_queue.cc:237] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.371117   597 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:39.349038  5382 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:39.354681  5519 consensus_queue.cc:1059] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:14:39.392320  5516 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:39.350919  5414 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:39.387452  5469 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:39.394681  5484 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:39.372644  5514 raft_consensus.cc:2749] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:39.387737  5479 raft_consensus.cc:697] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:39.396376  5479 consensus_queue.cc:237] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.396888   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.397907  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:39.399694  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:39.397965   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.387423  5451 consensus_queue.cc:1059] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:14:39.401198   557 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:39.395251  5037 consensus_queue.cc:260] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.402086   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.402356  5541 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:39.362172  5291 consensus_queue.cc:1048] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:14:39.402931  5037 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:39.403685   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.335273  5388 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:14:39.333086  5438 consensus_queue.cc:1059] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:14:39.405068   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.405733   551 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:39.377456   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:39.406813   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.389494   559 raft_consensus.cc:1275] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:39.390072   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.371387  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:39.376820   522 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:39.392093   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:39.334595  5385 consensus_queue.cc:1059] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:14:39.400729  5457 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:39.403761   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:39.405777  5438 raft_consensus.cc:3055] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:39.407086   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.420642   550 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:39.378661  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:39.421568  1171 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:39.422508  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:39.399603   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:39.425494  5603 log.cc:927] Time spent T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.560s	user 0.002s	sys 0.000s
I20260709 13:14:39.420311  5438 raft_consensus.cc:740] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:39.426703  5438 consensus_queue.cc:260] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.428020  5438 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:39.430555  1169 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 7.
I20260709 13:14:39.383414  5410 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.409328   551 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:14:39.391307  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:39.410630   597 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:39.414448   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:39.415589   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:39.443423   483 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 16.
I20260709 13:14:39.417330   558 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:14:39.419878   448 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:39.444607   558 pending_rounds.cc:85] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 6
I20260709 13:14:39.444892   558 pending_rounds.cc:107] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:14:39.445120   558 raft_consensus.cc:2889] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:39.420593  5103 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:39.447933   448 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:39.435590  5328 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:39.438333   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 61635.3us
I20260709 13:14:39.439430   523 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:39.363870   480 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 16.
I20260709 13:14:39.432956   552 raft_consensus.cc:2410] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:14:39.449393   448 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:39.450263   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:39.450380   597 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:39.416620  5385 raft_consensus.cc:3055] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:39.452960   522 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:39.452332  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:39.460736   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:39.461699   448 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:39.467947   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:39.468724   631 raft_consensus.cc:2393] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 12: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:39.459918   523 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:39.463524   625 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 15.
I20260709 13:14:39.459923   597 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:39.472433   448 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:39.474792  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 59068.4us
I20260709 13:14:39.448632  5478 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:39.447335  5541 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:39.452328  5414 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:39.448299  5103 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:39.447747  5410 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:39.453292  5307 raft_consensus.cc:2749] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:39.490175  1141 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:39.509624   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:39.511960   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 52114us
I20260709 13:14:39.464478  5518 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:39.487623  5451 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:39.470829  5176 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:39.461853  5385 raft_consensus.cc:740] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:39.490346   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:39.482455  5412 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:39.520748   630 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 15.
I20260709 13:14:39.464255  5514 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:39.475528  5519 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:39.520606  1141 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:39.471029  5405 consensus_queue.cc:1059] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:14:39.461006  5328 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.516220   597 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:39.549543   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:39.545085  1141 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:39.551612   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:39.556294   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.558380   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.515182  5103 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:39.515259  5388 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:14:39.562207   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 89907us
I20260709 13:14:39.551659  1141 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:39.568358  5434 consensus_queue.cc:1059] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:14:39.568432  5546 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.544544  5322 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:39.539480  5414 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:14:39.579609  5632 log.cc:927] Time spent T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.238s	user 0.002s	sys 0.000s
I20260709 13:14:39.560787  5629 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:39.581817  5629 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.536934  5385 consensus_queue.cc:260] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.585376  5615 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:39.589756   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:39.562425  5514 raft_consensus.cc:697] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:39.558486  5478 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:39.567179  5328 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:39.568485   597 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:39.527698  5412 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:39.569514   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 58733.3us
I20260709 13:14:39.571223   448 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:39.565629   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.475345  5396 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.595831   448 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:39.527367  5457 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:39.582237  5629 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:14:39.608503  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 56931us
I20260709 13:14:39.559087  5541 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:39.609797   597 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:39.612855   597 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:39.562357  5382 raft_consensus.cc:2804] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:39.544015  5616 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.619540  5630 raft_consensus.cc:2749] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:39.619463  5541 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.607758  5457 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.631381  1167 raft_consensus.cc:1240] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:14:39.617604  5434 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:39.611682  5527 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:39.616384  5388 raft_consensus.cc:697] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:39.633502  5514 consensus_queue.cc:237] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.603933  5396 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.626176  5548 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:39.601224  5307 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:39.601511  5414 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:39.599097  5412 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:39.599864   448 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:39.640759   448 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:39.608335  5516 raft_consensus.cc:3055] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:39.637662  1174 raft_consensus.cc:1240] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:39.645330   557 raft_consensus.cc:2393] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 16: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:39.644809  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:39.634651  5388 consensus_queue.cc:237] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.661072   448 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:39.662599   555 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 16.
I20260709 13:14:39.638707  5541 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:39.662293  5638 raft_consensus.cc:2749] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:39.640373  5382 raft_consensus.cc:697] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:39.642800  5417 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:39.665696  5414 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:39.668627  5638 consensus_queue.cc:1048] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:39.676880  1175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36724 (request call id 674) took 1428 ms. Trace:
I20260709 13:14:39.678035   447 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:39.689790  1175 rpcz_store.cc:276] 0709 13:14:38.248458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.248588 (+   130us) service_pool.cc:224] Handling call
0709 13:14:39.676607 (+1428019us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b540069f5d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:39.676801 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1803221248}
W20260709 13:14:39.691979  5608 log.cc:927] Time spent T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.605s	user 0.003s	sys 0.000s
I20260709 13:14:39.692456  5414 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:39.692950   523 leader_election.cc:400] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 15. Current term is 16.
I20260709 13:14:39.693440   523 leader_election.cc:403] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:14:39.693388  5638 consensus_queue.cc:1243] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 6ba2a9c02b534120bbf26e56a1e920ca log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:39.681613  5396 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:39.678418  5410 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.659931  5307 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.682569  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:39.688786  1172 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:39.692901  5414 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.642478  5516 raft_consensus.cc:740] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:39.686524   599 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:39.682548  5417 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:39.693516  5547 raft_consensus.cc:3055] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:14:39.714660   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 51450us
I20260709 13:14:39.706753  5414 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:39.671023  5469 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.725169   448 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:39.715502  5434 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:39.762639   551 raft_consensus.cc:1240] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:39.720284  5417 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:39.722007  5615 raft_consensus.cc:3060] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:39.799608   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.720148  5547 raft_consensus.cc:740] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:39.814950   551 raft_consensus.cc:2393] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 16: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:39.714164  5527 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:14:39.821408   551 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:39.817863   550 raft_consensus.cc:1275] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:39.706601  5307 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.817799   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:39.732291  5629 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.799330  5382 consensus_queue.cc:237] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.841423  5629 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 17 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:39.842969  5616 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:39.845391  5543 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.846058  5543 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.848034  5616 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:39.848584  5616 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.851200  5573 consensus_queue.cc:1059] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:39.851951  5507 consensus_queue.cc:1059] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:39.852973  5507 raft_consensus.cc:3055] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:39.853297  5507 raft_consensus.cc:740] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:39.854177  5507 consensus_queue.cc:260] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.857964  5614 raft_consensus.cc:3055] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:39.858367  5614 raft_consensus.cc:740] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:39.816569  5434 raft_consensus.cc:697] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:39.860306  5434 consensus_queue.cc:237] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:39.864074   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 147002us
I20260709 13:14:39.806792  5328 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:39.721817  5103 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:39.876681   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.890470   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:39.891254   481 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:14:39.895812  5641 log.cc:927] Time spent T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 13:14:39.896795  5328 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.897739  5540 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:39.898182  5488 consensus_meta.cc:287] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.537s	user 0.008s	sys 0.001s
I20260709 13:14:39.898371  5540 raft_consensus.cc:493] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:39.898626  5488 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.899555   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:39.900470  5307 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:39.900740  5488 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:39.902954  5103 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:39.907745  5547 consensus_queue.cc:260] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.909133  5547 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:39.813701  5516 consensus_queue.cc:260] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.917132   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.920058   475 raft_consensus.cc:1275] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:39.899019  5328 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:39.911886  5516 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:39.929091   475 raft_consensus.cc:1275] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:14:39.929649   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:39.939105   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.934626   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:39.941267   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:39.941995   475 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:39.947654   480 raft_consensus.cc:1240] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:39.864080  5548 consensus_queue.cc:1048] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:14:39.914919  5410 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:39.920184  5384 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:39.970038   481 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 16.
I20260709 13:14:39.971418   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:39.927498  5364 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:39.859097  5614 consensus_queue.cc:260] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:39.983606  5614 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:39.960111   475 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 17.
I20260709 13:14:39.936775  5616 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:39.972213  5291 consensus_queue.cc:1059] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:14:39.977331  5513 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:39.958508  5543 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:39.947891  5507 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:39.979298  5412 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.991082   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:39.921156  5540 raft_consensus.cc:515] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:39.922235  5438 consensus_queue.cc:1059] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.061s
W20260709 13:14:40.002808   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 277731us
I20260709 13:14:39.999383   550 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 11.
W20260709 13:14:40.052083   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 44844.4us
I20260709 13:14:40.056298   448 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:40.001885  1141 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:14:40.057981  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 56165.9us
I20260709 13:14:40.059368   597 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:40.075017  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:14:40.110860   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 102723us
I20260709 13:14:40.110899   448 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:40.061342  5440 raft_consensus.cc:2764] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:14:40.062989  5382 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:40.064625  5514 raft_consensus.cc:3055] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:14:40.127449   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 262470us
I20260709 13:14:40.061123  5650 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:40.152606   525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.024s
W20260709 13:14:40.153920   525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.000s	sys 0.024s
I20260709 13:14:40.119477  5489 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:40.147998  5654 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:14:40.115078  5647 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 13:14:40.162978  5628 log.cc:927] Time spent T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.820s	user 0.003s	sys 0.000s
W20260709 13:14:40.176368  5653 log.cc:927] Time spent T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:14:40.178341  5618 log.cc:927] Time spent T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 1.087s	user 0.007s	sys 0.000s
I20260709 13:14:40.179983  5540 leader_election.cc:290] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:40.187252   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:40.185009   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 74134.9us
I20260709 13:14:40.118086  5417 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.147158  5514 raft_consensus.cc:740] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:40.182410  5526 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:40.150194  5382 raft_consensus.cc:697] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:40.218147  5382 consensus_queue.cc:237] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:40.200385   477 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 13.
I20260709 13:14:40.218250  5514 consensus_queue.cc:260] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:40.201164   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:40.204222   484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38134 (request call id 2180) took 2892 ms. Trace:
I20260709 13:14:40.205240  5412 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:40.150522  5650 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.222793   558 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:40.222744   484 rpcz_store.cc:276] 0709 13:14:37.311952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.759966 (+448014us) service_pool.cc:224] Handling call
0709 13:14:39.276247 (+1516281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:39.282293 (+  6046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.204055 (+921762us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400184050. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:40.204152 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3486331136}
I20260709 13:14:40.224910  5650 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:40.210651  5414 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.212029   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:40.230921   557 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:40.224105  5514 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:40.216315   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 266662us
W20260709 13:14:40.233107   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:40.234392   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.165038  5489 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:40.237381   448 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:40.236176   558 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:40.247113   482 raft_consensus.cc:1240] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:40.249660   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:40.241220  5489 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:40.255578  5414 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:40.263788  5518 consensus_meta.cc:287] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.747s	user 0.009s	sys 0.003s
I20260709 13:14:40.264279  5518 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:40.265043   553 raft_consensus.cc:1240] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:40.267483  5569 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:40.273092  5417 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:40.275216  5615 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 15. Current term is 16.
W20260709 13:14:40.275934   624 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54256 (request call id 2197) took 3083 ms (client timeout 1762 ms). Trace:
W20260709 13:14:40.276300   624 rpcz_store.cc:269] 0709 13:14:37.192675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.192814 (+   139us) service_pool.cc:224] Handling call
0709 13:14:40.275734 (+3082920us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b54001e5354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:40.275839 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4406302464}
I20260709 13:14:40.278120  5479 raft_consensus.cc:3055] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:40.278492  5479 raft_consensus.cc:740] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:40.279697   633 raft_consensus.cc:1275] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:14:40.284775   554 raft_consensus.cc:2468] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 16.
I20260709 13:14:40.285967   599 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:40.289083   557 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:40.281389   597 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:40.296118   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:40.296885   558 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 17.
I20260709 13:14:40.303807   557 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:14:40.304991   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 55405.1us
I20260709 13:14:40.237283  5412 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.324756  5675 raft_consensus.cc:2804] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:40.266801  5489 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.325476  5675 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:40.280833  5525 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.329638  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:40.331382  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:40.337294  1173 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:40.293015  5429 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:40.328234   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:40.335347  5676 consensus_queue.cc:1048] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:40.296294  5479 consensus_queue.cc:260] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:40.344516  5668 raft_consensus.cc:3060] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:40.345011  5469 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:40.345119   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.336222  5675 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:40.342721   557 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:40.308161  5666 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:40.354619  1174 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:40.333806  5412 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.358686  5412 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:40.359724  1173 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:40.341550  5525 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.335597  5489 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:40.361477   557 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:40.345013  5479 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:40.363878   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:40.364728   557 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:40.369051  5525 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:40.343425  5548 consensus_queue.cc:1048] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:14:40.383852  5457 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:40.388036   557 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:40.405474  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:40.405722   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:40.406246  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:40.406821  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:40.407325  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:40.403683  5448 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:40.408485  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:40.409004  1166 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:40.408852  5448 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.409639   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 929) took 1103 ms. Trace:
I20260709 13:14:40.410014   477 rpcz_store.cc:276] 0709 13:14:39.306581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.309098 (+  2517us) service_pool.cc:224] Handling call
0709 13:14:40.409483 (+1100385us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b54002b25d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:40.409584 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1978046848}
I20260709 13:14:40.411417  1168 raft_consensus.cc:1240] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:40.411885   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:40.406780   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:40.413040   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:40.413046  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:40.413748   557 raft_consensus.cc:2393] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 16: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:40.414405  5444 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:40.410969  5448 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:40.417899   448 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:40.391208  1169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36742 (request call id 733) took 1003 ms. Trace:
I20260709 13:14:40.418562  1169 rpcz_store.cc:276] 0709 13:14:39.387773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.399457 (+ 11684us) service_pool.cc:224] Handling call
0709 13:14:40.391046 (+991589us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b54004439d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:40.391149 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55287040}
I20260709 13:14:40.419724   448 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:40.420053   633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54256 (request call id 2217) took 1826 ms. Trace:
I20260709 13:14:40.420792   479 raft_consensus.cc:2410] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:14:40.420744  5444 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:40.420837   448 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:40.421427  5444 raft_consensus.cc:697] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:40.421625  5307 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:40.422179  5307 raft_consensus.cc:697] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:40.422832   481 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:14:40.422305   448 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:40.423207   481 pending_rounds.cc:85] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 8
I20260709 13:14:40.423656   481 pending_rounds.cc:107] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:14:40.423686   552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2279) took 1129 ms. Trace:
I20260709 13:14:40.424027   481 raft_consensus.cc:2889] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:40.424413  5578 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:40.424845  5578 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.425192  5578 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:40.422302  5444 consensus_queue.cc:237] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.422211   479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41384 (request call id 931) took 1114 ms. Trace:
I20260709 13:14:40.431916  1166 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 16.
I20260709 13:14:40.431867   479 rpcz_store.cc:276] 0709 13:14:39.307357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.309874 (+  2517us) service_pool.cc:224] Handling call
0709 13:14:40.422021 (+1112147us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002dc654. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:40.422160 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2483804928}
I20260709 13:14:40.420467   633 rpcz_store.cc:276] 0709 13:14:38.593385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.721508 (+128123us) service_pool.cc:224] Handling call
0709 13:14:40.279358 (+1557850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.280037 (+   679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.419871 (+139834us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54001e5350. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:40.419993 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3581927680}
I20260709 13:14:40.424288   552 rpcz_store.cc:276] 0709 13:14:39.294461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.326091 (+ 31630us) service_pool.cc:224] Handling call
0709 13:14:40.423518 (+1097427us) spinlock_profiling.cc:243] Waited 90.6 ms on lock 0x7b54001f27d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:40.423635 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208329472}
I20260709 13:14:40.433868   597 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:40.434643   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:40.427619  1141 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:40.428146   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:40.423156  5307 consensus_queue.cc:237] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.438966   448 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:40.425864  5613 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:40.431217  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
W20260709 13:14:40.442715   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 114079us
I20260709 13:14:40.443217   552 raft_consensus.cc:1240] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:14:40.443408   599 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:40.444968   552 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:14:40.445914   599 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:40.454370  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.457096  5385 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:40.447906  5438 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:40.431506  5507 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.468884  5652 raft_consensus.cc:2804] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:40.441805  5322 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:40.469175  5507 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:40.469748  5322 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:40.470213  5322 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:40.471153  5388 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:40.473050  5438 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:40.440531  5513 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:40.473563  5438 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.449960  5605 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:40.473913  5513 raft_consensus.cc:697] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:40.463702   558 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:14:40.463455  5610 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:40.475907  5610 raft_consensus.cc:697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:40.476797  5610 consensus_queue.cc:237] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.477540  5652 raft_consensus.cc:697] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:40.464186   555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2288) took 1077 ms. Trace:
I20260709 13:14:40.478138   555 rpcz_store.cc:276] 0709 13:14:39.386339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.391844 (+  5505us) service_pool.cc:224] Handling call
0709 13:14:40.463157 (+1071313us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54000eae54. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:40.464125 (+   968us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417864576}
I20260709 13:14:40.478577  5652 consensus_queue.cc:237] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:40.479286  5647 consensus_queue.cc:1048] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:40.479380  5478 consensus_queue.cc:1059] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:40.480588  5478 raft_consensus.cc:3055] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:40.480949  5478 raft_consensus.cc:740] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:40.466992   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:40.466015   480 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:40.474587  5605 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.475023  5513 consensus_queue.cc:237] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.492748   599 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:40.468214  1169 raft_consensus.cc:2468] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 9.
I20260709 13:14:40.431080  5434 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:14:40.496354   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:40.497409   477 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:14:40.499568   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:40.454881  5569 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:40.496780  5676 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:40.493781  5388 consensus_queue.cc:1059] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:14:40.523528   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2289) took 1136 ms. Trace:
I20260709 13:14:40.524160   556 rpcz_store.cc:276] 0709 13:14:39.386739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.387546 (+   807us) service_pool.cc:224] Handling call
0709 13:14:39.387867 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:39.388239 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:39.388274 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:39.388690 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 13:14:40.404840 (+1016150us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b18003f6100. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb90d1 00007f4b683d4a0f
0709 13:14:40.496336 (+ 91496us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:40.496378 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.496450 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:40.523131 (+ 26681us) raft_consensus.cc:1685] finished
0709 13:14:40.523164 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:40.523448 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23899,"raft.queue_time_us":88,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":16783,"spinlock_wait_cycles":5989248,"thread_start_us":91311,"threads_started":1,"wal-append.queue_time_us":1132913}
I20260709 13:14:40.510331  5569 raft_consensus.cc:697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:40.538125  5569 consensus_queue.cc:237] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:40.573100  5388 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:40.573773  5388 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:40.575559  5668 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:40.576145  5388 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:40.576617  5438 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:40.578959  5629 raft_consensus.cc:3055] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:40.579545  5629 raft_consensus.cc:740] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:40.511992  5469 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:14:40.526894  5507 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:40.624953  5478 consensus_queue.cc:260] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.626362  5478 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:40.627897  5605 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:40.626391   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:40.629541  5546 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:40.633569   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:40.634155   627 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:40.634717   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:40.635293   624 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:40.635732   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:40.636435   628 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 17.
I20260709 13:14:40.638790  5655 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.639302  5655 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.641268  5655 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:40.641916   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 213919us
I20260709 13:14:40.642735  5546 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:40.643337   523 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:40.643457  5613 consensus_queue.cc:1059] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:40.644213   523 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:40.644464  5613 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:40.644955  5613 raft_consensus.cc:697] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:40.645571   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ade492740624caba667436aa666025c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:40.647195   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:40.647552   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:40.648108   633 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:40.648391   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:40.649344  5615 raft_consensus.cc:3055] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:40.649715  5615 raft_consensus.cc:740] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:40.649930  5328 raft_consensus.cc:2804] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:40.650470  5328 raft_consensus.cc:697] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:40.651468  5328 consensus_queue.cc:237] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:40.655367  5645 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.655866  5645 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:40.656082   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.658113  5645 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:40.658764  5621 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.659360  5621 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:40.659868   629 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:14:40.661439  1171 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:40.662242  5621 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:40.662791  5666 raft_consensus.cc:3055] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:40.663185  5666 raft_consensus.cc:740] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:40.663568   448 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:40.664005  5666 consensus_queue.cc:260] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.665200  5666 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:40.666760  5448 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:40.672470  5408 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.672689   553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2378) took 1124 ms. Trace:
I20260709 13:14:40.673017  5408 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.673084   553 rpcz_store.cc:276] 0709 13:14:39.548687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.550720 (+  2033us) service_pool.cc:224] Handling call
0709 13:14:39.551121 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.265401 (+714280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.672484 (+407083us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b54001518d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:40.672636 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1641426176}
I20260709 13:14:40.674443   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:40.675309  5444 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:40.676468   554 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:40.670329  5429 consensus_queue.cc:1059] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:14:40.677331   559 raft_consensus.cc:1275] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:14:40.677778  5429 consensus_queue.cc:1243] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer 6ba2a9c02b534120bbf26e56a1e920ca log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:40.678249  5429 raft_consensus.cc:3055] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:40.678593  5429 raft_consensus.cc:740] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:40.669658  5546 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.679701  5429 consensus_queue.cc:260] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.680763  5546 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:40.675441   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:40.674985   553 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 14.
I20260709 13:14:40.686895   627 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:40.650524  5615 consensus_queue.cc:260] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:40.700589   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:40.700877  5615 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:40.701323  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:40.689015   633 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:40.680961  5429 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:40.690135   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:40.690820   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:40.694291   624 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:40.701938  1169 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 7.
I20260709 13:14:40.728650   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:40.729414   624 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:40.731452   481 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:14:40.734771   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:40.736608   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:40.736965   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:40.738039   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:40.738333   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:40.675169  5408 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:40.596199  5675 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:40.744836  1139 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:40.750782   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:40.753499   478 raft_consensus.cc:2393] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 16: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
W20260709 13:14:40.745267  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 238756us
I20260709 13:14:40.760772   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:40.771394   477 raft_consensus.cc:1240] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:40.777258   477 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:14:40.761373   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:40.786687   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:40.788005   477 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:40.791059   626 raft_consensus.cc:1240] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:40.799208   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:40.799877   627 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 17.
I20260709 13:14:40.800192  1138 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:40.801062   629 raft_consensus.cc:1240] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:14:40.753664  5382 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:40.808034   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:40.753733  5408 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.809546   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:40.814256   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:40.815515   478 raft_consensus.cc:1240] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:40.817891   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:40.819330   628 raft_consensus.cc:1240] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:40.819332   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:40.820174   631 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:40.820606   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:40.821717   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:40.822979   630 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:40.823979   632 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:40.824326   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:40.825014   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:40.825161   630 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 11.
I20260709 13:14:40.825704   632 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:40.826298   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:40.826640   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:40.827407   632 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:40.831141   628 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:40.791954  5307 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:40.750164  5469 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:14:40.750080  5467 consensus_queue.cc:1048] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:14:40.836654   631 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 16.
I20260709 13:14:40.803872  5385 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:40.880736  5307 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.881044  5385 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:40.803571  5513 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:40.890868  5513 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.892974  5513 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:40.814831  5479 raft_consensus.cc:2764] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:14:40.893887   599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.793761  5613 consensus_queue.cc:237] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:40.895726  5675 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:40.895484  5578 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:40.753710  5322 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:40.896778  5681 log.cc:927] Time spent T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:14:40.897526  5578 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 18 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:40.898169  5322 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:40.832787  5408 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:40.811566  5382 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.898869  5382 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:40.898922   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:40.899758   482 raft_consensus.cc:2393] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 18: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:40.900022  5408 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:40.902011   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:40.903674   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:40.904703   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:40.904938   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:40.905848   554 raft_consensus.cc:2393] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 13: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:40.910501   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:40.911458   630 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 6.
I20260709 13:14:40.911814  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:40.911885   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:40.914461   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:40.917869   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:40.918882  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.921949   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:40.922772   628 raft_consensus.cc:3060] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:40.928843   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:40.930008   478 raft_consensus.cc:2368] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 16. Current term is 17.
I20260709 13:14:40.915059   480 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 15.
I20260709 13:14:40.931530   633 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:14:40.932542   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:40.933665   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:40.934144   631 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:40.934852   447 leader_election.cc:304] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:40.935990  5605 raft_consensus.cc:2749] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:40.937501   599 leader_election.cc:400] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 16. Current term is 17.
I20260709 13:14:40.938194   599 leader_election.cc:403] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:14:40.938406   525 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:40.941990   525 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:40.944746   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:40.936183  5414 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:40.949304   447 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:40.951439   624 raft_consensus.cc:2410] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:14:40.957571  5629 consensus_queue.cc:260] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:40.966636  5629 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:40.971541  5640 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:40.948518  5547 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:40.883158  5307 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:40.972776   633 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:40.945186  5434 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:40.974594  5434 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:40.975607   633 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:14:40.976850  5434 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:40.977881   447 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:40.979918  5652 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:40.974623   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:40.981021   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:40.979518   447 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:40.982033  5652 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:40.807173  5616 consensus_queue.cc:1059] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.131s
I20260709 13:14:40.985627   447 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:40.987743  5652 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:40.988711  5573 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:40.990213  5630 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:14:40.989950   447 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:40.993870  5652 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:41.001070   558 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 11. Current term is 12. Ops: []
W20260709 13:14:41.002208   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 50703.2us
I20260709 13:14:41.002950   525 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:41.003671   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:41.004803   525 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:41.007272   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:41.007635   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:41.008984   628 raft_consensus.cc:2468] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 17.
I20260709 13:14:41.015769   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:41.017107   630 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:41.017113   522 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:41.019618   525 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:41.022826   523 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:41.028469   525 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:40.956001   631 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 18.
I20260709 13:14:41.035691   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:41.038231  5328 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:41.038904   522 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:41.040189   522 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:41.042037   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:41.044541   552 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:41.016139  5526 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:41.054219   525 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:41.052151  5457 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:41.063437  1171 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:41.065961  5519 consensus_queue.cc:1059] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:41.067574   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:41.046111  5451 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:41.068023   448 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:41.073298   522 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:41.018821  5489 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 16. Current term is 17.
I20260709 13:14:41.053715   597 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:41.030967  5621 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:41.093082   447 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:41.097568   447 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:41.052663  5414 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:41.038240  5408 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:41.040223  5328 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.109529   556 raft_consensus.cc:2468] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 15.
I20260709 13:14:41.073779  5410 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:41.052537  5434 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:41.076421  5518 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:41.111117  5576 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:41.084236  5457 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:41.094826  5621 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.095204  5548 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:41.101271  5616 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:14:41.139472   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 85825.7us
I20260709 13:14:41.124562  5328 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:41.170456   597 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:41.140455   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 67274.2us
I20260709 13:14:41.130420   447 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:41.142297   484 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 13.
I20260709 13:14:41.114924  5525 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:41.166527  5621 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:41.181563  5676 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.190689  5676 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.173658  5548 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:41.192781  5676 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:41.166153  5576 raft_consensus.cc:697] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:41.193464  5548 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:41.194144  5576 consensus_queue.cc:237] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.195297  5547 raft_consensus.cc:3055] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:41.195693  5547 raft_consensus.cc:740] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:41.138782  5457 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:41.177692   380 catalog_manager.cc:5697] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:41.138234  5675 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:41.202522  5675 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.204564  5675 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:41.169909  5680 log.cc:927] Time spent T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:14:41.142289  5569 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:41.206097  5569 raft_consensus.cc:697] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:41.206087  5676 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:41.207661  5569 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.208403  5676 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:41.210994  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 404610us
W20260709 13:14:41.205935   381 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48622 (request call id 250) took 46553 ms (client timeout 15000 ms). Trace:
W20260709 13:14:41.173916   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 43603.1us
W20260709 13:14:41.216707  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.137843  5385 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:41.217424  1141 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:41.136545  5434 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:41.167364  5526 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:14:41.222276  5451 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:41.168668  5666 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:41.217458  5489 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:41.223322   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:41.262329   478 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:41.223930   625 raft_consensus.cc:1275] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:14:41.223798   380 catalog_manager.cc:5697] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 3 to 12, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 12 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:41.223840  5518 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:41.225010   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:41.265426   552 raft_consensus.cc:2393] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 15: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:41.226001   482 raft_consensus.cc:1275] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:41.225953   555 raft_consensus.cc:3055] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:41.266161  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:41.228271   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:41.226950   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:41.220638   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:41.267803   558 raft_consensus.cc:2410] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:14:41.217559   522 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:41.233935   630 raft_consensus.cc:1275] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:41.231015   628 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:14:41.188164  5694 log.cc:927] Time spent T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:14:41.222862  1171 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:14:41.238031   633 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:14:41.239334   366 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4e472c1c82c9467a9a5563d6b06e3b53 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6e6df7e8ed204f1db5c371536b5b0683 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:41.240424  5414 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:41.279800  5414 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:41.172766  5616 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.280099  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:41.280364  5616 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:41.177966  5429 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:14:41.266322   555 raft_consensus.cc:740] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:41.234830   626 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:41.280048   380 catalog_manager.cc:5697] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 8 to 13, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 13 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:41.237123  5686 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:41.284152  5686 raft_consensus.cc:697] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:41.284175   380 catalog_manager.cc:5697] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 8 to 11, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 11 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:41.285976  5615 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:41.286448  5615 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.286264   380 catalog_manager.cc:5697] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:41.286909  5615 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:41.275717   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:41.276839   553 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
W20260709 13:14:41.277347   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 59887.5us
I20260709 13:14:41.292007   522 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:41.280957   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:41.227622  5382 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:41.217708  5676 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:41.285295  5686 consensus_queue.cc:237] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:41.295246   380 catalog_manager.cc:5697] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:41.296703  5547 consensus_queue.cc:260] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.297875  5547 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:41.297463   380 catalog_manager.cc:5697] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 11 to 13, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 13 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:41.299160   380 catalog_manager.cc:5697] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 5 to 8, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 8 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:41.237525  5525 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:41.301175   597 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:41.301533  5525 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:41.305138   599 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:41.303746   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:41.311582   626 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:41.313369  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:41.340592  1171 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 7: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:41.314123   380 catalog_manager.cc:5697] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 11 to 12, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 12 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:41.317883  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:41.322338   555 consensus_queue.cc:260] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.342831   555 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:41.326282  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:41.344020  1169 raft_consensus.cc:2393] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 15: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:41.330637  1166 raft_consensus.cc:1240] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:14:41.333284   522 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:41.345758  1167 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:14:41.347163   478 raft_consensus.cc:1275] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
W20260709 13:14:41.215428   381 rpcz_store.cc:269] 0709 13:13:54.658847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.746026 (+ 87179us) service_pool.cc:224] Handling call
0709 13:14:41.205832 (+46459806us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:36.552318 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:36.573144 (+ 20826us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:36.573217 (+    73us) write_op.cc:435] Acquired schema lock
0709 13:14:36.573245 (+    28us) tablet.cc:662] Decoding operations
0709 13:14:36.573630 (+   385us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:36.573715 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:36.573740 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:36.573977 (+   237us) tablet.cc:701] Row locks acquired
0709 13:14:36.574018 (+    41us) write_op.cc:260] PREPARE: finished
0709 13:14:36.574164 (+   146us) write_op.cc:270] Start()
0709 13:14:36.574301 (+   137us) write_op.cc:276] Timestamp: P: 1783602876574104 usec, L: 0
0709 13:14:36.574323 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:14:36.575137 (+   814us) log.cc:844] Serialized 541 byte log entry
0709 13:14:37.580293 (+1005156us) op_driver.cc:464] REPLICATION: finished
0709 13:14:37.871064 (+290771us) write_op.cc:301] APPLY: starting
0709 13:14:37.871211 (+   147us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:37.985542 (+114331us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:37.985647 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:37.986343 (+   696us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:37.986515 (+   172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:14:37.986560 (+    45us) write_op.cc:312] APPLY: finished
0709 13:14:37.986751 (+   191us) log.cc:844] Serialized 25 byte log entry
0709 13:14:37.986922 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:37.987014 (+    92us) write_op.cc:454] Released schema lock
0709 13:14:37.987059 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:38.039811 (+ 52752us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:38.040824 (+  1013us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2672292,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":287966,"apply.run_cpu_time_us":3266,"apply.run_wall_time_us":153717,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8311,"num_ops":1,"prepare.queue_time_us":108226,"prepare.run_cpu_time_us":27678,"prepare.run_wall_time_us":359732,"raft.queue_time_us":191791,"raft.run_cpu_time_us":49091,"raft.run_wall_time_us":507355,"replication_time_us":878674,"thread_start_us":596239,"threads_started":4,"wal-append.queue_time_us":321960,"wal-append.run_cpu_time_us":23442,"wal-append.run_wall_time_us":2073156}]]}
W20260709 13:14:41.353003   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 47971.3us
I20260709 13:14:41.349361   522 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:41.357827   380 catalog_manager.cc:5697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:41.360102   599 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:41.370091   626 raft_consensus.cc:1240] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:41.336244  5541 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:41.341997  5525 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:41.376446  1139 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:41.351526  5644 raft_consensus.cc:2804] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:41.361231  5548 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:41.342700  5328 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.397641  5328 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 18 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:41.342106  5655 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:14:41.383725  5640 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.399809  5640 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.400028  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:41.404294   551 raft_consensus.cc:2393] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 18: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:41.383862  5541 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.383442  5385 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:41.419272   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:41.389644  5573 raft_consensus.cc:2804] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:14:41.395174  5691 log.cc:927] Time spent T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:14:41.432042   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:41.445662   478 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:41.392094  5548 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.433568  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:41.374521  5384 consensus_queue.cc:1048] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:14:41.388711  5644 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.431623  5543 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:41.404639  5629 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:41.412367  5614 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:14:41.415889  5519 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:41.402235  5364 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:41.466233  5621 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:41.412928  5414 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.468624  5621 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:41.468425  5629 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:41.469468  5414 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:41.424224  5541 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:41.470619  5629 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:41.401852  5640 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:41.459981  5573 raft_consensus.cc:697] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:41.459839  5543 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.463176  5699 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:41.404640  5639 consensus_queue.cc:1048] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:14:41.463640  5507 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:41.458964  5644 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:41.464138  1169 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:14:41.465186  5382 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:41.480906   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:41.453642  5548 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:41.390697  5457 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:41.488034  5457 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:41.472347  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:41.466137  5291 consensus_queue.cc:1048] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:14:41.494623  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:41.495189  1174 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:41.498428  5615 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.499472  5457 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:41.472558   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:41.501466   478 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:41.472745   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:41.503942   628 raft_consensus.cc:2410] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:14:41.509474   627 raft_consensus.cc:1240] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:41.511077  1174 raft_consensus.cc:2468] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:41.513490   523 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:41.540751   478 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:41.525792  5576 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:41.531555  5457 raft_consensus.cc:2804] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:14:41.550516   481 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.010s	sys 0.020s
W20260709 13:14:41.566476   481 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.010s	sys 0.020s
W20260709 13:14:41.551934   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 483993us
I20260709 13:14:41.563798  5444 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:41.531131  5527 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:41.573513  5434 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:41.575672  5615 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:41.572139  5457 raft_consensus.cc:697] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:41.576540   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:41.576767  5457 consensus_queue.cc:237] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:41.578140  5543 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:41.578792   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:41.580686  5616 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.582742  5616 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:41.583444   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:41.584002  5548 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.586033  5548 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:41.584388   481 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:41.592613   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:41.593731   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:41.594376   478 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:41.594616   481 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 16.
I20260709 13:14:41.567194  5576 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.599766  5576 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:41.600426   483 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:14:41.601194  5307 consensus_queue.cc:1048] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:41.602299  5605 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:41.600389  5429 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:41.604468  5668 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:41.619652   483 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:41.624230  5547 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.634058   597 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:41.634783   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:41.687146   552 raft_consensus.cc:3060] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:41.687363   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 53384.9us
I20260709 13:14:41.640336  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:41.643795   558 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:41.644268  5384 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.689278   597 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:41.644755   553 raft_consensus.cc:1275] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:41.646124   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:41.646272   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:41.672869  5539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.003s	sys 0.025s
W20260709 13:14:41.691342  5539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.004s	sys 0.025s
I20260709 13:14:41.691531   555 raft_consensus.cc:2368] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12.
I20260709 13:14:41.649911  5519 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:41.650014  5668 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.708093  5668 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.710354  5668 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:41.710386   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2388) took 1719 ms. Trace:
I20260709 13:14:41.710976   550 rpcz_store.cc:276] 0709 13:14:39.991010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.007718 (+ 16708us) service_pool.cc:224] Handling call
0709 13:14:40.008047 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:40.603686 (+595639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:40.603715 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:40.604127 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 13:14:40.979362 (+375235us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b18003e0da0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb90d1 00007f4b683d4a0f
0709 13:14:41.474992 (+495630us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:41.475053 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:41.475142 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:41.710102 (+234960us) raft_consensus.cc:1685] finished
0709 13:14:41.710125 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:41.710328 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":551443,"raft.queue_time_us":556050,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":12168,"spinlock_wait_cycles":4668160,"thread_start_us":494896,"threads_started":1,"wal-append.queue_time_us":1050243}
W20260709 13:14:41.716094   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.653592   478 raft_consensus.cc:2468] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:41.661990  5652 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:41.717118  5652 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.594599  5444 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:41.695924  5384 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.724794  5384 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:41.570288  5573 consensus_queue.cc:237] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:41.725463   599 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:41.727025   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:41.727628   480 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:41.727705   478 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:41.594276  5527 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:41.679711   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.639842   551 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:41.692773  5699 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.733073  5699 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:41.733556  5527 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:41.734134  5527 raft_consensus.cc:2804] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:41.734342  5382 consensus_queue.cc:1059] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:41.692751  5547 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.736248   599 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:41.737166  5385 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:41.737459  5547 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:41.695616  5548 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:41.704349   552 raft_consensus.cc:2410] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:14:41.707360  5434 raft_consensus.cc:3060] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:41.734649  5527 raft_consensus.cc:697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:41.694005   597 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:41.699708  5541 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.738685   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:41.739355   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:41.740670   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:41.785270   624 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 15.
I20260709 13:14:41.737569  5385 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.787317  5385 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:41.790130   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:41.671516  5429 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:14:41.793313   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:41.758284  5652 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:41.723022  5444 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:41.738057  5519 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:41.769058   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:41.770016   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:41.772050   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:41.804167  1138 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:41.773929   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:14:41.778990   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 85069.3us
I20260709 13:14:41.794224   552 raft_consensus.cc:2410] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:14:41.786204   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:41.806630   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:41.807148   624 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:14:41.782513   479 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 14.
I20260709 13:14:41.806931   597 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:41.808329   632 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:41.827065   627 raft_consensus.cc:2393] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 18: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:41.830543   597 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:41.833039   552 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:41.765061  5382 raft_consensus.cc:3055] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:41.838944   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:41.874969   624 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 16.
I20260709 13:14:41.843473  5527 consensus_queue.cc:237] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.844563  5478 consensus_queue.cc:1059] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:41.839764  5666 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:41.760123  5699 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:41.800518  5384 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:41.860984  5541 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:41.862282  5686 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:41.841708   597 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:41.879010   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:41.879164   522 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:41.886466   624 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:41.837293  5525 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:41.888978   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 47376.5us
I20260709 13:14:41.866616  5676 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:41.866482  5382 raft_consensus.cc:740] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:41.906152   625 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:14:41.827546  5610 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:14:41.885270  5686 raft_consensus.cc:493] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.896258  5614 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:41.896303  5478 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:41.923530   555 raft_consensus.cc:1275] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:41.919680   632 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:41.962323   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:41.918561  5686 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:41.899667  5525 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:41.921332  5410 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:14:41.963445  5541 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:41.959952  5614 raft_consensus.cc:697] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:41.957520  5676 consensus_queue.cc:1059] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:14:41.957551  5652 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.978535   522 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:41.980727   552 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
W20260709 13:14:41.996795   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 328075us
W20260709 13:14:42.003448  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 152394us
I20260709 13:14:42.012650   624 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 15.
I20260709 13:14:42.022832   522 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:41.987470  5675 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.036460  5675 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:42.038537  5675 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:42.033947   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 434297us
I20260709 13:14:41.970347  5644 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:42.005872  1139 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:42.015493  5676 consensus_queue.cc:1243] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer 6ba2a9c02b534120bbf26e56a1e920ca log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:14:42.045430  1139 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:42.028829  5721 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:41.988153  5541 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:42.044788  5484 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:14:42.072448  5716 log.cc:927] Time spent T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:14:42.016417  5677 consensus_queue.cc:1048] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:14:41.971966  5382 consensus_queue.cc:260] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:42.056766  5614 consensus_queue.cc:237] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:42.052389  5526 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:42.058557  5719 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:14:42.059163  5718 log.cc:927] Time spent T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:14:42.054714   558 raft_consensus.cc:1240] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:42.042748  5518 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:42.102792  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:41.998642  5652 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:42.082701   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:42.081075   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:42.032838  5429 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:14:42.094697   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:42.112231   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:42.112787   631 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:42.100776   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:42.114440   629 raft_consensus.cc:2368] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12.
I20260709 13:14:42.052968  5211 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:42.117026   597 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:42.046865  5668 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:14:42.087471  5677 consensus_queue.cc:1243] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer 6ba2a9c02b534120bbf26e56a1e920ca log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:42.118428   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:42.101924  5526 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:42.123375  1169 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:42.126554   629 raft_consensus.cc:2393] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 15: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:42.128615  1166 raft_consensus.cc:1240] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 13:14:42.129932   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 96542.5us
I20260709 13:14:42.130964   448 leader_election.cc:400] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12.
W20260709 13:14:42.098881  5467 consensus_queue.cc:1175] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" responder_term: 14 status { last_received { term: 12 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:42.132229  5539 consensus_queue.cc:1048] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:42.132907   555 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:42.133078   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:42.133827   629 raft_consensus.cc:2368] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 14. Current term is 15.
I20260709 13:14:42.134594   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:42.137387  5610 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:42.142349   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:42.146560   448 leader_election.cc:403] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:14:42.150770  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.148505   631 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
W20260709 13:14:42.252318   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 121451us
W20260709 13:14:42.275511   628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.016s	sys 0.015s
W20260709 13:14:42.276237   628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.016s	sys 0.015s
I20260709 13:14:42.120244  5518 raft_consensus.cc:697] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:42.301944  5546 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12.
W20260709 13:14:42.359719  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 229999us
W20260709 13:14:42.372046  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.393245  1166 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:14:42.389099  5689 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.011s	sys 0.036s
W20260709 13:14:42.465847  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 104471us
I20260709 13:14:42.469933  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:42.474982  5484 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.475716  5484 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:42.478425  5484 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:42.397270  5525 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:42.487890  5720 log.cc:927] Time spent T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.446s	user 0.001s	sys 0.001s
I20260709 13:14:42.470799  5547 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:42.502393  5721 raft_consensus.cc:697] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:14:42.536468  5727 log.cc:927] Time spent T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.416s	user 0.000s	sys 0.001s
W20260709 13:14:42.536458  5686 consensus_meta.cc:287] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.001s
I20260709 13:14:42.537811  5686 raft_consensus.cc:515] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:42.539501  5735 log.cc:927] Time spent T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:14:42.540829  5731 log.cc:927] Time spent T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
I20260709 13:14:42.541115  5686 leader_election.cc:290] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:42.542723  5721 consensus_queue.cc:237] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:42.544188  5728 log.cc:927] Time spent T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 13:14:42.547629  5652 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:42.596006   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 505191us
W20260709 13:14:42.605145   525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.005s	sys 0.005s
W20260709 13:14:42.605651   598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.010s	sys 0.038s
W20260709 13:14:42.606208   598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.010s	sys 0.038s
W20260709 13:14:42.609884   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 492722us
W20260709 13:14:42.605746   525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.005s	sys 0.005s
I20260709 13:14:42.611938   626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 766) took 1006 ms. Trace:
W20260709 13:14:42.632308   632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.015s	sys 0.022s
W20260709 13:14:42.633054   632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.015s	sys 0.022s
W20260709 13:14:42.630105   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 530898us
I20260709 13:14:42.637144  1167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 696) took 1232 ms. Trace:
I20260709 13:14:42.514405  5547 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:42.473886  5518 consensus_queue.cc:237] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:42.659852  5750 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.660244  5736 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:42.661250  5736 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:42.662233  5754 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:42.663407  5754 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:42.640981  1167 rpcz_store.cc:276] 0709 13:14:41.403110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.403291 (+   181us) service_pool.cc:224] Handling call
0709 13:14:41.431804 (+ 28513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:41.432238 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:41.432281 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:41.436095 (+  3814us) log.cc:844] Serialized 26 byte log entry
0709 13:14:41.599432 (+163337us) spinlock_profiling.cc:243] Waited 8.19 ms on lock 0x7b1800197860. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb90d1 00007f4b683d4a0f
0709 13:14:42.036401 (+436969us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:42.036440 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.036522 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:42.634985 (+598463us) raft_consensus.cc:1685] finished
0709 13:14:42.635034 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.635601 (+   567us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15275,"raft.queue_time_us":1008,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":18830208,"thread_start_us":436793,"threads_started":1,"wal-append.queue_time_us":670393}
I20260709 13:14:42.666465  1171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 700) took 1161 ms. Trace:
I20260709 13:14:42.665566  5384 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:42.661201  5750 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:42.666855  5754 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:42.667328  5753 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.613699   626 rpcz_store.cc:276] 0709 13:14:41.605579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.607483 (+  1904us) service_pool.cc:224] Handling call
0709 13:14:41.607810 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:41.608148 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:41.608179 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:41.608574 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 13:14:41.964001 (+355427us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:41.964047 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:41.964119 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:42.611112 (+646993us) raft_consensus.cc:1685] finished
0709 13:14:42.611187 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.611612 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3479,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"thread_start_us":355017,"threads_started":1,"wal-append.queue_time_us":446784}
W20260709 13:14:42.673379   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 48884.9us
W20260709 13:14:42.734171  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.729668   597 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:42.687610   628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 765) took 1082 ms. Trace:
W20260709 13:14:42.674940  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 208165us
I20260709 13:14:42.673637  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:42.692138   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:42.704977  5755 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:42.796371  5755 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:42.788868   628 rpcz_store.cc:276] 0709 13:14:41.605301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.605783 (+   482us) service_pool.cc:224] Handling call
0709 13:14:41.606113 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:41.606481 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:41.606512 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:41.607087 (+   575us) log.cc:844] Serialized 52 byte log entry
0709 13:14:42.276839 (+669752us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:42.339049 (+ 62210us) log.cc:844] Serialized 14 byte log entry
0709 13:14:42.339339 (+   290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.339452 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:42.641663 (+302211us) raft_consensus.cc:1685] finished
0709 13:14:42.646628 (+  4965us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.687376 (+ 40748us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":60004,"prepare.run_wall_time_us":22978,"raft.queue_time_us":56431,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":4065,"spinlock_wait_cycles":4899200,"thread_start_us":658628,"threads_started":1,"wal-append.queue_time_us":860084}
I20260709 13:14:42.804147   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:42.804701  1167 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:42.805035   626 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:42.667577  5384 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:42.807937  5541 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:42.808496   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:42.808786   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:42.809517   483 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:14:42.809809  5548 raft_consensus.cc:3055] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:42.810376  5548 raft_consensus.cc:740] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:42.734494   551 raft_consensus.cc:1217] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Deduplicated request from leader. Original: 11.10->[12.11-12.11]   Dedup: 12.11->[]
I20260709 13:14:42.811666   551 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:14:42.704211   525 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:42.814653   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 110701us
I20260709 13:14:42.815655   525 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:42.816610  5644 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:42.817282  5754 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:14:42.817651  5644 raft_consensus.cc:2764] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:14:42.817394   632 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:42.750041   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:42.829226   479 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
W20260709 13:14:42.830847   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 101422us
I20260709 13:14:42.707917   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:42.832293   552 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 16.
I20260709 13:14:42.834144  5750 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:42.834488   553 pending_rounds.cc:85] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 5
I20260709 13:14:42.834827   553 pending_rounds.cc:107] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:14:42.835178   553 raft_consensus.cc:2889] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:42.809341  5384 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:42.835031  5750 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:42.694006  5736 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:42.847944   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:42.687104  5547 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:42.695372  5666 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.746721  5382 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:42.756425  5478 raft_consensus.cc:3055] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:42.672621  5486 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.731468  5527 consensus_queue.cc:1059] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.130s
I20260709 13:14:42.666976  1171 rpcz_store.cc:276] 0709 13:14:41.504753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.504900 (+   147us) service_pool.cc:224] Handling call
0709 13:14:41.530221 (+ 25321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:41.530660 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:41.530702 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:41.546984 (+ 16282us) log.cc:844] Serialized 26 byte log entry
0709 13:14:41.908474 (+361490us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:41.908518 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:41.910586 (+  2068us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:42.646343 (+735757us) raft_consensus.cc:1685] finished
0709 13:14:42.648348 (+  2005us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.666233 (+ 17885us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":2944,"thread_start_us":361074,"threads_started":1,"wal-append.queue_time_us":503833}
I20260709 13:14:42.731210  5745 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:42.803112  5526 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:42.868239  5666 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:42.871412   597 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:42.854130  5750 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.892997  5736 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:42.889338   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:42.859364  5478 raft_consensus.cc:740] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:42.889911  5755 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:42.769757  5753 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:42.904049   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:42.897642  5745 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:42.899729  5750 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:42.908061  5666 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:42.913859  5677 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:42.914633  5677 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:42.917021  5677 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:42.917811  5610 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:42.918471   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:42.918800  5610 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:42.919538  5527 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:42.919461   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:42.919267   552 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:42.920174   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:42.920419  5605 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:42.927428   597 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:42.920297   550 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:42.930024   628 raft_consensus.cc:2393] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 14: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:42.920111  5527 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.923866   525 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:42.900548  5736 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:42.940977   554 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:42.943912   597 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:42.950582  5689 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:42.951749  5729 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:42.951501  5689 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:42.952437  5729 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:42.954370  5689 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:42.955549   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 61105us
I20260709 13:14:42.957101  1171 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:14:42.957413   525 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:42.958242  5729 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:42.951509  5526 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:42.936858  5527 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:42.943642   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:42.963416   483 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 15.
I20260709 13:14:42.940240  5677 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:42.932188  5755 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.971447   626 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 16.
I20260709 13:14:42.970719  5384 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:42.970984  5677 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:42.971455  5723 log.cc:927] Time spent T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.823s	user 0.005s	sys 0.011s
I20260709 13:14:42.965718  5526 raft_consensus.cc:697] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:14:42.984812   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 56133.7us
W20260709 13:14:42.985747  5434 consensus_meta.cc:287] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.128s	user 0.019s	sys 0.009s
I20260709 13:14:42.986385  5434 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:42.988099  5755 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:42.989820  5736 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:42.990839  5755 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:42.995446  5753 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:42.996169  5526 consensus_queue.cc:237] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:42.997614   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:42.998811   625 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:42.986024  5747 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:43.001974  5747 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.002655   558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2342) took 1310 ms. Trace:
I20260709 13:14:43.004701   558 rpcz_store.cc:276] 0709 13:14:41.668719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.714126 (+ 45407us) service_pool.cc:224] Handling call
0709 13:14:41.714388 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.099362 (+384974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.934753 (+835391us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54000ec254. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:42.978613 (+ 43860us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":782216960}
I20260709 13:14:43.006062  5457 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:43.008355   557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2403) took 1636 ms. Trace:
I20260709 13:14:43.008787   557 rpcz_store.cc:276] 0709 13:14:41.372162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.372427 (+   265us) service_pool.cc:224] Handling call
0709 13:14:41.372746 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:41.372960 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:41.372996 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:41.380289 (+  7293us) log.cc:844] Serialized 26 byte log entry
0709 13:14:41.770116 (+389827us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:41.770169 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:41.770256 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:42.833508 (+1063252us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:43.006264 (+172756us) raft_consensus.cc:1685] finished
0709 13:14:43.006290 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:43.008173 (+  1883us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8627584,"thread_start_us":353361,"threads_started":1,"wal-append.queue_time_us":587933}
I20260709 13:14:43.010016  5410 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:43.010686  5410 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.006805   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.015591   632 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:14:42.983129  5677 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:42.980450  5384 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:42.971848  5605 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.045634  5384 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:43.047494  5605 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:43.028870  5747 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:43.029440  5410 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:43.030961  5652 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:43.057823  5652 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.060176  5652 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:43.031544   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:43.033185  5729 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:43.060910  5729 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.060599   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.061309  5729 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:43.061686   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:43.064378  5745 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:43.067368   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:43.037889  5519 consensus_meta.cc:287] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 1.198s	user 0.010s	sys 0.011s
I20260709 13:14:42.975771  5489 consensus_queue.cc:1059] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 12.11, Next index: 11, Last known committed idx: 10, Time since last communication: 0.144s
I20260709 13:14:43.071774  5489 consensus_queue.cc:1243] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer 6ba2a9c02b534120bbf26e56a1e920ca log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:14:43.017690  1138 leader_election.cc:304] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:14:43.072683  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 97598.3us
W20260709 13:14:43.043882  5759 log.cc:927] Time spent T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.240s	user 0.000s	sys 0.002s
I20260709 13:14:43.075623  5467 raft_consensus.cc:2804] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:43.076201  5467 raft_consensus.cc:697] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:43.077287  5467 consensus_queue.cc:237] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.051564   597 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:43.084594   553 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:43.085700  5676 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:43.086097  5676 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.086440  5676 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:43.087860   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.088971   559 raft_consensus.cc:2410] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:14:42.948489  5486 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.092779  5666 consensus_queue.cc:1059] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:43.094676   553 raft_consensus.cc:1275] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260709 13:14:43.043116  5385 consensus_meta.cc:287] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 1.255s	user 0.015s	sys 0.003s
I20260709 13:14:43.097883  5385 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.099191   630 raft_consensus.cc:2393] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 14: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:14:43.054548   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 97303.1us
I20260709 13:14:43.055207  5525 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:43.103686  5525 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.105100   447 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:43.106146  5525 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:43.108038  5385 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:43.109936  5605 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:43.111081  5745 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:43.110605  5729 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.132251  5322 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:14:43.111624  5750 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.119058   447 leader_election.cc:400] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 11. Current term is 12.
I20260709 13:14:43.130955   633 raft_consensus.cc:1240] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:14:43.152573   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.155972   553 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:14:43.154526   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.152766  5745 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.171536  5747 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.172202  5747 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.172734  5729 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:43.172943  5652 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:43.173735  5652 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.174181   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54268 (request call id 2210) took 1399 ms. Trace:
I20260709 13:14:43.174491  5747 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:43.174618   630 rpcz_store.cc:276] 0709 13:14:41.774763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.838636 (+ 63873us) service_pool.cc:224] Handling call
0709 13:14:43.173952 (+1335316us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54001e4954. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:43.174109 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2831716608}
I20260709 13:14:43.176055  5754 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:43.176867  5754 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:43.170722   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 63776.9us
I20260709 13:14:43.142720  5525 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:43.184397   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:43.161947  5410 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:43.184926   525 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:43.195905   447 leader_election.cc:400] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 14. Current term is 15.
I20260709 13:14:43.196327   447 leader_election.cc:403] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:43.150341  5519 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.195467  5605 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:43.206457  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:43.211212  1171 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:43.198962  5322 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.213989   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.214728   556 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:43.215281  5525 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.216073  5384 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.217160  5410 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.218956   625 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:43.219589  5410 leader_election.cc:290] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:43.220192  5419 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:43.220908  1169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36732 (request call id 885) took 1142 ms. Trace:
I20260709 13:14:43.221340  1169 rpcz_store.cc:276] 0709 13:14:42.078221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.078345 (+   124us) service_pool.cc:224] Handling call
0709 13:14:43.220525 (+1142180us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b54003f9654. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:43.220668 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45308672}
I20260709 13:14:43.223729  5614 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:43.218858   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:43.212307   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 59538us
I20260709 13:14:43.233052  5652 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:43.234517  5757 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:43.235119  5757 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.208961  5754 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:43.212486  5729 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 14. Current term is 15.
I20260709 13:14:43.225832   522 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:43.245591   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.245570   525 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:43.243798   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:43.228065  5614 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.236842  5745 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:43.237637  5750 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:43.252499  5614 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:43.209417  5527 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.253934   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:43.250734  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:43.242991  5652 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:43.252393   559 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 18.
I20260709 13:14:43.254212  5639 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:43.263876  5527 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:43.255559  5211 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:43.266242   476 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:43.267711   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:43.268563   475 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 16.
I20260709 13:14:43.265781  5211 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.276108  1169 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:43.277578   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:43.244760  5605 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.220911  5419 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.254011  5754 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:43.251834  5712 raft_consensus.cc:493] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:43.291814   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:43.240025  5322 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.299547   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:43.306416   483 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:43.303762   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:43.300869   597 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:43.253186  5676 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.302938  5639 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.309306  5639 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.309716   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.310448  5676 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:43.316854   627 raft_consensus.cc:2393] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 15: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:43.311131   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:43.315336   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 74831us
I20260709 13:14:43.321475   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:43.258667  5677 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.293146  5486 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:43.311353   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:43.328284   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.328608   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:43.329073   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.346156   553 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 12.
I20260709 13:14:43.352538   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.347534   478 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:43.350191   550 raft_consensus.cc:1275] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:14:43.353839   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:43.354418   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.354672  5211 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:43.355592   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.300169  5754 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.352118   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:43.351197  5778 log.cc:927] Time spent T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:14:43.354449   559 raft_consensus.cc:3060] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:14:43.356386   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 55613us
I20260709 13:14:43.357101   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.356212   550 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:43.365348  5639 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:43.365293   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.366415  5322 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:43.367719  5772 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:14:43.367992   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.355268  5736 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:43.375403  5736 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.376317  5211 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.376808  5211 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.377820  5736 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:43.378772  5211 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:43.381443  5729 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:43.382135  5729 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.375797   556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43548 (request call id 760) took 1370 ms. Trace:
I20260709 13:14:43.316674  5605 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:43.309815  5519 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:43.391566  1171 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:43.312727  5419 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:43.397290   553 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:14:43.398125  5610 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:43.369338  5754 raft_consensus.cc:3060] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:43.399168  5729 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:43.399798   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 2214) took 1296 ms. Trace:
I20260709 13:14:43.400197   631 rpcz_store.cc:276] 0709 13:14:42.103699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.177378 (+ 73679us) service_pool.cc:224] Handling call
0709 13:14:42.177734 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:42.301661 (+123927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:42.301705 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:42.302161 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:14:43.058384 (+756223us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b18002d4300. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb90d1 00007f4b683d4a0f
0709 13:14:43.257001 (+198617us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:43.257073 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:43.257156 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:43.399354 (+142198us) raft_consensus.cc:1685] finished
0709 13:14:43.399376 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:43.399628 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128299,"raft.queue_time_us":153203,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":23121,"spinlock_wait_cycles":26083072,"thread_start_us":198284,"threads_started":1,"wal-append.queue_time_us":1025565}
I20260709 13:14:43.402285   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:43.403818  1139 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:43.405187  5211 raft_consensus.cc:2764] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:14:43.405890  5211 consensus_queue.cc:1048] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:43.406628  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:43.407497  1171 raft_consensus.cc:2368] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 13. Current term is 14.
I20260709 13:14:43.407759  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:43.408138   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.409068  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:43.391867   624 raft_consensus.cc:1240] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:43.384578   556 rpcz_store.cc:276] 0709 13:14:42.005056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.005204 (+   148us) service_pool.cc:224] Handling call
0709 13:14:42.005613 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:43.215227 (+1209614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:43.375552 (+160325us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400152cd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:43.375725 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2771217152}
I20260709 13:14:43.391634   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:43.368835  5745 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:43.411005   633 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:43.418458  5513 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:43.443866   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:43.447845   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 57101.5us
I20260709 13:14:43.374850  5712 raft_consensus.cc:515] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.394140  5736 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:43.419273  5754 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.317627  5652 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.421205  5745 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.316978  5548 consensus_queue.cc:260] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.482810   559 raft_consensus.cc:2468] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:43.491277   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:43.493002   555 raft_consensus.cc:2393] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 13: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:43.478758  5745 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:43.497001   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:43.511835   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:43.512564   481 raft_consensus.cc:3060] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:43.514357   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:43.515141   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:43.515380   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:43.523752   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:43.524902   478 raft_consensus.cc:2393] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 13: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:43.525722   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:43.526296   478 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:43.525966  5478 consensus_queue.cc:260] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.527454  5478 raft_consensus.cc:3060] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:43.527904   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:43.529315   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:43.527462  1138 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:43.536077   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:43.536839   484 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:14:43.539391   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:43.539836   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:43.540575   482 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:43.540838  5525 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:43.542306  1138 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:43.544838   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:43.547062  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:43.547622  5760 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:43.548175  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:43.550498  5467 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:43.556623  5384 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:43.501711  5541 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:43.557449  5541 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.559573  5541 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:43.561874  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:43.460117  5605 consensus_queue.cc:1059] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:14:43.540578   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:43.563741  5652 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:43.564329  5652 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:43.567268  1169 raft_consensus.cc:2468] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:43.572399   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:43.572995   559 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:43.580652   481 raft_consensus.cc:2468] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:43.583395   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:43.584182   553 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:43.580063   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.588909   555 raft_consensus.cc:2393] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 13: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:43.588734   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:43.590896  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:43.505200  5736 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.599383   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.612257   556 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
W20260709 13:14:43.608057  5675 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.013s	sys 0.021s
W20260709 13:14:43.627445   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.641479   597 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:43.608191  5434 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.651749   558 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:14:43.589368  5410 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
W20260709 13:14:43.637863  5675 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.014s	sys 0.022s
I20260709 13:14:43.652233   558 pending_rounds.cc:85] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 8
I20260709 13:14:43.632045  5513 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:43.660372   558 pending_rounds.cc:107] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:14:43.660683   558 raft_consensus.cc:2889] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:43.661453  5434 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.662122  5605 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:43.662977  5605 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.663836  5434 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:43.664588 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:43.665627  5605 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:43.667451  5429 raft_consensus.cc:3055] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:43.667937  5429 raft_consensus.cc:740] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:43.668977  5429 consensus_queue.cc:260] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.682462   484 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 15.
I20260709 13:14:43.684588   478 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 17.
I20260709 13:14:43.650086  5489 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:43.644007  5757 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:43.693578   559 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 15.
I20260709 13:14:43.704037   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:43.681056  5525 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:43.684832  5434 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.710469   599 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:43.695796  5489 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:14:43.715121   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 208649us
I20260709 13:14:43.719971   553 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 17.
I20260709 13:14:43.706843  5754 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:43.725409   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 147316us
I20260709 13:14:43.726382   599 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:43.707746  5712 leader_election.cc:290] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:43.699703  5513 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.729631   599 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:43.718289  5489 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:43.728674  5610 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:43.731956  5384 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:43.742838   599 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:43.731815  5750 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:43.751205   447 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:43.751731   599 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:43.745674   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 184169us
I20260709 13:14:43.753845   522 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:43.756982   523 leader_election.cc:400] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 13. Current term is 14.
I20260709 13:14:43.757320   523 leader_election.cc:403] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:43.740017  5385 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:43.755424  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 139644us
I20260709 13:14:43.722167  5525 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.728430  5434 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.750576  5384 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:43.754453  5676 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:43.757611  5478 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:14:43.776857   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 121217us
I20260709 13:14:43.771157  5518 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:43.774770  5384 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:43.797546  5783 log.cc:927] Time spent T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:14:43.798640   632 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:43.798787  5802 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:43.799430   629 raft_consensus.cc:1275] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:14:43.799722   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:43.799589   523 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:43.801254   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:43.802457   627 raft_consensus.cc:2393] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 13: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:43.776729  5757 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.766745  5610 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.794075   448 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:43.797640   633 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:14:43.780949  5410 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939) with higher term. Message: Invalid argument: T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 13. Current term is 14.
W20260709 13:14:43.814721   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 71150.1us
I20260709 13:14:43.815593   447 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:43.790509  5518 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:14:43.820977   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 69335.1us
I20260709 13:14:43.824321   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.825449  5605 raft_consensus.cc:2764] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:14:43.824489  5802 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:43.826377  5802 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.828779  5802 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:43.829249  5526 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:43.810695  5652 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:43.830381  5652 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.832630  5652 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:43.835417   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.837845  5434 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:43.813318  5736 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:43.822726  5518 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:43.844733  5771 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:43.845052  5793 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:43.845909  5614 consensus_meta.cc:287] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.000s
I20260709 13:14:43.846347  5614 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.846638  5745 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.847469   554 raft_consensus.cc:2393] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 14: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
W20260709 13:14:43.819613  5791 log.cc:927] Time spent T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:14:43.848820   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:43.849437  5803 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:14:43.850865   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:43.852735   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:43.857038  5513 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:43.845799   448 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:43.860448  5410 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:43.823421  5757 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.865046  5610 leader_election.cc:290] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:43.820852  5792 log.cc:927] Time spent T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:14:43.821663   599 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:43.871618   476 raft_consensus.cc:2393] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 14: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:43.882512   625 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 18. Current term is 19. Ops: []
W20260709 13:14:43.884624   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 63024.2us
I20260709 13:14:43.885551   599 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:43.857067  5525 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:43.888304  1139 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:43.890233   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:43.890908   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cfcc65b0e14d6cb141bc839a21b558" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:43.896579   478 raft_consensus.cc:3060] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:14:43.898449   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 82971.4us
I20260709 13:14:43.900110  5810 raft_consensus.cc:2804] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:43.906733  5385 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:43.907364  5790 raft_consensus.cc:2804] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:43.909417   627 raft_consensus.cc:1275] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:14:43.879347  5712 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:43.889356  5610 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:43.845904  5793 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.917948   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:43.931037   447 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:43.933398   597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.966796   478 raft_consensus.cc:2468] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 16.
I20260709 13:14:43.968361   484 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 14.
I20260709 13:14:43.918220  5614 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:43.973851  5790 raft_consensus.cc:697] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:43.975044  5790 consensus_queue.cc:237] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.979620   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:43.983811   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:43.990610  5801 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:43.913048  5810 raft_consensus.cc:697] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:43.992573  5810 consensus_queue.cc:237] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.993914  5489 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:43.964731  5610 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:43.995720  5610 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:43.996616  5489 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:44.000865   447 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:44.001673  5801 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:44.002056  5801 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:43.930550  5513 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:43.930347  5757 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:43.928350  5745 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 19 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:44.011452  5513 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:43.917471  5805 consensus_queue.cc:1059] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.116s
I20260709 13:14:44.014254  5805 raft_consensus.cc:3055] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:44.014649  5805 raft_consensus.cc:740] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:43.929093  5384 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:44.022182   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 222700us
I20260709 13:14:44.002409  5801 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:43.906766  5518 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:44.033385   523 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:44.034462   447 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:43.984704  5755 consensus_queue.cc:1048] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:14:44.037307  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:44.044206  1169 raft_consensus.cc:2410] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:14:44.044361   523 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:44.048899  5771 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:44.050212  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:44.051126  1174 raft_consensus.cc:2393] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 13: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:44.041131  5652 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:44.046639   448 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:44.060922  5384 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:44.065716  5813 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:44.066151  5518 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:44.068989  5766 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:44.064177  5793 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:44.064407  5513 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:44.064608  5809 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:44.015573  5805 consensus_queue.cc:260] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:44.042033  5802 consensus_queue.cc:1059] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:14:44.078130   448 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:44.098567  5801 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:44.089605   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:44.113511   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:44.114106  5801 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:44.114653   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:44.094450  5806 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:44.094942   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:44.120677  5806 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:44.121277   448 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:44.121531  5806 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:44.100672   597 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:44.102855   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:44.126477   553 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:44.124148   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:44.084818   523 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:44.038434  5712 consensus_queue.cc:1059] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:14:44.115876   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:44.118335  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:44.118544  5805 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:44.119832  5802 raft_consensus.cc:3055] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:44.133733   632 raft_consensus.cc:2393] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 14: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
W20260709 13:14:44.132141   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 84428.1us
W20260709 13:14:44.132238   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 47552us
I20260709 13:14:44.140992   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:44.129410  5712 raft_consensus.cc:3055] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:44.148144  1168 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
I20260709 13:14:44.150744  1168 pending_rounds.cc:85] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Aborting all ops after (but not including) 12
I20260709 13:14:44.150980  1168 pending_rounds.cc:107] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 13:14:44.151146  1168 raft_consensus.cc:2889] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:44.151175   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.130110  5745 raft_consensus.cc:2804] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:44.133210  5525 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:44.131702  5652 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:44.144315  5814 log.cc:927] Time spent T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 13:14:44.154066   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:44.140033  5614 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:44.132926  5802 raft_consensus.cc:740] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:44.163816   630 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:14:44.155611  5745 raft_consensus.cc:697] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:44.168313  5745 consensus_queue.cc:237] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:44.147648  5513 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.150666  5712 raft_consensus.cc:740] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:44.140951  5610 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:44.156633  5806 consensus_queue.cc:1059] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:14:44.123337  5809 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:44.194154   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:44.199368  5802 consensus_queue.cc:260] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:44.205803  5610 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:44.211122  5804 raft_consensus.cc:3055] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:44.222764  5804 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:44.240096   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:44.240960   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:44.195144  5614 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:14:44.242389   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:44.242743  5677 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:44.243064   553 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 8.
I20260709 13:14:44.244046  5802 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:44.244114   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:44.245303  5804 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:44.195015  5513 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:44.244448   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:44.240475   597 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:44.255460   597 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:44.257752  5385 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:44.286088   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:44.286900   559 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:44.240964  5712 consensus_queue.cc:260] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:44.285336   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 139754us
I20260709 13:14:44.295411   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:44.296340   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 147427us
W20260709 13:14:44.315395   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.284610  5385 raft_consensus.cc:697] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:44.288275  5677 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:44.324347   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:44.324988   559 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 19.
I20260709 13:14:44.324404  5790 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:44.326696  5801 consensus_queue.cc:1059] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:44.326875   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:44.327152  5790 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:44.329324  5790 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:44.329804  5790 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:44.330482   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:44.331553   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:44.333101   476 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:44.333990   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:44.334225   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:44.335748   558 raft_consensus.cc:2393] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 14: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:44.295928  5384 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:44.287647  5610 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:14:44.329348   628 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:44.341725   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:44.342727   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.338537  5790 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:44.345877   559 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 13:14:44.345490   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:44.348276   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:44.355717   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:44.342247  5677 raft_consensus.cc:697] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:44.344538  5712 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:44.361096   629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 2224) took 1191 ms. Trace:
I20260709 13:14:44.370862   629 rpcz_store.cc:276] 0709 13:14:43.169574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.292833 (+123259us) service_pool.cc:224] Handling call
0709 13:14:43.327902 (+ 35069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:43.799790 (+471888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.360804 (+561014us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b54000af854. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:44.361021 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":947069312}
I20260709 13:14:44.375778   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:44.375677  5677 consensus_queue.cc:237] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:44.353096  5736 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:44.343767  5384 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:44.382822   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:44.387562   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:44.389717   476 raft_consensus.cc:2393] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 14: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:44.395256  5736 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:44.395656  5525 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:44.431103   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:14:44.434724  5828 log.cc:927] Time spent T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:14:44.435847  5513 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:44.426965   447 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:44.436580  5798 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:44.437940   630 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:44.421823  5736 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:44.461692  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.437330  5790 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:44.437403  5795 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:44.472656   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:44.480075   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.480789  5576 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.498057  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:44.507507  5576 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:44.510054  5576 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:44.511185  5513 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:44.511759  5513 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:44.512444  5736 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:44.513007  5736 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:44.513759  5513 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:44.416874  5385 consensus_queue.cc:237] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:44.521600   479 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:44.524336   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:44.522275   624 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 14. Current term is 15. Ops: []
W20260709 13:14:44.538208   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 103980us
I20260709 13:14:44.520766  5766 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:44.515174  5736 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:44.535665  5548 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:44.546669   525 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:44.551664   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:44.551637   525 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:44.557096   525 leader_election.cc:304] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:44.559962   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 212521us
I20260709 13:14:44.568502  5414 consensus_queue.cc:1059] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:14:44.573279   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:44.574687   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:44.557987  5639 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:44.575963  5849 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:44.583972   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:44.585265   477 raft_consensus.cc:2410] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 6.
I20260709 13:14:44.586665   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:44.586838   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:44.589848   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:44.594380   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:44.560022  5614 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:44.598366  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 112909us
I20260709 13:14:44.600862  5419 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:14:44.599170   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:44.550254  5766 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:44.616546   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:44.627085   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:44.628008   476 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:44.644500   554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59128 (request call id 2427) took 1418 ms (client timeout 1569 ms). Trace:
W20260709 13:14:44.644996   554 rpcz_store.cc:269] 0709 13:14:43.226095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.226773 (+   678us) service_pool.cc:224] Handling call
0709 13:14:44.644278 (+1417505us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b54000497d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:44.644413 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1379627776}
W20260709 13:14:44.646126   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.649360   625 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:44.653666  5766 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:44.658556  5845 log.cc:927] Time spent T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:14:44.659545  5843 log.cc:927] Time spent T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:14:44.660401  5809 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:44.659668   632 raft_consensus.cc:2410] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:14:44.659536   447 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:44.663270   625 raft_consensus.cc:1240] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:44.671834   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:44.675123   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:44.676256   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:44.668417  5414 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:44.692339   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:44.689567   476 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 15.
I20260709 13:14:44.697962   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:44.698961   554 raft_consensus.cc:1275] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:14:44.695056   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 127975us
I20260709 13:14:44.700949   525 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:44.703590   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:44.704622   631 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 8: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:44.709710   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:44.712553   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:44.713379   476 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:44.715655   447 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:44.683014  5525 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:44.715494   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:44.721347   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:44.721920   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:44.733523   447 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:44.724236  5795 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:44.722584  5809 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:44.722134  5810 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.735186   476 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 16.
I20260709 13:14:44.736495   550 raft_consensus.cc:1217] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Deduplicated request from leader. Original: 11.10->[12.11-12.11]   Dedup: 12.11->[]
I20260709 13:14:44.740331  5576 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:44.734899  5525 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:44.755138  5810 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:44.757333  5810 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:44.770054  5856 consensus_queue.cc:1048] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:44.741129  1141 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:44.771771  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 72909us
I20260709 13:14:44.772506  5858 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:44.773798  5809 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:44.742548  1167 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:57004
I20260709 13:14:44.774423  1141 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:44.775046  1167 raft_consensus.cc:606] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:44.775885   476 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:44.776027  5322 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:44.743362  5541 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:44.744141   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:44.779038   551 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 8: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:44.778514  1141 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:44.749284   550 raft_consensus.cc:1240] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:14:44.724836  5851 consensus_queue.cc:1059] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:14:44.741945   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:44.740978  5429 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:44.778009  5541 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:44.781466   550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59128 (request call id 2432) took 1214 ms. Trace:
I20260709 13:14:44.784664   550 rpcz_store.cc:276] 0709 13:14:43.566668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.570974 (+  4306us) service_pool.cc:224] Handling call
0709 13:14:43.588905 (+ 17931us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:44.736379 (+1147474us) spinlock_profiling.cc:243] Waited 70.8 ms on lock 0x7b54001b0420. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68390dc0 00007f4b6841b1c0 00007f4b6841c231 00007f4b68418d8f 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c
0709 13:14:44.781236 (+ 44857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.781414 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162940800}
I20260709 13:14:44.781495   476 raft_consensus.cc:1275] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:14:44.783365  5322 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:44.791308  5322 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:44.791826  5322 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:44.788518  5541 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:44.789275  5419 raft_consensus.cc:3055] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:44.792789  5419 raft_consensus.cc:740] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:44.793462   481 raft_consensus.cc:1240] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:44.793905  5419 consensus_queue.cc:260] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:44.789808  5795 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:44.795230   481 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:14:44.806968  5712 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:44.808681   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:44.735291  5854 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:14:44.816478   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 71840.1us
W20260709 13:14:44.815604   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 114755us
I20260709 13:14:44.819535   525 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:44.795971  5795 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:44.828358  1141 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:44.830015  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:44.834981  1174 raft_consensus.cc:2393] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 15: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:44.837683  5860 consensus_queue.cc:1059] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:44.838095  5854 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:44.841295  5854 raft_consensus.cc:3055] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:44.841629  5854 raft_consensus.cc:740] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:44.842545  5854 consensus_queue.cc:260] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:44.852347   484 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:44.855350  1170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:44.824848  5419 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:44.851540  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:44.863464  1168 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:44.865873  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:44.849243  5211 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:44.827328  5856 consensus_queue.cc:1059] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:14:44.885748  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:44.863336  5801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.011s	sys 0.007s
W20260709 13:14:44.888402   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 57980.9us
I20260709 13:14:44.895943  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f221a3b77aba453e80c06e1de30b76aa" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:44.896986  5857 log.cc:927] Time spent T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:14:44.899197   480 raft_consensus.cc:2410] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:14:44.904347  5795 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:44.905095   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:44.907399  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:44.908619  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:44.890414  5801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.012s	sys 0.008s
W20260709 13:14:44.911504  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 59497us
I20260709 13:14:44.932590   484 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:44.948071  1138 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:44.949919   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:44.950819   633 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 15.
I20260709 13:14:44.951902  1138 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:44.959199  5211 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:44.959568  5861 consensus_queue.cc:1059] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:14:44.952602  5809 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:44.955451  5741 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:44.959903  5822 consensus_queue.cc:1059] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
W20260709 13:14:44.967967   447 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.968830  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:44.981835   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:44.982728   555 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:44.985589  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:45.005273   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:45.005584   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:45.007808  5864 log.cc:927] Time spent T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:14:44.963722  5869 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:45.063345  5869 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:45.064517  5741 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:45.065521  5869 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:44.983959  5547 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:45.024381   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:45.026870   558 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:45.043439  5322 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:45.047600  5809 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:44.955142  5771 consensus_queue.cc:1059] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:14:45.061721  5795 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.062119  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:45.062289   551 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:14:45.067817  1174 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:45.085932  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:45.087256  1167 raft_consensus.cc:1240] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 14. Current term is 15. Ops: []
W20260709 13:14:45.087464  1140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.078589  5810 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:45.085096   597 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:45.095523   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.093801   597 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:45.080601  5429 consensus_queue.cc:1059] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
W20260709 13:14:45.112980  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 161178us
I20260709 13:14:45.119024  5513 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:45.119560  5513 raft_consensus.cc:697] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:45.080530  5547 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:45.088835  5605 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.123858  5605 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:45.125738  5605 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:45.127008   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:45.083679  5795 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:45.084326  5809 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:45.140708  1171 raft_consensus.cc:1275] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:14:45.142942   448 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:45.146309   448 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:45.151173   448 leader_election.cc:304] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:45.106431  5610 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:45.158699   448 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:45.117234  5810 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:45.161098   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:45.161945  5211 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.162495  5429 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:45.162894  5605 raft_consensus.cc:2749] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:45.161242   448 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:45.168157   480 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:14:45.146790  5513 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:45.174767  5809 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:45.176712   484 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
W20260709 13:14:45.180531   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 86822.1us
I20260709 13:14:45.155472  5806 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:45.156937  5801 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:45.182750   448 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:45.189867   597 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:45.199179  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.206172  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:45.158668  5840 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:14:45.208190   448 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:45.205600  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:45.215755   448 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:45.189828  5793 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:45.180823  5211 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:45.224319   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 795) took 1105 ms. Trace:
I20260709 13:14:45.219106  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:45.231432  1167 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 15.
I20260709 13:14:45.226678  5810 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:45.226769  5835 raft_consensus.cc:3055] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:45.247927  5835 raft_consensus.cc:740] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:45.217191  5806 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:45.213248  5712 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:45.248845  5835 consensus_queue.cc:260] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:45.227543  5771 consensus_queue.cc:1059] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:14:45.232494   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:45.230981   630 rpcz_store.cc:276] 0709 13:14:44.118936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.164628 (+ 45692us) service_pool.cc:224] Handling call
0709 13:14:44.164910 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:44.438448 (+273538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:45.224102 (+785654us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400023354. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:45.224264 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627395456}
I20260709 13:14:45.251709   484 raft_consensus.cc:1275] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:14:45.211086  5804 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:45.237854   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:45.254962   483 raft_consensus.cc:2393] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 15: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:45.238299  5322 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:45.239480  5795 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:45.256747  5771 raft_consensus.cc:3055] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:45.257150  5771 raft_consensus.cc:740] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:45.257627   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:45.241315  5211 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:45.257901  5771 consensus_queue.cc:260] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:45.242383  5547 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:45.218112  5883 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:45.233645  5801 raft_consensus.cc:2749] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:45.247293  5854 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:45.260423  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:45.262121   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 301321us
I20260709 13:14:45.264902  1169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36724 (request call id 715) took 1208 ms. Trace:
I20260709 13:14:45.265367  5384 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:45.265529  1169 rpcz_store.cc:276] 0709 13:14:44.056222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.056361 (+   139us) service_pool.cc:224] Handling call
0709 13:14:44.087972 (+ 31611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:44.102877 (+ 14905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:44.102921 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:44.102978 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:44.103021 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:45.264612 (+1161591us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b54004583d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:45.264685 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:45.264827 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33786624}
I20260709 13:14:45.233572   597 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:45.253188   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:45.262912   522 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:45.255208   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:45.267899   480 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:45.234041   525 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.17.129:45711 timed out after 1.573s (SENT) [suppressed 5 similar messages]
I20260709 13:14:45.268528   448 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:45.271008   523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.273025   448 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:45.275457   522 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:45.259104  5771 raft_consensus.cc:3060] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:45.277411   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 43882.1us
I20260709 13:14:45.279490   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:45.283269   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:45.283865   624 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:45.291317   597 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:45.272320  5795 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:45.272563  5384 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:14:45.297183   625 raft_consensus.cc:1240] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:45.297749   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:45.275252  5801 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:45.278601  5835 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:45.280763  5806 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:45.281005  5547 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:45.302731   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:45.302274  5810 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:45.312153  5810 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.312508  5810 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:45.312834   478 raft_consensus.cc:1240] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:45.317126  5754 raft_consensus.cc:3055] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:45.317539  5754 raft_consensus.cc:740] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:45.318423  5754 consensus_queue.cc:260] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:45.293933  5860 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:45.322841  5860 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:45.323221  5860 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:45.303874  5677 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:14:45.278051  5712 consensus_queue.cc:1048] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:14:45.329185   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372575938bbf471c935e1b39ba9e588f" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:45.307039  5806 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:45.330608  5806 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:45.341271  5525 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:45.338660   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:45.351922   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 117889us
I20260709 13:14:45.353552   525 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:45.330677   522 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:45.366348   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 63737.9us
I20260709 13:14:45.290393  5760 consensus_queue.cc:1048] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:14:45.371723   522 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:45.372663   597 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:45.380805  5755 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:45.366353  5871 consensus_queue.cc:1048] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:14:45.374210  5547 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:45.387405  5754 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:45.387745  5547 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:45.388347  5547 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:45.368790  5849 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:45.396332   556 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 15.
W20260709 13:14:45.399336   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.391736  5753 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:45.412226   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:45.413003   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:45.414285   552 raft_consensus.cc:1275] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:14:45.417517   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:45.423885   476 raft_consensus.cc:1240] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:45.407754  1139 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:45.373757  5525 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:14:45.439383   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.441140   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:45.448047   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:45.455262   476 raft_consensus.cc:2393] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 15: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:45.419942  5849 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:45.481863  5849 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:45.460834  5429 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.487532  5429 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:45.477226  5806 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:45.432430  5795 raft_consensus.cc:493] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:45.503110   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:45.504020   478 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:45.523980  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:45.461387  5677 consensus_queue.cc:1048] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:14:45.499989  5736 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.521299  5858 raft_consensus.cc:493] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.532434  5429 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:45.532140  5858 raft_consensus.cc:515] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:45.534714  5858 leader_election.cc:290] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:45.537556   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:45.540205  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12fb4cc9b97f4bab8a7fad87dcdba73c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:45.540686  5806 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:45.542131  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:45.543969  5547 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:45.545418   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:45.547817   477 raft_consensus.cc:2410] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:14:45.554356   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:45.555184   557 raft_consensus.cc:2393] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 13: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:45.514119  5486 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:45.545140  5849 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:45.584218   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:45.585994   447 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:45.586840   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:45.601293   625 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:45.602066   552 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:45.508806  5795 raft_consensus.cc:515] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:45.546173  5736 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:45.606774   559 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:14:45.615571  5871 consensus_queue.cc:1059] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:45.618330  5795 leader_election.cc:290] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:45.623488  5745 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:45.635210   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:45.636588   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:45.637651   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:45.638701   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:45.613880  5513 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:14:45.641173   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:45.649529   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:45.655220  1169 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:45.648188   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:45.657985   483 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:14:45.661947   626 raft_consensus.cc:2393] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 13: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:45.657155   629 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 16.
I20260709 13:14:45.664906   559 raft_consensus.cc:1240] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:45.664505   525 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:45.670758   480 raft_consensus.cc:2468] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 15.
I20260709 13:14:45.672617   477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38132 (request call id 2411) took 1147 ms. Trace:
I20260709 13:14:45.673126   477 rpcz_store.cc:276] 0709 13:14:44.513790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.612087 (+ 98297us) service_pool.cc:224] Handling call
0709 13:14:45.661010 (+1048923us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b54001419d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b6841d2fa 00007f4b6d3deb17 00007f4b669596d4 00007f4b66959662 00007f4b66959591 00007f4b6695950c 00007f4b669587c2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:45.661193 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2137910656}
I20260709 13:14:45.626312  5840 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:45.679824   525 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:45.681025  5677 consensus_queue.cc:1059] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:14:45.684358  5677 raft_consensus.cc:3055] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:45.684733  5677 raft_consensus.cc:740] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:45.685555  5677 consensus_queue.cc:260] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:45.686280  5869 raft_consensus.cc:3055] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:45.686712  5869 raft_consensus.cc:740] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:45.687470  5869 consensus_queue.cc:260] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:45.688745  5869 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:45.689446  5860 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:45.669271  5810 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:45.693336  5810 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:45.695403   550 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
W20260709 13:14:45.695544  5894 log.cc:927] Time spent T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:14:45.687876   554 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:14:45.697577   481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 2406) took 1185 ms. Trace:
I20260709 13:14:45.702453   479 raft_consensus.cc:1275] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:14:45.696563   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:45.703423   559 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:45.678897  5547 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:45.702371   481 rpcz_store.cc:276] 0709 13:14:44.512538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.817917 (+305379us) service_pool.cc:224] Handling call
0709 13:14:44.906146 (+ 88229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:44.906325 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:44.906351 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:44.906389 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:44.906419 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.906465 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:45.692462 (+785997us) spinlock_profiling.cc:243] Waited 87.9 ms on lock 0x7b5400132750. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b684188ad 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6 00007f4b6675326f
0709 13:14:45.697522 (+  5060us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202173824}
I20260709 13:14:45.747829   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:45.747920   477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df062554d8014455b179c819406964fb"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:14:45.752908   477 raft_consensus.cc:606] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:45.753968   559 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 16.
I20260709 13:14:45.707197  5614 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:45.747182  5677 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:45.747923  5806 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.758493  5518 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:45.768934  5614 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:45.769497  5860 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:45.786852   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 118590us
I20260709 13:14:45.789611   599 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:45.785826  5614 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:45.809943   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:45.810547   599 leader_election.cc:304] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:45.810809   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:45.798864  5871 raft_consensus.cc:493] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:45.800908   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:45.789721  5809 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:45.806052  5548 raft_consensus.cc:2749] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:45.807387   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:45.821512   626 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:45.809146  5835 consensus_meta.cc:287] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Time spent flushing consensus metadata: real 0.503s	user 0.005s	sys 0.004s
I20260709 13:14:45.818738   624 raft_consensus.cc:2368] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 15. Current term is 16.
I20260709 13:14:45.778859  5806 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:45.836287  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 195039us
W20260709 13:14:45.836649  5900 log.cc:927] Time spent T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:14:45.837327  5806 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:45.838711  1141 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:45.820327   599 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:45.828658  5805 raft_consensus.cc:993] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
W20260709 13:14:45.830929  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 305341us
W20260709 13:14:45.833446  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 282131us
I20260709 13:14:45.848394   599 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:45.841836   448 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:14:45.841130   450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.849606   597 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:45.820741  5860 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:45.822986  5810 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:45.856125   599 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:45.858088   597 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:45.854507   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74f5d3a02ed490499ba666721531edc" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:45.859647   599 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:45.868198  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:45.869187  1169 raft_consensus.cc:2393] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 15: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:45.854555  5885 raft_consensus.cc:1081] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:14:45.856316  5548 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:45.856308  5652 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:45.820865  5871 raft_consensus.cc:515] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:45.857602  5745 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:14:45.877527   598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.877928   626 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:45.861781  5525 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:45.861936  5883 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:45.865899  5211 raft_consensus.cc:2804] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:45.864006  5859 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:45.865444  5736 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:45.879474  5322 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.897006  5322 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:45.898876  5614 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:45.891976  5652 raft_consensus.cc:697] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:45.878968  5813 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:45.888087  5810 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:45.920769  5810 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:45.921216  5810 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:45.891315  5883 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:45.923435  5883 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:45.864095  5860 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:45.909049  5652 consensus_queue.cc:237] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:45.899168  5322 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:45.884295  5548 raft_consensus.cc:697] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:45.933154  5849 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:45.933919  5548 consensus_queue.cc:237] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:45.901686  5211 raft_consensus.cc:697] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:45.937743   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:45.938177   448 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:45.914870  5614 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:45.944171  5211 consensus_queue.cc:237] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:45.947602  5801 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:45.955034   484 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:45.970238   525 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:45.978102   554 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:14:45.982034   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 122660us
I20260709 13:14:45.970381  5801 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.928957  5813 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:45.989701  5801 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:45.981429  5839 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:45.994239  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:45.994499   484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:14:45.995759  1167 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:45.996037   484 raft_consensus.cc:606] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:45.998068  1169 raft_consensus.cc:1275] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:14:46.007503   484 raft_consensus.cc:614] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:46.018826  5614 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:46.019433  5614 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:46.020466  5860 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:46.021445  5614 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:46.023366   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:46.025281  5883 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:46.029632   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 126133us
I20260709 13:14:46.030480   597 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:46.031971  5871 leader_election.cc:290] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:46.032387  5859 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:46.016528  1167 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 16.
I20260709 13:14:46.033303  5385 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:46.033944  5385 raft_consensus.cc:697] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:46.035193  1138 leader_election.cc:304] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:46.035652  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:46.037117  5885 raft_consensus.cc:2749] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:46.038304   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 53998.2us
I20260709 13:14:46.050971   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:46.051677   483 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
W20260709 13:14:46.039783  5907 log.cc:927] Time spent T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.150s	user 0.002s	sys 0.001s
I20260709 13:14:45.984052  5806 raft_consensus.cc:493] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.053450   599 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:46.055466   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:46.052836   525 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:46.060581   483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:14:46.058725   630 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 13.
I20260709 13:14:46.063519   599 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:46.067725  1138 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:46.061108   483 raft_consensus.cc:606] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:46.071260   599 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:46.047611  5839 raft_consensus.cc:697] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:46.071826  5614 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:46.064532  5809 consensus_queue.cc:1048] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:14:46.065128   630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54754
I20260709 13:14:46.071695  5322 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:46.089574  5525 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:46.106057   630 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:46.034847  5385 consensus_queue.cc:237] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:46.110507   630 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:46.069490  5806 raft_consensus.cc:515] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:46.107803  5322 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.109557  5859 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:46.059355  5745 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:14:46.093039  5909 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:46.060322  5810 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:46.119550  1169 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:57004
I20260709 13:14:46.107411  5614 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:14:46.132836   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 61674.7us
I20260709 13:14:46.137934   599 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:46.140499  5914 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:46.143019  5809 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:46.145244  5809 consensus_queue.cc:1048] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:46.128787  1169 raft_consensus.cc:606] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:46.110505  5883 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:46.118397  5322 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:46.156149  5813 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:46.156423  5911 log.cc:927] Time spent T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:14:46.161201   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b20e1b9bdf8473682b642fe0b3c0583" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:46.162740   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:46.185773   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:46.166628  5810 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:46.148077  5614 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:46.167084  5839 consensus_queue.cc:237] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:46.200532  5806 leader_election.cc:290] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:46.224308   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:46.192303  5883 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.227382   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:46.272886  5322 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:46.276144 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:46.289264   628 raft_consensus.cc:2468] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:46.296622   484 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 9. (term mismatch)
I20260709 13:14:46.297232   484 pending_rounds.cc:85] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting all ops after (but not including) 8
I20260709 13:14:46.297542   484 pending_rounds.cc:107] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Aborting uncommitted NO_OP operation due to leader change: 18.9
I20260709 13:14:46.297863   484 raft_consensus.cc:2889] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:46.298776   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:46.300904   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:46.288335   630 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:46.306033   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:46.344478   447 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:46.345342   630 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:46.347216  1169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:46.351159  1169 raft_consensus.cc:3055] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:46.351492  1169 raft_consensus.cc:740] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:46.352816   447 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:46.352607  1169 consensus_queue.cc:260] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:46.356941   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:46.357546   625 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:46.333169  5322 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:46.286882  5883 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:46.360564   447 leader_election.cc:304] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:46.366175   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:46.364691   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:46.367023   478 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:46.367530   631 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:46.377249  5883 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:46.348636  5806 raft_consensus.cc:493] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:46.382126   599 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:46.326745  5801 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:46.354456  5831 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:46.385957   478 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:46.387825   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:46.387341 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:46.389050   599 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:46.361649  5795 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:46.363945  5745 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:46.395802   599 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:46.397576   599 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:46.398476  5810 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:14:46.402297  5903 log.cc:927] Time spent T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.513s	user 0.003s	sys 0.000s
I20260709 13:14:46.403891   632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 2261) took 1495 ms. Trace:
I20260709 13:14:46.354950  5835 consensus_queue.cc:1059] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:14:46.404942  5806 raft_consensus.cc:515] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:46.405094  5745 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:46.388490  5652 raft_consensus.cc:2749] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:46.417358   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:46.409035  5801 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:46.391902  5525 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:46.423651  5835 raft_consensus.cc:3055] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:46.407166  5806 leader_election.cc:290] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:46.393707  5795 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.404253   632 rpcz_store.cc:276] 0709 13:14:44.908740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.908980 (+   240us) service_pool.cc:224] Handling call
0709 13:14:44.949816 (+ 40836us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:44.953163 (+  3347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:44.953193 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:44.953776 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:14:45.693033 (+739257us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b1800396ac0. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6530ee07 00007f4b6e169ab9 00007f4b6532b69b 00007f4b6532993f 00007f4b6532bc02 00007f4b67fb320b 00007f4b67fb8d23 00007f4b67fb90d1 00007f4b683d4a0f
0709 13:14:45.773634 (+ 80601us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:14:45.788125 (+ 14491us) log.cc:844] Serialized 14 byte log entry
0709 13:14:45.788403 (+   278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:45.788527 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:46.401752 (+613225us) spinlock_profiling.cc:243] Waited 57.6 ms on lock 0x7b4400022b4c. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b65252c85 00007f4b652536a2 00007f4b67fc51db 00007f4b67fc0aaf 00007f4b67fb486e 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221 00007f4b67fbd1d9 00007f4b67fbd169
0709 13:14:46.403600 (+  1848us) raft_consensus.cc:1685] finished
0709 13:14:46.403627 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:46.403830 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14025,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":1962,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":5982,"spinlock_wait_cycles":139560960,"thread_start_us":80424,"threads_started":1,"wal-append.queue_time_us":892928}
I20260709 13:14:46.424579  5614 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:46.417785  5745 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:46.410254  5883 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:14:46.409497  5859 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:46.437907   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:46.443302  5916 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:46.443850  5916 raft_consensus.cc:697] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:46.444799  5916 consensus_queue.cc:237] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:46.448421   552 raft_consensus.cc:1240] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Rejecting Update request from peer 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 12. Current term is 13. Ops: []
W20260709 13:14:46.442744   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 45236.9us
I20260709 13:14:46.451678   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:46.454047   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:46.454401   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:46.454967   484 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:46.426348  5835 raft_consensus.cc:740] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:46.435662  5795 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:14:46.465332  5906 log.cc:927] Time spent T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.545s	user 0.002s	sys 0.000s
I20260709 13:14:46.466960   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:46.467519   553 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:46.471187  5757 raft_consensus.cc:993] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:14:46.472261  5614 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:46.484941  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:46.488221   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:46.486183   448 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:46.489754   448 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:46.496838   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:46.497355   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13b3c82acf4ef9a2eb79441f61a80d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:46.487301  5840 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.493398   553 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:46.516283   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578ce25d78a849989220d2a8dcb91233" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:46.496738  5801 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:46.517809  5629 raft_consensus.cc:1081] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:14:46.520406   632 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54754
I20260709 13:14:46.521001   632 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:46.521497   632 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:46.509338  5840 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:46.533553  5840 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:46.491325  5652 consensus_queue.cc:1059] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:14:46.539637   625 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 14.
I20260709 13:14:46.540951  1138 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:46.544147   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:46.544812   630 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:46.545845   627 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:14:46.564298   599 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:46.569913   630 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:46.577811  5860 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.578271   522 leader_election.cc:400] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 15. Current term is 16.
I20260709 13:14:46.578696   522 leader_election.cc:403] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:14:46.578353  5860 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:46.580518  5860 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:46.582167  1169 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:46.582405  5795 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:46.556532  5741 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:46.588285   478 raft_consensus.cc:2368] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 16. Current term is 17.
I20260709 13:14:46.596453   522 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:46.616472   522 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:46.619767  1169 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:46.620855  5616 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 15. Current term is 16.
I20260709 13:14:46.621054  5614 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:46.621656  5614 raft_consensus.cc:697] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:46.612248  5741 raft_consensus.cc:697] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:46.623292  5741 consensus_queue.cc:237] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:46.623807   599 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:46.626487  5909 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:46.588732  5384 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:46.646716   559 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:14:46.633425   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 132978us
I20260709 13:14:46.622560  5614 consensus_queue.cc:237] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:46.586382  5854 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.670125   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:46.670776   556 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:46.671594   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:46.664271  1169 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:14:46.655217   632 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:46.661979  5871 raft_consensus.cc:2804] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:14:46.697901   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 200526us
I20260709 13:14:46.651875  5384 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.725694   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:46.726523   632 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:46.707274  5384 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:46.663722  5810 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:14:46.795372  5835 consensus_queue.cc:260] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:46.796706  5835 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:46.801311  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:46.802057  1168 raft_consensus.cc:3055] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:46.802350  1168 raft_consensus.cc:740] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:46.804035  5795 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:46.708748  5871 raft_consensus.cc:697] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:46.805321  5871 consensus_queue.cc:237] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:46.752445   557 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:14:46.755704   625 raft_consensus.cc:1240] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:46.758167   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:46.759598   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:46.758997   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:46.693965  5854 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:46.913797  5854 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:46.914391   555 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 13.
I20260709 13:14:46.735002  5841 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.915508  5841 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:46.917724  5841 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:46.771695  5813 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.918644  5813 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:46.920042  5835 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.696306  5652 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:14:46.868361  5629 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:46.925072  5629 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:46.928858  5629 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:46.883953   448 leader_election.cc:304] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:46.930127   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 46272.8us
I20260709 13:14:46.893635  5908 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.931911  5908 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:46.934845  5908 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:46.862033  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.858502   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c11587863a4a73ae8fca1c867e545d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:46.938413   448 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:46.855129  5810 consensus_queue.cc:1059] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:46.939836  5927 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:46.940575  5927 raft_consensus.cc:697] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:46.941572  5927 consensus_queue.cc:237] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:46.943672  5810 raft_consensus.cc:3055] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:46.944084  5810 raft_consensus.cc:740] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:46.803110  1168 consensus_queue.cc:260] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:46.892050   380 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41332 (request call id 158) took 23903 ms (client timeout 15000 ms). Trace:
I20260709 13:14:46.948378  1168 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:46.949544  5850 consensus_queue.cc:1175] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" responder_term: 12 status { last_received { term: 12 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 12 index: 10 } }
I20260709 13:14:46.945007  5810 consensus_queue.cc:260] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:46.909502   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:46.958807   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:46.959417   552 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:14:46.960876   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:46.961489   478 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:14:46.921515  5813 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:46.782326  5804 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.856485   481 raft_consensus.cc:1275] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:14:46.965436  5804 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:46.851979  5795 raft_consensus.cc:993] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:14:46.966917  5806 raft_consensus.cc:1081] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Signalling peer 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:14:46.967757  5804 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:46.974051  5322 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:14:46.976296   448 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:46.977602  5804 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:46.978135  5804 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.978578  5804 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:46.955459  5810 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:46.948297   380 rpcz_store.cc:269] 0709 13:14:22.988220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:22.988426 (+   206us) service_pool.cc:224] Handling call
0709 13:14:23.995705 (+1007279us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54000fbed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68383090 00007f4b68421f3a 00007f4b6e1d81cc 00007f4b6e2d637e 00007f4b6c7972a4 00007f4b6c797232 00007f4b6c797161 00007f4b6c7970dc 00007f4b6c796392 00007f4b6675448c 00007f4b667538c6
0709 13:14:46.891853 (+22896148us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:42.039775 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:42.071186 (+ 31411us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:42.071229 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:14:42.071267 (+    38us) tablet.cc:662] Decoding operations
0709 13:14:42.301099 (+229832us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:42.305663 (+  4564us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:42.311198 (+  5535us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:14:42.544617 (+233419us) tablet.cc:701] Row locks acquired
0709 13:14:42.544647 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:14:42.544852 (+   205us) write_op.cc:270] Start()
0709 13:14:42.545008 (+   156us) write_op.cc:276] Timestamp: P: 1783602882544788 usec, L: 0
0709 13:14:42.545039 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:14:42.545841 (+   802us) log.cc:844] Serialized 3984 byte log entry
0709 13:14:43.199776 (+653935us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b180016f300. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6be5041d 00007f4b6be5271a 00007f4b6be526a8 00007f4b6be52628 00007f4b6be525e3 00007f4b6be517fc 00007f4b6e284626 00007f4b6e27edd8 00007f4b68425310
0709 13:14:43.210262 (+ 10486us) op_driver.cc:464] REPLICATION: finished
0709 13:14:43.551423 (+341161us) write_op.cc:301] APPLY: starting
0709 13:14:43.551559 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:43.807387 (+255828us) spinlock_profiling.cc:243] Waited 5.75 ms on lock 0x7b180016f300. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b6e1f4de1 00007f4b6e2015b1 00007f4b6532c522 00007f4b6532e7c1 00007f4b6532e779 00007f4b6532e709 00007f4b6532e6d1 00007f4b6532d9cd 000000000038f354 000000000038f199 00007f4b6530f83a
0709 13:14:43.858609 (+ 51222us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:43.858651 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:43.926083 (+ 67432us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:43.926352 (+   269us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 13:14:43.926422 (+    70us) write_op.cc:312] APPLY: finished
0709 13:14:43.926842 (+   420us) log.cc:844] Serialized 97 byte log entry
0709 13:14:44.033495 (+106653us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:44.066540 (+ 33045us) write_op.cc:454] Released schema lock
0709 13:14:44.066623 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:44.067142 (+   519us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:44.067192 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":721847,"reported_tablets":28,"spinlock_wait_cycles":419772160,"child_traces":[["op",{"apply.queue_time_us":320219,"apply.run_cpu_time_us":43984,"apply.run_wall_time_us":515741,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45967,"num_ops":10,"prepare.queue_time_us":507735,"prepare.run_cpu_time_us":7574,"prepare.run_wall_time_us":522855,"raft.queue_time_us":2388,"raft.run_cpu_time_us":35819,"raft.run_wall_time_us":941234,"replication_time_us":19655,"spinlock_wait_cycles":17687552,"thread_start_us":751229,"threads_started":5,"wal-append.queue_time_us":137007,"wal-append.run_cpu_time_us":6199,"wal-append.run_wall_time_us":2150329}]]}
I20260709 13:14:47.000147  1169 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:14:47.001461  5806 raft_consensus.cc:993] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:14:47.001935  5806 raft_consensus.cc:1081] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Signalling peer 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:14:47.003252  5835 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.006026  5835 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:47.021060   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:47.021417  5795 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:47.021981  5795 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.024478  5795 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:47.026192   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:47.026957   484 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:47.053850  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.056321   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:47.056674   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:47.057799   484 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:47.058010   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:47.075413   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:47.076465   626 raft_consensus.cc:2393] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 14: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:47.088969   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:47.090106   633 raft_consensus.cc:2393] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 16: Already voted for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in this term.
I20260709 13:14:47.092355   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:47.093150   632 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 8.
I20260709 13:14:47.106411   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:47.110939   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 64536.5us
I20260709 13:14:47.111444   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:47.112743   559 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
I20260709 13:14:47.114341   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:47.114974   625 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:47.091156   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:47.117621   633 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:47.120257   552 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 17.
I20260709 13:14:47.138063   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:47.139060   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:47.141202   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:47.139006   631 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 8.
W20260709 13:14:47.143937   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 74830us
I20260709 13:14:47.144428   522 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:47.149753   448 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:47.152407   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:47.153201   554 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:14:47.158043  5639 consensus_queue.cc:1059] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:47.159078  5639 raft_consensus.cc:3055] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:47.159423  5639 raft_consensus.cc:740] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:47.160209  5639 consensus_queue.cc:260] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.161350  5639 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:47.162933  5809 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:47.132723  1168 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:47.167529   599 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:47.168998  5677 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:47.169498  5677 raft_consensus.cc:697] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:47.169610   377 catalog_manager.cc:5697] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:47.170444  5677 consensus_queue.cc:237] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:14:47.193931   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 44239.8us
I20260709 13:14:47.195619   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:47.196750   484 raft_consensus.cc:2410] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:14:47.200276   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 55994.3us
I20260709 13:14:47.201402   522 leader_election.cc:304] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:47.203327   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:47.211190   448 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:47.226552   447 leader_election.cc:304] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:46.903085  5384 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.245543   559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59114
I20260709 13:14:47.246361   559 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:47.246877   559 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:47.171094   377 catalog_manager.cc:5697] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 6 to 15, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 15 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:47.219918  5839 raft_consensus.cc:2749] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:47.225368  5806 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:14:47.244542  5925 log.cc:927] Time spent T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:14:47.274955   628 raft_consensus.cc:2368] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 13. Current term is 14.
I20260709 13:14:46.986970  5804 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.281695   480 raft_consensus.cc:2393] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 15: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:47.283658  5804 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:47.269781   552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df062554d8014455b179c819406964fb"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59114
I20260709 13:14:47.228279  5835 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:14:47.255175   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 53877.1us
I20260709 13:14:47.260501  5854 raft_consensus.cc:2749] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:47.278522   377 catalog_manager.cc:5697] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:47.234036  5936 raft_consensus.cc:2749] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:47.233026  5548 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.296s	user 0.017s	sys 0.025s
I20260709 13:14:47.294878   552 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:47.258385  5605 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:14:47.299952   552 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:47.315676   475 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.005s	sys 0.029s
W20260709 13:14:47.316082   475 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.005s	sys 0.029s
I20260709 13:14:47.293792  5835 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.314324   377 catalog_manager.cc:5697] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 6 to 9, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 9 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.268935  5322 consensus_queue.cc:1048] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
W20260709 13:14:47.307595  5548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.371s	user 0.018s	sys 0.026s
I20260709 13:14:47.340768   522 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:47.462196   630 raft_consensus.cc:1240] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 13. Current term is 14. Ops: []
W20260709 13:14:47.430276  5925 log.cc:927] Time spent T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.120s	user 0.000s	sys 0.009s
I20260709 13:14:47.367300  5835 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:47.477615  5614 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.434562  5809 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:47.481858   377 catalog_manager.cc:5697] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 10 to 11, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 11 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:47.486352   377 catalog_manager.cc:5697] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:14:47.481587  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 329795us
I20260709 13:14:47.478609  5839 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:14:47.494513   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 237105us
I20260709 13:14:47.480039  5916 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.512971   626 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:47.513731   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:47.505479  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:47.513839  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 390418us
I20260709 13:14:47.515386   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:47.516165   629 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:47.474670   552 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.517500   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:47.502543   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.481293  5614 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:47.499542  5883 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:14:47.520077  1138 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.551546  5883 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.552565  1138 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:47.553071   627 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:47.553496  1138 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:47.554267  5883 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:47.555022  5741 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:47.521663   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:47.522816   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:47.523408   552 leader_election.cc:290] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:47.556192   633 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:47.524930   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:47.557875   483 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:47.499745  5933 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:47.494493  5809 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:47.559610  5933 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.560935  5809 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:47.509413  5839 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.561575  5933 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:47.561769  5839 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:47.501392  5831 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:47.555107  5887 raft_consensus.cc:2804] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:47.562629  5887 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.563014  5887 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:47.563218   633 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:14:47.568924  5614 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:47.519115  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:47.577898   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:47.580319  5384 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:47.518173  5916 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:47.582909  5916 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:47.588105   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38132 (request call id 2434) took 1267 ms. Trace:
I20260709 13:14:47.606974   482 rpcz_store.cc:276] 0709 13:14:46.320977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.322999 (+  2022us) service_pool.cc:224] Handling call
0709 13:14:46.341396 (+ 18397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.350814 (+  9418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.350847 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:46.785580 (+434733us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b2c000014c8. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b66d12a11 00007f4b66d22372 00007f4b68454a01 00007f4b6841943a 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2
0709 13:14:46.785949 (+   369us) log.cc:844] Serialized 26 byte log entry
0709 13:14:47.292232 (+506283us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:47.297137 (+  4905us) log.cc:844] Serialized 14 byte log entry
0709 13:14:47.500536 (+203399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.500679 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:47.587778 (+ 87099us) raft_consensus.cc:1685] finished
0709 13:14:47.587876 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.588023 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3594,"prepare.queue_time_us":4657,"prepare.run_wall_time_us":40,"raft.queue_time_us":21092,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":57550,"spinlock_wait_cycles":146855040,"thread_start_us":694487,"threads_started":2,"wal-append.queue_time_us":718508}
I20260709 13:14:47.606395   447 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:47.595007  5839 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.598877   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:47.600524   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:47.604979   524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:47.606379  5810 consensus_meta.cc:287] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3: Time spent flushing consensus metadata: real 0.615s	user 0.007s	sys 0.001s
W20260709 13:14:47.594611  5942 log.cc:927] Time spent T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.144s	user 0.000s	sys 0.002s
I20260709 13:14:47.615918  5839 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:47.617966  5605 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:47.618526  5605 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.619052   624 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:47.620589  5605 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:47.621132  5605 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:47.622542  5652 raft_consensus.cc:2749] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:47.627015  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:47.627501  1169 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:14:47.628578   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:47.628928   447 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:47.629292   556 raft_consensus.cc:2393] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 15: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:47.630046  5513 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:47.630538  5513 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.632550  5513 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:47.633055  5938 log.cc:927] Time spent T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:14:47.632822   377 catalog_manager.cc:5697] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:47.635071 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:47.635573  5927 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:47.637075   483 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:47.637619   447 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:47.627024  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:47.642441  5927 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:47.642979  5927 raft_consensus.cc:697] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:14:47.643808  5939 log.cc:927] Time spent T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:14:47.643958  5927 consensus_queue.cc:237] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.634457   377 catalog_manager.cc:5697] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 5 to 12, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 12 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.646890   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:47.647976   550 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:47.648720   629 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 17.
I20260709 13:14:47.649008   630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54754 (request call id 832) took 1053 ms. Trace:
I20260709 13:14:47.649626   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:47.650632   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:47.649367   630 rpcz_store.cc:276] 0709 13:14:46.595273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.596249 (+   976us) service_pool.cc:224] Handling call
0709 13:14:46.596649 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:47.462841 (+866192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.648800 (+185959us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b54001ae0d4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:47.648953 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1989976448}
I20260709 13:14:47.654438   557 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:47.657887   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:47.657719   377 catalog_manager.cc:5697] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 7 to 9, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 9 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:47.660221   525 leader_election.cc:400] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 16. Current term is 17.
I20260709 13:14:47.661083  1168 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:14:47.647425   559 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.668231   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:47.668781   525 leader_election.cc:403] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:47.669180   557 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 16. Current term is 17. Ops: []
W20260709 13:14:47.662178   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 321486us
I20260709 13:14:47.664160   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:47.664105   377 catalog_manager.cc:5697] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:47.670430   522 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:47.675953   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:47.677160   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:47.679317   522 leader_election.cc:400] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 13. Current term is 14.
I20260709 13:14:47.680029   475 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:47.680192   522 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:47.688675   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:47.688769   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:47.689518   624 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:47.689780  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:47.693204   627 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:47.694196   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:47.695604   628 raft_consensus.cc:1240] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:47.661795  5806 raft_consensus.cc:697] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:47.700417   631 raft_consensus.cc:2393] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 15: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:47.689781  5841 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 16. Current term is 17.
I20260709 13:14:47.702786   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:47.668224  5831 consensus_queue.cc:1059] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:14:47.703974   377 catalog_manager.cc:5697] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:47.705500   377 catalog_manager.cc:5697] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:47.671697  5745 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:47.707402  5745 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.708287   482 raft_consensus.cc:3060] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:47.709908  5745 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:47.657315  5835 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.712059   484 raft_consensus.cc:2368] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15.
I20260709 13:14:47.713282  5835 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:47.684092  5860 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:47.700047  5813 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:47.699877  5677 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:14:47.706740   377 catalog_manager.cc:5697] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 6 to 9, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 9 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:47.723445   559 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 17 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:47.724119   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 63617.2us
I20260709 13:14:47.725612   629 raft_consensus.cc:1275] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:47.729697   597 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:47.721095   377 catalog_manager.cc:5697] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 10 to 14, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 14 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:47.740711   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:47.740921  5952 consensus_queue.cc:1059] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:47.736747  5810 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:47.748576  5813 raft_consensus.cc:697] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:47.754251  5813 consensus_queue.cc:237] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.706753  5887 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:47.750065  5806 consensus_queue.cc:237] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.741863  5729 raft_consensus.cc:3055] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:47.748965   377 catalog_manager.cc:5697] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 8 to 10, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 10 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:47.763697   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:47.764330   558 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:47.764578   624 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:47.760155  5729 raft_consensus.cc:740] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:47.768596  5729 consensus_queue.cc:260] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.770088  5729 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:47.772076  1167 raft_consensus.cc:2393] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ba2a9c02b534120bbf26e56a1e920ca in current term 9: Already voted for candidate 6e6df7e8ed204f1db5c371536b5b0683 in this term.
I20260709 13:14:47.773005   559 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:47.774132   599 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:47.782280   377 catalog_manager.cc:5697] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 10 to 14, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 14 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:47.771348  5934 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:47.783788   377 catalog_manager.cc:5697] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:47.788282   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:47.801043   480 raft_consensus.cc:3055] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:47.804319   480 raft_consensus.cc:740] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
W20260709 13:14:47.782860  1141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.005s	sys 0.013s
I20260709 13:14:47.788713   482 raft_consensus.cc:1275] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:47.797034   377 catalog_manager.cc:5697] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 10 to 14, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 14 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.805029   480 consensus_queue.cc:260] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:47.805804  1141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.006s	sys 0.013s
W20260709 13:14:47.811388  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 706082us
I20260709 13:14:47.814044   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:47.814498   480 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:47.814751   624 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:47.793275  5934 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:14:47.838356   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 64309.7us
I20260709 13:14:47.838874   558 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:14:47.842785   599 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:47.824322   377 catalog_manager.cc:5697] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:47.806536  5916 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:47.849638   448 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:47.798738  5887 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:47.854650   480 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:47.858332   624 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:14:47.870803   377 catalog_manager.cc:5697] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 10 to 14, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 14 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:47.865185  5951 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:14:47.846535  5934 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:47.847368  5548 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:47.869834   599 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:47.859719  5652 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.853749  5955 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:47.868001  5840 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:47.866802  5936 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:14:47.886402   599 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:47.906291   599 leader_election.cc:400] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711) with higher term. Message: Invalid argument: T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15.
I20260709 13:14:47.889783  5840 raft_consensus.cc:697] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:47.908080  5840 consensus_queue.cc:237] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.910378  5934 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.891319  5513 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:47.888300  5652 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.891961  5860 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:47.926290  5745 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:47.885246  5809 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:47.891812   377 catalog_manager.cc:5697] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 10 to 11, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 11 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.892876  5955 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:47.920812   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:47.930224   481 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:47.931818   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.932032   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:47.934852   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 232416us
I20260709 13:14:47.935563   555 raft_consensus.cc:3060] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:47.940796   479 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:14:47.928131   377 catalog_manager.cc:5697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 8 to 11, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 11 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.954615   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:47.955228   633 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:47.956426   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:47.926988  5513 raft_consensus.cc:697] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:47.965358   525 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:47.966522   629 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:47.967896   627 raft_consensus.cc:2393] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 13: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:47.961565   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:47.963208   377 catalog_manager.cc:5697] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 8 to 11, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 11 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:47.961997   633 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:14:47.968475   482 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 17.
I20260709 13:14:47.982969   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:47.983777   633 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:48.000955   633 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 17.
I20260709 13:14:48.002291   627 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:14:48.005334  5934 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:47.962320  5745 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:48.011099   481 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
I20260709 13:14:48.006501   377 catalog_manager.cc:5697] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:48.014405   522 leader_election.cc:304] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:48.021908   377 catalog_manager.cc:5697] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:48.001962  5677 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.042749   377 catalog_manager.cc:5697] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:48.049741   525 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:48.060163   525 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:48.068938   377 catalog_manager.cc:5697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:14:48.062804   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 109337us
W20260709 13:14:48.073839   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 114310us
I20260709 13:14:48.001911  5813 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 13:14:48.117281   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 102978us
I20260709 13:14:48.119680   377 catalog_manager.cc:5697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:48.120820   377 catalog_manager.cc:5697] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:48.112485   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 52396.3us
I20260709 13:14:48.010321  5967 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:47.977154  5966 consensus_queue.cc:1059] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:14:48.122308   525 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:48.127997   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:48.018739  5745 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:48.144026   551 raft_consensus.cc:2368] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15.
I20260709 13:14:48.053957  5956 consensus_queue.cc:1048] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:14:48.064703  5614 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:14:48.164731  5964 log.cc:927] Time spent T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
W20260709 13:14:48.127516  5968 log.cc:927] Time spent T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:14:48.130869   377 catalog_manager.cc:5697] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 8 to 13, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 13 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:48.081928  5486 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:14:48.068171  5677 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:48.209077  5677 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:48.185644  5610 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.209856  5610 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:48.212309  5610 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:48.128728  5987 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
W20260709 13:14:48.220839   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 61775.4us
I20260709 13:14:48.224366  5955 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:48.185359  5614 raft_consensus.cc:697] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:48.129262  5957 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:14:48.154083  5945 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:14:48.203434  5978 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:14:48.203738  5652 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:48.203891  5985 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:48.204111  5745 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:48.140076  5513 consensus_queue.cc:237] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:48.200726  5969 log.cc:927] Time spent T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:14:48.252331   555 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 9.
W20260709 13:14:48.466943   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:48.283048   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 207503us
I20260709 13:14:48.503170   599 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:48.328287   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:48.329666  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 329666us
I20260709 13:14:48.282130   377 catalog_manager.cc:5697] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 9 to 13, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 13 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:48.307601   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 185330us
I20260709 13:14:48.509629   555 raft_consensus.cc:1275] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:14:48.310240   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:48.521015   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:48.529732  5916 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.529803  5518 consensus_queue.cc:1048] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:48.530427  5916 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:48.505260  5639 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:48.532627  5916 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:48.524072  5810 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:14:48.523867  5982 raft_consensus.cc:2764] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:14:48.549662  1141 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:48.550729  5984 raft_consensus.cc:2804] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:48.552389  5951 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:48.553895   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:14:48.554409  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 71732.3us
I20260709 13:14:48.557082  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:48.528347  5967 raft_consensus.cc:493] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:48.558280  5967 raft_consensus.cc:515] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:48.560631  5967 leader_election.cc:290] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:48.564839  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:48.567118   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:48.568069   481 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:48.526736   377 catalog_manager.cc:5697] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 8 to 11, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 11 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:48.579521   377 catalog_manager.cc:5697] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:48.639798  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:48.640609  5977 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:14:48.664721   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:48.665271   624 raft_consensus.cc:1275] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:14:48.665529   625 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:48.666370   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:48.667016   624 raft_consensus.cc:2393] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in current term 13: Already voted for candidate 6ba2a9c02b534120bbf26e56a1e920ca in this term.
I20260709 13:14:48.670358   626 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:14:48.663619  5986 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:48.674964   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 90960.9us
W20260709 13:14:48.684226  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 102735us
I20260709 13:14:48.662416  5810 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:48.684541  5525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.078s	sys 0.158s
W20260709 13:14:48.685935   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 105071us
I20260709 13:14:48.673799  5986 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:48.689616  5525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.078s	sys 0.161s
I20260709 13:14:48.714905  5652 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
W20260709 13:14:48.748021  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 62892.8us
W20260709 13:14:48.758595   522 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.016s	sys 0.022s
W20260709 13:14:48.760437   522 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.017s	sys 0.022s
W20260709 13:14:48.762329   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 621706us
I20260709 13:14:48.769747   522 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:48.741134  5745 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:48.707674  5810 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:48.772526  5806 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:48.773643  5804 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:48.802265  5986 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:48.779470  5984 raft_consensus.cc:697] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:48.744223  5652 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:48.823467  5712 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:48.824039  5712 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:48.826032  5712 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:48.828891  5927 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:48.829487  5927 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:48.845095  5927 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:48.810824  5806 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:48.848382  5806 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:48.835616  5860 raft_consensus.cc:3055] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:48.851836  5860 raft_consensus.cc:740] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:48.852629  5860 consensus_queue.cc:260] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:48.853698  5972 log.cc:927] Time spent T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.646s	user 0.007s	sys 0.030s
I20260709 13:14:48.853983  5860 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:48.855180  1167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36732 (request call id 919) took 1048 ms. Trace:
W20260709 13:14:48.856312   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 86678.5us
I20260709 13:14:48.855595  1167 rpcz_store.cc:276] 0709 13:14:47.806900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:47.807373 (+   473us) service_pool.cc:224] Handling call
0709 13:14:47.816708 (+  9335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:47.844485 (+ 27777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:47.844520 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:47.845035 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 13:14:48.045077 (+200042us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:48.045133 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:48.045225 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:48.853383 (+808158us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b24002e4018. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b651b29c4 00007f4b651b0acb 00007f4b6536bdc9 00007f4b6536ba55 00007f4b6536b09d 00007f4b67f9d10e 00007f4b67fb488c 00007f4b67fb3bb6 00007f4b67fb37d8 00007f4b67fbd221
0709 13:14:48.854878 (+  1495us) raft_consensus.cc:1685] finished
0709 13:14:48.854911 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:48.855119 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27384,"raft.queue_time_us":28578,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":143965440,"thread_start_us":199577,"threads_started":1,"wal-append.queue_time_us":362348}
I20260709 13:14:48.794922  5745 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:48.868762   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:48.865628   481 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 13. Current term is 14. Ops: []
W20260709 13:14:48.858932   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 175252us
I20260709 13:14:48.870851   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb12c292ec5d439b896dcc135d266150" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:48.811136  5804 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:48.906744   483 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 17.
I20260709 13:14:48.887667   597 leader_election.cc:400] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15.
I20260709 13:14:48.907682   597 leader_election.cc:403] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:14:48.771184  5614 consensus_queue.cc:237] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:48.915326  5934 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 for earlier term 14. Current term is 15.
I20260709 13:14:48.920799  5957 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:48.921360  5518 raft_consensus.cc:493] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:48.921485  5957 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:48.921885  5518 raft_consensus.cc:515] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:48.875461  5854 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:48.924314   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c3584d0546405ca79fa6b68e7468ec" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:48.925123   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:48.943881   553 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 13.
I20260709 13:14:48.944968   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:48.945720   553 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:48.890878  5927 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:48.925879   557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:48.950083   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:48.932987  5994 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:48.933593  5992 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:48.903025  5955 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:48.942979   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:48.950924   554 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:14:48.962801   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:48.955044  5854 raft_consensus.cc:697] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:48.952296   597 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:48.969419   597 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:48.970641   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:48.937626   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:48.972294   553 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:14:48.975678   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:48.980302  5652 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:48.958784   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 101985us
I20260709 13:14:48.948316  5745 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:48.964087  5984 consensus_queue.cc:237] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:48.948417  5927 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:48.981803  5934 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:48.991781  5980 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:49.018070   629 raft_consensus.cc:1275] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:48.959971  5994 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:49.028184  5994 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:49.049270   449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.056090  5804 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:49.059276  5957 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:49.067814  5810 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:49.111997  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:48.982571  5955 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:49.121446   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:48.971513  5992 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:49.129433   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 387935us
I20260709 13:14:49.011884  5980 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.164469 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:49.134778  5980 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:49.221582   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 47593.5us
I20260709 13:14:49.222543   599 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:49.228423  5992 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:49.235939   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049523b511884708bc0ac5adea131bc6" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:49.238463   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:49.239624   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:49.181368  5859 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:49.240253   481 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 16.
I20260709 13:14:49.263540   625 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:14:49.264348   599 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:49.265020   631 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:49.241133  5384 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:49.160192  5854 consensus_queue.cc:237] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:49.271842   599 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:49.278513   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 368242us
I20260709 13:14:49.281906   556 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:14:49.282407   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:49.277971   599 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:49.286041   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:49.287626   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:49.290313   556 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:14:49.286741  5997 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:49.299010   448 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:49.274267  5384 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:49.306296   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:49.292239  5677 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:14:49.310855   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 405469us
I20260709 13:14:49.314715   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:49.298324  5810 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:14:49.366184   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 47248.7us
I20260709 13:14:49.306737  5518 leader_election.cc:290] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:49.312598  5806 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:49.311530  5677 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.317452  5927 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:49.388693  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 68660.3us
I20260709 13:14:49.392894  6007 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:14:49.381986  5977 log.cc:927] Time spent T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:14:49.405443  6001 log.cc:927] Time spent T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 13:14:49.409320  6003 log.cc:927] Time spent T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:14:49.413312  5384 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:49.434106   631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54268 (request call id 2312) took 1440 ms. Trace:
I20260709 13:14:49.434670   631 rpcz_store.cc:276] 0709 13:14:47.994061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:47.994206 (+   145us) service_pool.cc:224] Handling call
0709 13:14:47.994491 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:49.269928 (+1275437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:49.433816 (+163888us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54001adbd4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68419e01 00007f4b6841883e 00007f4b6d3dd419 00007f4b66954bd4 00007f4b66954b62 00007f4b66954a91 00007f4b66954a0c 00007f4b66953cc2 00007f4b6675448c 00007f4b667538c6
0709 13:14:49.434033 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2921506176}
I20260709 13:14:49.316470  5936 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:14:49.375265  5955 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:49.375552  5806 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:49.384426  5677 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:14:49.438076  5998 log.cc:927] Time spent T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:14:49.370039  5987 consensus_queue.cc:1048] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
W20260709 13:14:49.469383  5860 consensus_meta.cc:287] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca: Time spent flushing consensus metadata: real 0.615s	user 0.014s	sys 0.000s
I20260709 13:14:49.475536   550 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 17.
I20260709 13:14:49.449692  5806 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:49.460678  5986 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:49.479703  5986 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:49.494267   631 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:49.447595  5841 consensus_queue.cc:1059] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:14:49.486999  5384 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:49.451743  5980 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:49.529143  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 139289us
I20260709 13:14:49.530078  6004 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.533247  6004 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:49.535303  6004 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:49.535979   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 224964us
I20260709 13:14:49.523907  5994 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:14:49.521497  5957 raft_consensus.cc:493] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
W20260709 13:14:49.544054   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 177449us
W20260709 13:14:49.557013   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 205284us
I20260709 13:14:49.539570  5841 consensus_queue.cc:1243] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer 50f7c2247be24f3685d7fbca7b6c71e3 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:14:49.571492  1167 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:57004
W20260709 13:14:49.548483  6012 log.cc:927] Time spent T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:14:49.574949   447 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:49.572114  1167 raft_consensus.cc:606] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:49.579505   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:49.583139   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:49.532727  5384 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:49.545994  5934 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:49.587594  5986 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:49.591607  5986 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.605341  5741 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:49.583122  6006 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:14:49.609215  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093a5bf347e94e52af24456f0631abe3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:49.548314  5957 raft_consensus.cc:515] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:49.585489  5997 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:49.623984   447 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:49.589953  5909 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:49.608140  5927 raft_consensus.cc:2749] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:14:49.636194  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 48300.7us
I20260709 13:14:49.607146  5966 raft_consensus.cc:493] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:49.640107  5966 raft_consensus.cc:515] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:49.642767  5966 leader_election.cc:290] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:49.637844  5677 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:49.643798  5793 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:49.639055   447 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:49.647040   448 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:49.648658  1167 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82382f158074497a857b03f9f87f9e86"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:57004
I20260709 13:14:49.651746  1167 raft_consensus.cc:606] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:49.649932  6017 log.cc:927] Time spent T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:14:49.603515  5934 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:49.654217   448 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:49.614001  5986 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:49.667500  5652 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:49.668079  5652 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:49.668751  5986 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:49.652403  6020 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:14:49.666857  6006 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:49.667313  5936 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:49.650599  5548 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:49.671070   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:49.678108   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:49.634627  5997 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:49.681624  5997 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:49.671419   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fc6eae3e44f9db61c22838e11247d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:49.671926   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:49.672736   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:49.684201   624 raft_consensus.cc:2368] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14.
I20260709 13:14:49.684484  5934 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:49.670483   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:49.685487   627 raft_consensus.cc:2368] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 17. Current term is 18.
I20260709 13:14:49.652725  5793 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:49.666273  6022 raft_consensus.cc:993] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: : Instructing follower 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:14:49.686406  5793 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:49.677601  5677 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:49.673256   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:49.690148   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:49.691152  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3253e2dfadea481ea66147319ece61c5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:49.693223   630 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:14:49.658034  5951 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:49.697371   525 leader_election.cc:304] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:14:49.688349  6014 log.cc:927] Time spent T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:14:49.687028  5652 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:49.696353  5840 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:49.667366  5927 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:14:49.704607  5741 raft_consensus.cc:1081] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Signalling peer 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:14:49.691589  5967 consensus_queue.cc:1059] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:14:49.705909  5841 raft_consensus.cc:2749] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:49.705739  5951 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:49.729184  5951 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:49.715209  5859 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:49.692759  5548 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:49.731590   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:49.703402  5804 raft_consensus.cc:493] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.747591   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:49.748553   483 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 15.
I20260709 13:14:49.752100   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:49.754312   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:49.758030   558 raft_consensus.cc:3055] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:49.758533   558 raft_consensus.cc:740] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:49.710587  5840 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:49.766572   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 18 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:49.771818   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:49.774256   477 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:14:49.778421   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 88943.2us
I20260709 13:14:49.778438   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:49.778745   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:49.751408  5548 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:49.764559   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 18 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:49.731607  5859 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:49.762629  5951 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:49.773698  5840 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:49.781615   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:49.794477   554 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:49.784183   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:49.788456  5980 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:49.817216   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:49.818348   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:49.818964   483 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 15.
I20260709 13:14:49.782995  5384 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:49.775282  5916 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:49.799750   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:49.827571   559 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:49.759457   558 consensus_queue.cc:260] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:49.785548   448 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:49.764238  5804 raft_consensus.cc:515] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:49.777468  5806 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:49.812939  5957 leader_election.cc:290] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:49.814828  6006 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:49.846621   559 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 18.
I20260709 13:14:49.847263  5806 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:49.815814   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:49.851751   599 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:49.820997   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
W20260709 13:14:49.823463   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 130265us
I20260709 13:14:49.829380   626 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:49.836862  5745 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.838471  5916 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:49.842307  5804 leader_election.cc:290] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:49.850421   480 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:49.863085   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c23e2e725f4945b79fe36fc271ccc2" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:49.856594   554 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
W20260709 13:14:49.859190   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 73708.8us
I20260709 13:14:49.867372  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:49.874423  5745 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:49.875721  6007 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:49.876549   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:49.876801  5745 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:49.877135   559 raft_consensus.cc:2468] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 9.
I20260709 13:14:49.874450  6032 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:14:49.882027  5916 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:49.887842   480 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:14:49.895741   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:49.896134  5859 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:49.898283  5859 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:49.903192   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:49.907783   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 56168us
I20260709 13:14:49.907991   559 raft_consensus.cc:2368] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14.
I20260709 13:14:49.908548   599 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:49.903503  5840 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:49.918318   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 59101.9us
W20260709 13:14:49.954263  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 299159us
I20260709 13:14:50.080834  5840 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:50.081379  5677 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:50.081802   482 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:50.082252  5384 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:49.919340   597 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:50.087211   448 leader_election.cc:400] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14.
I20260709 13:14:50.099089   448 leader_election.cc:403] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:14:50.082770  5793 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:50.090126  5810 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:49.922122  5966 raft_consensus.cc:493] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:50.092494  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:50.093407   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 181785us
W20260709 13:14:50.099664   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 171208us
W20260709 13:14:50.135782   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 216516us
I20260709 13:14:50.128852  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:50.129386  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:50.130988   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12805530d9a3471aa3d5b4c086cc454a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:50.137574   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:50.158617   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 47690.1us
I20260709 13:14:50.158839   550 raft_consensus.cc:2368] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 17. Current term is 18.
I20260709 13:14:50.099283  5677 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:50.136922   597 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:50.222344   447 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.031s	sys 0.036s
W20260709 13:14:50.223784   447 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.031s	sys 0.037s
W20260709 13:14:50.224654   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 65335.5us
I20260709 13:14:50.224470   482 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 18.
W20260709 13:14:50.223958   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 89247.4us
I20260709 13:14:50.103986  6005 raft_consensus.cc:2749] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14.
I20260709 13:14:50.096256  5525 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:14:50.242652   599 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:50.243521   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 106660us
I20260709 13:14:50.137588  5810 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:50.239945  6033 log.cc:927] Time spent T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.136s	user 0.003s	sys 0.005s
I20260709 13:14:50.247136   597 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:50.221288  5980 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:50.252384  5793 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:50.248235  5548 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:50.256276  5996 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:50.225226  5677 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:50.158041  5966 raft_consensus.cc:515] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:50.281773   630 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:50.292116  5804 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
W20260709 13:14:50.293569   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 48961.4us
W20260709 13:14:50.298105   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 55602.6us
I20260709 13:14:50.289657  5610 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.348109   599 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:50.348845   480 raft_consensus.cc:1275] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:50.372766  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:50.349628   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:50.350319   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:50.350997   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:50.351670   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:50.362700  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:50.364074   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:50.377767   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2131bd04d2d4f3da62d75b100a2aecd" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:50.380733  5927 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:50.381373  5927 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:50.383714  5927 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:50.377313  5934 raft_consensus.cc:2749] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:50.387802   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:50.388381   555 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:50.293100  5996 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:50.396673  5986 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.295814  5548 raft_consensus.cc:697] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:50.413499   555 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 15.
I20260709 13:14:50.302536  5916 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:50.421248   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54372ad9508c44d2824f4810f03a5081" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:50.374989  6004 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:50.429023   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 186533us
I20260709 13:14:50.420933  5996 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:50.372890  5741 consensus_queue.cc:1059] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:14:50.438755   448 leader_election.cc:400] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 election: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 17. Current term is 18.
I20260709 13:14:50.439124   448 leader_election.cc:403] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:14:50.371577  5804 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:50.377475  5610 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:50.433609  5916 raft_consensus.cc:697] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:50.452625   484 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:50.455929   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:50.426178  5986 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:50.465361  5986 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:50.467425  5548 consensus_queue.cc:237] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:50.467800   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:50.471845  5804 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:50.442118  5955 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159) with higher term. Message: Invalid argument: T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 17. Current term is 18.
I20260709 13:14:50.432598  6004 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:50.478740   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 251767us
I20260709 13:14:50.481617  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:50.450205  5992 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:50.451637  5966 leader_election.cc:290] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:50.487494   522 leader_election.cc:304] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:50.491261   558 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:50.497330  6048 log.cc:927] Time spent T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:14:50.499859   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b1684e65e840ce8bcb13346b86d204" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:50.506166  6051 log.cc:927] Time spent T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.256s	user 0.004s	sys 0.000s
I20260709 13:14:50.509598   447 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:50.509563   483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:14:50.510972   483 raft_consensus.cc:606] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:50.511021   482 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:50.511195   447 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:50.519626   447 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:50.519379   525 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:50.523711   625 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:14:50.526590   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 137110us
I20260709 13:14:50.529382   525 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:50.529935   447 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:50.531409   484 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:14:50.530928   525 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:50.534574   525 leader_election.cc:304] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:50.535089   447 leader_election.cc:400] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 13. Current term is 14.
I20260709 13:14:50.536185   447 leader_election.cc:400] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245) with higher term. Message: Invalid argument: T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 17. Current term is 18.
I20260709 13:14:50.538138   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:50.537016   447 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:50.543643   525 leader_election.cc:304] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:50.545609   558 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:14:50.548367   558 pending_rounds.cc:85] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting all ops after (but not including) 8
I20260709 13:14:50.549890   558 pending_rounds.cc:107] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:14:50.526717  5518 raft_consensus.cc:2749] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:50.519379  5793 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:50.571276  5805 raft_consensus.cc:3055] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:50.571687  5805 raft_consensus.cc:740] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:50.572516  5805 consensus_queue.cc:260] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:50.573441   550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82382f158074497a857b03f9f87f9e86"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:43548
I20260709 13:14:50.534121  5810 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:50.577179   625 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:50.577836  5810 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:50.495596  5992 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:50.551518   630 raft_consensus.cc:1240] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:14:50.581327   556 raft_consensus.cc:1240] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:14:50.537385  5729 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:50.540764  5916 consensus_queue.cc:237] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:50.583479  5805 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:50.554490  5840 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:50.584152  5840 raft_consensus.cc:493] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:50.584517  5840 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:50.587539  5987 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:50.559955  5957 raft_consensus.cc:2749] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:50.592358  6004 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:50.560369  5990 raft_consensus.cc:993] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:14:50.593480  5990 raft_consensus.cc:1081] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:14:50.534802  5994 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:50.539570  5988 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:50.528308  5955 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:14:50.549003  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 60465.5us
I20260709 13:14:50.488679  5741 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:14:50.534518  6005 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:50.567499  5610 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:14:50.567685  6054 log.cc:927] Time spent T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:14:50.567816  6057 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:50.533025  6011 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:50.597193   625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54754
I20260709 13:14:50.626901   625 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:50.627511   625 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:50.594892  1168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:57004
I20260709 13:14:50.550993  5639 raft_consensus.cc:2749] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:14:50.604993   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 205276us
I20260709 13:14:50.641218   599 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:50.641954  1141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.642413   599 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:50.564586   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:50.643436  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:50.640908  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:50.645334   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 80815.2us
I20260709 13:14:50.556445   558 raft_consensus.cc:2889] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:50.536705  5966 consensus_queue.cc:1048] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:14:50.628436  1168 raft_consensus.cc:606] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:50.647046  1168 raft_consensus.cc:614] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:50.656440   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:50.657311   550 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:50.657796   550 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:50.594959  5840 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:50.639480   625 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:50.678644   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:50.664490   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:50.679628   480 raft_consensus.cc:2393] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 14: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:14:50.673244   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:50.675683   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
W20260709 13:14:50.652182  5860 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
W20260709 13:14:50.699863  6050 log.cc:927] Time spent T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.448s	user 0.000s	sys 0.003s
I20260709 13:14:50.708998   480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:14:50.710083   480 raft_consensus.cc:606] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:50.710685   480 raft_consensus.cc:614] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:50.677767   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:50.658213  5513 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:50.651050  5934 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:50.684437   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:50.711862   481 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 17.
I20260709 13:14:50.676579  5859 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:50.713583   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 57938.6us
I20260709 13:14:50.725095  6018 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:50.727715 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:50.727789  6018 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:50.729655 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:50.730684  6018 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:14:50.731635  6047 log.cc:927] Time spent T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.475s	user 0.003s	sys 0.000s
I20260709 13:14:50.735736  5840 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:50.680887  5810 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
W20260709 13:14:50.738435   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 182578us
I20260709 13:14:50.640105  6057 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:50.742913   525 leader_election.cc:304] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:50.751199  6045 raft_consensus.cc:2749] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:50.751302  5859 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:50.751961  5859 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:50.753793  6045 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:50.754141  5859 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:50.738337  5513 raft_consensus.cc:697] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:50.755391  5513 consensus_queue.cc:237] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:50.755929  5639 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:14:50.759119  6059 log.cc:927] Time spent T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c: Append to log took a long time: real 0.221s	user 0.003s	sys 0.000s
I20260709 13:14:50.740689   625 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:50.744517  5610 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:14:50.777465  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:50.777994  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:14:50.778875  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:50.779649  1167 raft_consensus.cc:3055] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:50.780067  1167 raft_consensus.cc:740] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:50.783752  1167 consensus_queue.cc:260] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:50.766796   550 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:50.792912  1167 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:50.784512  5610 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:50.807325   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 272880us
I20260709 13:14:50.814440   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:50.811923  1167 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:50.823506   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:50.825889   597 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:14:50.828985   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 244282us
I20260709 13:14:50.836356  5996 raft_consensus.cc:515] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:50.838526  5996 leader_election.cc:290] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:50.844008   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:50.844695   630 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 13.
I20260709 13:14:50.846024   632 raft_consensus.cc:1240] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:50.847388  6018 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:50.847936  6018 raft_consensus.cc:697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:50.848594  5610 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:50.848788  6018 consensus_queue.cc:237] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:50.850445  5677 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:50.852512  5677 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:50.856731   627 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:50.858044   556 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:50.856961  6057 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:50.856253  5614 consensus_queue.cc:1059] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:14:50.945148  5614 raft_consensus.cc:3055] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:50.945524  5614 raft_consensus.cc:740] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:50.946319  5614 consensus_queue.cc:260] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:50.932375  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 72287.8us
I20260709 13:14:50.952639  6055 raft_consensus.cc:493] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6e6df7e8ed204f1db5c371536b5b0683)
I20260709 13:14:50.953241  6055 raft_consensus.cc:515] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:50.941461  5992 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:50.866411  6067 consensus_queue.cc:1059] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
W20260709 13:14:50.929574  6051 log.cc:927] Time spent T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:14:50.955624   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 95846us
I20260709 13:14:50.956135   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:50.958071   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:50.960417   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e472c1c82c9467a9a5563d6b06e3b53" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:50.974875   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:50.976168   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:50.976562  5614 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:50.980482  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:14:50.979482   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 113772us
I20260709 13:14:50.987363   597 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:50.977867  6055 leader_election.cc:290] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:50.989768   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:50.992676   478 raft_consensus.cc:1240] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:50.995353   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:50.998924  6055 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.002983   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e346d318734aba97a45543ff4ad474" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
W20260709 13:14:51.006131   525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:51.014338   525 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:51.015228  5985 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:51.015410  5610 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:51.016099  6046 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:51.006597  6055 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:51.030300   525 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:51.033582   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
W20260709 13:14:51.039618   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 56106.6us
I20260709 13:14:51.043278   525 leader_election.cc:304] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:51.044121  6067 raft_consensus.cc:2749] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:51.045018   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727ef43c64e147b3889a02b94ab53253" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:51.046456   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:51.047742   633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:51.051530   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:51.040657  5992 raft_consensus.cc:2749] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:51.073333   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:51.075135   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:51.075834   482 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:51.075949   479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:51.057251  5994 raft_consensus.cc:3055] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:51.080092   483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:51.083567   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:51.085405   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:51.087276   477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:51.070043  6025 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:14:51.104991   482 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 12.
I20260709 13:14:51.080062  5994 raft_consensus.cc:740] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:51.112082   447 leader_election.cc:304] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:51.118183   447 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:51.123301   551 raft_consensus.cc:1240] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Rejecting Update request from peer 6e6df7e8ed204f1db5c371536b5b0683 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:51.127759  5793 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:51.121850  6066 raft_consensus.cc:2749] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:51.140470   447 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:51.110409  6025 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:51.147298   447 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:51.155292  5804 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:51.162629   550 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:51.135083  5990 consensus_queue.cc:1059] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:14:51.167375   447 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:51.165704  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:51.152514  5793 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:51.177141   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:51.183691  6081 log.cc:927] Time spent T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:14:51.202056  5840 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:14:51.207062  6079 log.cc:927] Time spent T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:14:51.178531  6055 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:51.148564  5994 consensus_queue.cc:260] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:14:51.219520  6082 log.cc:927] Time spent T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.064s	user 0.003s	sys 0.000s
I20260709 13:14:51.220398  6025 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:14:51.220642  6083 log.cc:927] Time spent T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:14:51.221858  6080 log.cc:927] Time spent T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:14:51.231019   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:51.236407   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:14:51.244968   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 204132us
I20260709 13:14:51.253783   599 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:51.255115   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:51.255790   552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:51.256070   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:14:51.256287   599 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:51.257556   599 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:51.257759   559 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:14:51.266290  1167 raft_consensus.cc:3055] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:51.266822  1167 raft_consensus.cc:740] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:14:51.269963  6005 raft_consensus.cc:993] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:14:51.271020  6045 consensus_queue.cc:1059] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:51.272583  6045 raft_consensus.cc:3055] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:51.273057  6045 raft_consensus.cc:740] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:51.274078  6045 consensus_queue.cc:260] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:51.277081  5909 raft_consensus.cc:2749] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:51.277256   599 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:51.278438  6045 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:51.280320   599 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:51.280562  1138 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:51.282078  6036 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:51.282667  6073 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:51.283830  5859 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:51.282167  6028 raft_consensus.cc:2749] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:51.291796  6073 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:51.290776  1167 consensus_queue.cc:260] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:51.293299  5810 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:14:51.307176   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 109662us
I20260709 13:14:51.307863  1167 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:51.309418   447 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:51.314484   599 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:14:51.315639   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:51.316237   482 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:51.324129   482 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:51.324129  1167 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 12.
I20260709 13:14:51.327196   523 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:51.306593  6005 raft_consensus.cc:1081] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Signalling peer 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:14:51.330138   599 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:51.312778  6079 log.cc:927] Time spent T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:14:51.342628   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:51.308104  6073 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:14:51.354346   599 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:14:51.345904  6046 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:14:51.316924  5793 raft_consensus.cc:2749] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:51.342170  5980 raft_consensus.cc:2749] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:51.361461  5610 raft_consensus.cc:2749] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:51.355098  6073 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:51.352468  6057 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:51.392496  6057 raft_consensus.cc:697] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:51.393644  6057 consensus_queue.cc:237] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:51.363306  6018 raft_consensus.cc:2749] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:14:51.405216   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 87283.5us
W20260709 13:14:51.410794   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 56525.9us
I20260709 13:14:51.413936   447 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:51.419797  5927 raft_consensus.cc:2749] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:14:51.420488   480 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:51.421838   484 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:14:51.430359   555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59114
I20260709 13:14:51.430989   555 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:51.441386   555 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:51.443143  5994 raft_consensus.cc:3060] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:51.458734   555 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:51.468300   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:51.468904   475 raft_consensus.cc:3055] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:51.469205   475 raft_consensus.cc:740] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:51.469890   475 consensus_queue.cc:260] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:51.471043   475 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:51.472312   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:51.472916   624 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:51.467712  6073 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:51.479934  6073 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:51.480068   475 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:51.487594   624 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:51.489008   555 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:51.497153   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
W20260709 13:14:51.507341   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 56986us
I20260709 13:14:51.510059   522 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
W20260709 13:14:51.527863   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 175554us
I20260709 13:14:51.532042  5639 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:51.518504  6018 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:14:51.561338   525 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:51.570700  5860 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:51.549603  6108 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:14:51.569744  5639 raft_consensus.cc:697] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:51.587574  5639 consensus_queue.cc:237] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:51.607188   631 raft_consensus.cc:1240] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:51.611447  5614 consensus_queue.cc:1059] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:14:51.612039   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 43491.1us
I20260709 13:14:51.612497  5614 raft_consensus.cc:3055] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:51.612916  5614 raft_consensus.cc:740] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:51.632643   553 raft_consensus.cc:2468] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 16.
I20260709 13:14:51.635866  1167 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:14:51.636726   555 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:14:51.640103  1166 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:14:51.652334   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:51.693279  5986 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:51.702874   597 leader_election.cc:304] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:51.706473  6062 raft_consensus.cc:2804] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:51.707027  6062 raft_consensus.cc:697] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:51.707923  6062 consensus_queue.cc:237] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:51.714221   559 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:51.613718  5614 consensus_queue.cc:260] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:51.724020  5614 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:51.730875 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:51.760109  6018 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:51.761031  6109 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:51.775828   481 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:14:51.788089  6108 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:51.796967  6073 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
W20260709 13:14:51.833576  6117 log.cc:927] Time spent T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:14:51.875088   555 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 18.
I20260709 13:14:51.879424   597 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:51.885154  6073 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:51.885854  6073 raft_consensus.cc:697] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
W20260709 13:14:51.886765  6120 log.cc:927] Time spent T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:14:51.886865  6073 consensus_queue.cc:237] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:51.943781   481 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:14:51.948652  5860 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
W20260709 13:14:51.970534  6123 log.cc:927] Time spent T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:14:52.031273  1167 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:14:52.032791  5860 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:14:52.064790   377 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46008 (request call id 263) took 18347 ms (client timeout 15000 ms). Trace:
W20260709 13:14:52.068276   377 rpcz_store.cc:269] 0709 13:14:33.913752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.948237 (+ 34485us) service_pool.cc:224] Handling call
0709 13:14:52.064722 (+18116485us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:49.587225 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:49.694157 (+106932us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:49.694213 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:14:49.694233 (+    20us) tablet.cc:662] Decoding operations
0709 13:14:49.803397 (+109164us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:49.803509 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:49.803538 (+    29us) tablet.cc:685] Acquiring locks for 33 operations
0709 13:14:49.805763 (+  2225us) tablet.cc:701] Row locks acquired
0709 13:14:49.805815 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:14:49.805993 (+   178us) write_op.cc:270] Start()
0709 13:14:49.806157 (+   164us) write_op.cc:276] Timestamp: P: 1783602889805925 usec, L: 0
0709 13:14:49.806178 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:14:50.007270 (+201092us) log.cc:844] Serialized 12956 byte log entry
0709 13:14:50.932707 (+925437us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b54000fbed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68414e28 00007f4b6be4f581 00007f4b6be4ed58 00007f4b6be539f1 00007f4b6be539a9 00007f4b6be53939 00007f4b6be53901 00007f4b6be52b2d 000000000038f354 000000000038f199
0709 13:14:51.031114 (+ 98407us) op_driver.cc:464] REPLICATION: finished
0709 13:14:51.175856 (+144742us) write_op.cc:301] APPLY: starting
0709 13:14:51.175951 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:51.554592 (+378641us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:51.554622 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:51.860969 (+306347us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:51.861329 (+   360us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=66,key_file_lookups=66,delta_file_lookups=0,mrs_lookups=0
0709 13:14:51.861372 (+    43us) write_op.cc:312] APPLY: finished
0709 13:14:51.861854 (+   482us) log.cc:844] Serialized 284 byte log entry
0709 13:14:51.862035 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:51.862318 (+   283us) write_op.cc:454] Released schema lock
0709 13:14:51.862387 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:51.862751 (+   364us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:51.862777 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":327049,"reported_tablets":51,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":125218,"apply.run_cpu_time_us":42999,"apply.run_wall_time_us":688411,"cfile_cache_hit":134,"cfile_cache_hit_bytes":142199,"num_ops":33,"prepare.queue_time_us":259049,"prepare.run_cpu_time_us":45678,"prepare.run_wall_time_us":1375073,"raft.queue_time_us":239371,"raft.run_cpu_time_us":16745,"raft.run_wall_time_us":107188,"replication_time_us":1224751,"spinlock_wait_cycles":32233728,"thread_start_us":679359,"threads_started":4,"wal-append.queue_time_us":437887}]]}
I20260709 13:14:52.146377   481 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:14:52.158896   630 raft_consensus.cc:1275] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:52.167678  5518 consensus_queue.cc:1048] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:52.152467  6040 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:14:52.230114   482 raft_consensus.cc:1275] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:52.232286  5992 consensus_queue.cc:1048] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:14:52.264492   376 catalog_manager.cc:5697] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 8 to 11, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 11 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:52.273902   559 raft_consensus.cc:1275] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:14:52.277110  6109 consensus_queue.cc:1048] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:52.282004  5992 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.282513  5992 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:52.284786  5992 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:52.302896   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:52.303565   478 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:52.309237   554 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:14:52.311486   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:52.312155  6109 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:52.312582   624 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:14:52.316428   525 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:52.319802  5518 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:52.320209  5518 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:52.320533  5518 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:52.330915   478 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:52.266831   376 catalog_manager.cc:5697] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 12 to 14, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 14 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:52.360133   376 catalog_manager.cc:5697] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 11 to 13, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 13 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:52.364017   376 catalog_manager.cc:5697] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 10 to 12, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 12 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:52.366334   376 catalog_manager.cc:5697] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 10 to 12, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 12 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:52.380247   376 catalog_manager.cc:5697] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 11 to 14, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 14 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:52.358701  5518 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:52.384552   376 catalog_manager.cc:5697] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 8 to 12, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 12 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:52.388407   376 catalog_manager.cc:5697] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:52.369269   478 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:14:52.393283   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:52.390301   376 catalog_manager.cc:5697] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 9 to 11, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 11 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:52.406131   481 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:52.399611   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:52.411710   630 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:52.413646   481 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 15.
I20260709 13:14:52.414988   525 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:52.415814  6057 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:52.416375  6057 raft_consensus.cc:697] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:52.417277  6057 consensus_queue.cc:237] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:52.418614   630 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 15.
I20260709 13:14:52.401067  5518 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:52.432123  5909 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:52.590451  5518 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.591022  5518 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:52.598325   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:14:52.599022   481 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 15.
I20260709 13:14:52.600118   525 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:52.600904  6057 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:52.601302  6057 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:52.601630  6057 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:52.602393   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:14:52.603102   630 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 16.
I20260709 13:14:52.605417  5518 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:52.618045  6057 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:52.622764  6057 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 17 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:52.624446   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:52.625051   630 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:52.626780   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:52.627430   481 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:14:52.631976   630 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 17.
I20260709 13:14:52.643728   522 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:52.644728  5518 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:52.645274  5518 raft_consensus.cc:697] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:52.646158  5518 consensus_queue.cc:237] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:52.657629   375 catalog_manager.cc:5697] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:52.659320   375 catalog_manager.cc:5697] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:52.661157   375 catalog_manager.cc:5697] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 8 to 9, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 9 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:52.663336   375 catalog_manager.cc:5697] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 13 to 14, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 14 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:52.665068   375 catalog_manager.cc:5697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 11 to 16, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 16 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:52.666751   375 catalog_manager.cc:5697] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 11 to 14, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 14 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:52.680572   375 catalog_manager.cc:5697] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 12 to 14, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 14 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:52.686123   481 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 17.
W20260709 13:14:52.674507   376 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46024 (request call id 253) took 25042 ms (client timeout 15000 ms). Trace:
I20260709 13:14:52.872627   375 catalog_manager.cc:5697] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:14:52.718019   376 rpcz_store.cc:269] 0709 13:14:27.632063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:27.648533 (+ 16470us) service_pool.cc:224] Handling call
0709 13:14:52.674405 (+25025872us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:52.432350 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:52.432996 (+   646us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:52.433028 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:14:52.433045 (+    17us) tablet.cc:662] Decoding operations
0709 13:14:52.434177 (+  1132us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:52.434272 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:52.434303 (+    31us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:14:52.435153 (+   850us) tablet.cc:701] Row locks acquired
0709 13:14:52.435172 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:14:52.447434 (+ 12262us) write_op.cc:270] Start()
0709 13:14:52.447618 (+   184us) write_op.cc:276] Timestamp: P: 1783602892447357 usec, L: 0
0709 13:14:52.447656 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:14:52.448584 (+   928us) log.cc:844] Serialized 3627 byte log entry
0709 13:14:52.460505 (+ 11921us) op_driver.cc:464] REPLICATION: finished
0709 13:14:52.461976 (+  1471us) write_op.cc:301] APPLY: starting
0709 13:14:52.462068 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:52.486792 (+ 24724us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:52.486913 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:52.506525 (+ 19612us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:52.522406 (+ 15881us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0709 13:14:52.522457 (+    51us) write_op.cc:312] APPLY: finished
0709 13:14:52.522765 (+   308us) log.cc:844] Serialized 89 byte log entry
0709 13:14:52.522951 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:52.523099 (+   148us) write_op.cc:454] Released schema lock
0709 13:14:52.523150 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:52.523584 (+   434us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:52.523615 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1241934,"reported_tablets":50,"spinlock_wait_cycles":44416,"child_traces":[["op",{"apply.queue_time_us":1214,"apply.run_cpu_time_us":13741,"apply.run_wall_time_us":61575,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41783,"num_ops":9,"prepare.queue_time_us":21020,"prepare.run_cpu_time_us":4587,"prepare.run_wall_time_us":22601,"replication_time_us":12669,"thread_start_us":24976,"threads_started":2}]]}
I20260709 13:14:52.877135   375 catalog_manager.cc:5697] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 10 to 11, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 11 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:52.879878   375 catalog_manager.cc:5697] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 12 to 14, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 14 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:52.892328   375 catalog_manager.cc:5697] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:52.898105   375 catalog_manager.cc:5697] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 12 to 15, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 15 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:52.900799   375 catalog_manager.cc:5697] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 12 to 19. New cstate: current_term: 19 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:52.903334   375 catalog_manager.cc:5697] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 12 to 17, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 17 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:52.959492   482 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:14:52.975281  5518 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:53.022014   630 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:14:52.912760   375 catalog_manager.cc:5697] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 12 to 13, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 13 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:53.031299   375 catalog_manager.cc:5697] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 8 to 10, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 10 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:53.033700   375 catalog_manager.cc:5697] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:53.035429  5518 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:53.117599   624 raft_consensus.cc:1275] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:14:53.127059  5518 consensus_queue.cc:1048] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:53.134159 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:53.149755   375 catalog_manager.cc:5697] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 14 to 15, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 15 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:53.159303   375 catalog_manager.cc:5697] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.162027   375 catalog_manager.cc:5697] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 14 to 15, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 15 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:53.163810   375 catalog_manager.cc:5697] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.174923   476 raft_consensus.cc:1275] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:14:53.181488  6057 consensus_queue.cc:1048] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:53.211864   375 catalog_manager.cc:5697] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 14 to 17, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 17 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:53.232069   375 catalog_manager.cc:5697] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:53.252333   375 catalog_manager.cc:5697] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:53.276404   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 96725.7us
I20260709 13:14:53.256707   375 catalog_manager.cc:5697] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:53.294679   375 catalog_manager.cc:5697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:53.374478   375 catalog_manager.cc:5697] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 5 to 13, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 13 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:53.377144   375 catalog_manager.cc:5697] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:53.378804   375 catalog_manager.cc:5697] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 11 to 15, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 15 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:53.414755   375 catalog_manager.cc:5697] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 11 to 15, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 15 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.416965   375 catalog_manager.cc:5697] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 11 to 15, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 15 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:53.418593   375 catalog_manager.cc:5697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 10 to 13, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 13 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:53.444818   375 catalog_manager.cc:5697] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 13 to 15, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 15 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:53.446399   375 catalog_manager.cc:5697] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 13 to 15, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 15 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:53.466257  1167 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "304d1b96642140f19543be15d23a061c"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:57004
I20260709 13:14:53.467067  1167 raft_consensus.cc:606] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:53.467453  1167 raft_consensus.cc:614] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:53.478736   375 catalog_manager.cc:5697] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:53.480499   375 catalog_manager.cc:5697] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 14 to 15, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 15 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:53.482224   375 catalog_manager.cc:5697] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:53.488512   481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:14:53.489166   481 raft_consensus.cc:606] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:53.489516   481 raft_consensus.cc:614] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:53.496325  1167 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:57004
I20260709 13:14:53.496910  1167 raft_consensus.cc:606] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:53.497262  1167 raft_consensus.cc:614] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:53.499915   481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac7da405058744b49aee8b0adbc78189"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:14:53.500432   481 raft_consensus.cc:606] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:53.500708   481 raft_consensus.cc:614] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:53.503340   481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:14:53.503923   481 raft_consensus.cc:606] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:53.504323   481 raft_consensus.cc:614] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:53.505952 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:53.508260 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:53.884886   375 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46008 (request call id 264) took 3061 ms. Trace:
I20260709 13:14:53.893272   379 catalog_manager.cc:5697] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.885376   375 rpcz_store.cc:276] 0709 13:14:50.823366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.823622 (+   256us) service_pool.cc:224] Handling call
0709 13:14:53.884785 (+3061163us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:53.560154 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:53.560884 (+   730us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:53.560949 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:14:53.560967 (+    18us) tablet.cc:662] Decoding operations
0709 13:14:53.571740 (+ 10773us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:53.571836 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:53.571859 (+    23us) tablet.cc:685] Acquiring locks for 37 operations
0709 13:14:53.574507 (+  2648us) tablet.cc:701] Row locks acquired
0709 13:14:53.574563 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:14:53.574723 (+   160us) write_op.cc:270] Start()
0709 13:14:53.574860 (+   137us) write_op.cc:276] Timestamp: P: 1783602893574655 usec, L: 0
0709 13:14:53.574894 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:14:53.575708 (+   814us) log.cc:844] Serialized 14494 byte log entry
0709 13:14:53.605972 (+ 30264us) op_driver.cc:464] REPLICATION: finished
0709 13:14:53.612184 (+  6212us) write_op.cc:301] APPLY: starting
0709 13:14:53.612290 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:53.686538 (+ 74248us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:53.686672 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:53.765232 (+ 78560us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:53.765766 (+   534us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=74,key_file_lookups=74,delta_file_lookups=0,mrs_lookups=0
0709 13:14:53.765835 (+    69us) write_op.cc:312] APPLY: finished
0709 13:14:53.766591 (+   756us) log.cc:844] Serialized 316 byte log entry
0709 13:14:53.779448 (+ 12857us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:53.779750 (+   302us) write_op.cc:454] Released schema lock
0709 13:14:53.779852 (+   102us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:53.795531 (+ 15679us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:53.795583 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":66172,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":5904,"apply.run_cpu_time_us":45199,"apply.run_wall_time_us":183317,"cfile_cache_hit":150,"cfile_cache_hit_bytes":158935,"num_ops":37,"prepare.queue_time_us":33370,"prepare.run_cpu_time_us":10048,"prepare.run_wall_time_us":38970,"raft.queue_time_us":14176,"raft.run_cpu_time_us":982,"raft.run_wall_time_us":13781,"replication_time_us":30874,"thread_start_us":87005,"threads_started":4,"wal-append.queue_time_us":11903}]]}
I20260709 13:14:54.002731   380 catalog_manager.cc:5697] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 14 to 16, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 16 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:54.005285   380 catalog_manager.cc:5697] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:54.007166   380 catalog_manager.cc:5697] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 13 to 14, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 14 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:54.012441   380 catalog_manager.cc:5697] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 9 to 13, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 13 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:54.016057   380 catalog_manager.cc:5697] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:54.014055   379 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48622 (request call id 251) took 27717 ms (client timeout 15000 ms). Trace:
W20260709 13:14:54.019486   379 rpcz_store.cc:269] 0709 13:14:26.296621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.296816 (+   195us) service_pool.cc:224] Handling call
0709 13:14:27.312463 (+1015647us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5400260610. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b651b4db1 00007f4b652f4b71 00007f4b652f50b2 00007f4b6e26ea89 00007f4b6e206da6 00007f4b6e1d8088 00007f4b6e2d637e 00007f4b6c7972a4 00007f4b6c797232 00007f4b6c797161 00007f4b6c7970dc
0709 13:14:54.013957 (+26701494us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:53.924954 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:53.925498 (+   544us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:53.925533 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:14:53.925551 (+    18us) tablet.cc:662] Decoding operations
0709 13:14:53.925915 (+   364us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:53.925970 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:53.925997 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:53.926175 (+   178us) tablet.cc:701] Row locks acquired
0709 13:14:53.926193 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:14:53.926325 (+   132us) write_op.cc:270] Start()
0709 13:14:53.926429 (+   104us) write_op.cc:276] Timestamp: P: 1783602893926283 usec, L: 0
0709 13:14:53.926445 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:14:53.930465 (+  4020us) log.cc:844] Serialized 536 byte log entry
0709 13:14:53.932973 (+  2508us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b54000fbed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68414e28 00007f4b6be4f581 00007f4b6be4ed58 00007f4b6be539f1 00007f4b6be539a9 00007f4b6be53939 00007f4b6be53901 00007f4b6be52b2d 000000000038f354 000000000038f199
0709 13:14:53.941935 (+  8962us) op_driver.cc:464] REPLICATION: finished
0709 13:14:53.942363 (+   428us) write_op.cc:301] APPLY: starting
0709 13:14:53.942435 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:53.943212 (+   777us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:53.943255 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:53.943880 (+   625us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:53.944044 (+   164us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:14:53.944095 (+    51us) write_op.cc:312] APPLY: finished
0709 13:14:53.944283 (+   188us) log.cc:844] Serialized 25 byte log entry
0709 13:14:53.944438 (+   155us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:53.944513 (+    75us) write_op.cc:454] Released schema lock
0709 13:14:53.944549 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:53.944898 (+   349us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:53.944926 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2325102,"reported_tablets":50,"spinlock_wait_cycles":41877760,"child_traces":[["op",{"apply.queue_time_us":238,"apply.run_cpu_time_us":2488,"apply.run_wall_time_us":2488,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4184,"num_ops":1,"prepare.queue_time_us":307,"prepare.run_cpu_time_us":4953,"prepare.run_wall_time_us":8201,"replication_time_us":15355,"spinlock_wait_cycles":7736192}]]}
I20260709 13:14:54.033280   380 catalog_manager.cc:5697] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 1 to 16. New cstate: current_term: 16 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:54.035079   380 catalog_manager.cc:5697] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 10 to 12, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 12 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:54.036986   380 catalog_manager.cc:5697] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 11 to 13, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 13 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:54.039302   380 catalog_manager.cc:5697] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 12 to 13, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 13 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:54.040992   380 catalog_manager.cc:5697] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 12 to 15, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 15 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:54.043704   380 catalog_manager.cc:5697] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 4 to 14, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 14 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:54.045960   380 catalog_manager.cc:5697] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 11 to 13, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 13 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:54.095757   375 catalog_manager.cc:5697] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:54.097555   375 catalog_manager.cc:5697] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 13 to 14, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 14 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:54.098783   375 catalog_manager.cc:5697] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 9 to 13, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 13 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:54.100023   375 catalog_manager.cc:5697] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:54.101742   375 catalog_manager.cc:5697] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 12 to 14, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 14 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:54.104475   375 catalog_manager.cc:5697] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:54.106068   375 catalog_manager.cc:5697] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:54.119380   375 catalog_manager.cc:5697] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 13 to 14, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 14 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:54.120919   375 catalog_manager.cc:5697] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 13 to 14, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 14 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:54.122334   375 catalog_manager.cc:5697] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 16 to 18, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 18 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:54.124133   375 catalog_manager.cc:5697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 11 to 12, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 12 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:54.125723   375 catalog_manager.cc:5697] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 15 to 16, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 16 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } }
I20260709 13:14:54.127110   375 catalog_manager.cc:5697] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 11 to 12, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 12 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:54.118404   380 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46024 (request call id 254) took 6193 ms. Trace:
I20260709 13:14:54.131450   380 rpcz_store.cc:276] 0709 13:14:47.925145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:47.925355 (+   210us) service_pool.cc:224] Handling call
0709 13:14:54.118323 (+6192968us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:54.052670 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:54.053258 (+   588us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:54.053301 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:14:54.053320 (+    19us) tablet.cc:662] Decoding operations
0709 13:14:54.054444 (+  1124us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:54.054512 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:54.054548 (+    36us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:14:54.055817 (+  1269us) tablet.cc:701] Row locks acquired
0709 13:14:54.055837 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:14:54.055996 (+   159us) write_op.cc:270] Start()
0709 13:14:54.056128 (+   132us) write_op.cc:276] Timestamp: P: 1783602894055943 usec, L: 0
0709 13:14:54.056148 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:14:54.056839 (+   691us) log.cc:844] Serialized 4771 byte log entry
0709 13:14:54.059900 (+  3061us) op_driver.cc:464] REPLICATION: finished
0709 13:14:54.060336 (+   436us) write_op.cc:301] APPLY: starting
0709 13:14:54.060409 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:54.066218 (+  5809us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:54.066323 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:54.073353 (+  7030us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:54.073608 (+   255us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 13:14:54.073660 (+    52us) write_op.cc:312] APPLY: finished
0709 13:14:54.073994 (+   334us) log.cc:844] Serialized 113 byte log entry
0709 13:14:54.074911 (+   917us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:54.075055 (+   144us) write_op.cc:454] Released schema lock
0709 13:14:54.075108 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:54.087428 (+ 12320us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:54.087464 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":81,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":249,"apply.run_cpu_time_us":14224,"apply.run_wall_time_us":27008,"cfile_cache_hit":48,"cfile_cache_hit_bytes":50208,"num_ops":12,"prepare.queue_time_us":124,"prepare.run_cpu_time_us":4471,"prepare.run_wall_time_us":14718,"replication_time_us":3610}]]}
I20260709 13:14:54.231860   381 catalog_manager.cc:5697] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:54.265450   378 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48622 (request call id 252) took 7501 ms. Trace:
I20260709 13:14:54.274042   378 rpcz_store.cc:276] 0709 13:14:46.763726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.767306 (+  3580us) service_pool.cc:224] Handling call
0709 13:14:54.265266 (+7497960us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29,"reported_tablets":50}
I20260709 13:14:54.344163   375 catalog_manager.cc:5697] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 12 to 15, leader changed from 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 15 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:14:54.350903   381 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41332 (request call id 159) took 10525 ms. Trace:
I20260709 13:14:54.351382   381 rpcz_store.cc:276] 0709 13:14:43.825171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.827444 (+  2273us) service_pool.cc:224] Handling call
0709 13:14:54.350806 (+10523362us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:54.256681 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:54.257207 (+   526us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:54.257254 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:14:54.257269 (+    15us) tablet.cc:662] Decoding operations
0709 13:14:54.257599 (+   330us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:54.257654 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:54.257681 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:54.257859 (+   178us) tablet.cc:701] Row locks acquired
0709 13:14:54.257876 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:14:54.258002 (+   126us) write_op.cc:270] Start()
0709 13:14:54.258117 (+   115us) write_op.cc:276] Timestamp: P: 1783602894257960 usec, L: 0
0709 13:14:54.258135 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:14:54.264036 (+  5901us) log.cc:844] Serialized 536 byte log entry
0709 13:14:54.264850 (+   814us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b54000fbed4. stack: 00007f4b652fa343 00007f4b652fa240 00007f4b64c891d4 00007f4b6e9c7304 00007f4b6e9c7299 00007f4b68382571 00007f4b68414e28 00007f4b6be4f581 00007f4b6be4ed58 00007f4b6be539f1 00007f4b6be539a9 00007f4b6be53939 00007f4b6be53901 00007f4b6be52b2d 000000000038f354 000000000038f199
0709 13:14:54.271225 (+  6375us) op_driver.cc:464] REPLICATION: finished
0709 13:14:54.273236 (+  2011us) write_op.cc:301] APPLY: starting
0709 13:14:54.273322 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:54.274128 (+   806us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:54.274150 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:54.274888 (+   738us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:54.275057 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:14:54.275105 (+    48us) write_op.cc:312] APPLY: finished
0709 13:14:54.275343 (+   238us) log.cc:844] Serialized 25 byte log entry
0709 13:14:54.275501 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:54.275587 (+    86us) write_op.cc:454] Released schema lock
0709 13:14:54.275623 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:54.275934 (+   311us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:54.275965 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20407,"reported_tablets":28,"spinlock_wait_cycles":7552,"child_traces":[["op",{"apply.queue_time_us":1723,"apply.run_cpu_time_us":2683,"apply.run_wall_time_us":2682,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4184,"num_ops":1,"prepare.queue_time_us":294,"prepare.run_cpu_time_us":3257,"prepare.run_wall_time_us":8338,"replication_time_us":12969,"spinlock_wait_cycles":11995904}]]}
W20260709 13:14:54.431546   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 65504.8us
W20260709 13:14:54.439042   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 68935.6us
I20260709 13:14:54.512470 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:55.222774   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 46036.2us
W20260709 13:14:55.518560   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 245209us
I20260709 13:14:55.764721 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:56.165117   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 60166us
I20260709 13:14:56.172729   555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:14:56.173524   555 raft_consensus.cc:606] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:14:56.219026  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 61943.4us
I20260709 13:14:56.248222   624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:14:56.248898   624 raft_consensus.cc:606] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:14:56.282255   624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:14:56.282971   624 raft_consensus.cc:606] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:56.296227   624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:14:56.297147   624 raft_consensus.cc:606] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:56.301914   624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:14:56.302721   624 raft_consensus.cc:606] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:56.307992   624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:14:56.308769   624 raft_consensus.cc:606] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:56.325851 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:56.327797 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:56.411175  6188 raft_consensus.cc:993] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:14:56.411801  6188 raft_consensus.cc:1081] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
W20260709 13:14:56.425691   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 67422.3us
W20260709 13:14:56.459494   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 59560.5us
I20260709 13:14:56.460263  6195 raft_consensus.cc:993] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:14:56.461057  6195 raft_consensus.cc:1081] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:14:56.465498  6187 raft_consensus.cc:993] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:14:56.465999  6187 raft_consensus.cc:1081] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Signalling peer 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:14:56.467885  6197 raft_consensus.cc:993] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:14:56.468353  6197 raft_consensus.cc:1081] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:14:56.471837  6189 raft_consensus.cc:993] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:14:56.472321  6189 raft_consensus.cc:1081] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:14:56.475523   475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:14:56.476192   556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59128
I20260709 13:14:56.476349   475 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:56.476706   556 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:56.476716   475 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:56.477494   556 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:56.477969   478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:14:56.478477   478 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:56.478807   478 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:56.483425   481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:14:56.484040   481 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:56.484383   481 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:56.485603   475 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:56.488154   475 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:56.489065   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:56.492399   554 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:56.497857   481 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:56.499827   554 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 17.
I20260709 13:14:56.499001   556 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:56.500495   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:56.501816   448 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:56.503194   555 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:56.503328  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:14:56.503944  1171 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:56.504011   478 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:56.506610   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:56.507108   554 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:56.503973  6185 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:56.508507  6185 raft_consensus.cc:697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:56.509440  6185 consensus_queue.cc:237] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:56.510154   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:56.510716   624 raft_consensus.cc:3055] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:56.511008   624 raft_consensus.cc:740] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:56.511564   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fe583d0f84434a92093dc2407b787f" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:56.511773   624 consensus_queue.cc:260] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:56.512092   630 raft_consensus.cc:3055] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:56.512571   630 raft_consensus.cc:740] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:56.513103   624 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:56.513717   630 consensus_queue.cc:260] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:56.514711   630 raft_consensus.cc:3060] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:56.518247   478 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 18 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:56.502144   556 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 17 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:14:56.520082   554 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 18.
I20260709 13:14:56.530035   448 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:56.523954   624 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 17.
I20260709 13:14:56.531014  6198 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:56.531915  6198 raft_consensus.cc:697] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:56.532889  6198 consensus_queue.cc:237] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:56.500131   481 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:56.512571   555 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:14:56.526887  1171 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 17.
I20260709 13:14:56.537134   448 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:56.538228   523 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:14:56.539141   626 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:14:56.539528  6177 raft_consensus.cc:2804] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:56.539723   626 raft_consensus.cc:493] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:56.540196   626 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:56.540227  6177 raft_consensus.cc:697] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:56.541611   630 raft_consensus.cc:2468] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:14:56.541508  6177 consensus_queue.cc:237] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:56.543653  6184 raft_consensus.cc:2804] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:56.544193  6184 raft_consensus.cc:697] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:56.545092  6184 consensus_queue.cc:237] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:56.547837   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2f65eaa10d4428a49b5f1ed8b939f1" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:56.548453   627 raft_consensus.cc:3055] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:56.548735   627 raft_consensus.cc:740] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:56.549427   627 consensus_queue.cc:260] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:14:56.550748   627 raft_consensus.cc:3060] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:56.554847   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:56.555517   624 raft_consensus.cc:3055] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:56.555852   624 raft_consensus.cc:740] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:56.556612   624 consensus_queue.cc:260] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:56.557799   624 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:56.568797   381 catalog_manager.cc:5697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 16 to 17, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 17 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:56.573757   375 catalog_manager.cc:5697] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 16 to 17, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 17 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:56.577628   626 raft_consensus.cc:515] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:56.581117   630 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:56.586174   627 raft_consensus.cc:2468] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 17.
I20260709 13:14:56.595927   624 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 18.
I20260709 13:14:56.601276   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:56.602047   481 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:56.602104   626 leader_election.cc:290] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:56.603070   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f95c82063d490481f1c94cc64f7311" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:56.601234  6201 consensus_queue.cc:1059] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:14:56.615211   555 raft_consensus.cc:3055] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:56.625990   555 raft_consensus.cc:740] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:56.626756   555 consensus_queue.cc:260] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:56.627848   555 raft_consensus.cc:3060] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:56.630673   481 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 18.
I20260709 13:14:56.631503   478 raft_consensus.cc:1240] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:56.635852   599 leader_election.cc:304] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:14:56.636776  6199 raft_consensus.cc:2804] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:56.637300  6199 raft_consensus.cc:697] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:56.638268  6199 consensus_queue.cc:237] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:56.659053   555 raft_consensus.cc:2468] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 18.
W20260709 13:14:56.666282  6201 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:14:56.710892   378 catalog_manager.cc:5697] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 17 to 18, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 18 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:56.756145  6200 raft_consensus.cc:993] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:14:56.756736  6188 raft_consensus.cc:1081] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:14:56.758622   478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:14:56.759202   478 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:56.759574   478 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:56.773948   478 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:56.777833   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:56.778385   556 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:56.782816   478 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 20 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:56.784209   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:56.784684   626 raft_consensus.cc:3055] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:56.784922   626 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:56.788800   626 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:56.794315   626 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:56.815011   626 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 20.
I20260709 13:14:56.828557   556 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 20.
I20260709 13:14:56.829674   448 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:56.838881   381 catalog_manager.cc:5697] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 17 to 18, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 18 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:56.849663  6172 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:56.850559  6172 raft_consensus.cc:697] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 20 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:56.851660  6172 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:56.840721   381 catalog_manager.cc:5697] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 14 to 15, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 15 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:56.915884   556 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:14:56.917626  6198 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:56.935876   626 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:14:56.937795  6198 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:14:56.945900   627 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:14:56.949225  6172 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:14:57.022675   381 catalog_manager.cc:5697] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 19 to 20, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 20 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:57.031453  6213 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:14:57.046756   478 raft_consensus.cc:1275] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:14:57.052879   556 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:14:57.065691   624 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:14:57.070741  6170 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:57.074651  6198 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:57.077844  6200 consensus_queue.cc:1048] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:57.127698   556 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:14:57.137701  6185 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 13:14:57.188133   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 178761us
W20260709 13:14:57.244522   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 65587us
I20260709 13:14:57.299437   554 raft_consensus.cc:1275] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:14:57.305256  6230 consensus_queue.cc:1048] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:14:57.310741   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 129795us
I20260709 13:14:57.328758 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:57.330080  1168 raft_consensus.cc:1275] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:14:57.333189  6201 consensus_queue.cc:1048] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:14:57.369098   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 144141us
I20260709 13:14:57.375360   624 raft_consensus.cc:1275] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:14:57.376824   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 151238us
W20260709 13:14:57.393020   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 176776us
W20260709 13:14:57.425733   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 55956.9us
I20260709 13:14:57.488583   555 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 20 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260709 13:14:57.490935   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 117783us
W20260709 13:14:57.519498   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 148112us
I20260709 13:14:57.537192  6228 consensus_queue.cc:1048] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:57.621272   627 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 20 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:14:57.635900  6184 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
W20260709 13:14:57.753222   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 82726us
I20260709 13:14:57.757265  6226 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:14:57.839198   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 194119us
W20260709 13:14:57.845117  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 199194us
W20260709 13:14:57.849103   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 189769us
W20260709 13:14:57.931377   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 54163.4us
W20260709 13:14:57.931890   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 65931.5us
I20260709 13:14:58.648559 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:58.890350   624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:14:58.890990   624 raft_consensus.cc:606] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:14:58.894129   554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:14:58.894654   554 raft_consensus.cc:606] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:14:58.896107 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:58.897902 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:59.279954  6200 raft_consensus.cc:993] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:14:59.280544  6229 raft_consensus.cc:1081] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:14:59.282691   476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:14:59.283350   476 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:59.283722   476 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:59.295765   476 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:59.309444   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:59.310113   554 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:59.318411   554 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 19.
I20260709 13:14:59.319744   448 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:59.320641  6252 raft_consensus.cc:2804] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:59.321159  6252 raft_consensus.cc:697] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:14:59.322111  6252 consensus_queue.cc:237] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:59.332647   476 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 19 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:14:59.343801  6247 raft_consensus.cc:993] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:14:59.344326  6247 raft_consensus.cc:1081] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:14:59.344530   626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6d1c43240c46d49621e3a2fb49b972" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:14:59.345193   626 raft_consensus.cc:3055] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:59.345515   626 raft_consensus.cc:740] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:59.346333   626 consensus_queue.cc:260] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:59.347545   629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:14:59.348250   629 raft_consensus.cc:493] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:59.348709   629 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:59.347733   626 raft_consensus.cc:3060] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:59.375285   378 catalog_manager.cc:5697] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 18 to 19, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 19 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.377965   626 raft_consensus.cc:2468] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 19.
I20260709 13:14:59.357841   629 raft_consensus.cc:515] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:59.381100   476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:14:59.381294   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37a8f9254954f1f9db70e23a26e512b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:14:59.381799   476 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:59.381878   554 raft_consensus.cc:3055] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:59.382329   554 raft_consensus.cc:740] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:14:59.383045   554 consensus_queue.cc:260] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:59.384121   554 raft_consensus.cc:3060] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:59.392374   629 leader_election.cc:290] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:14:59.394160   554 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 16.
I20260709 13:14:59.401659   597 leader_election.cc:304] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:14:59.402452  6229 raft_consensus.cc:2804] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:59.402940  6229 raft_consensus.cc:697] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:14:59.403795  6229 consensus_queue.cc:237] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:14:59.423913   476 raft_consensus.cc:2468] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 16.
I20260709 13:14:59.506485   381 catalog_manager.cc:5697] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 15 to 16, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 16 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:59.720994   554 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:14:59.732472  6234 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:59.869359   556 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:14:59.872587  6229 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:59.896456   625 raft_consensus.cc:1275] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:14:59.898876 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:59.900348  6252 consensus_queue.cc:1048] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:59.960943   476 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:14:59.962656  6229 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:00.986485 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:01.098778   476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:01.099526   476 raft_consensus.cc:606] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 20 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:01.105829   624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:15:01.106580   624 raft_consensus.cc:606] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:01.119360 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:01.121155 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:01.135046  6278 raft_consensus.cc:993] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:01.135710  6282 raft_consensus.cc:993] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:01.136119  6278 raft_consensus.cc:1081] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 20 LEADER]: Signalling peer 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:01.136227  6281 raft_consensus.cc:1081] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:01.138764   475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:15:01.139326   475 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:01.139676   475 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:01.142199   554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59114
I20260709 13:15:01.142787   554 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:01.143111   554 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:01.146519   475 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:01.148633   475 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:01.152897   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:01.153528   551 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:01.173933   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:01.174571   625 raft_consensus.cc:3055] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:01.174861   625 raft_consensus.cc:740] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:01.175567   625 consensus_queue.cc:260] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:01.176813   625 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:01.181598   554 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:01.177923   551 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:15:01.188745   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:01.189350   475 raft_consensus.cc:3055] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:15:01.189635   475 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:01.189718   448 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:01.190750  6226 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:01.190382   475 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:01.191601   475 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:01.194412   625 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:15:01.195138  6226 raft_consensus.cc:697] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:01.196386  6226 consensus_queue.cc:237] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:01.210028   475 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 21.
I20260709 13:15:01.211797   525 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:01.212836  6279 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:15:01.214152  6279 raft_consensus.cc:697] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 21 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:01.214430   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:01.215054   624 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:01.215063  6279 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:01.232775   554 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 21 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:01.234756   624 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 21.
I20260709 13:15:01.265254   378 catalog_manager.cc:5697] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 20 to 21, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 21 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:01.300993   381 catalog_manager.cc:5697] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 14 to 15, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 15 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:01.657099   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 59835.2us
I20260709 13:15:01.668903   625 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 21 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:15:01.670514  6276 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:01.671655   625 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:01.675828  6252 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:01.767968   551 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:01.777769  6291 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:15:01.816092   475 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 21 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:15:01.819880  6276 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:02.122301 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:02.162364   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 56190.9us
W20260709 13:15:02.170315  6299 log.cc:927] Time spent T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.078s	user 0.000s	sys 0.003s
W20260709 13:15:02.175601  6296 log.cc:927] Time spent T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.154s	user 0.003s	sys 0.000s
W20260709 13:15:02.234300  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 118771us
W20260709 13:15:02.267865   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 44414.6us
W20260709 13:15:02.429059   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 133835us
W20260709 13:15:02.432294   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 126087us
I20260709 13:15:03.571738 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:03.823876   478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:03.824891   478 raft_consensus.cc:606] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:15:03.830657   553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:15:03.831224   553 raft_consensus.cc:606] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:03.839386 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:03.841130 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:04.097067  6234 raft_consensus.cc:993] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:04.097810  6323 raft_consensus.cc:1081] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:04.175889   629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54256
I20260709 13:15:04.176577   629 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:04.177032   629 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:04.185817   629 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:04.203218   629 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:04.208392   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:04.215682   553 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:04.247452   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:04.248319   475 raft_consensus.cc:3055] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:04.248714   475 raft_consensus.cc:740] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:04.250406   475 consensus_queue.cc:260] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:04.264017   475 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:15:04.421928   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 132972us
I20260709 13:15:04.455945   553 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 18.
I20260709 13:15:04.473500   475 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 18.
I20260709 13:15:04.475610   597 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:04.477264  6326 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:04.477808  6326 raft_consensus.cc:697] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:04.478375  6339 raft_consensus.cc:993] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:04.478874  6326 consensus_queue.cc:237] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:04.513300  6307 raft_consensus.cc:1081] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:04.515561   478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38134
I20260709 13:15:04.516099   478 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:04.516475   478 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:04.532758   478 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:04.536469   478 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:15:04.552093   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 102751us
I20260709 13:15:04.574677   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:04.576557   554 raft_consensus.cc:3055] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:04.576859   554 raft_consensus.cc:740] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:04.583997   554 consensus_queue.cc:260] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:04.585405   554 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:04.632927   554 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:15:04.647451   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9a9d4a92fc4cadac1b3bf82763cfc0" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:04.643200   448 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:04.648159   629 raft_consensus.cc:3060] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:04.648535  6323 raft_consensus.cc:2804] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:04.649001  6323 raft_consensus.cc:697] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:04.650012  6323 consensus_queue.cc:237] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:04.666728   629 raft_consensus.cc:2468] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:15:04.669981   381 catalog_manager.cc:5697] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 17 to 18, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 18 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:04.729880   378 catalog_manager.cc:5697] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 14 to 15, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 15 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:04.847857 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:04.980201   554 raft_consensus.cc:1275] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:15:04.983482  6326 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:05.054602   550 raft_consensus.cc:1275] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:05.066543  6323 consensus_queue.cc:1048] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:05.088416   484 raft_consensus.cc:1275] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:15:05.106843  6347 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 13:15:05.229725  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 54797.4us
I20260709 13:15:05.387030   629 raft_consensus.cc:1275] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:05.407224  6348 consensus_queue.cc:1048] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:15:05.656376   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 125832us
W20260709 13:15:05.730930   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 97563.1us
W20260709 13:15:05.742131   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 157716us
W20260709 13:15:05.969928   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 47806us
I20260709 13:15:06.082773 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:06.215410   632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:15:06.216002   632 raft_consensus.cc:606] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:06.239866   484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:06.240540   484 raft_consensus.cc:606] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:06.245972 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:06.247599 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:06.442378  6362 raft_consensus.cc:993] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:06.443019  6362 raft_consensus.cc:1081] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 LEADER]: Signalling peer 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:06.447118   556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59114
I20260709 13:15:06.447999   556 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:06.448423   556 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:06.510632  6389 raft_consensus.cc:993] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:06.511361  6389 raft_consensus.cc:1081] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
W20260709 13:15:06.584134   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 74471.1us
I20260709 13:15:06.589424   478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:15:06.590261   478 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:06.590740   478 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:06.663304   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 99833.3us
W20260709 13:15:06.662564   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 106035us
I20260709 13:15:06.672936   478 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:15:06.674440   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 50491.9us
I20260709 13:15:06.654966   556 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:06.717593   556 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 19 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:06.732909   478 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:06.740906   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:06.741498   625 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:15:06.748370   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 68199.5us
I20260709 13:15:06.751156   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:06.751788   556 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:06.760852   556 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 16.
I20260709 13:15:06.761993   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:06.771029   478 raft_consensus.cc:3055] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:06.776648   478 raft_consensus.cc:740] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:06.764252   625 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 19.
I20260709 13:15:06.780658   624 raft_consensus.cc:1240] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:06.781054   478 consensus_queue.cc:260] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:06.782305   478 raft_consensus.cc:3060] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:06.776121   448 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:06.787568  6396 raft_consensus.cc:2804] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:06.788224  6396 raft_consensus.cc:697] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:06.793123   522 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:06.793082  6396 consensus_queue.cc:237] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:06.798086  6395 raft_consensus.cc:2804] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:06.800165  6395 raft_consensus.cc:697] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:06.801261  6395 consensus_queue.cc:237] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:06.821724   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb9f12275c47c4989d775511376bdf" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:06.828543   632 raft_consensus.cc:3055] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:06.829002   632 raft_consensus.cc:740] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:06.830039   632 consensus_queue.cc:260] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:06.832406   632 raft_consensus.cc:3060] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:06.831039   478 raft_consensus.cc:2468] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 19.
I20260709 13:15:06.863027   375 catalog_manager.cc:5697] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 15 to 16, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 16 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:06.885160   632 raft_consensus.cc:2468] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 16.
I20260709 13:15:06.891080   378 catalog_manager.cc:5697] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 18 to 19, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 19 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:07.215057   554 raft_consensus.cc:1275] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:07.217072  6396 consensus_queue.cc:1048] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:07.250321 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:07.280086   627 raft_consensus.cc:1275] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:07.282843   481 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:15:07.284938  6395 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:07.288882  6396 consensus_queue.cc:1048] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:07.320114   627 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:15:07.330173  6374 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:15:07.439669   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 61815.6us
W20260709 13:15:07.511646   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 78498.5us
W20260709 13:15:07.585985   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 60717.6us
W20260709 13:15:07.755256   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 104219us
I20260709 13:15:08.611562 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:08.784772   554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df062554d8014455b179c819406964fb"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:15:08.815747   554 raft_consensus.cc:606] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:08.870579   481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:08.906014   481 raft_consensus.cc:606] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:15:08.908653   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 55962.6us
W20260709 13:15:08.908058   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 55116.8us
I20260709 13:15:08.918762 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:08.920619 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:08.922986  6394 raft_consensus.cc:993] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:08.923655  6394 raft_consensus.cc:1081] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
W20260709 13:15:08.964651   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 50945.6us
W20260709 13:15:08.997644   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 85068.8us
I20260709 13:15:09.001252   481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df062554d8014455b179c819406964fb"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38134
I20260709 13:15:09.001866   481 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.002233   481 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:09.020453   481 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:09.039197   481 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:09.039666   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:09.040280   554 raft_consensus.cc:3055] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:09.040552   554 raft_consensus.cc:740] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:09.041334   554 consensus_queue.cc:260] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:09.042443   554 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:09.051554   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:09.054167   627 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:09.073258   627 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:15:09.082334  6383 raft_consensus.cc:993] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:09.082954  6422 raft_consensus.cc:1081] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:09.089001   624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54256
I20260709 13:15:09.089588   624 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.089946   624 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:09.112284   554 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:15:09.115602   448 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:09.116559  6419 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:09.121271  6419 raft_consensus.cc:697] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:09.122402  6419 consensus_queue.cc:237] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:09.185276   624 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:09.192414   554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:09.192967   554 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:09.193717   624 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:09.200085   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:09.200628   481 raft_consensus.cc:3055] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:09.200907   481 raft_consensus.cc:740] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:09.202524   481 consensus_queue.cc:260] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:09.207051   481 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:09.212634   381 catalog_manager.cc:5697] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 14 to 15, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 15 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.218034   554 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 15.
I20260709 13:15:09.219502   597 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:09.220708  6421 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:09.221226  6421 raft_consensus.cc:697] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:09.222165  6421 consensus_queue.cc:237] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:09.278319   481 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 15.
I20260709 13:15:09.302153   378 catalog_manager.cc:5697] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 14 to 15, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 15 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:09.580229   632 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:09.587464  6440 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:09.652581   556 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:09.654230  6419 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:09.658080   478 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:09.664011  6439 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:09.743270   556 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:09.747303  6392 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:09.921675 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:11.289166  1196 debug-util.cc:398] Leaking SignalData structure 0x7b080037b4a0 after lost signal to thread 31817
W20260709 13:15:11.290349  1196 debug-util.cc:398] Leaking SignalData structure 0x7b08000d38a0 after lost signal to thread 415
W20260709 13:15:11.291774  1196 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7a40 after lost signal to thread 508
W20260709 13:15:11.292840  1196 debug-util.cc:398] Leaking SignalData structure 0x7b08002e71e0 after lost signal to thread 583
W20260709 13:15:11.293917  1196 debug-util.cc:398] Leaking SignalData structure 0x7b0800422120 after lost signal to thread 657
W20260709 13:15:11.295064  1196 debug-util.cc:398] Leaking SignalData structure 0x7b0800217460 after lost signal to thread 1199
I20260709 13:15:11.411971 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:11.651439   629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:15:11.652050   629 raft_consensus.cc:606] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:11.655975   482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:11.656533   482 raft_consensus.cc:606] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:11.657831 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:11.659580 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:15:11.957616  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 58600.6us
I20260709 13:15:12.065014  6438 raft_consensus.cc:993] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:12.065578  6424 raft_consensus.cc:1081] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:12.072525  6437 raft_consensus.cc:993] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:12.073050  6437 raft_consensus.cc:1081] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Signalling peer 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:12.074340   481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:15:12.079146   556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59114
I20260709 13:15:12.079794   556 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:12.080173   556 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:12.075011   481 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:12.089552   481 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:12.134250   481 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:12.156179   481 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:15:12.157321   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:12.157703  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:15:12.197425  1168 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:12.197338   629 raft_consensus.cc:3055] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:12.202782   629 raft_consensus.cc:740] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:12.203783   629 consensus_queue.cc:260] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:12.246553   629 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:12.259443  1168 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:15:12.198774   556 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:12.273375   448 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:15:12.302691   632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:12.304351   632 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:12.312527  6459 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:12.313207  6459 raft_consensus.cc:697] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:12.314211  6459 consensus_queue.cc:237] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:12.320215   556 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:12.322660   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:12.324707   482 raft_consensus.cc:3055] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:12.325038   482 raft_consensus.cc:740] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:12.325801   482 consensus_queue.cc:260] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:12.327003   482 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:12.319721   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 46424.5us
I20260709 13:15:12.370609   632 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
W20260709 13:15:12.425504   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 63308.7us
I20260709 13:15:12.434473   522 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:12.435453  6465 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:12.435947  6465 raft_consensus.cc:697] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:12.436798  6465 consensus_queue.cc:237] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:12.478495   482 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:15:12.491334   381 catalog_manager.cc:5697] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 13 to 14, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 14 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.517441   629 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:15:12.600472   378 catalog_manager.cc:5697] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 14 to 15, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 15 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.660938 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:12.933974   481 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:12.937633  1168 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:15:12.938477   632 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:12.939357  6455 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:15:12.939955  6432 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:15:12.943063   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 127794us
I20260709 13:15:12.948107  6428 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:12.951537   624 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 13:15:13.090991   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 72728us
W20260709 13:15:13.094249   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 60902.4us
W20260709 13:15:13.109172   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 56053.6us
I20260709 13:15:13.160401  6472 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
W20260709 13:15:13.258690   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 116298us
W20260709 13:15:13.365226   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 67921.3us
W20260709 13:15:13.537020   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 252077us
W20260709 13:15:14.146960   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 58669.9us
I20260709 13:15:14.223734 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:14.570802   475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:14.615985   475 raft_consensus.cc:606] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:15:14.678138   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 67706.1us
W20260709 13:15:14.765417  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 140491us
W20260709 13:15:14.780125   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 130599us
I20260709 13:15:14.790411   551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82382f158074497a857b03f9f87f9e86"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:15:14.791074   551 raft_consensus.cc:606] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:14.793115 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:14.795073 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:14.977690  6519 raft_consensus.cc:993] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:14.978312  6519 raft_consensus.cc:1081] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:14.992274   475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82382f158074497a857b03f9f87f9e86"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38134
I20260709 13:15:14.992959   475 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:14.993360   475 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:14.994036  6515 raft_consensus.cc:993] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:14.995070  6521 raft_consensus.cc:1081] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:15.002755   475 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:15.009126   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:15.009826   551 raft_consensus.cc:3055] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:15.010175   551 raft_consensus.cc:740] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:15.011137   551 consensus_queue.cc:260] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:15.012624   551 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:15.021498   551 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:15:15.029071   475 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:15:15.037581  1171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82382f158074497a857b03f9f87f9e86" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:15:15.045964  1171 raft_consensus.cc:3060] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:15.038362   632 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54256
I20260709 13:15:15.051301   632 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:15.051770   632 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:15.062775  1171 raft_consensus.cc:2468] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:15:15.065303   448 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:15.086174   632 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:15.099395  6516 raft_consensus.cc:2804] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:15.100466   632 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:15.101011  6516 raft_consensus.cc:697] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:15.101807   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:15.109344   553 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:15.109722  6516 consensus_queue.cc:237] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:15.102711   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:15.115576   475 raft_consensus.cc:3055] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:15.115904   475 raft_consensus.cc:740] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:15.116689   475 consensus_queue.cc:260] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:15.117761   475 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:15.124717   553 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 16.
I20260709 13:15:15.128181   597 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:15.126737   475 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 16.
I20260709 13:15:15.129257  6508 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:15.139585  6508 raft_consensus.cc:697] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:15.140548  6508 consensus_queue.cc:237] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:15.183706   378 catalog_manager.cc:5697] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 15 to 16, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 16 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:15.195545   381 catalog_manager.cc:5697] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 12 to 13, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 13 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:15.496047   556 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:15:15.498716  6480 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:15.574807  1168 raft_consensus.cc:1275] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:15:15.581780  6516 consensus_queue.cc:1048] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:15.644554   482 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:15.650446  6520 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:15.654569   553 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:15.803746 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:15.681529  6508 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
W20260709 13:15:15.878554   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 197635us
W20260709 13:15:15.926149   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 51158.7us
W20260709 13:15:15.980679   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 104820us
W20260709 13:15:16.029646   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 51418.6us
W20260709 13:15:16.071729   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 90267.1us
W20260709 13:15:16.162647   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 69579.7us
W20260709 13:15:16.172463  6563 log.cc:927] Time spent T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:15:16.251785   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 77613.2us
W20260709 13:15:16.388177   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 60592.7us
W20260709 13:15:16.518873   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 57084.1us
W20260709 13:15:16.552690  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 188655us
W20260709 13:15:16.623677  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 190320us
W20260709 13:15:16.625064  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 162062us
W20260709 13:15:16.661211   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 76383.6us
W20260709 13:15:16.787997  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 115659us
I20260709 13:15:17.572206 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:17.910442   480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:17.911059   480 raft_consensus.cc:606] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:17.914846   629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:15:17.915436   629 raft_consensus.cc:606] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:17.921649 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:17.923445 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:18.197501  6544 raft_consensus.cc:993] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:18.198056  6544 raft_consensus.cc:1081] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:18.200855   482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:15:18.201377   482 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:18.201694   482 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:18.211226   482 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:18.220934   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:18.221504   556 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:18.223033   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:18.223639   624 raft_consensus.cc:3055] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:18.223897   624 raft_consensus.cc:740] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:18.224619   624 consensus_queue.cc:260] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:18.225680   624 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:18.234151   482 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:18.238003   556 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 16.
I20260709 13:15:18.248915   448 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:18.250293  6543 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:18.251092  6543 raft_consensus.cc:697] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:18.251998  6543 consensus_queue.cc:237] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:18.264328  6542 raft_consensus.cc:993] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:18.264801  6542 raft_consensus.cc:1081] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Signalling peer 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:18.270555   551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59114
I20260709 13:15:18.271087   551 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:18.271425   551 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:18.280107   551 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:18.240320   624 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 16.
I20260709 13:15:18.289660   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:18.290230   482 raft_consensus.cc:3055] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:18.290544   482 raft_consensus.cc:740] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:18.291272   482 consensus_queue.cc:260] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:18.292681   482 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:18.300760   482 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:15:18.310016   551 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:15:18.312117  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:15:18.357159  1172 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:18.329770   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:18.358306   624 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:18.365409  1172 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:15:18.370814   523 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:15:18.372543  6586 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:18.373018  6586 raft_consensus.cc:697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:18.374095  6586 consensus_queue.cc:237] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:18.381330   375 catalog_manager.cc:5697] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 15 to 16, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 16 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.396853   624 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:15:18.425609   378 catalog_manager.cc:5697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 13 to 14, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 14 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.566305   550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45502
I20260709 13:15:18.566922   550 raft_consensus.cc:606] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Received request to transfer leadership
I20260709 13:15:18.594559   550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45502
I20260709 13:15:18.595341   550 raft_consensus.cc:606] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Received request to transfer leadership
W20260709 13:15:18.596611   366 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 227b93e1b31e4b058d5ec1fc69bd6849 already in progress [suppressed 2 similar messages]
I20260709 13:15:18.634027   550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45502
I20260709 13:15:18.634649   550 raft_consensus.cc:606] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Received request to transfer leadership
I20260709 13:15:18.645408   551 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:18.655089  6543 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:18.739706   624 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:18.745936  6588 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:15:18.813508   429 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:15:18.813973   429 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 227b93e1b31e4b058d5ec1fc69bd6849 already in progress
W20260709 13:15:18.814268   429 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 227b93e1b31e4b058d5ec1fc69bd6849 already in progress
I20260709 13:15:18.814972   480 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:18.817071  6586 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:15:18.891611   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 86210.5us
I20260709 13:15:18.897339   630 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:18.924712 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:18.930533  6510 raft_consensus.cc:993] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:18.933436  6586 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:15:18.937861  6557 raft_consensus.cc:1081] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:18.973501   480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38134
I20260709 13:15:18.974267   480 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:18.974691   480 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:18.986495  1172 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:18.992549  6557 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:18.996768   480 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:19.011044   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:19.011806   551 raft_consensus.cc:3055] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:19.012153   551 raft_consensus.cc:740] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:19.012013   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:19.013343   551 consensus_queue.cc:260] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:19.014684   551 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:19.016137  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:15:19.022406   448 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:15:19.023285   480 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:15:19.023686  6588 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:19.025053   551 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
W20260709 13:15:19.974599   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 60123.6us
W20260709 13:15:20.099979  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 75514.8us
I20260709 13:15:20.158401 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:20.164820   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 75471.3us
W20260709 13:15:20.196674  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 94903.9us
I20260709 13:15:20.466859  6627 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:15:20.467553  6627 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:20.471902   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:15:20.472749   478 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 15: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:15:20.476748  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:15:20.478410   597 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:15:20.479218  6620 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:20.481982   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:15:20.482715  6627 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:15:20.497017  6620 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:20.503589  6552 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:15:20.504292  6552 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:20.482784   555 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50f7c2247be24f3685d7fbca7b6c71e3 in current term 15: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:15:20.508842   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" is_pre_election: true
I20260709 13:15:20.509570   482 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 15: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:15:20.512027   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:15:20.513398   555 raft_consensus.cc:2393] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6df7e8ed204f1db5c371536b5b0683 in current term 15: Already voted for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in this term.
I20260709 13:15:20.513598  6552 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:20.513183   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:15:20.514623   631 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 15.
I20260709 13:15:20.516260  1139 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:20.517462  6552 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:20.538830  6552 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:20.660285   482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:20.660890   482 raft_consensus.cc:606] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:15:20.663918   555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:15:20.664598   555 raft_consensus.cc:606] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 21 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:20.665834 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:20.667928 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:15:20.677428   505 debug-util.cc:398] Leaking SignalData structure 0x7b0800280fc0 after lost signal to thread 31817
W20260709 13:15:20.678592   505 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9e80 after lost signal to thread 415
W20260709 13:15:20.679939   505 debug-util.cc:398] Leaking SignalData structure 0x7b08001332c0 after lost signal to thread 508
W20260709 13:15:20.681161   505 debug-util.cc:398] Leaking SignalData structure 0x7b080036cfa0 after lost signal to thread 583
W20260709 13:15:20.682336   505 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8c60 after lost signal to thread 657
W20260709 13:15:20.683672   505 debug-util.cc:398] Leaking SignalData structure 0x7b0800397d20 after lost signal to thread 1199
I20260709 13:15:20.775033  6603 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.775728  6603 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:20.782857   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:15:20.783476   555 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:15:20.787683   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:15:20.788323   630 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:15:20.790534   447 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:20.791476  6614 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:20.791872  6614 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.792225  6614 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:20.796236  6603 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:15:20.798018  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:15:20.802104  1168 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:15:20.810750  6614 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:20.839188   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:20.839910   630 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:20.852371  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:15:20.853022  1168 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:20.855952   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:20.856784   551 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:20.860301  1168 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 16.
I20260709 13:15:20.861583  6614 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:15:20.910540   551 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 16.
I20260709 13:15:20.915081   448 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:15:20.916042  6614 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:20.916517  6614 raft_consensus.cc:697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:20.917394  6614 consensus_queue.cc:237] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:20.911729   630 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 16.
I20260709 13:15:20.955552   378 catalog_manager.cc:5697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 14 to 16, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 16 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.042948  6618 raft_consensus.cc:993] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:21.045218  6618 raft_consensus.cc:1081] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:21.079332   631 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54256
I20260709 13:15:21.080027   631 raft_consensus.cc:493] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:21.080412   631 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:21.091514   631 raft_consensus.cc:515] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:21.100641   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:21.101380   482 raft_consensus.cc:3055] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:21.101708   482 raft_consensus.cc:740] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:21.101873   631 leader_election.cc:290] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:15:21.102029   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 104754us
I20260709 13:15:21.102476   482 consensus_queue.cc:260] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:21.102967   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:21.104015   555 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:21.112481   482 raft_consensus.cc:3060] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:21.115615  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 48289.9us
I20260709 13:15:21.121093   482 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 15.
I20260709 13:15:21.122694   599 leader_election.cc:304] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:15:21.141373  6627 raft_consensus.cc:2804] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:21.147037  6627 raft_consensus.cc:697] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:21.163828  6627 consensus_queue.cc:237] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:15:21.179545   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 49515.4us
W20260709 13:15:21.177816  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 56774.4us
W20260709 13:15:21.185879   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 63326.6us
W20260709 13:15:21.187716  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 64225.6us
I20260709 13:15:21.195919   555 raft_consensus.cc:2468] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 15.
I20260709 13:15:21.191185  6650 raft_consensus.cc:993] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:21.243311  6650 raft_consensus.cc:1081] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 21 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
W20260709 13:15:21.252195   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 51919us
I20260709 13:15:21.279790   482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38134
I20260709 13:15:21.280495   482 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:21.280942   482 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:21.289186   482 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:21.294014   482 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 22 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:21.295549   555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:21.307053   555 raft_consensus.cc:3055] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:15:21.307546   555 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:21.308315   555 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:21.309450   555 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:21.318941   555 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 22.
W20260709 13:15:21.323078   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 202377us
I20260709 13:15:21.325577   448 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:21.326416  6614 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:15:21.326890  6614 raft_consensus.cc:697] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 22 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:21.327760  6614 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:21.339277   378 catalog_manager.cc:5697] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 14 to 15, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 15 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:21.365460   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:21.366122   627 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:21.374020   630 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:21.381649   627 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 22.
I20260709 13:15:21.382288  6618 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:21.389194   375 catalog_manager.cc:5697] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 21 to 22, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 22 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.426457   553 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:21.429924  6618 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:21.516351  1168 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:21.519294  6603 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:15:21.588698   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 81582.1us
I20260709 13:15:21.670670 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:21.748457   627 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 22 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:15:21.751708  6614 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:21.787317   553 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 22 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:15:21.790671  6603 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:21.795699   553 raft_consensus.cc:1275] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:21.801249  6620 consensus_queue.cc:1048] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:21.832827   478 raft_consensus.cc:1275] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:21.841326  6627 consensus_queue.cc:1048] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:15:21.988547   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 70471.6us
W20260709 13:15:22.044890   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 112171us
W20260709 13:15:22.788525   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 45270.2us
I20260709 13:15:22.862473 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:22.869215   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 64266.9us
W20260709 13:15:22.869612  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 56107.6us
W20260709 13:15:23.021826   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 137463us
W20260709 13:15:23.045529  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 231459us
I20260709 13:15:23.532668   478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "304d1b96642140f19543be15d23a061c"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:23.534107   478 raft_consensus.cc:606] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:15:23.538538   627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:15:23.539352   627 raft_consensus.cc:606] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:23.544961   478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df062554d8014455b179c819406964fb"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:23.545574   478 raft_consensus.cc:606] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:23.548609   478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:23.549206   478 raft_consensus.cc:606] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:23.551093 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:15:23.634805 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:23.696802  6618 raft_consensus.cc:993] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:23.697373  6618 raft_consensus.cc:1081] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 LEADER]: Signalling peer 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:23.702343   551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59114
I20260709 13:15:23.702982   551 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:23.703490   551 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:23.747200  6671 raft_consensus.cc:993] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:23.747838  6671 raft_consensus.cc:1081] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:23.747961   551 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:23.750257   628 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "304d1b96642140f19543be15d23a061c"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54256
I20260709 13:15:23.750819   628 raft_consensus.cc:493] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:23.751226   628 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:23.752303   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:23.753083   478 raft_consensus.cc:3055] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:23.753434   478 raft_consensus.cc:740] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:23.754400   478 consensus_queue.cc:260] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:23.755748   478 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:23.760659   628 raft_consensus.cc:515] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:23.764567   478 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 18.
I20260709 13:15:23.776952   525 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:23.778023  6650 raft_consensus.cc:2804] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:23.778515  6650 raft_consensus.cc:697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:23.779667  6650 consensus_queue.cc:237] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:23.784214  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:15:23.784452   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304d1b96642140f19543be15d23a061c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:23.784904  1172 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:23.785101   482 raft_consensus.cc:3055] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:23.785493   482 raft_consensus.cc:740] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:23.786406   482 consensus_queue.cc:260] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:23.790171   482 raft_consensus.cc:3060] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:23.792174   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd90dfa0b4483dae082de5ca5e77f0" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:23.792812   627 raft_consensus.cc:3060] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:23.798568  1172 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 16.
I20260709 13:15:23.804994   597 leader_election.cc:304] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:15:23.806210  6677 raft_consensus.cc:2804] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:23.806694  6677 raft_consensus.cc:697] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:23.800947   627 raft_consensus.cc:2468] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 18.
I20260709 13:15:23.807744  6677 consensus_queue.cc:237] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:23.801213   482 raft_consensus.cc:2468] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 16.
I20260709 13:15:23.801366   551 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 18 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:23.803279   628 leader_election.cc:290] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:15:23.933100   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 98874us
I20260709 13:15:23.967125  6670 raft_consensus.cc:993] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:23.967746  6670 raft_consensus.cc:1081] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:23.973188   478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:15:23.973716   478 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:23.974056   478 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:23.984172   378 catalog_manager.cc:5697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 17 to 18, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 18 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.987540   478 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:23.982412   381 catalog_manager.cc:5697] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 15 to 16, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 16 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.989773   478 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:15:23.990931  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:15:23.991636  1172 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:23.999671   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:24.000325   627 raft_consensus.cc:3055] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:24.000618   627 raft_consensus.cc:740] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:24.001386   627 consensus_queue.cc:260] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:24.002674   627 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:24.033480   627 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:15:24.039002   447 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:15:24.048044  6618 raft_consensus.cc:993] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:24.048539  6618 raft_consensus.cc:1081] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Signalling peer 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:24.056905  6614 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:24.057214  1172 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 13.
I20260709 13:15:24.057432  6614 raft_consensus.cc:697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:24.058669  6614 consensus_queue.cc:237] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:24.073386   550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df062554d8014455b179c819406964fb"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59114
I20260709 13:15:24.074165   550 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:24.074579   550 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:24.109237   550 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:24.153153   550 leader_election.cc:290] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:24.155705   478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:24.170163   478 raft_consensus.cc:3055] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:24.170586   478 raft_consensus.cc:740] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:24.171518   478 consensus_queue.cc:260] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:24.154294   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:24.172969   630 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:24.177814   478 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:24.193691   478 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 16.
I20260709 13:15:24.194746   482 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:24.196336   525 leader_election.cc:304] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:24.197187  6650 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:24.197639  6650 raft_consensus.cc:697] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:24.198576  6650 consensus_queue.cc:237] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:24.198850  6685 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:24.193593  1172 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:15:24.206540  6679 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:15:24.221405   630 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 16.
I20260709 13:15:24.239693   375 catalog_manager.cc:5697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 12 to 13, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 13 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:24.281842   478 raft_consensus.cc:1275] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:15:24.311993  6679 consensus_queue.cc:1048] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
W20260709 13:15:24.371490  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 64988.1us
I20260709 13:15:24.372385   627 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:24.373950   378 catalog_manager.cc:5697] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 15 to 16, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 16 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:24.384388  6685 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:15:24.407322  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 103651us
W20260709 13:15:24.485881  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 54493.5us
I20260709 13:15:24.606969  1171 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:15:24.609236  6614 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:24.636336 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:24.644691   625 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:24.650643  6650 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:24.664906   630 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:15:24.666656  6671 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:24.709395   482 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:24.712251  6704 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:25.917600 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:26.146224   551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:15:26.146858   551 raft_consensus.cc:606] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:15:26.150158   630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:15:26.150763   630 raft_consensus.cc:606] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:26.153949 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:26.155786 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:26.298579  6670 raft_consensus.cc:993] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:26.299362  6670 raft_consensus.cc:1081] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Signalling peer 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:26.301227   551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59128
I20260709 13:15:26.301788   551 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:26.302121   551 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:26.309401   551 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:26.345157   625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:26.346069   625 raft_consensus.cc:3055] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:26.346383   625 raft_consensus.cc:740] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:26.347172   625 consensus_queue.cc:260] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:26.373726   625 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:26.393563   551 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:15:26.410804   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 71635.8us
I20260709 13:15:26.476619  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:15:26.477269  1172 raft_consensus.cc:3060] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:26.486976  1172 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 16.
I20260709 13:15:26.508735   523 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:15:26.516175  6720 raft_consensus.cc:2804] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:26.519428  6720 raft_consensus.cc:697] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:26.520533  6720 consensus_queue.cc:237] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:26.537405   625 raft_consensus.cc:2468] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 16.
W20260709 13:15:26.543757   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 194366us
I20260709 13:15:26.575541   380 catalog_manager.cc:5697] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 15 to 16, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 16 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.646572  6725 raft_consensus.cc:993] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:26.647146  6725 raft_consensus.cc:1081] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:26.657963   630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:15:26.658710   630 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:26.659027   630 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:26.676085   630 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:26.678200   630 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:26.679556   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:26.680146   550 raft_consensus.cc:3055] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:26.680426   550 raft_consensus.cc:740] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:26.681147   550 consensus_queue.cc:260] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:26.682574   550 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:26.691295   550 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:15:26.692656   597 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:26.694437  6727 raft_consensus.cc:2804] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:26.694989  6727 raft_consensus.cc:697] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:26.695891  6727 consensus_queue.cc:237] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:26.699693   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:26.700321   482 raft_consensus.cc:3060] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:26.837908   482 raft_consensus.cc:2468] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:15:26.858321   380 catalog_manager.cc:5697] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 13 to 14, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 14 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:26.873123   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 67525.8us
I20260709 13:15:27.118618   627 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:15:27.121268  6720 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:27.138381  1172 raft_consensus.cc:1275] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:15:27.146082  6720 consensus_queue.cc:1048] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:27.164654 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:27.228868   482 raft_consensus.cc:1275] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:27.234220  6718 consensus_queue.cc:1048] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:27.261042   550 raft_consensus.cc:1275] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:27.262677  6723 consensus_queue.cc:1048] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:28.476706 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:28.627272   627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:15:28.627856   627 raft_consensus.cc:606] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:28.639442   550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df062554d8014455b179c819406964fb"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:15:28.640054   550 raft_consensus.cc:606] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:15:28.643747 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:28.645936 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:28.733562   475 consensus_queue.cc:237] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:28.753607  1171 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:28.755178  6692 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:28.764990   627 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:28.771690  6752 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:28.786482  6692 raft_consensus.cc:2955] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 3 to 12, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:28.801860  1171 raft_consensus.cc:2955] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 3 to 12, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:28.809137   625 raft_consensus.cc:2955] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 3 to 12, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:28.849512   368 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 227b93e1b31e4b058d5ec1fc69bd6849 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
I20260709 13:15:28.858096  6723 raft_consensus.cc:993] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:28.858647  6723 raft_consensus.cc:1081] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:28.877888   378 catalog_manager.cc:5697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 3 to 12, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New cstate: current_term: 16 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:28.908807  6738 raft_consensus.cc:993] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:28.909397  6738 raft_consensus.cc:1081] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:28.911425   627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df062554d8014455b179c819406964fb"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:15:28.911958   627 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:28.912272   627 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:15:28.924036   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 68610.6us
I20260709 13:15:28.924773   627 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:28.926046   482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:15:28.926635   482 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:28.926762   627 leader_election.cc:290] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:28.927022   482 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:28.932119   550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:28.932699   550 raft_consensus.cc:3055] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:28.932997   550 raft_consensus.cc:740] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:28.933663   550 consensus_queue.cc:260] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:28.936479   482 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:28.938592   482 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:28.945286   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:28.945952   475 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:28.955745   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:28.956420   551 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:28.962003   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36746135a640a4916e9d4d974ce2b3" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:28.962636   624 raft_consensus.cc:3055] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:28.962918   624 raft_consensus.cc:740] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:28.963717   624 consensus_queue.cc:260] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:28.965099   624 raft_consensus.cc:3060] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:28.986418   550 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:29.003268   624 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 17.
I20260709 13:15:29.004988   447 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:15:29.006013  6752 raft_consensus.cc:2804] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:29.006565  6752 raft_consensus.cc:697] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:29.007501  6752 consensus_queue.cc:237] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:29.085100   475 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 17.
I20260709 13:15:29.085889   482 raft_consensus.cc:1240] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Rejecting Update request from peer 6ba2a9c02b534120bbf26e56a1e920ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:29.088966   599 leader_election.cc:304] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:15:29.090631   551 raft_consensus.cc:2468] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 17.
I20260709 13:15:29.095822   550 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 17.
I20260709 13:15:29.092177  6758 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:29.112059  6758 raft_consensus.cc:697] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:29.113830  6758 consensus_queue.cc:237] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:29.278595   375 catalog_manager.cc:5697] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 16 to 17, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 17 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.317514   545 tablet_service.cc:1558] Processing DeleteTablet for tablet 227b93e1b31e4b058d5ec1fc69bd6849 with delete_type TABLET_DATA_TOMBSTONED (TS 6ba2a9c02b534120bbf26e56a1e920ca not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:45502
I20260709 13:15:29.360121  6775 tablet_replica.cc:333] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
W20260709 13:15:29.563571  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 126822us
W20260709 13:15:29.607952  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 227445us
W20260709 13:15:29.612430   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 233867us
I20260709 13:15:29.623919   375 catalog_manager.cc:5697] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 16 to 17, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 17 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:29.607524   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 79124.8us
I20260709 13:15:29.647032 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:29.674332   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 109640us
I20260709 13:15:29.676939  6775 raft_consensus.cc:2243] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:29.678056  6775 raft_consensus.cc:2272] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:29.686807   553 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:29.695863  6775 ts_tablet_manager.cc:1916] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:29.726454   550 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:29.731916  6780 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:29.740375   627 raft_consensus.cc:1275] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:15:29.759951   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 93824.4us
I20260709 13:15:29.776214  6768 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:29.782780  6692 consensus_queue.cc:1048] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:29.788265   480 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:29.815093  6727 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:29.841280  6775 ts_tablet_manager.cc:1929] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 13:15:29.844487  6775 log.cc:1199] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-1-root/wals/227b93e1b31e4b058d5ec1fc69bd6849
I20260709 13:15:29.851136   366 catalog_manager.cc:5028] TS 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): tablet 227b93e1b31e4b058d5ec1fc69bd6849 (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:15:31.151085 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:31.641675   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 100716us
W20260709 13:15:31.658340  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 110586us
W20260709 13:15:31.682627   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 118728us
I20260709 13:15:31.694389   482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fc289132926446d9594150727e08b0b"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:31.695072   482 raft_consensus.cc:606] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:31.716365   631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:15:31.717114   631 raft_consensus.cc:606] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:31.718479 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:31.720227 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:15:31.721130  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 61683.3us
I20260709 13:15:31.721431  6768 raft_consensus.cc:993] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:31.723186  6768 raft_consensus.cc:1081] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Signalling peer 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:31.738163   558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fc289132926446d9594150727e08b0b"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59114
I20260709 13:15:31.738749   558 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:31.739089   558 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:31.741636  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 64011.4us
I20260709 13:15:31.746730   558 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:31.755474   558 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:31.756321   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:31.756910   630 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:31.763885   630 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 16.
I20260709 13:15:31.765334   522 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:31.766198  6769 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:31.766744  6769 raft_consensus.cc:697] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:31.767644  6769 consensus_queue.cc:237] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:31.772233   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:31.772977   480 raft_consensus.cc:3055] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:31.773339   480 raft_consensus.cc:740] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:31.774183   480 consensus_queue.cc:260] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:31.776695   480 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:31.787000   631 raft_consensus.cc:1240] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:31.796258   480 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 16.
I20260709 13:15:31.826120   378 catalog_manager.cc:5697] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 15 to 16, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 16 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:31.940543  6814 raft_consensus.cc:993] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:31.941179  6814 raft_consensus.cc:1081] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:31.943122   484 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:15:31.943670   484 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:31.943984   484 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:31.954696   484 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:31.958434   484 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 19 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:31.958597   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:31.959221   630 raft_consensus.cc:3055] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:31.959545   630 raft_consensus.cc:740] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:31.959764   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:31.960321   551 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:31.960315   630 consensus_queue.cc:260] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:31.962641   630 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:31.967183   551 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 19.
I20260709 13:15:31.968508   448 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:31.969262  6805 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:31.969738  6805 raft_consensus.cc:697] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:31.970633  6805 consensus_queue.cc:237] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:31.983754   630 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 19.
I20260709 13:15:32.004009   378 catalog_manager.cc:5697] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 18 to 19, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 19 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:32.202834   631 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:15:32.204355  6806 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:32.218838   480 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:15:32.220391  6769 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:15:32.237756   580 debug-util.cc:398] Leaking SignalData structure 0x7b08003da4c0 after lost signal to thread 31817
W20260709 13:15:32.239044   580 debug-util.cc:398] Leaking SignalData structure 0x7b08003caf80 after lost signal to thread 415
W20260709 13:15:32.240363   580 debug-util.cc:398] Leaking SignalData structure 0x7b0800170c60 after lost signal to thread 508
W20260709 13:15:32.241449   580 debug-util.cc:398] Leaking SignalData structure 0x7b080003ed20 after lost signal to thread 583
W20260709 13:15:32.242524   580 debug-util.cc:398] Leaking SignalData structure 0x7b0800230e40 after lost signal to thread 657
W20260709 13:15:32.243848   580 debug-util.cc:398] Leaking SignalData structure 0x7b0800424e60 after lost signal to thread 1199
I20260709 13:15:32.412237   558 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:15:32.420158  6768 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:32.445477   631 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:15:32.448678  6812 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:32.721271 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:33.947944 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:34.134598   484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:34.135617   484 raft_consensus.cc:606] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:15:34.172827   551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:15:34.173511   551 raft_consensus.cc:606] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:15:34.176054 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:34.177744 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:34.320636  6838 raft_consensus.cc:993] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:34.323509  6838 raft_consensus.cc:1081] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:34.391592   630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54256
I20260709 13:15:34.392297   630 raft_consensus.cc:493] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:34.392747   630 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:34.434259   630 raft_consensus.cc:515] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:34.441087   630 leader_election.cc:290] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:15:34.455869  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:15:34.456609  1168 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:34.472369   480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5153b5ac109e49b78fd24ec7f42e3c8e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:34.483971   480 raft_consensus.cc:3055] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:34.486093   480 raft_consensus.cc:740] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:34.490584   480 consensus_queue.cc:260] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:34.552127  6769 raft_consensus.cc:993] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:34.552613  6769 raft_consensus.cc:1081] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:34.555461   630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:15:34.556020   630 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:34.556401   630 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:34.564014   630 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:34.496656   480 raft_consensus.cc:3060] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:34.477414  1168 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:15:34.586143   630 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:15:34.592013   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:34.592602   551 raft_consensus.cc:3055] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:34.592883   551 raft_consensus.cc:740] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:34.593664   551 consensus_queue.cc:260] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:34.595075   551 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:34.601927   597 leader_election.cc:304] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:15:34.602046   480 raft_consensus.cc:2468] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:15:34.614638  6843 raft_consensus.cc:2804] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:34.615188  6843 raft_consensus.cc:697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:34.616204  6843 consensus_queue.cc:237] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:34.603560  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:15:34.628691  1168 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:34.632503   551 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 17.
I20260709 13:15:34.642462   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:34.643386  6843 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:34.644392  6843 raft_consensus.cc:697] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:34.647692  6843 consensus_queue.cc:237] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:34.654019  1168 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 17.
I20260709 13:15:34.643810   378 catalog_manager.cc:5697] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 13 to 14, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 14 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.749428   378 catalog_manager.cc:5697] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 16 to 17, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 17 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:35.119179  1171 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:35.139027  6814 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:35.174598   553 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:35.180656  6840 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:35.191798 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:35.205821  1166 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:15:35.208415   480 raft_consensus.cc:1275] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:15:35.216049  6840 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:35.329224  6872 consensus_queue.cc:1048] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:15:35.853302   412 debug-util.cc:398] Leaking SignalData structure 0x7b0800149fe0 after lost signal to thread 31817
W20260709 13:15:35.854462   412 debug-util.cc:398] Leaking SignalData structure 0x7b080013c0a0 after lost signal to thread 415
W20260709 13:15:35.855697   412 debug-util.cc:398] Leaking SignalData structure 0x7b080040a520 after lost signal to thread 508
W20260709 13:15:35.856820   412 debug-util.cc:398] Leaking SignalData structure 0x7b080039cd00 after lost signal to thread 583
W20260709 13:15:35.857892   412 debug-util.cc:398] Leaking SignalData structure 0x7b080034c7e0 after lost signal to thread 657
W20260709 13:15:35.860575   412 debug-util.cc:398] Leaking SignalData structure 0x7b08000b6120 after lost signal to thread 1199
W20260709 13:15:35.986152   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 72222.1us
W20260709 13:15:36.226006   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 234394us
I20260709 13:15:36.304818  6860 raft_consensus.cc:493] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 50f7c2247be24f3685d7fbca7b6c71e3)
I20260709 13:15:36.305531  6860 raft_consensus.cc:515] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:36.309314  6860 leader_election.cc:290] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:36.310072   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:15:36.334547   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596735598d7c4404a9c62f5a3a6c475c" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" is_pre_election: true
I20260709 13:15:36.374467   448 leader_election.cc:304] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:36.378549  6856 raft_consensus.cc:2749] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:36.423520 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:36.515480   624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:15:36.516094   624 raft_consensus.cc:606] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:36.519390   482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:36.519959   482 raft_consensus.cc:606] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 22 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:36.522827   624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df062554d8014455b179c819406964fb"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:15:36.523470   624 raft_consensus.cc:606] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:36.524806 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:36.526469 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:36.631744  6880 raft_consensus.cc:993] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:36.632301  6880 raft_consensus.cc:1081] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:36.633991   482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df062554d8014455b179c819406964fb"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:15:36.634574   482 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:36.634969   482 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:36.650776   482 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:36.653475   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:36.654004   551 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:36.661487   551 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 18.
I20260709 13:15:36.662916   448 leader_election.cc:304] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:36.663847  6812 raft_consensus.cc:2804] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:36.664463  6812 raft_consensus.cc:697] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:36.665361  6812 consensus_queue.cc:237] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:36.666322   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df062554d8014455b179c819406964fb" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:36.666922   624 raft_consensus.cc:3055] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:36.667203   624 raft_consensus.cc:740] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:36.668134   624 consensus_queue.cc:260] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:36.669143   624 raft_consensus.cc:3060] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:36.712689  6862 raft_consensus.cc:993] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:36.713426  6888 raft_consensus.cc:1081] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:36.809665   481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:15:36.810258   481 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:36.810642   481 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:36.880348   654 debug-util.cc:398] Leaking SignalData structure 0x7b08003d9f00 after lost signal to thread 31817
W20260709 13:15:36.881546   654 debug-util.cc:398] Leaking SignalData structure 0x7b0800195b00 after lost signal to thread 415
W20260709 13:15:36.882905   654 debug-util.cc:398] Leaking SignalData structure 0x7b08001c98e0 after lost signal to thread 508
W20260709 13:15:36.884099   654 debug-util.cc:398] Leaking SignalData structure 0x7b08002b9d00 after lost signal to thread 583
W20260709 13:15:36.885262   654 debug-util.cc:398] Leaking SignalData structure 0x7b08004161e0 after lost signal to thread 657
W20260709 13:15:36.886468   654 debug-util.cc:398] Leaking SignalData structure 0x7b0800138260 after lost signal to thread 1199
I20260709 13:15:36.932945   481 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:37.041422   481 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:15:36.974342   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 56877.8us
I20260709 13:15:36.980796   624 raft_consensus.cc:2468] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 18.
I20260709 13:15:37.008867   482 leader_election.cc:290] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 18 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:15:37.026623   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 43930.4us
I20260709 13:15:36.961984  6874 raft_consensus.cc:993] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:37.056747  6874 raft_consensus.cc:1081] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 22 LEADER]: Signalling peer 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:37.070878   556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59114
I20260709 13:15:37.071593   556 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:37.071995   556 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:37.092303   551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:37.093021   551 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:37.145088   380 catalog_manager.cc:5697] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 17 to 18, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 18 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:37.244868   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 74467.8us
I20260709 13:15:37.329628   556 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:15:37.352867   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 64010.4us
I20260709 13:15:37.365540   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:37.418891   630 raft_consensus.cc:3055] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:37.419377   630 raft_consensus.cc:740] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:37.420693   630 consensus_queue.cc:260] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:37.422302   630 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:37.463642   556 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 23 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:37.469939   631 raft_consensus.cc:1275] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:15:37.481493   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 141236us
I20260709 13:15:37.523011   551 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 16.
I20260709 13:15:37.527460 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:37.572124   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:37.573448   482 raft_consensus.cc:3055] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:15:37.573829   482 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:37.574620   482 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:37.575594   482 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:15:37.580487   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 97914.8us
W20260709 13:15:37.593132   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 294915us
I20260709 13:15:37.626871   556 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 23 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 22. Current term is 23. Ops: []
I20260709 13:15:37.630482   482 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 23.
I20260709 13:15:37.649358   448 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:37.660894  6838 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:15:37.715304   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 93432.9us
I20260709 13:15:37.717877   624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6316a42e235d497f96a57da84ac62c84" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:37.719123   630 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 16.
I20260709 13:15:37.719154   624 raft_consensus.cc:3060] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:37.730906   525 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:37.732506  6769 raft_consensus.cc:2804] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:15:37.737771   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 63625.1us
I20260709 13:15:37.750255   624 raft_consensus.cc:2468] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 23.
I20260709 13:15:37.751032   630 raft_consensus.cc:1240] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 23 FOLLOWER]: Rejecting Update request from peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 for earlier term 22. Current term is 23. Ops: []
I20260709 13:15:37.728847  6838 raft_consensus.cc:697] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:37.769354  6900 consensus_queue.cc:1048] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:37.780812  6838 consensus_queue.cc:237] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:15:37.791785   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 53438.8us
W20260709 13:15:37.804939   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 60190.4us
W20260709 13:15:37.807477  1139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 65547.5us
I20260709 13:15:37.807987  6769 raft_consensus.cc:697] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 23 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
W20260709 13:15:37.808621   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 57123.8us
I20260709 13:15:37.822523  6769 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:15:37.824213  1138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 94997.5us
I20260709 13:15:37.829846   380 catalog_manager.cc:5697] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 15 to 16, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 16 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:37.911491   380 catalog_manager.cc:5697] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 22 to 23, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 23 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:38.208470   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 53782.1us
I20260709 13:15:38.262359   630 raft_consensus.cc:1275] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:38.265671  6901 consensus_queue.cc:1048] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:38.301951   553 raft_consensus.cc:1275] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:38.303767  6838 consensus_queue.cc:1048] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:38.370165   475 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 23 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:15:38.371508  6905 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:38.374564   630 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 23 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:15:38.377301  6908 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:38.724557 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:38.804895   558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:15:38.805509   558 raft_consensus.cc:606] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:38.813550   481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:38.814198   481 raft_consensus.cc:606] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:15:38.816427 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:38.818439 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:38.857172  6838 raft_consensus.cc:993] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:38.857784  6901 raft_consensus.cc:1081] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:38.859565   624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54256
I20260709 13:15:38.860085   624 raft_consensus.cc:493] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:38.860458   624 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:38.868223   624 raft_consensus.cc:515] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:38.871960   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:38.872177   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed6b89407f0e4ba28f232c121543a24e" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:38.872660   481 raft_consensus.cc:3055] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:38.872784   553 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:38.873044   481 raft_consensus.cc:740] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:38.874017   481 consensus_queue.cc:260] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:38.884330   553 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 20.
I20260709 13:15:38.885629   597 leader_election.cc:304] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:38.886448  6904 raft_consensus.cc:2804] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:38.886942  6904 raft_consensus.cc:697] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 20 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:38.887873  6904 consensus_queue.cc:237] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:38.892828   624 leader_election.cc:290] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 20 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:38.875223   481 raft_consensus.cc:3060] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:38.901969  6769 raft_consensus.cc:993] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:38.902565  6905 raft_consensus.cc:1081] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:38.904498   477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38134
I20260709 13:15:38.905071   477 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:38.905398   477 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:38.920902   380 catalog_manager.cc:5697] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 19 to 20, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 20 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:39.045828   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 115245us
I20260709 13:15:39.049203   481 raft_consensus.cc:2468] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 20.
I20260709 13:15:39.063735   477 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:39.065865   477 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:39.067775   630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:39.068338   630 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:39.080247   553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:39.080873   553 raft_consensus.cc:3055] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:39.081157   553 raft_consensus.cc:740] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:39.081902   553 consensus_queue.cc:260] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:39.083190   553 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:39.490283   553 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:15:39.538892   630 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 15.
I20260709 13:15:39.546377   447 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:15:39.547266  6939 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:39.547758  6939 raft_consensus.cc:697] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:39.548614  6939 consensus_queue.cc:237] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:15:39.633832   597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.013s	sys 0.019s
W20260709 13:15:39.634199   597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.013s	sys 0.020s
W20260709 13:15:39.635749   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 568329us
W20260709 13:15:39.681048  1141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.001s	sys 0.009s
W20260709 13:15:39.681481  1141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.001s	sys 0.010s
W20260709 13:15:39.681735  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 590280us
W20260709 13:15:39.724721   596 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.002s	sys 0.011s
W20260709 13:15:39.725126   596 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.003s	sys 0.012s
W20260709 13:15:39.738360   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 108618us
I20260709 13:15:39.743052   481 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 20 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:15:39.762146  6949 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:15:39.768759   378 catalog_manager.cc:5697] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 14 to 15, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 15 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:39.802637   559 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 20 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:15:39.818734  6950 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:15:39.933060 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:40.004686   631 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:40.005995  6901 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:40.019546   559 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:40.021988  6923 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:15:40.254590 31819 debug-util.cc:398] Leaking SignalData structure 0x7b08000b4640 after lost signal to thread 597
W20260709 13:15:40.444289   505 debug-util.cc:398] Leaking SignalData structure 0x7b080034ff20 after lost signal to thread 31817
W20260709 13:15:40.445410   505 debug-util.cc:398] Leaking SignalData structure 0x7b080037ad00 after lost signal to thread 415
W20260709 13:15:40.446632   505 debug-util.cc:398] Leaking SignalData structure 0x7b080027f120 after lost signal to thread 508
W20260709 13:15:40.447671   505 debug-util.cc:398] Leaking SignalData structure 0x7b08003201c0 after lost signal to thread 583
W20260709 13:15:40.448593   505 debug-util.cc:398] Leaking SignalData structure 0x7b080032bda0 after lost signal to thread 657
W20260709 13:15:40.449597   505 debug-util.cc:398] Leaking SignalData structure 0x7b080034a3e0 after lost signal to thread 1199
I20260709 13:15:40.987035 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:41.053009   475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:41.053656   475 raft_consensus.cc:606] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:41.059298   631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:15:41.059969   631 raft_consensus.cc:606] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:41.070494 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:41.072296 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:41.077978  6923 raft_consensus.cc:993] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:41.079681  6923 raft_consensus.cc:1081] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Signalling peer 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:41.088387   556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59114
I20260709 13:15:41.088967   556 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:41.089311   556 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:41.101735   556 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:41.108319   556 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:41.108633   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:41.109342   627 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:41.126960   481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5436dcd825914fdca953dd01eb60ec88" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:41.127703   481 raft_consensus.cc:3055] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:41.128013   481 raft_consensus.cc:740] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:41.128756   481 consensus_queue.cc:260] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:41.130097   481 raft_consensus.cc:3060] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:41.132117   627 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 16.
I20260709 13:15:41.134690   522 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:41.135713  6942 raft_consensus.cc:2804] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:41.136263  6942 raft_consensus.cc:697] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:41.137121  6942 consensus_queue.cc:237] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:41.160188   481 raft_consensus.cc:2468] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 16.
I20260709 13:15:41.169260   380 catalog_manager.cc:5697] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 15 to 16, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 16 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.297247  1172 consensus_queue.cc:237] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:41.321017   627 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:41.323102  6964 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:41.329245   556 raft_consensus.cc:1275] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:41.331693  6935 consensus_queue.cc:1048] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:41.345840  6963 raft_consensus.cc:2955] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 3 to 9, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:41.350508   556 raft_consensus.cc:2955] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 3 to 9, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:41.359293   627 raft_consensus.cc:2955] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 3 to 9, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:41.369206   366 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4e472c1c82c9467a9a5563d6b06e3b53 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
I20260709 13:15:41.377038   380 catalog_manager.cc:5697] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 3 to 9, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New cstate: current_term: 9 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.393283   467 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e472c1c82c9467a9a5563d6b06e3b53 with delete_type TABLET_DATA_TOMBSTONED (TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:59316
I20260709 13:15:41.400310  6975 tablet_replica.cc:333] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:41.401512  6975 raft_consensus.cc:2243] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:41.402550  6975 raft_consensus.cc:2272] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:41.423508  6975 ts_tablet_manager.cc:1916] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:41.440601  6975 ts_tablet_manager.cc:1929] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 13:15:41.441059  6975 log.cc:1199] T 4e472c1c82c9467a9a5563d6b06e3b53 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-0-root/wals/4e472c1c82c9467a9a5563d6b06e3b53
I20260709 13:15:41.443122   368 catalog_manager.cc:5028] TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): tablet 4e472c1c82c9467a9a5563d6b06e3b53 (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:15:41.544111   627 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:41.545769  6965 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:41.570402   481 raft_consensus.cc:1275] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:41.573472  6940 consensus_queue.cc:1048] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:41.586577  6971 raft_consensus.cc:993] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:41.587312  6904 raft_consensus.cc:1081] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:41.599977   475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:15:41.600558   475 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:41.600888   475 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:41.610102   475 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:41.616503   475 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 19 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:41.617491   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:41.618319   627 raft_consensus.cc:3055] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:41.618753   627 raft_consensus.cc:740] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:41.619702   627 consensus_queue.cc:260] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:41.620996   627 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:41.637616   627 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 19.
I20260709 13:15:41.637656   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658ec34f01e349a4b86604b64fb8b9be" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:41.638926   556 raft_consensus.cc:3060] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:41.639321   447 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:15:41.640352  6923 raft_consensus.cc:2804] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:41.645063   556 raft_consensus.cc:2468] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 19.
I20260709 13:15:41.646415  6923 raft_consensus.cc:697] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:41.647459  6923 consensus_queue.cc:237] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:41.659044   378 catalog_manager.cc:5697] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 18 to 19, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 19 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.073343 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:42.085644   627 raft_consensus.cc:1275] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:15:42.087003  6981 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:42.138618   559 raft_consensus.cc:1275] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:15:42.140818  6981 consensus_queue.cc:1048] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:42.503552   631 consensus_queue.cc:237] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:42.509847   484 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:42.510047   559 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:15:42.510639   597 consensus_peers.cc:597] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec13b3c82acf4ef9a2eb79441f61a80d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:42.511647  6947 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:42.512513  6984 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:42.521867  6947 raft_consensus.cc:2955] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:42.522996   559 raft_consensus.cc:2955] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:42.531786   484 raft_consensus.cc:2955] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:42.543371   559 consensus_queue.cc:237] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:42.544889   378 catalog_manager.cc:5697] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 14 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
W20260709 13:15:42.558879   523 consensus_peers.cc:597] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 727ef43c64e147b3889a02b94ab53253. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:42.563333   475 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:15:42.564284   627 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:15:42.565944  6942 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:42.570986  6965 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:42.585083   475 raft_consensus.cc:2955] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:42.583058  6995 raft_consensus.cc:2955] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:42.611006   375 catalog_manager.cc:5697] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 13 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:42.620746   627 raft_consensus.cc:2955] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:42.631675   628 consensus_queue.cc:237] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:42.654208   559 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 20 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:15:42.654317   597 consensus_peers.cc:597] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ed6b89407f0e4ba28f232c121543a24e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:42.659739  6984 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:15:42.664489   484 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 20 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:15:42.666234  6984 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:15:42.672811  7004 raft_consensus.cc:2955] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index -1 to 15, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:42.674028   556 raft_consensus.cc:2955] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index -1 to 15, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:42.682693   475 raft_consensus.cc:2955] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index -1 to 15, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:42.693082   628 consensus_queue.cc:237] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:42.696552   378 catalog_manager.cc:5697] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index -1 to 15, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 20 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:42.706017   597 consensus_peers.cc:597] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d37a8f9254954f1f9db70e23a26e512b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:42.706480   556 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:42.707892  6984 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:42.718091  6971 raft_consensus.cc:2955] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:42.719590   556 raft_consensus.cc:2955] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:42.721241   475 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:42.723166  7004 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:42.742595   375 catalog_manager.cc:5697] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index -1 to 11, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 16 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:42.762372   475 raft_consensus.cc:2955] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:42.929486  7011 ts_tablet_manager.cc:933] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:42.931583  7011 tablet_copy_client.cc:323] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.131:36245
I20260709 13:15:42.933178   642 tablet_copy_service.cc:140] P 50f7c2247be24f3685d7fbca7b6c71e3: Received BeginTabletCopySession request for tablet ec13b3c82acf4ef9a2eb79441f61a80d from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:54754)
I20260709 13:15:42.933725   642 tablet_copy_service.cc:161] P 50f7c2247be24f3685d7fbca7b6c71e3: Beginning new tablet copy session on tablet ec13b3c82acf4ef9a2eb79441f61a80d from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:54754: session id = 6e6df7e8ed204f1db5c371536b5b0683-ec13b3c82acf4ef9a2eb79441f61a80d
I20260709 13:15:42.941664   642 tablet_copy_source_session.cc:215] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:42.945748  7011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec13b3c82acf4ef9a2eb79441f61a80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.957615  7011 tablet_copy_client.cc:806] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:42.958217  7011 tablet_copy_client.cc:670] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:42.962141  7011 tablet_copy_client.cc:538] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:42.972898  7011 tablet_bootstrap.cc:492] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:15:42.991495  7013 ts_tablet_manager.cc:933] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:43.001367  7013 tablet_copy_client.cc:323] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.130:41159
I20260709 13:15:43.004304   569 tablet_copy_service.cc:140] P 6ba2a9c02b534120bbf26e56a1e920ca: Received BeginTabletCopySession request for tablet 727ef43c64e147b3889a02b94ab53253 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:43548)
I20260709 13:15:43.004915   569 tablet_copy_service.cc:161] P 6ba2a9c02b534120bbf26e56a1e920ca: Beginning new tablet copy session on tablet 727ef43c64e147b3889a02b94ab53253 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:43548: session id = 6e6df7e8ed204f1db5c371536b5b0683-727ef43c64e147b3889a02b94ab53253
I20260709 13:15:43.010876   569 tablet_copy_source_session.cc:215] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:43.015678  7013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 727ef43c64e147b3889a02b94ab53253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:43.026053  7011 tablet_bootstrap.cc:492] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:43.027083  7011 tablet_bootstrap.cc:492] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:15:43.028609  7011 ts_tablet_manager.cc:1403] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.056s	user 0.037s	sys 0.007s
I20260709 13:15:43.031905  7011 raft_consensus.cc:359] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:43.032750  7011 raft_consensus.cc:740] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:15:43.033385  7011 consensus_queue.cc:260] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:43.035964  7011 ts_tablet_manager.cc:1434] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:43.039105   642 tablet_copy_service.cc:342] P 50f7c2247be24f3685d7fbca7b6c71e3: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-ec13b3c82acf4ef9a2eb79441f61a80d received from {username='slave'} at 127.0.0.1:54754
I20260709 13:15:43.039847   642 tablet_copy_service.cc:434] P 50f7c2247be24f3685d7fbca7b6c71e3: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-ec13b3c82acf4ef9a2eb79441f61a80d on tablet ec13b3c82acf4ef9a2eb79441f61a80d with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:15:43.069105  7013 tablet_copy_client.cc:806] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:43.069715  7013 tablet_copy_client.cc:670] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:43.075577  7013 tablet_copy_client.cc:538] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:43.083563  7013 tablet_bootstrap.cc:492] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:15:43.121871  7013 tablet_bootstrap.cc:492] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:43.122972  7013 tablet_bootstrap.cc:492] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:15:43.123772  7013 ts_tablet_manager.cc:1403] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.041s	user 0.029s	sys 0.011s
I20260709 13:15:43.126751  7013 raft_consensus.cc:359] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:43.127425  7013 raft_consensus.cc:740] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:15:43.128010  7013 consensus_queue.cc:260] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:43.134075  7013 ts_tablet_manager.cc:1434] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:43.135401 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:43.143741   569 tablet_copy_service.cc:342] P 6ba2a9c02b534120bbf26e56a1e920ca: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-727ef43c64e147b3889a02b94ab53253 received from {username='slave'} at 127.0.0.1:43548
I20260709 13:15:43.144205   569 tablet_copy_service.cc:434] P 6ba2a9c02b534120bbf26e56a1e920ca: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-727ef43c64e147b3889a02b94ab53253 on tablet 727ef43c64e147b3889a02b94ab53253 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:15:43.161607  7013 ts_tablet_manager.cc:933] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:43.163663  7013 tablet_copy_client.cc:323] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.131:36245
I20260709 13:15:43.165105   642 tablet_copy_service.cc:140] P 50f7c2247be24f3685d7fbca7b6c71e3: Received BeginTabletCopySession request for tablet ed6b89407f0e4ba28f232c121543a24e from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:54754)
I20260709 13:15:43.165620   642 tablet_copy_service.cc:161] P 50f7c2247be24f3685d7fbca7b6c71e3: Beginning new tablet copy session on tablet ed6b89407f0e4ba28f232c121543a24e from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:54754: session id = 6e6df7e8ed204f1db5c371536b5b0683-ed6b89407f0e4ba28f232c121543a24e
I20260709 13:15:43.178874   642 tablet_copy_source_session.cc:215] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:43.181751  7013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed6b89407f0e4ba28f232c121543a24e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:43.198412   559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:15:43.202245   559 raft_consensus.cc:606] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:43.202416  7013 tablet_copy_client.cc:806] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:43.203013  7013 tablet_copy_client.cc:670] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:43.206826   475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:43.207432   475 raft_consensus.cc:606] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:15:43.208123  7013 tablet_copy_client.cc:538] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:43.210398   475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:43.210994   475 raft_consensus.cc:606] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:15:43.213330 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:43.214948 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:43.217834  7013 tablet_bootstrap.cc:492] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:15:43.229920  7011 ts_tablet_manager.cc:933] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:43.232188  7011 tablet_copy_client.cc:323] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.131:36245
I20260709 13:15:43.241914   642 tablet_copy_service.cc:140] P 50f7c2247be24f3685d7fbca7b6c71e3: Received BeginTabletCopySession request for tablet d37a8f9254954f1f9db70e23a26e512b from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:54754)
I20260709 13:15:43.242542   642 tablet_copy_service.cc:161] P 50f7c2247be24f3685d7fbca7b6c71e3: Beginning new tablet copy session on tablet d37a8f9254954f1f9db70e23a26e512b from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:54754: session id = 6e6df7e8ed204f1db5c371536b5b0683-d37a8f9254954f1f9db70e23a26e512b
I20260709 13:15:43.251721   642 tablet_copy_source_session.cc:215] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:43.256035  7011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d37a8f9254954f1f9db70e23a26e512b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:43.278762  7011 tablet_copy_client.cc:806] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:43.279356  7011 tablet_copy_client.cc:670] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:43.284341  7013 tablet_bootstrap.cc:492] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:43.284090  7011 tablet_copy_client.cc:538] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:43.285373  7013 tablet_bootstrap.cc:492] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:15:43.286074  7013 ts_tablet_manager.cc:1403] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.068s	user 0.050s	sys 0.010s
I20260709 13:15:43.288542  7013 raft_consensus.cc:359] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:43.289104  7013 raft_consensus.cc:740] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:15:43.289558  7013 consensus_queue.cc:260] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:43.291460  7013 ts_tablet_manager.cc:1434] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:15:43.294154  7011 tablet_bootstrap.cc:492] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:15:43.294866   642 tablet_copy_service.cc:342] P 50f7c2247be24f3685d7fbca7b6c71e3: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-ed6b89407f0e4ba28f232c121543a24e received from {username='slave'} at 127.0.0.1:54754
I20260709 13:15:43.295343   642 tablet_copy_service.cc:434] P 50f7c2247be24f3685d7fbca7b6c71e3: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-ed6b89407f0e4ba28f232c121543a24e on tablet ed6b89407f0e4ba28f232c121543a24e with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:15:43.324003  6838 raft_consensus.cc:993] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:43.324431  6838 raft_consensus.cc:1081] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:43.327373   628 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54256
I20260709 13:15:43.328052   628 raft_consensus.cc:493] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:43.328465   628 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:43.343506   628 raft_consensus.cc:515] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:43.345587   628 leader_election.cc:290] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:43.346647   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:43.347309   475 raft_consensus.cc:3055] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:43.347631   475 raft_consensus.cc:740] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:43.348397   475 consensus_queue.cc:260] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:43.349490   475 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:43.351143   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf3f4dcd2994ae4b21fc89b93484482" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:43.351724   556 raft_consensus.cc:3060] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:43.362764  7011 tablet_bootstrap.cc:492] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:43.363813  7011 tablet_bootstrap.cc:492] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:15:43.364513  7011 ts_tablet_manager.cc:1403] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.071s	user 0.050s	sys 0.011s
I20260709 13:15:43.367410  7011 raft_consensus.cc:359] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:43.368220  7011 raft_consensus.cc:740] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:15:43.368872  7011 consensus_queue.cc:260] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:43.369338   556 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 17.
I20260709 13:15:43.370656   597 leader_election.cc:304] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:43.371512  7004 raft_consensus.cc:2804] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:43.371996  7004 raft_consensus.cc:697] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:43.372875  7004 consensus_queue.cc:237] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:43.374724  7011 ts_tablet_manager.cc:1434] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:15:43.376394   642 tablet_copy_service.cc:342] P 50f7c2247be24f3685d7fbca7b6c71e3: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-d37a8f9254954f1f9db70e23a26e512b received from {username='slave'} at 127.0.0.1:54754
I20260709 13:15:43.376781   642 tablet_copy_service.cc:434] P 50f7c2247be24f3685d7fbca7b6c71e3: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-d37a8f9254954f1f9db70e23a26e512b on tablet d37a8f9254954f1f9db70e23a26e512b with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:15:43.386811   475 raft_consensus.cc:2468] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 17.
I20260709 13:15:43.395959   380 catalog_manager.cc:5697] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 16 to 17, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 17 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:43.426271  1172 raft_consensus.cc:1217] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 13:15:43.501191  1172 raft_consensus.cc:1217] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 13:15:43.599740  6942 raft_consensus.cc:993] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:43.600308  6942 raft_consensus.cc:1081] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:43.605827   475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38134
I20260709 13:15:43.606559   475 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:43.606897   475 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:43.614360   475 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:43.617183   475 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:43.618160   628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:43.618741   628 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:43.618728   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e103c8f4a7e48599f7b9bb07071e6cc" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:43.619760   556 raft_consensus.cc:3055] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:43.620019   556 raft_consensus.cc:740] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:43.620700   556 consensus_queue.cc:260] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:43.622098   556 raft_consensus.cc:3060] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:43.626138   628 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:15:43.627226   447 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 
I20260709 13:15:43.628090  6838 raft_consensus.cc:2804] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:43.628512  6838 raft_consensus.cc:697] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:43.629235  6838 consensus_queue.cc:237] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:43.641680   380 catalog_manager.cc:5697] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 11 to 12, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 12 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.643893   556 raft_consensus.cc:2468] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 12.
I20260709 13:15:43.687291  6923 raft_consensus.cc:993] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:43.687747  6923 raft_consensus.cc:1081] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:43.689328   628 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54256
I20260709 13:15:43.689841   628 raft_consensus.cc:493] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:43.690204   628 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:43.702332   628 raft_consensus.cc:515] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:43.704058   628 leader_election.cc:290] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:43.704933   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:43.705530   559 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:43.741268   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9108c5fc44794002b60442bd66404e6c" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:43.748739   475 raft_consensus.cc:3055] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:43.752074   475 raft_consensus.cc:740] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:43.771430  1172 raft_consensus.cc:1217] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 13:15:43.765861   475 consensus_queue.cc:260] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:43.810094   475 raft_consensus.cc:3060] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:43.853818   559 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 16.
I20260709 13:15:43.890349  1172 raft_consensus.cc:1217] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.14->[20.15-20.15]   Dedup: 20.15->[]
I20260709 13:15:43.894961   597 leader_election.cc:304] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:43.902427   475 raft_consensus.cc:2468] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 16.
I20260709 13:15:43.903611  7023 raft_consensus.cc:2804] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:43.904541  7023 raft_consensus.cc:697] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:43.906121  7023 consensus_queue.cc:237] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:43.918123   553 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:15:43.920333   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 74262.3us
I20260709 13:15:43.923918  7029 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:43.934366  7030 raft_consensus.cc:1064] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:15:43.942711  7030 consensus_queue.cc:237] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:43.988967   481 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:43.991787  7023 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:43.999126  7002 raft_consensus.cc:1064] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:15:44.018100  7002 consensus_queue.cc:237] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:44.021844   380 catalog_manager.cc:5697] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 15 to 16, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 16 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:44.027915  1172 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 LEARNER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:15:44.029735   559 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:15:44.032725  7030 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:44.039018   478 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:15:44.047785  7030 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:44.050098  7030 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:44.053097   627 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:44.053611   478 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:44.054733  6965 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:44.055962  6942 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:44.057657   551 raft_consensus.cc:1275] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:15:44.060106  6838 consensus_queue.cc:1048] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:44.063295  1172 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEARNER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:44.065862  7031 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:44.159613  7031 raft_consensus.cc:2955] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.169761  7030 raft_consensus.cc:2955] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.189073  1174 raft_consensus.cc:2955] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.203254   556 raft_consensus.cc:2955] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.221879   627 raft_consensus.cc:1275] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:15:44.224946  6923 consensus_queue.cc:1048] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:15:44.225934  1172 raft_consensus.cc:2955] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.240465   375 catalog_manager.cc:5697] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:44.235373   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 60982.3us
I20260709 13:15:44.244789 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:44.245731   624 raft_consensus.cc:2955] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.270598   378 catalog_manager.cc:5697] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.307163   481 raft_consensus.cc:2955] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:15:44.315375   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 89081us
W20260709 13:15:44.398708   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 49267.5us
I20260709 13:15:44.457679  7029 raft_consensus.cc:1064] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:15:44.466734   481 raft_consensus.cc:2955] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.520257   551 consensus_queue.cc:237] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:44.514973   556 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:44.496553  7029 consensus_queue.cc:237] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:44.533833  7023 raft_consensus.cc:1064] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:15:44.536286  7023 consensus_queue.cc:237] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:44.540345  7059 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:44.557237   481 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:15:44.558735  7002 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:44.563443  1168 raft_consensus.cc:1275] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:15:44.564941  7061 consensus_queue.cc:1048] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:44.566767  7051 raft_consensus.cc:2955] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.574290   551 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:44.575333  1168 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 LEARNER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:44.573937   481 raft_consensus.cc:2955] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.582280  1168 raft_consensus.cc:2955] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.601293  7059 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:44.614941   366 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 727ef43c64e147b3889a02b94ab53253 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:44.619029  7054 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:44.627507  1172 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683 [term 20 LEARNER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:15:44.632872   556 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 20 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:15:44.633417  7023 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:15:44.634845  7004 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:15:44.651597   381 catalog_manager.cc:5697] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 11 to 12, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New cstate: current_term: 13 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.653606   481 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:44.682094  7054 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:44.683431  7004 raft_consensus.cc:2955] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 20 LEADER]: Committing config change with OpId 20.16: config changed from index 15 to 16, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.691524   481 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:44.693985   481 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 20 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:15:44.695757   555 raft_consensus.cc:2955] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.710624  7054 raft_consensus.cc:2955] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.712971  1168 raft_consensus.cc:2955] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.716959   631 consensus_queue.cc:237] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:44.726902   617 tablet_service.cc:1558] Processing DeleteTablet for tablet 727ef43c64e147b3889a02b94ab53253 with delete_type TABLET_DATA_TOMBSTONED (TS 50f7c2247be24f3685d7fbca7b6c71e3 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:46830
I20260709 13:15:44.727596   551 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:15:44.729230  1172 raft_consensus.cc:1275] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:15:44.729231  7060 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:44.735813  7060 consensus_queue.cc:1048] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:44.737856   378 catalog_manager.cc:5697] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 11 to 12, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.745113   555 raft_consensus.cc:2955] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.755627  6971 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:44.742921   380 catalog_manager.cc:5697] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index 15 to 16, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.756731  1172 raft_consensus.cc:2955] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.758702  7023 raft_consensus.cc:2955] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.759563  1168 raft_consensus.cc:2955] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.766505   551 raft_consensus.cc:2955] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.770609  6971 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:15:44.777909  7077 tablet_replica.cc:333] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:44.787550   482 raft_consensus.cc:2955] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.788297   631 consensus_queue.cc:237] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:44.795922   556 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 20 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:15:44.799773  7004 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:15:44.798028  7077 raft_consensus.cc:2243] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.806282  7077 raft_consensus.cc:2272] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.811309   484 raft_consensus.cc:2955] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.819954  7054 raft_consensus.cc:2955] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 20 LEADER]: Committing config change with OpId 20.17: config changed from index 16 to 17, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.846331   365 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ec13b3c82acf4ef9a2eb79441f61a80d with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:44.847584  7077 ts_tablet_manager.cc:1916] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:44.846592   555 raft_consensus.cc:2955] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 20 FOLLOWER]: Committing config change with OpId 20.17: config changed from index 16 to 17, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.856144  1169 raft_consensus.cc:1275] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683 [term 20 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:15:44.859951   381 catalog_manager.cc:5697] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 11 to 12, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New cstate: current_term: 14 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.860407  7029 consensus_queue.cc:1048] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:15:44.870177   365 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ed6b89407f0e4ba28f232c121543a24e with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:44.872716  1169 raft_consensus.cc:2955] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683 [term 20 FOLLOWER]: Committing config change with OpId 20.17: config changed from index 16 to 17, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.895812   467 tablet_service.cc:1558] Processing DeleteTablet for tablet ec13b3c82acf4ef9a2eb79441f61a80d with delete_type TABLET_DATA_TOMBSTONED (TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:59316
I20260709 13:15:44.897986   631 consensus_queue.cc:237] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:44.904393  7080 tablet_replica.cc:333] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:44.910146  7080 raft_consensus.cc:2243] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.911118  7080 raft_consensus.cc:2272] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.917922  1168 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:15:44.919754  7080 ts_tablet_manager.cc:1916] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:44.919790  7029 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:44.920928   482 raft_consensus.cc:1275] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:15:44.924432   380 catalog_manager.cc:5697] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 16 to 17, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New cstate: current_term: 20 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.924432  7023 consensus_queue.cc:1048] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:15:44.932711  7029 raft_consensus.cc:2955] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.946728  1172 raft_consensus.cc:2955] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.966751   467 tablet_service.cc:1558] Processing DeleteTablet for tablet ed6b89407f0e4ba28f232c121543a24e with delete_type TABLET_DATA_TOMBSTONED (TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:59316
I20260709 13:15:44.969563  7077 ts_tablet_manager.cc:1929] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 13:15:44.968915   484 raft_consensus.cc:2955] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:44.970151  7077 log.cc:1199] T 727ef43c64e147b3889a02b94ab53253 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-2-root/wals/727ef43c64e147b3889a02b94ab53253
I20260709 13:15:44.977327  7080 ts_tablet_manager.cc:1929] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 13:15:44.981928  7080 log.cc:1199] T ec13b3c82acf4ef9a2eb79441f61a80d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-0-root/wals/ec13b3c82acf4ef9a2eb79441f61a80d
I20260709 13:15:44.984222  7080 tablet_replica.cc:333] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:44.984460   368 catalog_manager.cc:5028] TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): tablet ec13b3c82acf4ef9a2eb79441f61a80d (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:15:44.988857   365 catalog_manager.cc:5028] TS 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): tablet 727ef43c64e147b3889a02b94ab53253 (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:15:44.992633   365 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d37a8f9254954f1f9db70e23a26e512b with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:44.997725  7080 raft_consensus.cc:2243] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:45.001125  7080 raft_consensus.cc:2272] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:45.004089   380 catalog_manager.cc:5697] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 12 to 13, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New cstate: current_term: 16 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:45.006572  7080 ts_tablet_manager.cc:1916] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:45.027019   545 tablet_service.cc:1558] Processing DeleteTablet for tablet d37a8f9254954f1f9db70e23a26e512b with delete_type TABLET_DATA_TOMBSTONED (TS 6ba2a9c02b534120bbf26e56a1e920ca not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:45502
I20260709 13:15:45.028968  7080 ts_tablet_manager.cc:1929] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.16
I20260709 13:15:45.029510  7080 log.cc:1199] T ed6b89407f0e4ba28f232c121543a24e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-0-root/wals/ed6b89407f0e4ba28f232c121543a24e
I20260709 13:15:45.031225   368 catalog_manager.cc:5028] TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): tablet ed6b89407f0e4ba28f232c121543a24e (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:15:45.035813  7081 tablet_replica.cc:333] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:45.037151  7081 raft_consensus.cc:2243] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:45.037849  7081 raft_consensus.cc:2272] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:45.041209  7081 ts_tablet_manager.cc:1916] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:45.057976  7081 ts_tablet_manager.cc:1929] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 13:15:45.058298  7081 log.cc:1199] T d37a8f9254954f1f9db70e23a26e512b P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-1-root/wals/d37a8f9254954f1f9db70e23a26e512b
I20260709 13:15:45.059888   366 catalog_manager.cc:5028] TS 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): tablet d37a8f9254954f1f9db70e23a26e512b (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:15:45.636638 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:45.677451   482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:45.678161   482 raft_consensus.cc:606] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:45.681147   627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:15:45.681627   627 raft_consensus.cc:606] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Received request to transfer leadership to TS 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:45.684041   627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:15:45.684485   627 raft_consensus.cc:606] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:45.685477 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:45.686743 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:45.745533  6923 raft_consensus.cc:993] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:45.746114  7062 raft_consensus.cc:1081] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Signalling peer 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:45.747861   555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59114
I20260709 13:15:45.748425   555 raft_consensus.cc:493] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:45.748733   555 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:45.756024   555 raft_consensus.cc:515] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:45.757519   555 leader_election.cc:290] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:45.758642   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:45.758826   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b49b729462465a98ad914bf7ba3c10" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:45.759191   482 raft_consensus.cc:3055] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:45.759500   627 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:45.759544   482 raft_consensus.cc:740] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:45.760602   482 consensus_queue.cc:260] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:45.761664   482 raft_consensus.cc:3060] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:45.768553   482 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:15:45.769840   525 leader_election.cc:304] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:45.770754  7051 raft_consensus.cc:2804] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:45.771319  7051 raft_consensus.cc:697] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:45.772248  7051 consensus_queue.cc:237] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:45.773121   627 raft_consensus.cc:2468] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 14.
I20260709 13:15:45.786716   380 catalog_manager.cc:5697] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 13 to 14, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 14 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:45.820763  7054 raft_consensus.cc:993] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:45.821404  7023 raft_consensus.cc:1081] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:45.823107   482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:15:45.823689   482 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:45.824021   482 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:45.829582   482 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:45.832086   482 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:15:45.833313  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:15:45.834088  1172 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:45.833935   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:45.834816   627 raft_consensus.cc:3055] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:45.835114   627 raft_consensus.cc:740] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:45.835999   627 consensus_queue.cc:260] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:45.837491   627 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:45.842064  1172 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:15:45.843602   448 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:15:45.844556  7062 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:45.845005  7062 raft_consensus.cc:697] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:45.845575   627 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 14.
I20260709 13:15:45.845849  7062 consensus_queue.cc:237] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:45.857327   380 catalog_manager.cc:5697] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 13 to 14, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 14 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:45.899215  7054 raft_consensus.cc:993] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:45.899785  7023 raft_consensus.cc:1081] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Signalling peer 6ba2a9c02b534120bbf26e56a1e920ca to start an election
I20260709 13:15:45.901292   555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
 from {username='slave'} at 127.0.0.1:59128
I20260709 13:15:45.901856   555 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:45.902199   555 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:45.907866   555 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:45.909322   555 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 18 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:15:45.910032   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:45.910197  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:15:45.910640   627 raft_consensus.cc:3055] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:45.910794  1172 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:45.911007   627 raft_consensus.cc:740] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:45.911852   627 consensus_queue.cc:260] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:45.913043   627 raft_consensus.cc:3060] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:45.917412  1172 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 18.
I20260709 13:15:45.918550   523 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:15:45.919173   627 raft_consensus.cc:2468] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba2a9c02b534120bbf26e56a1e920ca in term 18.
I20260709 13:15:45.919389  7002 raft_consensus.cc:2804] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:45.919904  7002 raft_consensus.cc:697] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 LEADER]: Becoming Leader. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:45.920754  7002 consensus_queue.cc:237] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:45.933948   380 catalog_manager.cc:5697] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: term changed from 17 to 18, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130). New cstate: current_term: 18 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:46.098845   556 consensus_queue.cc:237] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:46.110186   627 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:15:46.111290   478 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:15:46.112069  7084 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:46.113478  7002 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:15:46.117950   523 consensus_peers.cc:597] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4bd90dfa0b4483dae082de5ca5e77f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:46.123189  7051 raft_consensus.cc:2955] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:46.125279   627 raft_consensus.cc:2955] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:46.139604   478 raft_consensus.cc:2955] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:46.145057   380 catalog_manager.cc:5697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index -1 to 13, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 18 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:46.150799   627 consensus_queue.cc:237] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:46.170782   556 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:15:46.170928   597 consensus_peers.cc:597] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9108c5fc44794002b60442bd66404e6c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:46.171316   478 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:46.173002  7054 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:46.174566  7054 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:46.195604  7023 raft_consensus.cc:2955] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:46.198427   478 raft_consensus.cc:2955] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:46.201267   556 raft_consensus.cc:2955] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:46.215857   555 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:46.219597   378 catalog_manager.cc:5697] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index -1 to 11, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 16 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:46.258008   627 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 23 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:15:46.258260   478 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 23 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:15:46.259599  7051 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:15:46.261207   523 consensus_peers.cc:597] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6316a42e235d497f96a57da84ac62c84. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:46.262423  7051 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:15:46.272053   631 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:15:46.275458  7062 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:46.284049  7095 raft_consensus.cc:2955] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 23 LEADER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:46.294080   482 raft_consensus.cc:1275] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:46.285944   478 raft_consensus.cc:2955] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:46.296286  7051 consensus_queue.cc:1048] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:46.300459   629 raft_consensus.cc:2955] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:46.310938   624 raft_consensus.cc:1275] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:15:46.312551  1172 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:15:46.312613  7002 consensus_queue.cc:1048] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:15:46.318245  7108 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:46.344485   627 consensus_queue.cc:237] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:46.353129   378 catalog_manager.cc:5697] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index -1 to 14, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 23 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:46.376534   556 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:46.377633   478 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:15:46.377725   597 consensus_peers.cc:597] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c5452210928414da7920e467cc1fbda. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:46.378944  7054 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:46.380896  7023 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:46.409379  1169 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 18 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:15:46.412943  7095 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:15:46.428876  7023 raft_consensus.cc:2955] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:46.432304   482 raft_consensus.cc:2955] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:46.435784   556 raft_consensus.cc:2955] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:46.456777   627 raft_consensus.cc:1275] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:15:46.460907  7095 consensus_queue.cc:1048] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:15:46.460784   380 catalog_manager.cc:5697] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 15 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:46.603323  7122 ts_tablet_manager.cc:933] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:46.608319  7122 tablet_copy_client.cc:323] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.130:41159
I20260709 13:15:46.610229   569 tablet_copy_service.cc:140] P 6ba2a9c02b534120bbf26e56a1e920ca: Received BeginTabletCopySession request for tablet e4bd90dfa0b4483dae082de5ca5e77f0 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:43548)
I20260709 13:15:46.610749   569 tablet_copy_service.cc:161] P 6ba2a9c02b534120bbf26e56a1e920ca: Beginning new tablet copy session on tablet e4bd90dfa0b4483dae082de5ca5e77f0 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:43548: session id = 6e6df7e8ed204f1db5c371536b5b0683-e4bd90dfa0b4483dae082de5ca5e77f0
I20260709 13:15:46.618418   569 tablet_copy_source_session.cc:215] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:46.621937  7122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4bd90dfa0b4483dae082de5ca5e77f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:46.637491  7122 tablet_copy_client.cc:806] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:46.638170  7122 tablet_copy_client.cc:670] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:46.644091  7122 tablet_copy_client.cc:538] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:46.652158  7122 tablet_bootstrap.cc:492] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:15:46.687668 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:46.691690  7122 tablet_bootstrap.cc:492] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:46.692813  7122 tablet_bootstrap.cc:492] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:15:46.693570  7122 ts_tablet_manager.cc:1403] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.042s	user 0.033s	sys 0.008s
I20260709 13:15:46.696794  7122 raft_consensus.cc:359] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:46.697633  7122 raft_consensus.cc:740] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:15:46.698334  7122 consensus_queue.cc:260] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:46.700913  7122 ts_tablet_manager.cc:1434] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:46.702822   569 tablet_copy_service.cc:342] P 6ba2a9c02b534120bbf26e56a1e920ca: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-e4bd90dfa0b4483dae082de5ca5e77f0 received from {username='slave'} at 127.0.0.1:43548
I20260709 13:15:46.703289   569 tablet_copy_service.cc:434] P 6ba2a9c02b534120bbf26e56a1e920ca: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-e4bd90dfa0b4483dae082de5ca5e77f0 on tablet e4bd90dfa0b4483dae082de5ca5e77f0 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:15:46.711684  7125 ts_tablet_manager.cc:933] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:46.724223  7125 tablet_copy_client.cc:323] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.130:41159
I20260709 13:15:46.726575   569 tablet_copy_service.cc:140] P 6ba2a9c02b534120bbf26e56a1e920ca: Received BeginTabletCopySession request for tablet 6316a42e235d497f96a57da84ac62c84 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:43548)
I20260709 13:15:46.727133   569 tablet_copy_service.cc:161] P 6ba2a9c02b534120bbf26e56a1e920ca: Beginning new tablet copy session on tablet 6316a42e235d497f96a57da84ac62c84 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:43548: session id = 6e6df7e8ed204f1db5c371536b5b0683-6316a42e235d497f96a57da84ac62c84
I20260709 13:15:46.735827   569 tablet_copy_source_session.cc:215] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:46.736596  7122 ts_tablet_manager.cc:933] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:46.741957  7125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6316a42e235d497f96a57da84ac62c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:46.801671  7125 tablet_copy_client.cc:806] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:46.818956  7125 tablet_copy_client.cc:670] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:46.817931  7122 tablet_copy_client.cc:323] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.131:36245
I20260709 13:15:46.824965   642 tablet_copy_service.cc:140] P 50f7c2247be24f3685d7fbca7b6c71e3: Received BeginTabletCopySession request for tablet 9108c5fc44794002b60442bd66404e6c from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:54754)
I20260709 13:15:46.825585   642 tablet_copy_service.cc:161] P 50f7c2247be24f3685d7fbca7b6c71e3: Beginning new tablet copy session on tablet 9108c5fc44794002b60442bd66404e6c from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:54754: session id = 6e6df7e8ed204f1db5c371536b5b0683-9108c5fc44794002b60442bd66404e6c
I20260709 13:15:46.835844   642 tablet_copy_source_session.cc:215] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:46.839634  7122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9108c5fc44794002b60442bd66404e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:46.865005  7125 tablet_copy_client.cc:538] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:46.870157  7122 tablet_copy_client.cc:806] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:46.870826  7122 tablet_copy_client.cc:670] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:46.877368  7125 tablet_bootstrap.cc:492] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:15:46.883916  7122 tablet_copy_client.cc:538] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:46.895342  7122 tablet_bootstrap.cc:492] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:15:46.949828  7122 tablet_bootstrap.cc:492] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:46.950985  7122 tablet_bootstrap.cc:492] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:15:46.951777  7122 ts_tablet_manager.cc:1403] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.057s	user 0.023s	sys 0.023s
I20260709 13:15:46.954453  7122 raft_consensus.cc:359] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:46.955221  7122 raft_consensus.cc:740] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:15:46.955838  7122 consensus_queue.cc:260] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:46.959581  7122 ts_tablet_manager.cc:1434] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:15:46.963128   642 tablet_copy_service.cc:342] P 50f7c2247be24f3685d7fbca7b6c71e3: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-9108c5fc44794002b60442bd66404e6c received from {username='slave'} at 127.0.0.1:54754
I20260709 13:15:46.963660   642 tablet_copy_service.cc:434] P 50f7c2247be24f3685d7fbca7b6c71e3: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-9108c5fc44794002b60442bd66404e6c on tablet 9108c5fc44794002b60442bd66404e6c with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:15:46.973227  7122 ts_tablet_manager.cc:933] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:46.977890  7125 tablet_bootstrap.cc:492] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:46.980129  7125 tablet_bootstrap.cc:492] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:15:46.980958  7125 ts_tablet_manager.cc:1403] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.104s	user 0.047s	sys 0.009s
I20260709 13:15:46.981026  7122 tablet_copy_client.cc:323] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.131:36245
I20260709 13:15:46.986176  7125 raft_consensus.cc:359] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:46.987329  7125 raft_consensus.cc:740] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:15:46.988016  7125 consensus_queue.cc:260] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:46.989574   642 tablet_copy_service.cc:140] P 50f7c2247be24f3685d7fbca7b6c71e3: Received BeginTabletCopySession request for tablet 3c5452210928414da7920e467cc1fbda from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:54754)
I20260709 13:15:46.990195   642 tablet_copy_service.cc:161] P 50f7c2247be24f3685d7fbca7b6c71e3: Beginning new tablet copy session on tablet 3c5452210928414da7920e467cc1fbda from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:54754: session id = 6e6df7e8ed204f1db5c371536b5b0683-3c5452210928414da7920e467cc1fbda
I20260709 13:15:46.991412  7125 ts_tablet_manager.cc:1434] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:15:46.998349   642 tablet_copy_source_session.cc:215] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:47.004179  7122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5452210928414da7920e467cc1fbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:47.005264   569 tablet_copy_service.cc:342] P 6ba2a9c02b534120bbf26e56a1e920ca: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-6316a42e235d497f96a57da84ac62c84 received from {username='slave'} at 127.0.0.1:43548
I20260709 13:15:47.005735   569 tablet_copy_service.cc:434] P 6ba2a9c02b534120bbf26e56a1e920ca: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-6316a42e235d497f96a57da84ac62c84 on tablet 6316a42e235d497f96a57da84ac62c84 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:15:47.025367  7122 tablet_copy_client.cc:806] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:47.026038  7122 tablet_copy_client.cc:670] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:47.029726  7122 tablet_copy_client.cc:538] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:47.037986  7122 tablet_bootstrap.cc:492] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:15:47.069531  7122 tablet_bootstrap.cc:492] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:47.070576  7122 tablet_bootstrap.cc:492] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:15:47.071264  7122 ts_tablet_manager.cc:1403] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.033s	user 0.031s	sys 0.001s
I20260709 13:15:47.073894  7122 raft_consensus.cc:359] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:47.074497  7122 raft_consensus.cc:740] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:15:47.074965  7122 consensus_queue.cc:260] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:47.076946  7122 ts_tablet_manager.cc:1434] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:15:47.079380   642 tablet_copy_service.cc:342] P 50f7c2247be24f3685d7fbca7b6c71e3: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-3c5452210928414da7920e467cc1fbda received from {username='slave'} at 127.0.0.1:54754
I20260709 13:15:47.079850   642 tablet_copy_service.cc:434] P 50f7c2247be24f3685d7fbca7b6c71e3: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-3c5452210928414da7920e467cc1fbda on tablet 3c5452210928414da7920e467cc1fbda with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:15:47.099819  1169 raft_consensus.cc:1217] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.12->[18.13-18.13]   Dedup: 18.13->[]
I20260709 13:15:47.136230  1169 raft_consensus.cc:1217] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 13:15:47.173539  1169 raft_consensus.cc:1217] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.13->[23.14-23.14]   Dedup: 23.14->[]
I20260709 13:15:47.501682  7095 raft_consensus.cc:1064] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:15:47.503382  1169 raft_consensus.cc:1217] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 13:15:47.504503  7095 consensus_queue.cc:237] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:47.519171   627 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:15:47.521602  1169 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683 [term 18 LEARNER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:15:47.521564  7094 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:15:47.522820   482 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:15:47.523296  7051 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:15:47.524472  7095 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:15:47.561465  7121 raft_consensus.cc:1064] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:15:47.564288  7121 consensus_queue.cc:237] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:15:47.707043  7136 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:15:47.711059  1168 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 LEARNER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:47.721721   478 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:47.735320   556 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:15:47.737311  7138 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Append to log took a long time: real 0.178s	user 0.000s	sys 0.003s
W20260709 13:15:47.739267  7149 log.cc:927] Time spent T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:15:47.740849  7137 log.cc:927] Time spent T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:15:47.739581  7145 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:47.753767  7157 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:47.776394  7121 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:47.797106   631 raft_consensus.cc:2955] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:47.803617  7163 raft_consensus.cc:1064] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:15:47.809219  7163 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 12, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:47.795717  7095 raft_consensus.cc:2955] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:15:47.833746   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 46927.8us
W20260709 13:15:47.837798   597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 47289.2us
I20260709 13:15:47.847376 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:47.884572   478 raft_consensus.cc:2955] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:47.909360   380 catalog_manager.cc:5697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index 13 to 14, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:47.944494  7133 raft_consensus.cc:2955] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:47.948309  7157 raft_consensus.cc:1064] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:15:47.951988   482 raft_consensus.cc:2955] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:47.957103  1168 raft_consensus.cc:2955] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:47.951067  7157 consensus_queue.cc:237] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:15:47.984401  7168 log.cc:927] Time spent T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:15:48.005522   631 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 23 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:15:48.008361  7140 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:15:48.012830   478 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:48.015897  1169 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683 [term 23 LEARNER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:15:48.027382  7145 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:48.029184   559 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:48.032608  1172 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEARNER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:48.029973   484 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 23 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:15:48.031087  7140 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 13:15:48.034516  7155 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:48.035382  7095 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:15:48.037599  7155 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:15:48.041301  1168 raft_consensus.cc:2955] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.096323   378 catalog_manager.cc:5697] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 11 to 12, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.105408  7146 raft_consensus.cc:2955] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index 14 to 15, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.110513   555 raft_consensus.cc:2955] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.113684  1168 raft_consensus.cc:2955] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.117141  7157 raft_consensus.cc:2955] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.119848   482 raft_consensus.cc:2955] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.120496  1172 raft_consensus.cc:2955] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.122227   559 consensus_queue.cc:237] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:48.126600   627 raft_consensus.cc:2955] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.128930  1169 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683 [term 18 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:15:48.131178  7163 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:15:48.134361   551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:15:48.134855   551 raft_consensus.cc:606] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:48.144009  7141 raft_consensus.cc:2955] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 LEADER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.163045   551 raft_consensus.cc:2955] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.173732  1169 raft_consensus.cc:2955] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.179533   378 catalog_manager.cc:5697] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index 14 to 15, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:48.188449   482 raft_consensus.cc:2955] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.190613   478 raft_consensus.cc:1275] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:15:48.193332   484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:48.193879   484 raft_consensus.cc:606] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:15:48.198462   366 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e4bd90dfa0b4483dae082de5ca5e77f0 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:48.198717  7140 consensus_queue.cc:1048] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:15:48.201929  7163 raft_consensus.cc:993] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:48.202356  7163 raft_consensus.cc:1081] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:48.204057   482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38134
I20260709 13:15:48.204624   482 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:48.205003   482 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:48.205654   555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fc289132926446d9594150727e08b0b"
dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
mode: GRACEFUL
new_leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:15:48.206300   555 raft_consensus.cc:606] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Received request to transfer leadership to TS 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:15:48.207576 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:48.209159 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:48.209247   559 consensus_queue.cc:237] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:48.219837   380 catalog_manager.cc:5697] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.221087   475 raft_consensus.cc:2955] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.227444   484 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 23 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:15:48.229184  7146 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:15:48.237507   627 consensus_queue.cc:237] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:48.236522   378 catalog_manager.cc:5697] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index 14 to 15, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New cstate: current_term: 18 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:48.242385  1168 raft_consensus.cc:1275] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683 [term 23 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:15:48.245345  7166 raft_consensus.cc:2955] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index 15 to 16, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.252321   482 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:48.254727   482 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:48.255321   559 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:15:48.257476   631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:48.258039   631 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:48.261118  1174 raft_consensus.cc:1275] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:15:48.263870   484 raft_consensus.cc:2955] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.270277   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea38de651624cd48fa0e7a5a85467d5" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:48.270815   559 raft_consensus.cc:3055] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:48.271106   559 raft_consensus.cc:740] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:48.272044   366 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6316a42e235d497f96a57da84ac62c84 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:48.271860   559 consensus_queue.cc:260] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:48.273135   559 raft_consensus.cc:3060] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:48.276260  7161 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:48.278024  7161 consensus_queue.cc:1048] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:48.279794   559 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 17.
I20260709 13:15:48.284863   617 tablet_service.cc:1558] Processing DeleteTablet for tablet e4bd90dfa0b4483dae082de5ca5e77f0 with delete_type TABLET_DATA_TOMBSTONED (TS 50f7c2247be24f3685d7fbca7b6c71e3 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:46830
I20260709 13:15:48.288087   629 consensus_queue.cc:237] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:48.298434   478 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:48.305109  7051 consensus_queue.cc:1048] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:15:48.305405  7145 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:48.306567   448 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:48.307832  7143 raft_consensus.cc:2804] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:48.308347  7143 raft_consensus.cc:697] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:48.309178  7143 consensus_queue.cc:237] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:48.320205  1169 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:48.326876  7155 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:48.329627  7133 raft_consensus.cc:2955] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.322238  1168 raft_consensus.cc:2955] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.345709   631 raft_consensus.cc:2468] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 17.
I20260709 13:15:48.349141   559 raft_consensus.cc:2955] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.352674  7157 raft_consensus.cc:2955] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.353907  7182 tablet_replica.cc:333] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:48.355062  7182 raft_consensus.cc:2243] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:48.354300  1169 raft_consensus.cc:2955] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.357681   378 catalog_manager.cc:5697] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index 15 to 16, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New cstate: current_term: 23 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:48.361515   365 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9108c5fc44794002b60442bd66404e6c with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:48.384341  7182 raft_consensus.cc:2272] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:48.398528  7182 ts_tablet_manager.cc:1916] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:48.410473  7146 raft_consensus.cc:993] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:48.411147  7146 raft_consensus.cc:1081] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:48.412797   631 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fc289132926446d9594150727e08b0b"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:15:48.413371   631 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:48.413731   631 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:48.364729   475 raft_consensus.cc:2955] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.370034  1172 raft_consensus.cc:2955] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.376374   380 catalog_manager.cc:5697] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 12 to 13, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New cstate: current_term: 16 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:48.376732   375 catalog_manager.cc:5697] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 16 to 17, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 17 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:48.420722   631 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:48.433681   631 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:48.434249   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:48.434911   559 raft_consensus.cc:3055] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:48.435285   559 raft_consensus.cc:740] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6ba2a9c02b534120bbf26e56a1e920ca, State: Running, Role: LEADER
I20260709 13:15:48.436046   559 consensus_queue.cc:260] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:48.437330   559 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:48.445359  7182 ts_tablet_manager.cc:1929] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.14
I20260709 13:15:48.445952  7182 log.cc:1199] T e4bd90dfa0b4483dae082de5ca5e77f0 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-2-root/wals/e4bd90dfa0b4483dae082de5ca5e77f0
I20260709 13:15:48.446753   559 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 17.
I20260709 13:15:48.448076   365 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3c5452210928414da7920e467cc1fbda with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:48.449330   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:48.448925   365 catalog_manager.cc:5028] TS 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): tablet e4bd90dfa0b4483dae082de5ca5e77f0 (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:15:48.449923   484 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:48.452069   617 tablet_service.cc:1558] Processing DeleteTablet for tablet 6316a42e235d497f96a57da84ac62c84 with delete_type TABLET_DATA_TOMBSTONED (TS 50f7c2247be24f3685d7fbca7b6c71e3 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:46830
I20260709 13:15:48.464480   467 tablet_service.cc:1558] Processing DeleteTablet for tablet 9108c5fc44794002b60442bd66404e6c with delete_type TABLET_DATA_TOMBSTONED (TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:59316
I20260709 13:15:48.464066   380 catalog_manager.cc:5697] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 11 to 12, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New cstate: current_term: 15 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:48.449381   597 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:48.476737  7145 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:48.477252  7145 raft_consensus.cc:697] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:48.478169  7145 consensus_queue.cc:237] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:48.478870  7182 tablet_replica.cc:333] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:48.480010  7182 raft_consensus.cc:2243] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:48.481694   545 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c5452210928414da7920e467cc1fbda with delete_type TABLET_DATA_TOMBSTONED (TS 6ba2a9c02b534120bbf26e56a1e920ca not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:45502
I20260709 13:15:48.471061   484 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 17.
I20260709 13:15:48.488600  7182 raft_consensus.cc:2272] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:48.493781  7186 tablet_replica.cc:333] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:48.494305  7184 tablet_replica.cc:333] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:48.495467  7182 ts_tablet_manager.cc:1916] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:48.496598  7184 raft_consensus.cc:2243] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:48.497376  7184 raft_consensus.cc:2272] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:48.499272  7186 raft_consensus.cc:2243] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:48.500023  7186 raft_consensus.cc:2272] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:48.503723  7186 ts_tablet_manager.cc:1916] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:48.504380  7184 ts_tablet_manager.cc:1916] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:48.504314   375 catalog_manager.cc:5697] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 16 to 17, leader changed from 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 17 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:48.513484  7182 ts_tablet_manager.cc:1929] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 23.15
I20260709 13:15:48.514024  7182 log.cc:1199] T 6316a42e235d497f96a57da84ac62c84 P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-2-root/wals/6316a42e235d497f96a57da84ac62c84
I20260709 13:15:48.515779   365 catalog_manager.cc:5028] TS 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): tablet 6316a42e235d497f96a57da84ac62c84 (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:15:48.520274  7186 ts_tablet_manager.cc:1929] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 13:15:48.520709  7186 log.cc:1199] T 3c5452210928414da7920e467cc1fbda P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-1-root/wals/3c5452210928414da7920e467cc1fbda
I20260709 13:15:48.522229   366 catalog_manager.cc:5028] TS 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): tablet 3c5452210928414da7920e467cc1fbda (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:15:48.526343  7184 ts_tablet_manager.cc:1929] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 13:15:48.526794  7184 log.cc:1199] T 9108c5fc44794002b60442bd66404e6c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-0-root/wals/9108c5fc44794002b60442bd66404e6c
I20260709 13:15:48.528328   368 catalog_manager.cc:5028] TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): tablet 9108c5fc44794002b60442bd66404e6c (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:15:48.565981  7154 raft_consensus.cc:993] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:48.566818  7160 raft_consensus.cc:1081] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Signalling peer 50f7c2247be24f3685d7fbca7b6c71e3 to start an election
I20260709 13:15:48.568933   627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
 from {username='slave'} at 127.0.0.1:54256
I20260709 13:15:48.569459   627 raft_consensus.cc:493] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:48.569826   627 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:48.575644   627 raft_consensus.cc:515] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:48.577334   627 leader_election.cc:290] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:48.583065   556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:48.583706   556 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:48.583927   484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f03a9828994cee972e513efbaaea6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:48.584502   484 raft_consensus.cc:3055] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:48.584790   484 raft_consensus.cc:740] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:48.585484   484 consensus_queue.cc:260] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:48.586632   484 raft_consensus.cc:3060] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:48.590476   556 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 17.
I20260709 13:15:48.591727   597 leader_election.cc:304] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:48.592497  7145 raft_consensus.cc:2804] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:48.592981  7145 raft_consensus.cc:697] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:48.593104   484 raft_consensus.cc:2468] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 17.
I20260709 13:15:48.593864  7145 consensus_queue.cc:237] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:48.603881   375 catalog_manager.cc:5697] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 16 to 17, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 17 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:48.794483   556 raft_consensus.cc:1275] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:15:48.797374  7154 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:48.810422   631 raft_consensus.cc:1275] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:15:48.812011  7160 consensus_queue.cc:1048] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:48.895602   475 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:15:48.897317  7157 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:48.914760   556 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:15:48.916327  7145 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:49.071485   475 raft_consensus.cc:1275] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:49.072785  7145 consensus_queue.cc:1048] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:49.084985   559 raft_consensus.cc:1275] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:49.086797  7157 consensus_queue.cc:1048] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:49.211452 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:49.567544   631 consensus_queue.cc:237] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:49.573932   475 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:15:49.574810   556 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:15:49.574898   597 consensus_peers.cc:597] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b20e1b9bdf8473682b642fe0b3c0583. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:49.575490  7133 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:49.576460  7145 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:49.586504  7194 raft_consensus.cc:2955] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:49.589761   559 raft_consensus.cc:2955] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:49.603287   475 raft_consensus.cc:2955] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:49.615406   559 consensus_queue.cc:237] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:49.612999   375 catalog_manager.cc:5697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 13 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:49.623086   631 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:49.625109  7166 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:15:49.629076   523 consensus_peers.cc:597] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 569fc6eae3e44f9db61c22838e11247d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:49.636525  7166 raft_consensus.cc:2955] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:49.651984   475 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:49.653658  7140 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:49.662426   631 consensus_queue.cc:237] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:49.668939   627 raft_consensus.cc:2955] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:49.684561   475 raft_consensus.cc:2955] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:49.691891   484 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:15:49.691984   597 consensus_peers.cc:597] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eaf3f4dcd2994ae4b21fc89b93484482. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:49.693815   559 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:49.693575  7194 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:49.700353  7194 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:49.710572  7145 raft_consensus.cc:2955] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:49.713213   559 raft_consensus.cc:2955] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:49.719521   484 raft_consensus.cc:2955] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:49.731294   559 consensus_queue.cc:237] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:49.733978   378 catalog_manager.cc:5697] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca reported cstate change: config changed from index -1 to 10, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 15 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:49.741133   523 consensus_peers.cc:597] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9140b212cfde4d8d83cbe538fc50d88d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:49.741737   484 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:15:49.741768   627 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:15:49.743971  7140 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:49.745061  7206 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:49.745597   380 catalog_manager.cc:5697] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index -1 to 12, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 17 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:49.760229  7140 raft_consensus.cc:2955] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:49.771948   627 raft_consensus.cc:2955] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:49.774513   475 raft_consensus.cc:2955] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:49.805096   378 catalog_manager.cc:5697] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index -1 to 13, NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) added. New cstate: current_term: 19 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } }
I20260709 13:15:50.118021  7218 ts_tablet_manager.cc:933] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:50.119773  7218 tablet_copy_client.cc:323] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.131:36245
I20260709 13:15:50.121294   642 tablet_copy_service.cc:140] P 50f7c2247be24f3685d7fbca7b6c71e3: Received BeginTabletCopySession request for tablet 7b20e1b9bdf8473682b642fe0b3c0583 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:54754)
I20260709 13:15:50.121770   642 tablet_copy_service.cc:161] P 50f7c2247be24f3685d7fbca7b6c71e3: Beginning new tablet copy session on tablet 7b20e1b9bdf8473682b642fe0b3c0583 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:54754: session id = 6e6df7e8ed204f1db5c371536b5b0683-7b20e1b9bdf8473682b642fe0b3c0583
I20260709 13:15:50.127132   642 tablet_copy_source_session.cc:215] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:50.130532  7218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b20e1b9bdf8473682b642fe0b3c0583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.145191  7218 tablet_copy_client.cc:806] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:50.145766  7218 tablet_copy_client.cc:670] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:50.149603  7218 tablet_copy_client.cc:538] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:50.159005  7218 tablet_bootstrap.cc:492] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:15:50.190441  7220 ts_tablet_manager.cc:933] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:50.196965  7220 tablet_copy_client.cc:323] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.130:41159
I20260709 13:15:50.198644   569 tablet_copy_service.cc:140] P 6ba2a9c02b534120bbf26e56a1e920ca: Received BeginTabletCopySession request for tablet 9140b212cfde4d8d83cbe538fc50d88d from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:43548)
I20260709 13:15:50.199169   569 tablet_copy_service.cc:161] P 6ba2a9c02b534120bbf26e56a1e920ca: Beginning new tablet copy session on tablet 9140b212cfde4d8d83cbe538fc50d88d from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:43548: session id = 6e6df7e8ed204f1db5c371536b5b0683-9140b212cfde4d8d83cbe538fc50d88d
I20260709 13:15:50.200330  7218 tablet_bootstrap.cc:492] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:50.201295  7218 tablet_bootstrap.cc:492] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:15:50.201988  7218 ts_tablet_manager.cc:1403] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.043s	user 0.025s	sys 0.016s
I20260709 13:15:50.205782  7218 raft_consensus.cc:359] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:50.206606  7218 raft_consensus.cc:740] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:15:50.207259  7218 consensus_queue.cc:260] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:50.210479   569 tablet_copy_source_session.cc:215] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:50.212949  7223 ts_tablet_manager.cc:933] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:50.214053  7218 ts_tablet_manager.cc:1434] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:15:50.216871   642 tablet_copy_service.cc:342] P 50f7c2247be24f3685d7fbca7b6c71e3: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-7b20e1b9bdf8473682b642fe0b3c0583 received from {username='slave'} at 127.0.0.1:54754
I20260709 13:15:50.217278   642 tablet_copy_service.cc:434] P 50f7c2247be24f3685d7fbca7b6c71e3: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-7b20e1b9bdf8473682b642fe0b3c0583 on tablet 7b20e1b9bdf8473682b642fe0b3c0583 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:15:50.218022  7223 tablet_copy_client.cc:323] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.130:41159
I20260709 13:15:50.222942  7225 ts_tablet_manager.cc:933] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:50.224310   569 tablet_copy_service.cc:140] P 6ba2a9c02b534120bbf26e56a1e920ca: Received BeginTabletCopySession request for tablet 569fc6eae3e44f9db61c22838e11247d from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:43548)
I20260709 13:15:50.224889   569 tablet_copy_service.cc:161] P 6ba2a9c02b534120bbf26e56a1e920ca: Beginning new tablet copy session on tablet 569fc6eae3e44f9db61c22838e11247d from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:43548: session id = 6e6df7e8ed204f1db5c371536b5b0683-569fc6eae3e44f9db61c22838e11247d
I20260709 13:15:50.225589  7220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9140b212cfde4d8d83cbe538fc50d88d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.232939   569 tablet_copy_source_session.cc:215] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:50.238446  7225 tablet_copy_client.cc:323] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.131:36245
I20260709 13:15:50.241220   642 tablet_copy_service.cc:140] P 50f7c2247be24f3685d7fbca7b6c71e3: Received BeginTabletCopySession request for tablet eaf3f4dcd2994ae4b21fc89b93484482 from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:54754)
I20260709 13:15:50.241768   642 tablet_copy_service.cc:161] P 50f7c2247be24f3685d7fbca7b6c71e3: Beginning new tablet copy session on tablet eaf3f4dcd2994ae4b21fc89b93484482 from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:54754: session id = 6e6df7e8ed204f1db5c371536b5b0683-eaf3f4dcd2994ae4b21fc89b93484482
I20260709 13:15:50.241799  7220 tablet_copy_client.cc:806] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:50.242650  7220 tablet_copy_client.cc:670] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:50.249835  7223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 569fc6eae3e44f9db61c22838e11247d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.250715   642 tablet_copy_source_session.cc:215] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:50.254016  7225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf3f4dcd2994ae4b21fc89b93484482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.257504 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:50.267833  7223 tablet_copy_client.cc:806] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:50.268460  7223 tablet_copy_client.cc:670] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:50.270756  7220 tablet_copy_client.cc:538] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:50.273023  7223 tablet_copy_client.cc:538] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:50.290763  7223 tablet_bootstrap.cc:492] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:15:50.297681  7225 tablet_copy_client.cc:806] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:50.298787  7225 tablet_copy_client.cc:670] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:50.300944  7220 tablet_bootstrap.cc:492] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:15:50.304419  7225 tablet_copy_client.cc:538] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:50.327867  7225 tablet_bootstrap.cc:492] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:15:50.388051  7223 tablet_bootstrap.cc:492] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:50.389086  7223 tablet_bootstrap.cc:492] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:15:50.389770  7223 ts_tablet_manager.cc:1403] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.099s	user 0.035s	sys 0.005s
I20260709 13:15:50.392807  7223 raft_consensus.cc:359] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:50.393630  7223 raft_consensus.cc:740] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:15:50.394273  7223 consensus_queue.cc:260] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:50.397389  7223 ts_tablet_manager.cc:1434] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.002s
I20260709 13:15:50.403915   569 tablet_copy_service.cc:342] P 6ba2a9c02b534120bbf26e56a1e920ca: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-569fc6eae3e44f9db61c22838e11247d received from {username='slave'} at 127.0.0.1:43548
I20260709 13:15:50.404383   569 tablet_copy_service.cc:434] P 6ba2a9c02b534120bbf26e56a1e920ca: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-569fc6eae3e44f9db61c22838e11247d on tablet 569fc6eae3e44f9db61c22838e11247d with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:15:50.416318  7220 tablet_bootstrap.cc:492] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:50.417346  7220 tablet_bootstrap.cc:492] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:15:50.418013  7220 ts_tablet_manager.cc:1403] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.117s	user 0.030s	sys 0.016s
I20260709 13:15:50.420785  7225 tablet_bootstrap.cc:492] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:50.420998  7220 raft_consensus.cc:359] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:50.422044  7225 tablet_bootstrap.cc:492] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:15:50.422138  7220 raft_consensus.cc:740] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:15:50.423090  7220 consensus_queue.cc:260] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:50.426596  7220 ts_tablet_manager.cc:1434] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 13:15:50.433925  7225 ts_tablet_manager.cc:1403] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.106s	user 0.034s	sys 0.013s
I20260709 13:15:50.434593   475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
mode: GRACEFUL
new_leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:59582
I20260709 13:15:50.435168   475 raft_consensus.cc:606] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Received request to transfer leadership to TS 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:15:50.437781  7225 raft_consensus.cc:359] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:50.438630  7225 raft_consensus.cc:740] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:15:50.438747   627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c5452210928414da7920e467cc1fbda"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:15:50.439414   627 raft_consensus.cc:606] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Received request to transfer leadership to TS 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:15:50.439356  7225 consensus_queue.cc:260] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:50.441627  7225 ts_tablet_manager.cc:1434] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:50.446566   642 tablet_copy_service.cc:342] P 50f7c2247be24f3685d7fbca7b6c71e3: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-eaf3f4dcd2994ae4b21fc89b93484482 received from {username='slave'} at 127.0.0.1:54754
I20260709 13:15:50.446997   642 tablet_copy_service.cc:434] P 50f7c2247be24f3685d7fbca7b6c71e3: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-eaf3f4dcd2994ae4b21fc89b93484482 on tablet eaf3f4dcd2994ae4b21fc89b93484482 with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:15:50.449805   627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fc289132926446d9594150727e08b0b"
dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
mode: GRACEFUL
new_leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:58994
I20260709 13:15:50.450735   627 raft_consensus.cc:606] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Received request to transfer leadership to TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:50.454792 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:50.457134 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:15:50.458365  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 46294us
I20260709 13:15:50.465183   569 tablet_copy_service.cc:342] P 6ba2a9c02b534120bbf26e56a1e920ca: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-9140b212cfde4d8d83cbe538fc50d88d received from {username='slave'} at 127.0.0.1:43548
I20260709 13:15:50.465605   569 tablet_copy_service.cc:434] P 6ba2a9c02b534120bbf26e56a1e920ca: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-9140b212cfde4d8d83cbe538fc50d88d on tablet 9140b212cfde4d8d83cbe538fc50d88d with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:15:50.604586  7145 raft_consensus.cc:993] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:50.604501  1168 raft_consensus.cc:1217] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.12->[19.13-19.13]   Dedup: 19.13->[]
I20260709 13:15:50.605105  7145 raft_consensus.cc:1081] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Signalling peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 to start an election
I20260709 13:15:50.612696   475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fc289132926446d9594150727e08b0b"
dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
 from {username='slave'} at 127.0.0.1:38132
I20260709 13:15:50.613325   475 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:50.613694   475 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:50.620657   475 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:50.623881   475 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 18 election: Requested vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:50.624590   559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "6ba2a9c02b534120bbf26e56a1e920ca"
I20260709 13:15:50.625221   559 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:50.627370   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc289132926446d9594150727e08b0b" candidate_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:50.627956   629 raft_consensus.cc:3055] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:50.628269   629 raft_consensus.cc:740] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:50.628968   629 consensus_queue.cc:260] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:50.630154   629 raft_consensus.cc:3060] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:50.631188   559 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 18.
I20260709 13:15:50.632306   448 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca; no voters: 
I20260709 13:15:50.632959  7160 raft_consensus.cc:2804] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:50.633407  7160 raft_consensus.cc:697] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 LEADER]: Becoming Leader. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:50.634379  7160 consensus_queue.cc:237] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:50.636699   629 raft_consensus.cc:2468] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6f5b2f91e54c8c95f7b19c1b9ecee2 in term 18.
I20260709 13:15:50.644277   380 catalog_manager.cc:5697] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: term changed from 17 to 18, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129). New cstate: current_term: 18 leader_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:50.673295  1168 raft_consensus.cc:1217] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.11->[17.12-17.12]   Dedup: 17.12->[]
I20260709 13:15:50.684262  1168 raft_consensus.cc:1217] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 13:15:50.688532  1168 raft_consensus.cc:1217] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 13:15:50.729259  7133 raft_consensus.cc:993] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3: : Instructing follower 6e6df7e8ed204f1db5c371536b5b0683 to start an election
I20260709 13:15:50.729799  7133 raft_consensus.cc:1081] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Signalling peer 6e6df7e8ed204f1db5c371536b5b0683 to start an election
I20260709 13:15:50.731775  1169 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c5452210928414da7920e467cc1fbda"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:36732
I20260709 13:15:50.732558  1169 raft_consensus.cc:493] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:50.732954  1169 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:50.740392  1169 raft_consensus.cc:515] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:50.743530   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:50.746258   475 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:50.752386   475 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 16.
I20260709 13:15:50.752751   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5452210928414da7920e467cc1fbda" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:50.753476  1169 leader_election.cc:290] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:50.753545   629 raft_consensus.cc:3055] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:50.753587  1141 leader_election.cc:304] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:15:50.754643  7232 raft_consensus.cc:2804] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:50.754261   629 raft_consensus.cc:740] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:50.755223  7232 raft_consensus.cc:697] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:15:50.755962   629 consensus_queue.cc:260] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:50.756258  7232 consensus_queue.cc:237] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:50.756934   629 raft_consensus.cc:3060] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:50.763339   629 raft_consensus.cc:2468] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 16.
I20260709 13:15:50.772136   375 catalog_manager.cc:5697] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 15 to 16, leader changed from 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 16 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:50.794896  7160 raft_consensus.cc:993] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: : Instructing follower 6e6df7e8ed204f1db5c371536b5b0683 to start an election
I20260709 13:15:50.795449  7144 raft_consensus.cc:1081] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Signalling peer 6e6df7e8ed204f1db5c371536b5b0683 to start an election
I20260709 13:15:50.797161  1169 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb"
dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
 from {username='slave'} at 127.0.0.1:36742
I20260709 13:15:50.797696  1169 raft_consensus.cc:493] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:50.798125  1169 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:50.806039  1169 raft_consensus.cc:515] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:50.809643  1169 leader_election.cc:290] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:50.810391   475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: true dest_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2"
I20260709 13:15:50.811101   475 raft_consensus.cc:3055] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:50.811734   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18dea61d0790411c88602b2cfc2fbcdb" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: true dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:50.812281   629 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:50.814282   475 raft_consensus.cc:740] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, State: Running, Role: LEADER
I20260709 13:15:50.815106   475 consensus_queue.cc:260] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:50.816277   475 raft_consensus.cc:3060] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:50.818993   629 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 16.
I20260709 13:15:50.820291  1138 leader_election.cc:304] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:15:50.821393  7232 raft_consensus.cc:2804] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:50.822836  7232 raft_consensus.cc:697] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:15:50.823683  7232 consensus_queue.cc:237] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:50.824911   475 raft_consensus.cc:2468] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 16.
I20260709 13:15:50.843138   375 catalog_manager.cc:5697] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 15 to 16, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 16 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:50.986325  7140 raft_consensus.cc:1064] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:15:50.989038  7140 consensus_queue.cc:237] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:50.995296   627 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:15:50.995522  1168 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683 [term 19 LEARNER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:15:50.996981  7234 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:15:50.998127   484 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:15:50.998977  7235 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:15:51.000315  7234 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:15:51.017390  7234 raft_consensus.cc:2955] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.019726   484 raft_consensus.cc:2955] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.024348  1168 raft_consensus.cc:2955] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.030141   627 raft_consensus.cc:2955] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.043440   375 catalog_manager.cc:5697] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 reported cstate change: config changed from index 13 to 14, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.065815   559 consensus_queue.cc:237] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:51.074391   627 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:15:51.077080  1168 raft_consensus.cc:1275] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683 [term 19 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:15:51.079135  7140 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:15:51.080296  7206 consensus_queue.cc:1048] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:15:51.087370  7206 raft_consensus.cc:2955] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.090016   627 raft_consensus.cc:2955] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.092159  1168 raft_consensus.cc:2955] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.099427   366 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9140b212cfde4d8d83cbe538fc50d88d with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:51.105445   375 catalog_manager.cc:5697] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 14 to 15, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New cstate: current_term: 19 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.123715   467 tablet_service.cc:1558] Processing DeleteTablet for tablet 9140b212cfde4d8d83cbe538fc50d88d with delete_type TABLET_DATA_TOMBSTONED (TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:59316
I20260709 13:15:51.126959   559 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:15:51.129181  7144 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:51.132874  7246 tablet_replica.cc:333] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:51.134234  7246 raft_consensus.cc:2243] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:51.135931  7246 raft_consensus.cc:2272] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:51.140282  7246 ts_tablet_manager.cc:1916] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:51.157825  7235 raft_consensus.cc:1064] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:15:51.160816  7235 consensus_queue.cc:237] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:51.165910   627 raft_consensus.cc:1275] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Refusing update from remote peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:15:51.167435  7160 consensus_queue.cc:1048] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:51.175277   484 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:15:51.176781  7232 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:51.206336  7233 raft_consensus.cc:1064] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:15:51.209195  7233 consensus_queue.cc:237] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:51.223220  7246 ts_tablet_manager.cc:1929] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.14
I20260709 13:15:51.228451  7246 log.cc:1199] T 9140b212cfde4d8d83cbe538fc50d88d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-0-root/wals/9140b212cfde4d8d83cbe538fc50d88d
I20260709 13:15:51.230937   368 catalog_manager.cc:5028] TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): tablet 9140b212cfde4d8d83cbe538fc50d88d (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
W20260709 13:15:51.248817   523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:39939, user_credentials={real_user=slave}} blocked reactor thread for 44681.3us
I20260709 13:15:51.262389   481 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:15:51.264183  7198 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:15:51.268625  1169 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEARNER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:51.278555   631 raft_consensus.cc:1275] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:15:51.280195  7257 consensus_queue.cc:1048] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:51.254639  7133 raft_consensus.cc:1064] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3: attempting to promote NON_VOTER 6e6df7e8ed204f1db5c371536b5b0683 to VOTER
I20260709 13:15:51.302223  7133 consensus_queue.cc:237] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:51.312137   484 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:51.311548   629 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:51.313866  7140 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:51.320147  7140 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:51.334591  1172 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 LEARNER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:51.339428   478 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:51.336491   555 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:51.344050   631 raft_consensus.cc:1275] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:15:51.345409  7232 consensus_queue.cc:1048] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:15:51.345896  7256 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:51.352490  7260 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:51.358407  7145 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:51.391266  7140 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:51.405267  7145 raft_consensus.cc:2955] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:15:51.420642   448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:41159, user_credentials={real_user=slave}} blocked reactor thread for 148430us
I20260709 13:15:51.413725   555 raft_consensus.cc:2955] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.458823 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:51.462872  1172 raft_consensus.cc:2955] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:15:51.475811   447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 134332us
I20260709 13:15:51.524500  7235 raft_consensus.cc:2955] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.524837   378 catalog_manager.cc:5697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.527186   629 raft_consensus.cc:2955] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.545595  1172 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 LEARNER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:51.547381  7275 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:51.551687   555 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:51.555585  7275 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:51.555625  1169 raft_consensus.cc:2955] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.586104   482 raft_consensus.cc:2955] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.610131   380 catalog_manager.cc:5697] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } attrs { replace: true } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.611501   484 raft_consensus.cc:2955] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } attrs { replace: true } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.628190  7133 raft_consensus.cc:2955] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.626176   482 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:51.633167  1169 raft_consensus.cc:2955] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.639927  7256 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:51.645569   555 consensus_queue.cc:237] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:51.654692   627 consensus_queue.cc:237] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:51.660586   478 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:51.662046  1172 raft_consensus.cc:1275] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:15:51.662758  1168 raft_consensus.cc:1275] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Refusing update from remote peer 6ba2a9c02b534120bbf26e56a1e920ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:51.663758  7275 consensus_queue.cc:1048] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 1
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:15:51.668606 31814 tablet_server.cc:179] TabletServer@127.31.17.129:0 shutting down...
I20260709 13:15:51.680208  7256 raft_consensus.cc:2955] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.683816  1172 raft_consensus.cc:2955] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.687388   555 raft_consensus.cc:2955] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.662057  7235 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:15:51.692868  7206 consensus_queue.cc:1048] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:15:51.698953  1141 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:51.696305   375 catalog_manager.cc:5697] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 12 to 13, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.751276  7234 raft_consensus.cc:2955] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:15:51.771384   525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 66337.3us
I20260709 13:15:51.771657   375 catalog_manager.cc:5697] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 11 to 12, VOTER 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130) evicted. New cstate: current_term: 13 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.745644  1168 raft_consensus.cc:2955] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.775560   482 raft_consensus.cc:2955] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:15:51.834120  1141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 135177us
W20260709 13:15:51.835616   599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:45711, user_credentials={real_user=slave}} blocked reactor thread for 99309.6us
I20260709 13:15:51.843853   365 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7b20e1b9bdf8473682b642fe0b3c0583 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:51.849550   627 consensus_queue.cc:237] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:51.860693   556 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:15:51.862286  7256 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:15:51.863744  1168 raft_consensus.cc:1275] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:15:51.867344   525 consensus_peers.cc:597] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:51.867935   525 consensus_peers.cc:597] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:51.869040   525 consensus_peers.cc:597] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:51.871038   381 catalog_manager.cc:5697] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: config changed from index 11 to 12, VOTER 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131) evicted. New cstate: current_term: 15 leader_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:15:51.889282   599 consensus_peers.cc:597] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:51.888547  7256 consensus_queue.cc:1048] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
W20260709 13:15:51.898743   522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:36245, user_credentials={real_user=slave}} blocked reactor thread for 88346.1us
W20260709 13:15:51.902530   599 consensus_peers.cc:597] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:51.903802   525 consensus_peers.cc:597] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:51.905778  7275 raft_consensus.cc:2955] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:15:51.910655  1141 consensus_peers.cc:597] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:51.903205   599 consensus_peers.cc:597] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:51.916453   599 consensus_peers.cc:597] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:51.917095   599 consensus_peers.cc:597] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:51.917639   599 consensus_peers.cc:597] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:51.926229   617 tablet_service.cc:1558] Processing DeleteTablet for tablet 569fc6eae3e44f9db61c22838e11247d with delete_type TABLET_DATA_TOMBSTONED (TS 50f7c2247be24f3685d7fbca7b6c71e3 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:46830
I20260709 13:15:51.925892   556 raft_consensus.cc:2955] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
I20260709 13:15:51.934984   366 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 569fc6eae3e44f9db61c22838e11247d with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:51.937927   545 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b20e1b9bdf8473682b642fe0b3c0583 with delete_type TABLET_DATA_TOMBSTONED (TS 6ba2a9c02b534120bbf26e56a1e920ca not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:45502
I20260709 13:15:51.941015  1168 raft_consensus.cc:2955] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } } }
W20260709 13:15:51.936216  1141 consensus_peers.cc:597] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:51.953037  1141 consensus_peers.cc:597] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:51.953609  1141 consensus_peers.cc:597] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:51.954121  1141 consensus_peers.cc:597] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:51.954599  1141 consensus_peers.cc:597] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:51.967922   365 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eaf3f4dcd2994ae4b21fc89b93484482 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:51.968830   381 catalog_manager.cc:5697] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: config changed from index 13 to 14, VOTER 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) evicted. New cstate: current_term: 17 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:51.976873  1141 consensus_peers.cc:597] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:51.977422   599 consensus_peers.cc:597] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.015590  7285 tablet_replica.cc:333] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:52.017045  7285 raft_consensus.cc:2243] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.019767  7284 tablet_replica.cc:333] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:52.021211  7284 raft_consensus.cc:2243] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.022136  7284 raft_consensus.cc:2272] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.023167  7285 raft_consensus.cc:2272] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.030066  7284 ts_tablet_manager.cc:1916] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:15:52.031507   525 consensus_peers.cc:597] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.030484  7285 ts_tablet_manager.cc:1916] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:15:52.033259   599 consensus_peers.cc:597] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.034757 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:52.036511 31814 tablet_replica.cc:333] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.037613 31814 raft_consensus.cc:2243] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.039845 31814 raft_consensus.cc:2272] T ac7da405058744b49aee8b0adbc78189 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.042738 31814 tablet_replica.cc:333] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.043648 31814 raft_consensus.cc:2243] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.044327 31814 raft_consensus.cc:2272] T d2131bd04d2d4f3da62d75b100a2aecd P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.047077 31814 tablet_replica.cc:333] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.047924 31814 raft_consensus.cc:2243] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.048578 31814 raft_consensus.cc:2272] T 6316a42e235d497f96a57da84ac62c84 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.051026 31814 tablet_replica.cc:333] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.051867 31814 raft_consensus.cc:2243] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.052484 31814 raft_consensus.cc:2272] T 569fc6eae3e44f9db61c22838e11247d P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:52.053215   525 consensus_peers.cc:597] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:52.053470   368 catalog_manager.cc:4755] TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet eaf3f4dcd2994ae4b21fc89b93484482: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:15:52.055341  7284 ts_tablet_manager.cc:1929] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 13:15:52.055568 31814 tablet_replica.cc:333] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.055855  7284 log.cc:1199] T 569fc6eae3e44f9db61c22838e11247d P 50f7c2247be24f3685d7fbca7b6c71e3: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-2-root/wals/569fc6eae3e44f9db61c22838e11247d
I20260709 13:15:52.056459 31814 raft_consensus.cc:2243] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.056983 31814 raft_consensus.cc:2272] T 093a5bf347e94e52af24456f0631abe3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.057482   365 catalog_manager.cc:5028] TS 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): tablet 569fc6eae3e44f9db61c22838e11247d (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:15:52.059048 31814 tablet_replica.cc:333] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.059442  7285 ts_tablet_manager.cc:1929] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 13:15:52.059808  7285 log.cc:1199] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6ba2a9c02b534120bbf26e56a1e920ca: Deleting WAL directory at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0/minicluster-data/ts-1-root/wals/7b20e1b9bdf8473682b642fe0b3c0583
I20260709 13:15:52.059804 31814 raft_consensus.cc:2243] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.060667 31814 raft_consensus.cc:2272] T 70cfcc65b0e14d6cb141bc839a21b558 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.061527   366 catalog_manager.cc:5028] TS 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): tablet 7b20e1b9bdf8473682b642fe0b3c0583 (table test-workload [id=9d0c23c9b9af4c1bbe1f3b7f7ef803fb]) successfully deleted
I20260709 13:15:52.062781 31814 tablet_replica.cc:333] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.063500 31814 raft_consensus.cc:2243] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:15:52.064277 31814 raft_consensus.cc:2272] T 372575938bbf471c935e1b39ba9e588f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.066895 31814 tablet_replica.cc:333] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.067619 31814 raft_consensus.cc:2243] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:15:52.068642  1141 consensus_peers.cc:597] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.068642 31814 raft_consensus.cc:2272] T b1c23e2e725f4945b79fe36fc271ccc2 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.070927 31814 tablet_replica.cc:333] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.071553 31814 raft_consensus.cc:2243] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.072106 31814 raft_consensus.cc:2272] T 727ef43c64e147b3889a02b94ab53253 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.074497 31814 tablet_replica.cc:333] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.075282 31814 raft_consensus.cc:2243] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.075906 31814 raft_consensus.cc:2272] T 049523b511884708bc0ac5adea131bc6 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.079713 31814 tablet_replica.cc:333] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.080438 31814 raft_consensus.cc:2243] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.080946 31814 raft_consensus.cc:2272] T 18dea61d0790411c88602b2cfc2fbcdb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:52.083106   599 consensus_peers.cc:597] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.084070 31814 tablet_replica.cc:333] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.084931 31814 raft_consensus.cc:2243] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.085448 31814 raft_consensus.cc:2272] T 5436dcd825914fdca953dd01eb60ec88 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.087894 31814 tablet_replica.cc:333] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.088841 31814 raft_consensus.cc:2243] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.089493 31814 raft_consensus.cc:2272] T cb12c292ec5d439b896dcc135d266150 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.091742 31814 tablet_replica.cc:333] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.092372 31814 raft_consensus.cc:2243] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.092819 31814 raft_consensus.cc:2272] T 54372ad9508c44d2824f4810f03a5081 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.094822 31814 tablet_replica.cc:333] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.095587 31814 raft_consensus.cc:2243] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.096119 31814 raft_consensus.cc:2272] T 4ac2ec9819fa4c2193431a046e90dd6e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.099098 31814 tablet_replica.cc:333] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.100121 31814 raft_consensus.cc:2243] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:15:52.101208 31814 raft_consensus.cc:2272] T b5fe583d0f84434a92093dc2407b787f P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:52.103278   525 consensus_peers.cc:597] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.104182 31814 tablet_replica.cc:333] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.104948 31814 raft_consensus.cc:2243] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.105439 31814 raft_consensus.cc:2272] T 44f95c82063d490481f1c94cc64f7311 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.107869 31814 tablet_replica.cc:333] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.108702 31814 raft_consensus.cc:2243] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.109179 31814 raft_consensus.cc:2272] T 99b1684e65e840ce8bcb13346b86d204 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.111613 31814 tablet_replica.cc:333] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.112277 31814 raft_consensus.cc:2243] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:15:52.113108 31814 raft_consensus.cc:2272] T dbb5b767a04141fab4e7259cec37f6d7 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.115590 31814 tablet_replica.cc:333] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.116380 31814 raft_consensus.cc:2243] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:15:52.117434 31814 raft_consensus.cc:2272] T df062554d8014455b179c819406964fb P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.119807 31814 tablet_replica.cc:333] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.120579 31814 raft_consensus.cc:2243] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.121160 31814 raft_consensus.cc:2272] T 5153b5ac109e49b78fd24ec7f42e3c8e P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.123900 31814 tablet_replica.cc:333] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.124693 31814 raft_consensus.cc:2243] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:15:52.125761 31814 raft_consensus.cc:2272] T 82382f158074497a857b03f9f87f9e86 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:52.127116   525 consensus_peers.cc:597] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.127961 31814 tablet_replica.cc:333] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.128643 31814 raft_consensus.cc:2243] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:15:52.129544 31814 raft_consensus.cc:2272] T 0a36746135a640a4916e9d4d974ce2b3 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.131434 31814 tablet_replica.cc:333] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.131989 31814 raft_consensus.cc:2243] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.132496 31814 raft_consensus.cc:2272] T d37a8f9254954f1f9db70e23a26e512b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.134287 31814 tablet_replica.cc:333] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.134928 31814 raft_consensus.cc:2243] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.135437 31814 raft_consensus.cc:2272] T e4bd90dfa0b4483dae082de5ca5e77f0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.137554 31814 tablet_replica.cc:333] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.138239 31814 raft_consensus.cc:2243] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:15:52.139038 31814 raft_consensus.cc:2272] T 0ea38de651624cd48fa0e7a5a85467d5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:52.139894  1141 consensus_peers.cc:597] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.141297 31814 tablet_replica.cc:333] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.141921 31814 raft_consensus.cc:2243] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:15:52.142762 31814 raft_consensus.cc:2272] T 6fc289132926446d9594150727e08b0b P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.145308 31814 tablet_replica.cc:333] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.146095 31814 raft_consensus.cc:2243] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.146690 31814 raft_consensus.cc:2272] T 304d1b96642140f19543be15d23a061c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.149415 31814 tablet_replica.cc:333] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.150132 31814 raft_consensus.cc:2243] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.150712 31814 raft_consensus.cc:2272] T eaf3f4dcd2994ae4b21fc89b93484482 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.153692 31814 tablet_replica.cc:333] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.154515 31814 raft_consensus.cc:2243] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.155143 31814 raft_consensus.cc:2272] T 578ce25d78a849989220d2a8dcb91233 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.157968 31814 tablet_replica.cc:333] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.158674 31814 raft_consensus.cc:2243] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:15:52.159616 31814 raft_consensus.cc:2272] T 1e103c8f4a7e48599f7b9bb07071e6cc P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.161901 31814 tablet_replica.cc:333] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.162472 31814 raft_consensus.cc:2243] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.162997 31814 raft_consensus.cc:2272] T 596735598d7c4404a9c62f5a3a6c475c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.164882 31814 tablet_replica.cc:333] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.165537 31814 raft_consensus.cc:2243] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.166082 31814 raft_consensus.cc:2272] T 3253e2dfadea481ea66147319ece61c5 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.168565 31814 tablet_replica.cc:333] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.169420 31814 raft_consensus.cc:2243] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.169888 31814 raft_consensus.cc:2272] T 3c5452210928414da7920e467cc1fbda P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.172235 31814 tablet_replica.cc:333] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.172786 31814 raft_consensus.cc:2243] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.173753 31814 raft_consensus.cc:2272] T 9ade492740624caba667436aa666025c P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:52.175323   525 consensus_peers.cc:597] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.176102 31814 tablet_replica.cc:333] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.176687 31814 raft_consensus.cc:2243] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.177147 31814 raft_consensus.cc:2272] T f221a3b77aba453e80c06e1de30b76aa P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.179677 31814 tablet_replica.cc:333] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.180405 31814 raft_consensus.cc:2243] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:15:52.182691   599 consensus_peers.cc:597] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.183164 31814 raft_consensus.cc:2272] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.185940 31814 tablet_replica.cc:333] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.186691 31814 raft_consensus.cc:2243] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.187158 31814 raft_consensus.cc:2272] T 72b49b729462465a98ad914bf7ba3c10 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.189311 31814 tablet_replica.cc:333] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.189852 31814 raft_consensus.cc:2243] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:15:52.190598 31814 raft_consensus.cc:2272] T 227b93e1b31e4b058d5ec1fc69bd6849 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.192883 31814 tablet_replica.cc:333] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.193609 31814 raft_consensus.cc:2243] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:15:52.194640 31814 raft_consensus.cc:2272] T 658ec34f01e349a4b86604b64fb8b9be P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.197263 31814 tablet_replica.cc:333] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.197925 31814 raft_consensus.cc:2243] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:15:52.198835 31814 raft_consensus.cc:2272] T ef98285de93a4829880e7892e2b03e6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.201403 31814 tablet_replica.cc:333] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.202112 31814 raft_consensus.cc:2243] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.202729 31814 raft_consensus.cc:2272] T 7b20e1b9bdf8473682b642fe0b3c0583 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.206015 31814 tablet_replica.cc:333] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.206707 31814 raft_consensus.cc:2243] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:15:52.207757 31814 raft_consensus.cc:2272] T 62cb9f12275c47c4989d775511376bdf P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:52.209076  1141 consensus_peers.cc:597] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.210372 31814 tablet_replica.cc:333] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.211102 31814 raft_consensus.cc:2243] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:15:52.212105 31814 raft_consensus.cc:2272] T ad6d1c43240c46d49621e3a2fb49b972 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.214547 31814 tablet_replica.cc:333] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.215180 31814 raft_consensus.cc:2243] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.215701 31814 raft_consensus.cc:2272] T 67e346d318734aba97a45543ff4ad474 P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.218211 31814 tablet_replica.cc:333] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2: stopping tablet replica
I20260709 13:15:52.218861 31814 raft_consensus.cc:2243] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.226902 31814 raft_consensus.cc:2272] T 15f03a9828994cee972e513efbaaea6a P 3d6f5b2f91e54c8c95f7b19c1b9ecee2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.852721 31814 tablet_server.cc:196] TabletServer@127.31.17.129:0 shutdown complete.
I20260709 13:15:52.942628 31814 tablet_server.cc:179] TabletServer@127.31.17.130:0 shutting down...
W20260709 13:15:52.964998   597 consensus_peers.cc:597] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:52.976157   597 consensus_peers.cc:597] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.990935 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:52.992019 31814 tablet_replica.cc:333] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:52.993016 31814 raft_consensus.cc:2243] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.993736 31814 raft_consensus.cc:2272] T ac7da405058744b49aee8b0adbc78189 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.996381 31814 tablet_replica.cc:333] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:52.997116 31814 raft_consensus.cc:2243] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:15:52.998183 31814 raft_consensus.cc:2272] T 569fc6eae3e44f9db61c22838e11247d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:52.999782   597 consensus_peers.cc:597] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:53.000684 31814 tablet_replica.cc:333] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.001355 31814 raft_consensus.cc:2243] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:15:53.002349 31814 raft_consensus.cc:2272] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.005002 31814 tablet_replica.cc:333] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.005693 31814 raft_consensus.cc:2243] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:15:53.006624 31814 raft_consensus.cc:2272] T 6316a42e235d497f96a57da84ac62c84 P 6ba2a9c02b534120bbf26e56a1e920ca [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.008587 31814 tablet_replica.cc:333] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.009173 31814 raft_consensus.cc:2243] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:15:53.009936 31814 raft_consensus.cc:2272] T 093a5bf347e94e52af24456f0631abe3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.011963 31814 tablet_replica.cc:333] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.012555 31814 raft_consensus.cc:2243] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.013054 31814 raft_consensus.cc:2272] T d2131bd04d2d4f3da62d75b100a2aecd P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.015542 31814 tablet_replica.cc:333] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.016278 31814 raft_consensus.cc:2243] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:15:53.017258 31814 raft_consensus.cc:2272] T 9b7fddd60ae54606847dc6f4111a7e30 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:53.019070  1139 consensus_peers.cc:597] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:53.019970 31814 tablet_replica.cc:333] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.020952 31814 raft_consensus.cc:2243] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.021652 31814 raft_consensus.cc:2272] T b1c23e2e725f4945b79fe36fc271ccc2 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.024340 31814 tablet_replica.cc:333] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.025141 31814 raft_consensus.cc:2243] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:15:53.026086 31814 raft_consensus.cc:2272] T 9140b212cfde4d8d83cbe538fc50d88d P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.028596 31814 tablet_replica.cc:333] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.029377 31814 raft_consensus.cc:2243] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.029937 31814 raft_consensus.cc:2272] T 62cb9f12275c47c4989d775511376bdf P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.032688 31814 tablet_replica.cc:333] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.033324 31814 raft_consensus.cc:2243] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.033813 31814 raft_consensus.cc:2272] T 372575938bbf471c935e1b39ba9e588f P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.035661 31814 tablet_replica.cc:333] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.036195 31814 raft_consensus.cc:2243] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:15:53.037110 31814 raft_consensus.cc:2272] T 727ef43c64e147b3889a02b94ab53253 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.038792 31814 tablet_replica.cc:333] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.039381 31814 raft_consensus.cc:2243] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.039852 31814 raft_consensus.cc:2272] T 12805530d9a3471aa3d5b4c086cc454a P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.042295 31814 tablet_replica.cc:333] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.043030 31814 raft_consensus.cc:2243] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:15:53.044127 31814 raft_consensus.cc:2272] T 049523b511884708bc0ac5adea131bc6 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:53.044220   597 consensus_peers.cc:597] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:53.046686 31814 tablet_replica.cc:333] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.047538 31814 raft_consensus.cc:2243] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.048115 31814 raft_consensus.cc:2272] T b6c11587863a4a73ae8fca1c867e545d P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.050586 31814 tablet_replica.cc:333] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.051571 31814 raft_consensus.cc:2243] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:53.051776  1139 consensus_peers.cc:597] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:53.052268 31814 raft_consensus.cc:2272] T 4ac2ec9819fa4c2193431a046e90dd6e P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.054620 31814 tablet_replica.cc:333] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.055188 31814 raft_consensus.cc:2243] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.055691 31814 raft_consensus.cc:2272] T b5fe583d0f84434a92093dc2407b787f P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.058013 31814 tablet_replica.cc:333] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.058633 31814 raft_consensus.cc:2243] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:15:53.059664 31814 raft_consensus.cc:2272] T 5436dcd825914fdca953dd01eb60ec88 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.061956 31814 tablet_replica.cc:333] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.062492 31814 raft_consensus.cc:2243] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.063217 31814 raft_consensus.cc:2272] T cb12c292ec5d439b896dcc135d266150 P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.065045 31814 tablet_replica.cc:333] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.065536 31814 raft_consensus.cc:2243] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.065996 31814 raft_consensus.cc:2272] T 54372ad9508c44d2824f4810f03a5081 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.067445  7287 raft_consensus.cc:493] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.068076 31814 tablet_replica.cc:333] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.068022  7287 raft_consensus.cc:515] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:53.068785 31814 raft_consensus.cc:2243] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:15:53.069674 31814 raft_consensus.cc:2272] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.072124 31814 tablet_replica.cc:333] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.072853 31814 raft_consensus.cc:2243] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.073668 31814 raft_consensus.cc:2272] T ec13b3c82acf4ef9a2eb79441f61a80d P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:53.074179   597 leader_election.cc:336] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:53.076242 31814 tablet_replica.cc:333] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
W20260709 13:15:53.076718   599 leader_election.cc:336] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:53.077042 31814 raft_consensus.cc:2243] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.078184   599 leader_election.cc:304] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:53.078473 31814 raft_consensus.cc:2272] T 44f95c82063d490481f1c94cc64f7311 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.079067  7275 raft_consensus.cc:2749] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:53.081110 31814 tablet_replica.cc:333] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
W20260709 13:15:53.081254  1139 consensus_peers.cc:597] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:53.070154  7287 leader_election.cc:290] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:15:53.077798   597 consensus_peers.cc:597] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:53.082425 31814 raft_consensus.cc:2243] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.083027 31814 raft_consensus.cc:2272] T 82382f158074497a857b03f9f87f9e86 P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.085605 31814 tablet_replica.cc:333] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.086344 31814 raft_consensus.cc:2243] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.086894 31814 raft_consensus.cc:2272] T 0a36746135a640a4916e9d4d974ce2b3 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:53.087409  1139 consensus_peers.cc:597] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:53.089321 31814 tablet_replica.cc:333] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.090093 31814 raft_consensus.cc:2243] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.090636 31814 raft_consensus.cc:2272] T df062554d8014455b179c819406964fb P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.093044 31814 tablet_replica.cc:333] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
W20260709 13:15:53.093274   597 consensus_peers.cc:597] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:53.093735 31814 raft_consensus.cc:2243] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:15:53.094694 31814 raft_consensus.cc:2272] T c192fb76f82248d78ddc2aac1d721cd9 P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.096920 31814 tablet_replica.cc:333] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.097671 31814 raft_consensus.cc:2243] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.098186 31814 raft_consensus.cc:2272] T d74f5d3a02ed490499ba666721531edc P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:53.099164   429 auto_rebalancer.cc:629] Failed to schedule move for tablet 62cb9f12275c47c4989d775511376bdf: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:53.100544 31814 tablet_replica.cc:333] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.101240 31814 raft_consensus.cc:2243] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.101675 31814 raft_consensus.cc:2272] T 0ea38de651624cd48fa0e7a5a85467d5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:53.102716   429 auto_rebalancer.cc:629] Failed to schedule move for tablet df062554d8014455b179c819406964fb: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:53.103705 31814 tablet_replica.cc:333] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.104435 31814 raft_consensus.cc:2243] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.105026 31814 raft_consensus.cc:2272] T 99b1684e65e840ce8bcb13346b86d204 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.107369 31814 tablet_replica.cc:333] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.107390   629 consensus_queue.cc:237] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:53.108186 31814 raft_consensus.cc:2243] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:15:53.109202 31814 raft_consensus.cc:2272] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.111694 31814 tablet_replica.cc:333] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.112519 31814 raft_consensus.cc:2243] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:15:53.113554 31814 raft_consensus.cc:2272] T 01c3584d0546405ca79fa6b68e7468ec P 6ba2a9c02b534120bbf26e56a1e920ca [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:53.114828   597 consensus_peers.cc:597] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939): Couldn't send request to peer 6e6df7e8ed204f1db5c371536b5b0683. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ac2ec9819fa4c2193431a046e90dd6e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:53.116169 31814 tablet_replica.cc:333] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
W20260709 13:15:53.116442   597 consensus_peers.cc:597] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:53.117013 31814 raft_consensus.cc:2243] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.117552 31814 raft_consensus.cc:2272] T 6fc289132926446d9594150727e08b0b P 6ba2a9c02b534120bbf26e56a1e920ca [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:53.118350   599 consensus_peers.cc:597] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:53.119609 31814 tablet_replica.cc:333] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.120128 31814 raft_consensus.cc:2243] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.120798 31814 raft_consensus.cc:2272] T 9108c5fc44794002b60442bd66404e6c P 6ba2a9c02b534120bbf26e56a1e920ca [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.122668 31814 tablet_replica.cc:333] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.123318 31814 raft_consensus.cc:2243] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.123965 31814 raft_consensus.cc:2272] T eaf3f4dcd2994ae4b21fc89b93484482 P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.125757 31814 tablet_replica.cc:333] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.126345 31814 raft_consensus.cc:2243] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.126847 31814 raft_consensus.cc:2272] T ed6b89407f0e4ba28f232c121543a24e P 6ba2a9c02b534120bbf26e56a1e920ca [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.128557 31814 tablet_replica.cc:333] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.129050 31814 raft_consensus.cc:2243] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.129479 31814 raft_consensus.cc:2272] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.131289 31814 tablet_replica.cc:333] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.131796 31814 raft_consensus.cc:2243] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:15:53.132509 31814 raft_consensus.cc:2272] T 72b49b729462465a98ad914bf7ba3c10 P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.134702 31814 tablet_replica.cc:333] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.135226 31814 raft_consensus.cc:2243] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.135761 31814 raft_consensus.cc:2272] T 658ec34f01e349a4b86604b64fb8b9be P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.137938 31814 tablet_replica.cc:333] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.138645 31814 raft_consensus.cc:2243] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.139313 31814 raft_consensus.cc:2272] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.141129 31814 tablet_replica.cc:333] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.141633 31814 raft_consensus.cc:2243] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.142041 31814 raft_consensus.cc:2272] T 1e103c8f4a7e48599f7b9bb07071e6cc P 6ba2a9c02b534120bbf26e56a1e920ca [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.144012 31814 tablet_replica.cc:333] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.144536 31814 raft_consensus.cc:2243] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.145022 31814 raft_consensus.cc:2272] T 596735598d7c4404a9c62f5a3a6c475c P 6ba2a9c02b534120bbf26e56a1e920ca [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.147020 31814 tablet_replica.cc:333] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.147637 31814 raft_consensus.cc:2243] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:15:53.148437 31814 raft_consensus.cc:2272] T 3253e2dfadea481ea66147319ece61c5 P 6ba2a9c02b534120bbf26e56a1e920ca [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.150300 31814 tablet_replica.cc:333] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.150789 31814 raft_consensus.cc:2243] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.151328 31814 raft_consensus.cc:2272] T ad6d1c43240c46d49621e3a2fb49b972 P 6ba2a9c02b534120bbf26e56a1e920ca [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.153256 31814 tablet_replica.cc:333] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.153702 31814 raft_consensus.cc:2243] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.154173 31814 raft_consensus.cc:2272] T 67e346d318734aba97a45543ff4ad474 P 6ba2a9c02b534120bbf26e56a1e920ca [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.155994 31814 tablet_replica.cc:333] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca: stopping tablet replica
I20260709 13:15:53.156481 31814 raft_consensus.cc:2243] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.156899 31814 raft_consensus.cc:2272] T 15f03a9828994cee972e513efbaaea6a P 6ba2a9c02b534120bbf26e56a1e920ca [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:53.269330  1139 consensus_peers.cc:597] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:53.301627  1139 consensus_peers.cc:597] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:53.305617  1139 consensus_peers.cc:597] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:53.308693   597 consensus_peers.cc:597] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:53.309209   597 consensus_peers.cc:597] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:53.313220   368 catalog_manager.cc:4755] TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet eaf3f4dcd2994ae4b21fc89b93484482: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
W20260709 13:15:53.324754   597 consensus_peers.cc:597] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:53.359058  7275 raft_consensus.cc:493] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.359673  7275 raft_consensus.cc:515] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:53.360551  7287 raft_consensus.cc:493] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.361053  7287 raft_consensus.cc:515] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:53.361722  7275 leader_election.cc:290] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:53.363308  7287 leader_election.cc:290] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:53.368048  7301 raft_consensus.cc:493] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.368144  7287 raft_consensus.cc:493] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:15:53.369685   599 leader_election.cc:336] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:53.369915  7287 raft_consensus.cc:515] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
W20260709 13:15:53.370267   599 leader_election.cc:336] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:53.369930  7301 raft_consensus.cc:515] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:53.372165  7287 leader_election.cc:290] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:53.363978  7275 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.372771  7301 leader_election.cc:290] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:53.372939  7275 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:53.375196  7275 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:15:53.379767  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
W20260709 13:15:53.381237   597 leader_election.cc:336] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:53.381732   597 leader_election.cc:304] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:53.382463  7275 raft_consensus.cc:2749] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:15:53.383445   597 leader_election.cc:336] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
W20260709 13:15:53.383575   599 leader_election.cc:336] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:53.383905   597 leader_election.cc:304] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:15:53.384261   599 leader_election.cc:336] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:53.384712  7275 raft_consensus.cc:2749] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:15:53.385413   599 leader_election.cc:336] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
W20260709 13:15:53.387533  1139 consensus_peers.cc:597] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:53.391533  7232 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.391798   597 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:15:53.392071  7232 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:53.392586  7301 raft_consensus.cc:2749] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:53.394515  7289 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.395190  7289 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:53.397504  7289 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:53.398459   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:15:53.398780  7232 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:53.400384   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
W20260709 13:15:53.394590   597 leader_election.cc:336] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
W20260709 13:15:53.403342  1141 leader_election.cc:336] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:53.403843  1141 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
W20260709 13:15:53.404697  1141 leader_election.cc:336] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:53.404943  7232 raft_consensus.cc:2749] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:53.405072  1141 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 50f7c2247be24f3685d7fbca7b6c71e3
I20260709 13:15:53.405984  7232 raft_consensus.cc:2749] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:53.403407   597 leader_election.cc:304] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:53.408321  7301 raft_consensus.cc:2749] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:15:53.408478   597 leader_election.cc:336] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:53.409027   597 leader_election.cc:304] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:53.409765  7301 raft_consensus.cc:2749] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:15:53.414960   597 consensus_peers.cc:597] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:53.422381  7301 raft_consensus.cc:493] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.422933  7301 raft_consensus.cc:515] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:53.425014  7301 leader_election.cc:290] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:15:53.429401   599 leader_election.cc:336] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
W20260709 13:15:53.429940   597 leader_election.cc:336] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:53.430395   597 leader_election.cc:304] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:53.431025  7275 raft_consensus.cc:2749] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:53.437161  7232 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.437703  7232 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:53.439703  7232 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:15:53.441987   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:15:53.442596   629 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 13.
I20260709 13:15:53.443609  1138 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:15:53.444392  7232 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:53.444805  7232 raft_consensus.cc:493] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.445204  7232 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:53.447227  1141 leader_election.cc:336] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:53.451404  7287 raft_consensus.cc:493] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.451889  7287 raft_consensus.cc:515] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:53.452996  7232 raft_consensus.cc:515] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:53.453559  7287 leader_election.cc:290] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:53.456846   629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb5b767a04141fab4e7259cec37f6d7" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3"
I20260709 13:15:53.457005  7287 raft_consensus.cc:493] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.457402   629 raft_consensus.cc:3060] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:53.457501  7287 raft_consensus.cc:515] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:53.459364  7287 leader_election.cc:290] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:15:53.460803   599 leader_election.cc:336] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
W20260709 13:15:53.463894   599 leader_election.cc:336] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:53.463955   629 raft_consensus.cc:2468] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6df7e8ed204f1db5c371536b5b0683 in term 14.
I20260709 13:15:53.465204  7232 leader_election.cc:290] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 election: Requested vote from peers 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245), 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711)
I20260709 13:15:53.465348  1138 leader_election.cc:304] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
I20260709 13:15:53.466363  7232 raft_consensus.cc:2804] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:53.467554  7232 raft_consensus.cc:697] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 LEADER]: Becoming Leader. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Running, Role: LEADER
I20260709 13:15:53.468454  7232 consensus_queue.cc:237] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:15:53.477250  1141 leader_election.cc:336] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
W20260709 13:15:53.480779   597 leader_election.cc:336] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:53.481215   597 leader_election.cc:304] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:53.481860  7275 raft_consensus.cc:2749] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:15:53.482698   597 leader_election.cc:336] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:53.483122   597 leader_election.cc:304] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:53.483769  7275 raft_consensus.cc:2749] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:53.488240   375 catalog_manager.cc:5697] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 reported cstate change: term changed from 13 to 14, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132). New cstate: current_term: 14 leader_uuid: "6e6df7e8ed204f1db5c371536b5b0683" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.498129  7232 raft_consensus.cc:493] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.498798  7232 raft_consensus.cc:515] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:53.499975  7275 raft_consensus.cc:493] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.500486  7275 raft_consensus.cc:515] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:53.500799  7232 leader_election.cc:290] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:53.502383  7275 leader_election.cc:290] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:53.512739  7232 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
W20260709 13:15:53.512812  1141 leader_election.cc:336] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:53.513473  7232 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:15:53.516058   597 leader_election.cc:336] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
W20260709 13:15:53.519940  1141 leader_election.cc:336] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
W20260709 13:15:53.521363   599 leader_election.cc:336] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:53.521708  7232 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:53.521800   599 leader_election.cc:304] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:53.522723  7275 raft_consensus.cc:2749] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:15:53.523674  1139 leader_election.cc:336] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:53.524080  1139 leader_election.cc:304] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:15:53.526858  1139 leader_election.cc:336] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:53.527247  1139 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:53.527565  7289 raft_consensus.cc:2749] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:53.528237  7289 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:53.530684  7275 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.531224  7275 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:53.533099  7275 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
W20260709 13:15:53.537698   599 leader_election.cc:336] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:53.541078  1172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:15:53.541623  1172 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 14.
I20260709 13:15:53.542632   597 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:53.543830  7275 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:53.544198  7275 raft_consensus.cc:493] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.544546  7275 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:53.552752  7275 raft_consensus.cc:515] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:53.553828  7287 raft_consensus.cc:493] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.554658  7287 raft_consensus.cc:515] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:53.556041  7275 leader_election.cc:290] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:15:53.556654  7287 leader_election.cc:290] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:53.559446  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef98285de93a4829880e7892e2b03e6a" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:15:53.559966  1168 raft_consensus.cc:3060] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:53.562813   599 leader_election.cc:336] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
W20260709 13:15:53.563362   599 leader_election.cc:336] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
W20260709 13:15:53.564127   597 leader_election.cc:336] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:53.564529   597 leader_election.cc:304] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:53.565200  7287 raft_consensus.cc:2749] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:53.565899  1168 raft_consensus.cc:2468] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 15.
I20260709 13:15:53.566756   597 leader_election.cc:304] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:53.567487  7287 raft_consensus.cc:2804] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:53.567938  7287 raft_consensus.cc:697] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:53.568755  7287 consensus_queue.cc:237] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:53.568492  7301 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.573895  7301 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:53.576035  7301 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:15:53.578655  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:15:53.579324  1168 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 16.
I20260709 13:15:53.580535   597 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 
W20260709 13:15:53.581352   599 leader_election.cc:336] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:53.581573  7301 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:53.582129  7301 raft_consensus.cc:493] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.582602  7301 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:53.589356  7301 raft_consensus.cc:515] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:53.591135  7301 leader_election.cc:290] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 election: Requested vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:15:53.591984  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227b93e1b31e4b058d5ec1fc69bd6849" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683"
I20260709 13:15:53.592495  1168 raft_consensus.cc:3060] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:53.593868   375 catalog_manager.cc:5697] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 14 to 15, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 15 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.597468  1168 raft_consensus.cc:2468] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50f7c2247be24f3685d7fbca7b6c71e3 in term 17.
W20260709 13:15:53.603400   599 leader_election.cc:336] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:53.605644   597 leader_election.cc:304] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2
I20260709 13:15:53.607511  7287 raft_consensus.cc:2804] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:53.608004  7287 raft_consensus.cc:697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Becoming Leader. State: Replica: 50f7c2247be24f3685d7fbca7b6c71e3, State: Running, Role: LEADER
I20260709 13:15:53.608871  7287 consensus_queue.cc:237] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:53.622599  7301 raft_consensus.cc:493] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:53.621037   378 catalog_manager.cc:5697] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 reported cstate change: term changed from 16 to 17, leader changed from 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129) to 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131). New cstate: current_term: 17 leader_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.623268  7301 raft_consensus.cc:515] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:53.625303  7301 leader_election.cc:290] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:53.628201  7312 ts_tablet_manager.cc:933] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683: Initiating tablet copy from peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:15:53.629159   597 leader_election.cc:336] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:53.637413  7312 tablet_copy_client.cc:323] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Beginning tablet copy session from remote peer at address 127.31.17.131:36245
I20260709 13:15:53.639351   642 tablet_copy_service.cc:140] P 50f7c2247be24f3685d7fbca7b6c71e3: Received BeginTabletCopySession request for tablet 4ac2ec9819fa4c2193431a046e90dd6e from peer 6e6df7e8ed204f1db5c371536b5b0683 ({username='slave'} at 127.0.0.1:54754)
I20260709 13:15:53.639848   642 tablet_copy_service.cc:161] P 50f7c2247be24f3685d7fbca7b6c71e3: Beginning new tablet copy session on tablet 4ac2ec9819fa4c2193431a046e90dd6e from peer 6e6df7e8ed204f1db5c371536b5b0683 at {username='slave'} at 127.0.0.1:54754: session id = 6e6df7e8ed204f1db5c371536b5b0683-4ac2ec9819fa4c2193431a046e90dd6e
W20260709 13:15:53.644271   599 leader_election.cc:336] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:53.644716   599 leader_election.cc:304] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:53.645390  7275 raft_consensus.cc:2749] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:53.645697   642 tablet_copy_source_session.cc:215] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:53.649995  7312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ac2ec9819fa4c2193431a046e90dd6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:53.665930  7312 tablet_copy_client.cc:806] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:53.666553  7312 tablet_copy_client.cc:670] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:53.671157  7312 tablet_copy_client.cc:538] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:53.680843  7312 tablet_bootstrap.cc:492] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap starting.
I20260709 13:15:53.712118  7312 tablet_bootstrap.cc:492] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=2 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:15:53.712957  7312 tablet_bootstrap.cc:492] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683: Bootstrap complete.
I20260709 13:15:53.713521  7312 ts_tablet_manager.cc:1403] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683: Time spent bootstrapping tablet: real 0.033s	user 0.025s	sys 0.007s
I20260709 13:15:53.715651  7312 raft_consensus.cc:359] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:53.716611  7312 raft_consensus.cc:740] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 6e6df7e8ed204f1db5c371536b5b0683, State: Initialized, Role: LEARNER
I20260709 13:15:53.717221  7312 consensus_queue.cc:260] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } }
I20260709 13:15:53.719388  7312 ts_tablet_manager.cc:1434] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:15:53.721374   642 tablet_copy_service.cc:342] P 50f7c2247be24f3685d7fbca7b6c71e3: Request end of tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-4ac2ec9819fa4c2193431a046e90dd6e received from {username='slave'} at 127.0.0.1:54754
I20260709 13:15:53.721768   642 tablet_copy_service.cc:434] P 50f7c2247be24f3685d7fbca7b6c71e3: ending tablet copy session 6e6df7e8ed204f1db5c371536b5b0683-4ac2ec9819fa4c2193431a046e90dd6e on tablet 4ac2ec9819fa4c2193431a046e90dd6e with peer 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:15:53.832309 31814 tablet_server.cc:196] TabletServer@127.31.17.130:0 shutdown complete.
I20260709 13:15:53.890324   629 raft_consensus.cc:1275] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Refusing update from remote peer 6e6df7e8ed204f1db5c371536b5b0683: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:15:53.892443  7289 consensus_queue.cc:1048] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:15:53.927282  1141 consensus_peers.cc:597] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:53.976667   599 consensus_peers.cc:597] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:54.005155  1168 raft_consensus.cc:1275] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:15:54.007848  7275 consensus_queue.cc:1048] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:54.024104  7289 raft_consensus.cc:493] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:15:54.025120  7289 raft_consensus.cc:515] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:54.028292  7232 raft_consensus.cc:493] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:15:54.029374  7232 raft_consensus.cc:515] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:15:54.042368  1141 leader_election.cc:336] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:54.049800   627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9140b212cfde4d8d83cbe538fc50d88d" candidate_uuid: "6e6df7e8ed204f1db5c371536b5b0683" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" is_pre_election: true
I20260709 13:15:54.052850  1168 raft_consensus.cc:1217] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 13:15:54.059543  1172 raft_consensus.cc:1275] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Refusing update from remote peer 50f7c2247be24f3685d7fbca7b6c71e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:54.035036  7232 leader_election.cc:290] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:54.037711  7289 leader_election.cc:290] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:15:54.063337  1139 leader_election.cc:336] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:54.063102  7301 consensus_queue.cc:1048] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:54.063879  1139 leader_election.cc:304] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:54.064723  7289 raft_consensus.cc:2749] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:15:54.073535   599 consensus_peers.cc:597] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:54.075385   599 consensus_peers.cc:597] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:54.082265   599 consensus_peers.cc:597] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:54.095572  1139 leader_election.cc:336] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:54.096482  1139 leader_election.cc:304] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:54.097292  7289 raft_consensus.cc:2749] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:54.099501 31814 tablet_server.cc:179] TabletServer@127.31.17.131:0 shutting down...
W20260709 13:15:54.108301  1138 consensus_peers.cc:597] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Couldn't send request to peer 50f7c2247be24f3685d7fbca7b6c71e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:54.126672  1138 consensus_peers.cc:597] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Couldn't send request to peer 50f7c2247be24f3685d7fbca7b6c71e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:54.128620  7301 raft_consensus.cc:493] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:15:54.129355  7301 raft_consensus.cc:515] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:54.132824  7301 leader_election.cc:290] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:15:54.138540   599 leader_election.cc:336] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
W20260709 13:15:54.141949  1141 consensus_peers.cc:597] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:54.142946   597 leader_election.cc:336] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:54.143500   597 leader_election.cc:304] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:54.144510  7287 raft_consensus.cc:2749] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:15:54.150328  1138 consensus_peers.cc:597] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Couldn't send request to peer 50f7c2247be24f3685d7fbca7b6c71e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:54.150439   599 consensus_peers.cc:597] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:54.152987  7289 raft_consensus.cc:493] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:15:54.153690  7289 raft_consensus.cc:515] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:54.156140  7289 leader_election.cc:290] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:15:54.159206  1138 leader_election.cc:336] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:15:54.160660  1139 leader_election.cc:336] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:54.161078  1139 leader_election.cc:304] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:54.162073  7289 raft_consensus.cc:2749] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:54.164081 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:54.166639  7301 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:15:54.165673 31814 tablet_replica.cc:333] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.167356  7301 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:15:54.168627  1138 consensus_peers.cc:597] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Couldn't send request to peer 50f7c2247be24f3685d7fbca7b6c71e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:54.168732 31814 raft_consensus.cc:2243] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.169776 31814 raft_consensus.cc:2272] T 70cfcc65b0e14d6cb141bc839a21b558 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.171155  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7fddd60ae54606847dc6f4111a7e30" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:15:54.171689  7301 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:15:54.173671 31814 tablet_replica.cc:333] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
W20260709 13:15:54.174047   597 leader_election.cc:336] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:54.174616 31814 raft_consensus.cc:2243] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:15:54.174856   597 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
I20260709 13:15:54.175676  7301 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:54.175905 31814 raft_consensus.cc:2272] T ac7da405058744b49aee8b0adbc78189 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.178107 31814 tablet_replica.cc:333] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.178742 31814 raft_consensus.cc:2243] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.179376 31814 raft_consensus.cc:2272] T 658ec34f01e349a4b86604b64fb8b9be P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.181994 31814 tablet_replica.cc:333] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.182726 31814 raft_consensus.cc:2243] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.183614 31814 raft_consensus.cc:2272] T b1c23e2e725f4945b79fe36fc271ccc2 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.186434 31814 tablet_replica.cc:333] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.187213 31814 raft_consensus.cc:2243] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.188184 31814 raft_consensus.cc:2272] T 9140b212cfde4d8d83cbe538fc50d88d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.190260 31814 tablet_replica.cc:333] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.190905 31814 raft_consensus.cc:2243] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.191437 31814 raft_consensus.cc:2272] T 18dea61d0790411c88602b2cfc2fbcdb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.193357 31814 tablet_replica.cc:333] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.193953 31814 raft_consensus.cc:2243] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.194450 31814 raft_consensus.cc:2272] T 12805530d9a3471aa3d5b4c086cc454a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.194860  7301 raft_consensus.cc:493] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:15:54.195412  7301 raft_consensus.cc:515] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } }
I20260709 13:15:54.196625 31814 tablet_replica.cc:333] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.197482 31814 raft_consensus.cc:2243] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.197525  7301 leader_election.cc:290] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:54.198226 31814 raft_consensus.cc:2272] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.200488  7232 raft_consensus.cc:493] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:15:54.201033  7232 raft_consensus.cc:515] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:54.201403 31814 tablet_replica.cc:333] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
W20260709 13:15:54.202078   597 leader_election.cc:336] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:54.202325 31814 raft_consensus.cc:2243] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.202677  7232 leader_election.cc:290] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:15:54.202831   599 leader_election.cc:336] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:54.203334 31814 raft_consensus.cc:2272] T 5436dcd825914fdca953dd01eb60ec88 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.203369   599 leader_election.cc:304] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:15:54.204310   599 raft_consensus.cc:2686] T 049523b511884708bc0ac5adea131bc6 P 50f7c2247be24f3685d7fbca7b6c71e3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:15:54.205205  7232 raft_consensus.cc:493] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:15:54.205924  7232 raft_consensus.cc:515] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:54.206471 31814 tablet_replica.cc:333] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
W20260709 13:15:54.207199  1138 leader_election.cc:336] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:54.207472 31814 raft_consensus.cc:2243] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:54.207711  1139 leader_election.cc:336] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:54.208181  7232 leader_election.cc:290] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:54.208230 31814 raft_consensus.cc:2272] T b6c11587863a4a73ae8fca1c867e545d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.208189  1139 leader_election.cc:304] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:54.209347  7232 raft_consensus.cc:2749] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:54.211582 31814 tablet_replica.cc:333] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.212338 31814 raft_consensus.cc:2243] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:15:54.212812  1141 leader_election.cc:336] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
W20260709 13:15:54.213617  1139 leader_election.cc:336] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:54.213706 31814 pending_rounds.cc:70] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Trying to abort 1 pending ops.
I20260709 13:15:54.214020  1139 leader_election.cc:304] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:54.214762  7232 raft_consensus.cc:2749] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:54.214064 31814 pending_rounds.cc:77] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3: Aborting op as it isn't in flight: id { term: 15 index: 10 } timestamp: 7305637695922946048 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } } new_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } } }
I20260709 13:15:54.215391 31814 raft_consensus.cc:2917] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Aborting config change with OpId 15.10: Aborted: Op aborted
I20260709 13:15:54.215770 31814 raft_consensus.cc:2889] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:15:54.216337 31814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46828 (request call id 7) took 1111 ms. Trace:
I20260709 13:15:54.216631 31814 rpcz_store.cc:276] 0709 13:15:53.105200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.105376 (+   176us) service_pool.cc:224] Handling call
0709 13:15:53.110638 (+  5262us) log.cc:844] Serialized 506 byte log entry
0709 13:15:54.216249 (+1105611us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88,"raft.queue_time_us":426,"raft.run_cpu_time_us":1677,"raft.run_wall_time_us":1674,"spinlock_wait_cycles":19840,"thread_start_us":541,"threads_started":1,"wal-append.queue_time_us":845,"wal-append.run_cpu_time_us":1822,"wal-append.run_wall_time_us":1006126}
I20260709 13:15:54.217777 31814 raft_consensus.cc:2272] T 4ac2ec9819fa4c2193431a046e90dd6e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:54.218783   429 auto_rebalancer.cc:629] Failed to schedule move for tablet 4ac2ec9819fa4c2193431a046e90dd6e: Aborted: Op aborted
I20260709 13:15:54.220847 31814 tablet_replica.cc:333] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.221863 31814 raft_consensus.cc:2243] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.222671 31814 raft_consensus.cc:2272] T b5fe583d0f84434a92093dc2407b787f P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:54.222728   429 auto_rebalancer.cc:629] Failed to schedule move for tablet 15f03a9828994cee972e513efbaaea6a: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:54.225997 31814 tablet_replica.cc:333] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.226768 31814 raft_consensus.cc:2243] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:15:54.228111 31814 raft_consensus.cc:2272] T 44f95c82063d490481f1c94cc64f7311 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.230170 31814 tablet_replica.cc:333] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.230710 31814 raft_consensus.cc:2243] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:15:54.231622 31814 raft_consensus.cc:2272] T d37a8f9254954f1f9db70e23a26e512b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.233507 31814 tablet_replica.cc:333] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.234035 31814 raft_consensus.cc:2243] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:15:54.235014 31814 raft_consensus.cc:2272] T ec13b3c82acf4ef9a2eb79441f61a80d P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.237433 31814 tablet_replica.cc:333] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.238271 31814 raft_consensus.cc:2243] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.238924 31814 raft_consensus.cc:2272] T dbb5b767a04141fab4e7259cec37f6d7 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:54.239459  1141 consensus_peers.cc:597] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:54.241935 31814 tablet_replica.cc:333] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.242655 31814 raft_consensus.cc:2243] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.243340 31814 raft_consensus.cc:2272] T df062554d8014455b179c819406964fb P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.245877 31814 tablet_replica.cc:333] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.246405 31814 raft_consensus.cc:2243] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:15:54.247530 31814 raft_consensus.cc:2272] T 596735598d7c4404a9c62f5a3a6c475c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:54.247684  1141 consensus_peers.cc:597] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:54.248188  7289 raft_consensus.cc:493] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:15:54.248805  7289 raft_consensus.cc:515] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:54.249946 31814 tablet_replica.cc:333] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.250310  7301 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:15:54.250823 31814 raft_consensus.cc:2243] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.250864  7289 leader_election.cc:290] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
I20260709 13:15:54.250885  7301 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:54.251861 31814 raft_consensus.cc:2272] T 0ea38de651624cd48fa0e7a5a85467d5 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.254628 31814 tablet_replica.cc:333] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.255486 31814 raft_consensus.cc:2243] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.255739  7289 raft_consensus.cc:493] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:15:54.256210 31814 raft_consensus.cc:2272] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.256443  7289 raft_consensus.cc:515] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
W20260709 13:15:54.257519   597 leader_election.cc:336] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:54.258342  7301 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 6e6df7e8ed204f1db5c371536b5b0683 (127.31.17.132:39939)
I20260709 13:15:54.258366  7289 leader_election.cc:290] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:15:54.256458  1141 leader_election.cc:336] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:54.259438  7289 raft_consensus.cc:493] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:15:54.259413  1168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c192fb76f82248d78ddc2aac1d721cd9" candidate_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6e6df7e8ed204f1db5c371536b5b0683" is_pre_election: true
I20260709 13:15:54.261809   597 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50f7c2247be24f3685d7fbca7b6c71e3; no voters: 6ba2a9c02b534120bbf26e56a1e920ca, 6e6df7e8ed204f1db5c371536b5b0683
W20260709 13:15:54.263094   597 raft_consensus.cc:2686] T c192fb76f82248d78ddc2aac1d721cd9 P 50f7c2247be24f3685d7fbca7b6c71e3: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:15:54.260964  1139 leader_election.cc:336] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:54.264675 31814 tablet_replica.cc:333] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.265785 31814 raft_consensus.cc:2243] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:15:54.266388  1139 leader_election.cc:304] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
W20260709 13:15:54.266537   599 consensus_peers.cc:597] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:54.267517 31814 raft_consensus.cc:2272] T 7b20e1b9bdf8473682b642fe0b3c0583 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.267216  7232 raft_consensus.cc:2749] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:54.260635  7289 raft_consensus.cc:515] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:54.271023 31814 tablet_replica.cc:333] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
W20260709 13:15:54.271222  1141 leader_election.cc:336] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:54.272025 31814 raft_consensus.cc:2243] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.272825 31814 raft_consensus.cc:2272] T 62cb9f12275c47c4989d775511376bdf P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.272825  7289 leader_election.cc:290] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:15:54.274648  1138 leader_election.cc:336] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:15:54.274915  1139 leader_election.cc:336] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:54.275377  1139 leader_election.cc:304] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:54.276036 31814 tablet_replica.cc:333] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.275997  7289 raft_consensus.cc:2749] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:54.277010 31814 raft_consensus.cc:2243] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:15:54.278084  1139 leader_election.cc:336] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:54.278330 31814 raft_consensus.cc:2272] T d74f5d3a02ed490499ba666721531edc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.278445  1139 leader_election.cc:304] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:54.279167  7289 raft_consensus.cc:2749] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:54.280906 31814 tablet_replica.cc:333] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.281484 31814 raft_consensus.cc:2243] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:15:54.282855 31814 raft_consensus.cc:2272] T 5153b5ac109e49b78fd24ec7f42e3c8e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.285599 31814 tablet_replica.cc:333] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.286250 31814 raft_consensus.cc:2243] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.286943 31814 raft_consensus.cc:2272] T 0a36746135a640a4916e9d4d974ce2b3 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.289635 31814 tablet_replica.cc:333] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.290225 31814 raft_consensus.cc:2243] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.290781 31814 raft_consensus.cc:2272] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.292892 31814 tablet_replica.cc:333] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.293474 31814 raft_consensus.cc:2243] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.294067 31814 raft_consensus.cc:2272] T 01c3584d0546405ca79fa6b68e7468ec P 50f7c2247be24f3685d7fbca7b6c71e3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.296924 31814 tablet_replica.cc:333] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.297757 31814 raft_consensus.cc:2243] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.298502 31814 raft_consensus.cc:2272] T 6fc289132926446d9594150727e08b0b P 50f7c2247be24f3685d7fbca7b6c71e3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.301136 31814 tablet_replica.cc:333] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.301641 31814 raft_consensus.cc:2243] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:15:54.302466 31814 raft_consensus.cc:2272] T 9108c5fc44794002b60442bd66404e6c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.304339 31814 tablet_replica.cc:333] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.304839 31814 raft_consensus.cc:2243] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:15:54.305632 31814 raft_consensus.cc:2272] T 304d1b96642140f19543be15d23a061c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.307489 31814 tablet_replica.cc:333] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.307986 31814 raft_consensus.cc:2243] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:15:54.308808 31814 raft_consensus.cc:2272] T eaf3f4dcd2994ae4b21fc89b93484482 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.310961 31814 tablet_replica.cc:333] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.311601 31814 raft_consensus.cc:2243] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.312237 31814 raft_consensus.cc:2272] T 3c5452210928414da7920e467cc1fbda P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.314851 31814 tablet_replica.cc:333] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.315434 31814 raft_consensus.cc:2243] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.315867 31814 raft_consensus.cc:2272] T 9ade492740624caba667436aa666025c P 50f7c2247be24f3685d7fbca7b6c71e3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.317770 31814 tablet_replica.cc:333] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.318286 31814 raft_consensus.cc:2243] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:15:54.319123 31814 raft_consensus.cc:2272] T ed6b89407f0e4ba28f232c121543a24e P 50f7c2247be24f3685d7fbca7b6c71e3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.321209 31814 tablet_replica.cc:333] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.321703 31814 raft_consensus.cc:2243] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.322207 31814 raft_consensus.cc:2272] T 9b7fddd60ae54606847dc6f4111a7e30 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.324309 31814 tablet_replica.cc:333] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.324851 31814 raft_consensus.cc:2243] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:15:54.326143 31814 raft_consensus.cc:2272] T 578ce25d78a849989220d2a8dcb91233 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.328639 31814 tablet_replica.cc:333] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.329303 31814 raft_consensus.cc:2243] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.329938 31814 raft_consensus.cc:2272] T 1e103c8f4a7e48599f7b9bb07071e6cc P 50f7c2247be24f3685d7fbca7b6c71e3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.331961 31814 tablet_replica.cc:333] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.332506 31814 raft_consensus.cc:2243] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.332983 31814 raft_consensus.cc:2272] T 72b49b729462465a98ad914bf7ba3c10 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.334857 31814 tablet_replica.cc:333] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.335475 31814 raft_consensus.cc:2243] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.335988 31814 raft_consensus.cc:2272] T 8b9a9d4a92fc4cadac1b3bf82763cfc0 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.338035 31814 tablet_replica.cc:333] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.338877 31814 raft_consensus.cc:2243] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.339607 31814 raft_consensus.cc:2272] T ad6d1c43240c46d49621e3a2fb49b972 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.340858  7289 raft_consensus.cc:493] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:15:54.341534  7289 raft_consensus.cc:515] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:54.342583 31814 tablet_replica.cc:333] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.343647 31814 raft_consensus.cc:2243] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:15:54.345007 31814 raft_consensus.cc:2272] T 15f03a9828994cee972e513efbaaea6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:54.345887   368 catalog_manager.cc:4755] TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet eaf3f4dcd2994ae4b21fc89b93484482: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:54.346406  7289 leader_election.cc:290] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
W20260709 13:15:54.347445  1138 leader_election.cc:336] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:54.348126 31814 tablet_replica.cc:333] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
W20260709 13:15:54.348417  1139 leader_election.cc:336] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:54.348784 31814 raft_consensus.cc:2243] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.348803  1139 leader_election.cc:304] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:54.349635  7289 raft_consensus.cc:2749] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:54.349720 31814 raft_consensus.cc:2272] T f221a3b77aba453e80c06e1de30b76aa P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.352542 31814 tablet_replica.cc:333] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.353142 31814 raft_consensus.cc:2243] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.353870 31814 raft_consensus.cc:2272] T 4e472c1c82c9467a9a5563d6b06e3b53 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:54.354791  1141 consensus_peers.cc:597] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:54.356642 31814 tablet_replica.cc:333] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.357342 31814 raft_consensus.cc:2243] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:15:54.357296  7232 raft_consensus.cc:493] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:15:54.358072  7232 raft_consensus.cc:515] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:54.358815 31814 raft_consensus.cc:2272] T 227b93e1b31e4b058d5ec1fc69bd6849 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.359861  7232 leader_election.cc:290] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159), 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245)
I20260709 13:15:54.361663 31814 tablet_replica.cc:333] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.362288 31814 raft_consensus.cc:2243] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:15:54.363394  1139 leader_election.cc:336] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:54.363436 31814 raft_consensus.cc:2272] T ef98285de93a4829880e7892e2b03e6a P 50f7c2247be24f3685d7fbca7b6c71e3 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:54.364663  1138 leader_election.cc:336] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:54.365092  1138 leader_election.cc:304] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 50f7c2247be24f3685d7fbca7b6c71e3, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:54.365723  7232 raft_consensus.cc:2749] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:54.366168 31814 tablet_replica.cc:333] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3: stopping tablet replica
I20260709 13:15:54.366781 31814 raft_consensus.cc:2243] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.367214 31814 raft_consensus.cc:2272] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 50f7c2247be24f3685d7fbca7b6c71e3 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:54.379012  1138 consensus_peers.cc:597] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Couldn't send request to peer 50f7c2247be24f3685d7fbca7b6c71e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:54.422724  1141 consensus_peers.cc:597] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:54.427346  1138 consensus_peers.cc:597] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Couldn't send request to peer 50f7c2247be24f3685d7fbca7b6c71e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:54.444813  7232 raft_consensus.cc:493] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:15:54.445395  7232 raft_consensus.cc:515] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:54.447497  7232 leader_election.cc:290] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:15:54.452539  1141 leader_election.cc:336] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
W20260709 13:15:54.454309  1139 leader_election.cc:336] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:54.454774  1139 leader_election.cc:304] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:54.455572  7232 raft_consensus.cc:2749] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:54.463425  1138 consensus_peers.cc:597] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Couldn't send request to peer 50f7c2247be24f3685d7fbca7b6c71e3. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.131:36245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:54.470815  7232 raft_consensus.cc:493] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6ba2a9c02b534120bbf26e56a1e920ca)
I20260709 13:15:54.471515  7232 raft_consensus.cc:515] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:54.473112  7232 leader_election.cc:290] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:15:54.477142  1141 leader_election.cc:336] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
W20260709 13:15:54.477622  1139 leader_election.cc:336] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:54.478067  1139 leader_election.cc:304] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:54.478766  7232 raft_consensus.cc:2749] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:54.500069  1141 consensus_peers.cc:597] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:54.568279  1138 consensus_peers.cc:597] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Couldn't send request to peer 50f7c2247be24f3685d7fbca7b6c71e3. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.131:36245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:54.626117  1138 consensus_peers.cc:597] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 50f7c2247be24f3685d7fbca7b6c71e3 (127.31.17.131:36245): Couldn't send request to peer 50f7c2247be24f3685d7fbca7b6c71e3. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.131:36245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:54.636622  1141 consensus_peers.cc:597] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:54.714738  1141 consensus_peers.cc:597] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:54.775540  1141 consensus_peers.cc:597] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:54.810727  1141 consensus_peers.cc:597] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Couldn't send request to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:55.076606  7328 raft_consensus.cc:493] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d6f5b2f91e54c8c95f7b19c1b9ecee2)
I20260709 13:15:55.077248  7328 raft_consensus.cc:515] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: false } }
I20260709 13:15:55.079394  7328 leader_election.cc:290] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711), 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159)
W20260709 13:15:55.083998  1141 leader_election.cc:336] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
W20260709 13:15:55.085712  1139 leader_election.cc:336] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:55.086071  1139 leader_election.cc:304] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6df7e8ed204f1db5c371536b5b0683; no voters: 3d6f5b2f91e54c8c95f7b19c1b9ecee2, 6ba2a9c02b534120bbf26e56a1e920ca
I20260709 13:15:55.086726  7328 raft_consensus.cc:2749] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:55.114738 31814 tablet_server.cc:196] TabletServer@127.31.17.131:0 shutdown complete.
I20260709 13:15:55.212270 31814 tablet_server.cc:179] TabletServer@127.31.17.132:0 shutting down...
I20260709 13:15:55.259792 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:55.260797 31814 tablet_replica.cc:333] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.261966 31814 raft_consensus.cc:2243] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEARNER]: Raft consensus shutting down.
I20260709 13:15:55.262501 31814 pending_rounds.cc:70] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683: Trying to abort 1 pending ops.
I20260709 13:15:55.262714 31814 pending_rounds.cc:77] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683: Aborting op as it isn't in flight: id { term: 15 index: 10 } timestamp: 7305637695922946048 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "4ac2ec9819fa4c2193431a046e90dd6e" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } } new_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3d6f5b2f91e54c8c95f7b19c1b9ecee2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 45711 } attrs { replace: true } } peers { permanent_uuid: "6ba2a9c02b534120bbf26e56a1e920ca" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41159 } } peers { permanent_uuid: "50f7c2247be24f3685d7fbca7b6c71e3" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 36245 } } peers { permanent_uuid: "6e6df7e8ed204f1db5c371536b5b0683" member_type: NON_VOTER last_known_addr { host: "127.31.17.132" port: 39939 } attrs { promote: true } } } }
I20260709 13:15:55.263528 31814 raft_consensus.cc:2917] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEARNER]: Aborting config change with OpId 15.10: Aborted: Op aborted
I20260709 13:15:55.263846 31814 raft_consensus.cc:2889] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:15:55.264127 31814 raft_consensus.cc:2272] T 4ac2ec9819fa4c2193431a046e90dd6e P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 NON_PARTICIPANT]: Raft consensus is shut down!
I20260709 13:15:55.266445 31814 tablet_replica.cc:333] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.267177 31814 raft_consensus.cc:2243] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.268102 31814 raft_consensus.cc:2272] T 7b20e1b9bdf8473682b642fe0b3c0583 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.270632 31814 tablet_replica.cc:333] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.271278 31814 raft_consensus.cc:2243] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.272014 31814 raft_consensus.cc:2272] T 9108c5fc44794002b60442bd66404e6c P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.274502 31814 tablet_replica.cc:333] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.275158 31814 raft_consensus.cc:2243] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.275768 31814 raft_consensus.cc:2272] T 6316a42e235d497f96a57da84ac62c84 P 6e6df7e8ed204f1db5c371536b5b0683 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.278394 31814 tablet_replica.cc:333] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.278970 31814 raft_consensus.cc:2243] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.279687 31814 raft_consensus.cc:2272] T 727ef43c64e147b3889a02b94ab53253 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.282076 31814 tablet_replica.cc:333] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.282836 31814 raft_consensus.cc:2243] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.283511 31814 raft_consensus.cc:2272] T e4bd90dfa0b4483dae082de5ca5e77f0 P 6e6df7e8ed204f1db5c371536b5b0683 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.286046 31814 tablet_replica.cc:333] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.286891 31814 raft_consensus.cc:2243] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.287703 31814 raft_consensus.cc:2272] T d37a8f9254954f1f9db70e23a26e512b P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.291065 31814 tablet_replica.cc:333] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.292090 31814 raft_consensus.cc:2243] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.292912 31814 raft_consensus.cc:2272] T ec13b3c82acf4ef9a2eb79441f61a80d P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.296060 31814 tablet_replica.cc:333] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.296656 31814 raft_consensus.cc:2243] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.297317 31814 raft_consensus.cc:2272] T 227b93e1b31e4b058d5ec1fc69bd6849 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.299351 31814 tablet_replica.cc:333] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.299902 31814 raft_consensus.cc:2243] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.300354 31814 raft_consensus.cc:2272] T 372575938bbf471c935e1b39ba9e588f P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.302800 31814 tablet_replica.cc:333] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.303397 31814 raft_consensus.cc:2243] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.304327 31814 raft_consensus.cc:2272] T 70cfcc65b0e14d6cb141bc839a21b558 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.307017 31814 tablet_replica.cc:333] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.307673 31814 raft_consensus.cc:2243] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.308238 31814 raft_consensus.cc:2272] T 3253e2dfadea481ea66147319ece61c5 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:55.308323   429 auto_rebalancer.cc:629] Failed to schedule move for tablet b1c23e2e725f4945b79fe36fc271ccc2: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:55.310707 31814 tablet_replica.cc:333] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.311537 31814 raft_consensus.cc:2243] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.312542 31814 raft_consensus.cc:2272] T eaf3f4dcd2994ae4b21fc89b93484482 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:55.313124   429 auto_rebalancer.cc:629] Failed to schedule move for tablet ad6d1c43240c46d49621e3a2fb49b972: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:55.315754 31814 tablet_replica.cc:333] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
W20260709 13:15:55.316504   429 auto_rebalancer.cc:629] Failed to schedule move for tablet 62cb9f12275c47c4989d775511376bdf: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:55.316653 31814 raft_consensus.cc:2243] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.317353 31814 raft_consensus.cc:2272] T 569fc6eae3e44f9db61c22838e11247d P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.320353 31814 tablet_replica.cc:333] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
W20260709 13:15:55.320370   429 auto_rebalancer.cc:629] Failed to schedule move for tablet 72b49b729462465a98ad914bf7ba3c10: Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111)
I20260709 13:15:55.321316 31814 raft_consensus.cc:2243] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.321943 31814 raft_consensus.cc:2272] T 01c3584d0546405ca79fa6b68e7468ec P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.324594 31814 tablet_replica.cc:333] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.325210 31814 raft_consensus.cc:2243] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.325675 31814 raft_consensus.cc:2272] T c192fb76f82248d78ddc2aac1d721cd9 P 6e6df7e8ed204f1db5c371536b5b0683 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.327553 31814 tablet_replica.cc:333] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.328061 31814 raft_consensus.cc:2243] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.328670 31814 raft_consensus.cc:2272] T d74f5d3a02ed490499ba666721531edc P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.330533 31814 tablet_replica.cc:333] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.331077 31814 raft_consensus.cc:2243] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.331568 31814 raft_consensus.cc:2272] T 578ce25d78a849989220d2a8dcb91233 P 6e6df7e8ed204f1db5c371536b5b0683 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.333325 31814 tablet_replica.cc:333] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.333860 31814 raft_consensus.cc:2243] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.334369 31814 raft_consensus.cc:2272] T 9b7fddd60ae54606847dc6f4111a7e30 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.336279 31814 tablet_replica.cc:333] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.336840 31814 raft_consensus.cc:2243] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.337445 31814 raft_consensus.cc:2272] T ed6b89407f0e4ba28f232c121543a24e P 6e6df7e8ed204f1db5c371536b5b0683 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.339636 31814 tablet_replica.cc:333] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.340147 31814 raft_consensus.cc:2243] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.340929 31814 raft_consensus.cc:2272] T 9ade492740624caba667436aa666025c P 6e6df7e8ed204f1db5c371536b5b0683 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.342749 31814 tablet_replica.cc:333] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.343356 31814 raft_consensus.cc:2243] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.343824 31814 raft_consensus.cc:2272] T 093a5bf347e94e52af24456f0631abe3 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.346182 31814 tablet_replica.cc:333] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.346796 31814 raft_consensus.cc:2243] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.347445 31814 raft_consensus.cc:2272] T 5153b5ac109e49b78fd24ec7f42e3c8e P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:55.349002  1139 consensus_peers.cc:597] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 -> Peer 6ba2a9c02b534120bbf26e56a1e920ca (127.31.17.130:41159): Couldn't send request to peer 6ba2a9c02b534120bbf26e56a1e920ca. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:41159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:55.349779 31814 tablet_replica.cc:333] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.350327 31814 raft_consensus.cc:2243] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.351174 31814 raft_consensus.cc:2272] T 67e346d318734aba97a45543ff4ad474 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.352967 31814 tablet_replica.cc:333] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.353497 31814 raft_consensus.cc:2243] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.354282 31814 raft_consensus.cc:2272] T cb12c292ec5d439b896dcc135d266150 P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.356231 31814 tablet_replica.cc:333] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.356740 31814 raft_consensus.cc:2243] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.357496 31814 raft_consensus.cc:2272] T 54372ad9508c44d2824f4810f03a5081 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.359230 31814 tablet_replica.cc:333] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.359820 31814 raft_consensus.cc:2243] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.360455 31814 raft_consensus.cc:2272] T 9140b212cfde4d8d83cbe538fc50d88d P 6e6df7e8ed204f1db5c371536b5b0683 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.362532 31814 tablet_replica.cc:333] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.363059 31814 raft_consensus.cc:2243] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.363862 31814 raft_consensus.cc:2272] T d2131bd04d2d4f3da62d75b100a2aecd P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.365569 31814 tablet_replica.cc:333] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.366066 31814 raft_consensus.cc:2243] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.366837 31814 raft_consensus.cc:2272] T 4e472c1c82c9467a9a5563d6b06e3b53 P 6e6df7e8ed204f1db5c371536b5b0683 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.368613 31814 tablet_replica.cc:333] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.369112 31814 raft_consensus.cc:2243] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.369844 31814 raft_consensus.cc:2272] T f221a3b77aba453e80c06e1de30b76aa P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.371663 31814 tablet_replica.cc:333] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.372195 31814 raft_consensus.cc:2243] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.372658 31814 raft_consensus.cc:2272] T 304d1b96642140f19543be15d23a061c P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.374456 31814 tablet_replica.cc:333] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.374955 31814 raft_consensus.cc:2243] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.375734 31814 raft_consensus.cc:2272] T dbb5b767a04141fab4e7259cec37f6d7 P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.377476 31814 tablet_replica.cc:333] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.377987 31814 raft_consensus.cc:2243] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.378432 31814 raft_consensus.cc:2272] T 4d2f65eaa10d4428a49b5f1ed8b939f1 P 6e6df7e8ed204f1db5c371536b5b0683 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.380314 31814 tablet_replica.cc:333] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.380919 31814 raft_consensus.cc:2243] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.381876 31814 raft_consensus.cc:2272] T 18dea61d0790411c88602b2cfc2fbcdb P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.384455 31814 tablet_replica.cc:333] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.385171 31814 raft_consensus.cc:2243] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.385725 31814 raft_consensus.cc:2272] T 82382f158074497a857b03f9f87f9e86 P 6e6df7e8ed204f1db5c371536b5b0683 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.387662 31814 tablet_replica.cc:333] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.388152 31814 raft_consensus.cc:2243] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.388588 31814 raft_consensus.cc:2272] T 12fb4cc9b97f4bab8a7fad87dcdba73c P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.390424 31814 tablet_replica.cc:333] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.390897 31814 raft_consensus.cc:2243] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.391757 31814 raft_consensus.cc:2272] T 99b1684e65e840ce8bcb13346b86d204 P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.393549 31814 tablet_replica.cc:333] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.394114 31814 raft_consensus.cc:2243] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.394881 31814 raft_consensus.cc:2272] T 12805530d9a3471aa3d5b4c086cc454a P 6e6df7e8ed204f1db5c371536b5b0683 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.396847 31814 tablet_replica.cc:333] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.397341 31814 raft_consensus.cc:2243] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.398056 31814 raft_consensus.cc:2272] T b6c11587863a4a73ae8fca1c867e545d P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.399843 31814 tablet_replica.cc:333] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.401062 31814 raft_consensus.cc:2243] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.401866 31814 raft_consensus.cc:2272] T 3c5452210928414da7920e467cc1fbda P 6e6df7e8ed204f1db5c371536b5b0683 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.403872 31814 tablet_replica.cc:333] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683: stopping tablet replica
I20260709 13:15:55.404348 31814 raft_consensus.cc:2243] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.404788 31814 raft_consensus.cc:2272] T ef98285de93a4829880e7892e2b03e6a P 6e6df7e8ed204f1db5c371536b5b0683 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.669711 31814 tablet_server.cc:196] TabletServer@127.31.17.132:0 shutdown complete.
I20260709 13:15:55.738111 31814 master.cc:562] Master@127.31.17.190:46835 shutting down...
W20260709 13:15:56.413021   368 catalog_manager.cc:4755] TS 3d6f5b2f91e54c8c95f7b19c1b9ecee2 (127.31.17.129:45711): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet eaf3f4dcd2994ae4b21fc89b93484482: Network error: Client connection negotiation failed: client connection to 127.31.17.129:45711: connect: Connection refused (error 111)
I20260709 13:15:56.537245 31814 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:56.537974 31814 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:56.538326 31814 tablet_replica.cc:333] T 00000000000000000000000000000000 P 958aa06b858546888f102fe85618915c: stopping tablet replica
I20260709 13:15:56.721292 31814 master.cc:584] Master@127.31.17.190:46835 shutdown complete.
I20260709 13:15:56.756610 31814 test_util.cc:182] -----------------------------------------------
I20260709 13:15:56.756893 31814 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602713491408-31814-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (218733 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:15:56.760468 31814 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.31.17.190:35391
I20260709 13:15:56.761699 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:56.768465  7334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:56.768463  7335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:56.769636  7337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:56.771543 31814 server_base.cc:1061] running on GCE node
I20260709 13:15:56.774780 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:56.775035 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:56.775223 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602956775204 us; error 0 us; skew 500 ppm
I20260709 13:15:56.775836 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:56.779165 31814 webserver.cc:533] Webserver started at http://127.31.17.190:39927/ using document root <none> and password file <none>
I20260709 13:15:56.779808 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:56.780019 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:56.780313 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:56.781821 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/master-0-root/instance:
uuid: "0c77d1c2656b40b1a3fa069f44bf9467"
format_stamp: "Formatted at 2026-07-09 13:15:56 on dist-test-slave-zhw8"
I20260709 13:15:56.786655 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:56.790436  7342 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:56.791414 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:15:56.791750 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/master-0-root
uuid: "0c77d1c2656b40b1a3fa069f44bf9467"
format_stamp: "Formatted at 2026-07-09 13:15:56 on dist-test-slave-zhw8"
I20260709 13:15:56.792086 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:56.802492 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:56.803934 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:56.844362 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.190:35391
I20260709 13:15:56.844483  7393 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.190:35391 every 8 connection(s)
I20260709 13:15:56.848464  7394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:56.859123  7394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467: Bootstrap starting.
I20260709 13:15:56.863984  7394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.868341  7394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467: No bootstrap required, opened a new log
I20260709 13:15:56.870502  7394 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c77d1c2656b40b1a3fa069f44bf9467" member_type: VOTER }
I20260709 13:15:56.870865  7394 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.871131  7394 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c77d1c2656b40b1a3fa069f44bf9467, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.871806  7394 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c77d1c2656b40b1a3fa069f44bf9467" member_type: VOTER }
I20260709 13:15:56.872272  7394 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:56.872478  7394 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:56.872777  7394 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.877442  7394 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c77d1c2656b40b1a3fa069f44bf9467" member_type: VOTER }
I20260709 13:15:56.877990  7394 leader_election.cc:304] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c77d1c2656b40b1a3fa069f44bf9467; no voters: 
I20260709 13:15:56.879153  7394 leader_election.cc:290] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:56.879726  7397 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:56.881256  7397 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [term 1 LEADER]: Becoming Leader. State: Replica: 0c77d1c2656b40b1a3fa069f44bf9467, State: Running, Role: LEADER
I20260709 13:15:56.882061  7397 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c77d1c2656b40b1a3fa069f44bf9467" member_type: VOTER }
I20260709 13:15:56.882262  7394 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:56.887562  7398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c77d1c2656b40b1a3fa069f44bf9467" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c77d1c2656b40b1a3fa069f44bf9467" member_type: VOTER } }
I20260709 13:15:56.888389  7398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:56.888141  7399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c77d1c2656b40b1a3fa069f44bf9467. Latest consensus state: current_term: 1 leader_uuid: "0c77d1c2656b40b1a3fa069f44bf9467" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c77d1c2656b40b1a3fa069f44bf9467" member_type: VOTER } }
I20260709 13:15:56.889019  7399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:56.896909  7406 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:56.904539  7406 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:56.905565 31814 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:56.913443  7406 catalog_manager.cc:1383] Generated new cluster ID: c3070ebd5ad74dd78c1283f15eb2a0f4
I20260709 13:15:56.913730  7406 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:56.932126  7406 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:56.933472  7406 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:56.948698  7406 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467: Generated new TSK 0
I20260709 13:15:56.949465  7406 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:56.972692 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:56.979598  7415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:56.980780  7416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:56.983135  7418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:56.983927 31814 server_base.cc:1061] running on GCE node
I20260709 13:15:56.986255 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:56.986532 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:56.986747 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602956986720 us; error 0 us; skew 500 ppm
I20260709 13:15:56.987429 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:56.990105 31814 webserver.cc:533] Webserver started at http://127.31.17.129:40057/ using document root <none> and password file <none>
I20260709 13:15:56.990643 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:56.990877 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:56.991201 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:56.992600 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-0-root/instance:
uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
format_stamp: "Formatted at 2026-07-09 13:15:56 on dist-test-slave-zhw8"
I20260709 13:15:56.997895 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:15:57.001857  7423 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:57.002776 31814 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:15:57.003108 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-0-root
uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
format_stamp: "Formatted at 2026-07-09 13:15:56 on dist-test-slave-zhw8"
I20260709 13:15:57.003501 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:57.048681 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:57.050076 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:57.051798 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:57.054351 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:57.054616 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:57.054888 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:57.055101 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:57.103134 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.129:35515
I20260709 13:15:57.103381  7485 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.129:35515 every 8 connection(s)
I20260709 13:15:57.108343 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:57.117213  7490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:57.119091  7491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:57.124845  7493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:57.124930  7486 heartbeater.cc:344] Connected to a master server at 127.31.17.190:35391
I20260709 13:15:57.125679  7486 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:57.126561 31814 server_base.cc:1061] running on GCE node
I20260709 13:15:57.126919  7486 heartbeater.cc:507] Master 127.31.17.190:35391 requested a full tablet report, sending...
I20260709 13:15:57.128825 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:57.129096 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:57.129293 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602957129272 us; error 0 us; skew 500 ppm
I20260709 13:15:57.129364  7359 ts_manager.cc:194] Registered new tserver with Master: d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:15:57.129917 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:57.131747  7359 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38164
I20260709 13:15:57.132704 31814 webserver.cc:533] Webserver started at http://127.31.17.130:38087/ using document root <none> and password file <none>
I20260709 13:15:57.133248 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:57.133460 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:57.133723 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:57.134858 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-1-root/instance:
uuid: "4a0eef4c5880424694542637530b55c0"
format_stamp: "Formatted at 2026-07-09 13:15:57 on dist-test-slave-zhw8"
I20260709 13:15:57.139298 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:15:57.142762  7498 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:57.143787 31814 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:57.144136 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-1-root
uuid: "4a0eef4c5880424694542637530b55c0"
format_stamp: "Formatted at 2026-07-09 13:15:57 on dist-test-slave-zhw8"
I20260709 13:15:57.144443 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:57.164937 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:57.166471 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:57.168154 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:57.170514 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:57.170766 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:57.171027 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:57.171245 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:57.216696 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.130:45835
I20260709 13:15:57.216832  7560 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.130:45835 every 8 connection(s)
I20260709 13:15:57.222051 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:57.232313  7564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:57.234989  7565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:57.238714 31814 server_base.cc:1061] running on GCE node
I20260709 13:15:57.239557  7561 heartbeater.cc:344] Connected to a master server at 127.31.17.190:35391
W20260709 13:15:57.239795  7568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:57.239971  7561 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:57.240875 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:15:57.240931  7561 heartbeater.cc:507] Master 127.31.17.190:35391 requested a full tablet report, sending...
W20260709 13:15:57.241179 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:57.241478 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602957241460 us; error 0 us; skew 500 ppm
I20260709 13:15:57.242329 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:57.243536  7359 ts_manager.cc:194] Registered new tserver with Master: 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:15:57.245430 31814 webserver.cc:533] Webserver started at http://127.31.17.131:36525/ using document root <none> and password file <none>
I20260709 13:15:57.245720  7359 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38170
I20260709 13:15:57.246187 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:57.246495 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:57.246845 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:57.248584 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-2-root/instance:
uuid: "382e1f4385ac4066b7098e4fd1f5df06"
format_stamp: "Formatted at 2026-07-09 13:15:57 on dist-test-slave-zhw8"
I20260709 13:15:57.253786 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:15:57.257740  7572 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:57.258953 31814 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:15:57.259383 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-2-root
uuid: "382e1f4385ac4066b7098e4fd1f5df06"
format_stamp: "Formatted at 2026-07-09 13:15:57 on dist-test-slave-zhw8"
I20260709 13:15:57.259719 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:57.282368 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:57.283928 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:57.285640 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:57.288133 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:57.288414 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:57.288708 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:57.288914 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:57.333544 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.131:46815
I20260709 13:15:57.333657  7634 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.131:46815 every 8 connection(s)
I20260709 13:15:57.338603 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:57.346714  7638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:57.347289  7639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:57.350968  7641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:57.352349  7635 heartbeater.cc:344] Connected to a master server at 127.31.17.190:35391
I20260709 13:15:57.352715 31814 server_base.cc:1061] running on GCE node
I20260709 13:15:57.352871  7635 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:57.354079  7635 heartbeater.cc:507] Master 127.31.17.190:35391 requested a full tablet report, sending...
I20260709 13:15:57.354182 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:57.354512 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:57.354756 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602957354734 us; error 0 us; skew 500 ppm
I20260709 13:15:57.355726 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:57.356825  7359 ts_manager.cc:194] Registered new tserver with Master: 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:15:57.358544  7359 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38172
I20260709 13:15:57.358740 31814 webserver.cc:533] Webserver started at http://127.31.17.132:40833/ using document root <none> and password file <none>
I20260709 13:15:57.359431 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:57.359674 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:57.360078 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:57.361516 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-3-root/instance:
uuid: "e733469bde7c479a916acbbe84b5f342"
format_stamp: "Formatted at 2026-07-09 13:15:57 on dist-test-slave-zhw8"
I20260709 13:15:57.366173 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:15:57.369640  7646 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:57.370591 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:15:57.370935 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-3-root
uuid: "e733469bde7c479a916acbbe84b5f342"
format_stamp: "Formatted at 2026-07-09 13:15:57 on dist-test-slave-zhw8"
I20260709 13:15:57.371305 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:57.394719 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:57.396266 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:57.397656 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:57.399937 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:57.400207 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:57.400475 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:57.400677 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:57.445470 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.132:35931
I20260709 13:15:57.445612  7708 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.132:35931 every 8 connection(s)
I20260709 13:15:57.460863  7709 heartbeater.cc:344] Connected to a master server at 127.31.17.190:35391
I20260709 13:15:57.461237  7709 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:57.462126  7709 heartbeater.cc:507] Master 127.31.17.190:35391 requested a full tablet report, sending...
I20260709 13:15:57.464202  7359 ts_manager.cc:194] Registered new tserver with Master: e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:15:57.465337 31814 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016110342s
I20260709 13:15:57.465535  7359 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38180
I20260709 13:15:57.494587  7359 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38196:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:15:57.772850  7526 tablet_service.cc:1511] Processing CreateTablet for tablet 1e689baf00c741e2ae7e123bad19a9a7 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:57.774395  7526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e689baf00c741e2ae7e123bad19a9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.776516  7525 tablet_service.cc:1511] Processing CreateTablet for tablet 51c6aa50aa7a4ad9bbcbb6342bb232f2 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:57.778303  7525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51c6aa50aa7a4ad9bbcbb6342bb232f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.780511  7522 tablet_service.cc:1511] Processing CreateTablet for tablet cfd5d05ff1384d2c9c133fdb0483f29a (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:57.782130  7522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd5d05ff1384d2c9c133fdb0483f29a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.782928  7520 tablet_service.cc:1511] Processing CreateTablet for tablet aa473d10c0ad424f8268c67efcccccff (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:57.785106  7597 tablet_service.cc:1511] Processing CreateTablet for tablet c96e53ac6d4a4521824a0eef2bf0400b (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:57.785406  7600 tablet_service.cc:1511] Processing CreateTablet for tablet b2119d52e4a048ebb803fffdf77b85c2 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:57.786574  7597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96e53ac6d4a4521824a0eef2bf0400b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.786334  7521 tablet_service.cc:1511] Processing CreateTablet for tablet 1ea546eef5aa4273af08f1b3468c5369 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:57.788483  7598 tablet_service.cc:1511] Processing CreateTablet for tablet 5e84fe9726f946d2b3552cd90cf46b98 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:57.790081  7598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e84fe9726f946d2b3552cd90cf46b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.789691  7596 tablet_service.cc:1511] Processing CreateTablet for tablet d0a389b4005c4d6890f09b248b3e1ad8 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:57.785097  7520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa473d10c0ad424f8268c67efcccccff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.792102  7599 tablet_service.cc:1511] Processing CreateTablet for tablet 1e689baf00c741e2ae7e123bad19a9a7 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:57.793546  7595 tablet_service.cc:1511] Processing CreateTablet for tablet 1ea546eef5aa4273af08f1b3468c5369 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:57.794761  7519 tablet_service.cc:1511] Processing CreateTablet for tablet a87d88042080495293c0e772b280f3da (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:57.796584  7519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a87d88042080495293c0e772b280f3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.796362  7594 tablet_service.cc:1511] Processing CreateTablet for tablet aa473d10c0ad424f8268c67efcccccff (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:57.799036  7518 tablet_service.cc:1511] Processing CreateTablet for tablet 4d154a19800f414dbaec32117c0ca6bd (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:57.800686  7518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d154a19800f414dbaec32117c0ca6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.805210  7523 tablet_service.cc:1511] Processing CreateTablet for tablet c96e53ac6d4a4521824a0eef2bf0400b (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:57.806893  7523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96e53ac6d4a4521824a0eef2bf0400b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.809360  7524 tablet_service.cc:1511] Processing CreateTablet for tablet 5e84fe9726f946d2b3552cd90cf46b98 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:57.809727  7451 tablet_service.cc:1511] Processing CreateTablet for tablet b2119d52e4a048ebb803fffdf77b85c2 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:57.811645  7451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2119d52e4a048ebb803fffdf77b85c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.815716  7592 tablet_service.cc:1511] Processing CreateTablet for tablet 4d154a19800f414dbaec32117c0ca6bd (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:57.815771  7593 tablet_service.cc:1511] Processing CreateTablet for tablet e7bab86470a74fdfb18b961658f9e371 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:57.819651  7596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a389b4005c4d6890f09b248b3e1ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.820370  7594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa473d10c0ad424f8268c67efcccccff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.821766  7595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ea546eef5aa4273af08f1b3468c5369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.823199  7592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d154a19800f414dbaec32117c0ca6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.824860  7593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7bab86470a74fdfb18b961658f9e371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.826141  7524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e84fe9726f946d2b3552cd90cf46b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.827745  7521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ea546eef5aa4273af08f1b3468c5369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.840200  7517 tablet_service.cc:1511] Processing CreateTablet for tablet 361e20d70ddc4e43b3dcbe2e9ca30f50 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:57.841951  7517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 361e20d70ddc4e43b3dcbe2e9ca30f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.844882  7599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e689baf00c741e2ae7e123bad19a9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.860822  7600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2119d52e4a048ebb803fffdf77b85c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.862767  7450 tablet_service.cc:1511] Processing CreateTablet for tablet 1e689baf00c741e2ae7e123bad19a9a7 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:57.864292  7450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e689baf00c741e2ae7e123bad19a9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.864391  7448 tablet_service.cc:1511] Processing CreateTablet for tablet c96e53ac6d4a4521824a0eef2bf0400b (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:57.865820  7448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96e53ac6d4a4521824a0eef2bf0400b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.868112  7449 tablet_service.cc:1511] Processing CreateTablet for tablet 51c6aa50aa7a4ad9bbcbb6342bb232f2 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:57.868450  7447 tablet_service.cc:1511] Processing CreateTablet for tablet cfd5d05ff1384d2c9c133fdb0483f29a (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:57.870311  7591 tablet_service.cc:1511] Processing CreateTablet for tablet 361e20d70ddc4e43b3dcbe2e9ca30f50 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:57.871465  7446 tablet_service.cc:1511] Processing CreateTablet for tablet d0a389b4005c4d6890f09b248b3e1ad8 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:57.872939  7446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a389b4005c4d6890f09b248b3e1ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.876094  7449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51c6aa50aa7a4ad9bbcbb6342bb232f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.879609  7447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd5d05ff1384d2c9c133fdb0483f29a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.892431  7591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 361e20d70ddc4e43b3dcbe2e9ca30f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.894750  7597 tablet_service.cc:1511] Processing CreateTablet for tablet ecfe0c23a9c54b2dbe03deca022a9123 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:57.896251  7597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecfe0c23a9c54b2dbe03deca022a9123. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:57.899467  7407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:57.909017  7444 tablet_service.cc:1511] Processing CreateTablet for tablet a87d88042080495293c0e772b280f3da (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:57.907111  7445 tablet_service.cc:1511] Processing CreateTablet for tablet aa473d10c0ad424f8268c67efcccccff (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:57.912074  7729 tablet_bootstrap.cc:492] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:15:57.911005  7444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a87d88042080495293c0e772b280f3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.919746  7445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa473d10c0ad424f8268c67efcccccff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.929010  7443 tablet_service.cc:1511] Processing CreateTablet for tablet e7bab86470a74fdfb18b961658f9e371 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:57.932061  7442 tablet_service.cc:1511] Processing CreateTablet for tablet 361e20d70ddc4e43b3dcbe2e9ca30f50 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:57.943663  7673 tablet_service.cc:1511] Processing CreateTablet for tablet 51c6aa50aa7a4ad9bbcbb6342bb232f2 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:57.945158  7673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51c6aa50aa7a4ad9bbcbb6342bb232f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.945677  7669 tablet_service.cc:1511] Processing CreateTablet for tablet 1ea546eef5aa4273af08f1b3468c5369 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:57.947955  7672 tablet_service.cc:1511] Processing CreateTablet for tablet 5e84fe9726f946d2b3552cd90cf46b98 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:57.948480  7668 tablet_service.cc:1511] Processing CreateTablet for tablet a87d88042080495293c0e772b280f3da (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:57.950431  7671 tablet_service.cc:1511] Processing CreateTablet for tablet cfd5d05ff1384d2c9c133fdb0483f29a (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:57.950778  7674 tablet_service.cc:1511] Processing CreateTablet for tablet b2119d52e4a048ebb803fffdf77b85c2 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:57.952963  7670 tablet_service.cc:1511] Processing CreateTablet for tablet d0a389b4005c4d6890f09b248b3e1ad8 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:57.954722  7666 tablet_service.cc:1511] Processing CreateTablet for tablet 4d154a19800f414dbaec32117c0ca6bd (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:57.952971  7667 tablet_service.cc:1511] Processing CreateTablet for tablet e7bab86470a74fdfb18b961658f9e371 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:57.957666  7665 tablet_service.cc:1511] Processing CreateTablet for tablet 20ee12a0193649c295925bc14e57d382 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:57.959337  7669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ea546eef5aa4273af08f1b3468c5369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.963207  7670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a389b4005c4d6890f09b248b3e1ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.965281  7668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a87d88042080495293c0e772b280f3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.967595  7674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2119d52e4a048ebb803fffdf77b85c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.968480  7671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd5d05ff1384d2c9c133fdb0483f29a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.979543  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d154a19800f414dbaec32117c0ca6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.983820  7665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20ee12a0193649c295925bc14e57d382. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.989599  7672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e84fe9726f946d2b3552cd90cf46b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.990303  7667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7bab86470a74fdfb18b961658f9e371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.002768  7729 tablet_bootstrap.cc:654] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.014245  7524 tablet_service.cc:1511] Processing CreateTablet for tablet 20ee12a0193649c295925bc14e57d382 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:58.028179  7443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7bab86470a74fdfb18b961658f9e371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.034853  7520 tablet_service.cc:1511] Processing CreateTablet for tablet 33e9e771ee0f4cb6b649f9ebc0056443 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:58.053164  7449 tablet_service.cc:1511] Processing CreateTablet for tablet 20ee12a0193649c295925bc14e57d382 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:58.054011  7442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 361e20d70ddc4e43b3dcbe2e9ca30f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.057345  7449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20ee12a0193649c295925bc14e57d382. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.026902  7524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20ee12a0193649c295925bc14e57d382. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.080948  7517 tablet_service.cc:1511] Processing CreateTablet for tablet 120b8b81bd894896b1bdf58d7b461d41 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:58.083406  7451 tablet_service.cc:1511] Processing CreateTablet for tablet ecfe0c23a9c54b2dbe03deca022a9123 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:58.085384  7451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecfe0c23a9c54b2dbe03deca022a9123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.107647  7730 tablet_bootstrap.cc:492] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:15:58.107873  7518 tablet_service.cc:1511] Processing CreateTablet for tablet 0ce2cd95149b4e5999f7b078e668f5b7 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:58.109483  7520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33e9e771ee0f4cb6b649f9ebc0056443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.117432  7522 tablet_service.cc:1511] Processing CreateTablet for tablet e250baa9f7b44f2fb0002ff47f7c34db (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:58.118762  7522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e250baa9f7b44f2fb0002ff47f7c34db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.135553  7486 heartbeater.cc:499] Master 127.31.17.190:35391 was elected leader, sending a full tablet report...
I20260709 13:15:58.136405  7521 tablet_service.cc:1511] Processing CreateTablet for tablet a899962d588849ccb4af0f8cb06c07d0 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:58.137912  7521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a899962d588849ccb4af0f8cb06c07d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.138646  7730 tablet_bootstrap.cc:654] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.164083  7592 tablet_service.cc:1511] Processing CreateTablet for tablet 120b8b81bd894896b1bdf58d7b461d41 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:58.186975  7592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 120b8b81bd894896b1bdf58d7b461d41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.191839  7671 tablet_service.cc:1511] Processing CreateTablet for tablet 0ce2cd95149b4e5999f7b078e668f5b7 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:58.193233  7671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ce2cd95149b4e5999f7b078e668f5b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.193109  7450 tablet_service.cc:1511] Processing CreateTablet for tablet 0ce2cd95149b4e5999f7b078e668f5b7 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:58.194520  7450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ce2cd95149b4e5999f7b078e668f5b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.195106  7596 tablet_service.cc:1511] Processing CreateTablet for tablet 58b825b38d394fbfbdf8cb645514c782 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:58.170461  7595 tablet_service.cc:1511] Processing CreateTablet for tablet a899962d588849ccb4af0f8cb06c07d0 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:58.177743  7669 tablet_service.cc:1511] Processing CreateTablet for tablet 33e9e771ee0f4cb6b649f9ebc0056443 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:58.180091  7600 tablet_service.cc:1511] Processing CreateTablet for tablet 868663ec219f46a5abe840f8d43158e7 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:58.199672  7595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a899962d588849ccb4af0f8cb06c07d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.182154  7525 tablet_service.cc:1511] Processing CreateTablet for tablet 82d28d9895a5469db67cd40794083e95 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:58.135800  7599 tablet_service.cc:1511] Processing CreateTablet for tablet 33e9e771ee0f4cb6b649f9ebc0056443 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:58.185003  7594 tablet_service.cc:1511] Processing CreateTablet for tablet e250baa9f7b44f2fb0002ff47f7c34db (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:58.185482  7597 tablet_service.cc:1511] Processing CreateTablet for tablet fb1b71c94d284d209da03c159c07316f (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:58.199672  7669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33e9e771ee0f4cb6b649f9ebc0056443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.180126  7666 tablet_service.cc:1511] Processing CreateTablet for tablet ecfe0c23a9c54b2dbe03deca022a9123 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:58.221673  7451 tablet_service.cc:1511] Processing CreateTablet for tablet 868663ec219f46a5abe840f8d43158e7 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:58.222383  7526 tablet_service.cc:1511] Processing CreateTablet for tablet 58b825b38d394fbfbdf8cb645514c782 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:58.224061  7731 tablet_bootstrap.cc:492] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:15:58.224117  7448 tablet_service.cc:1511] Processing CreateTablet for tablet a899962d588849ccb4af0f8cb06c07d0 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:58.157723  7445 tablet_service.cc:1511] Processing CreateTablet for tablet 120b8b81bd894896b1bdf58d7b461d41 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:58.227655  7449 tablet_service.cc:1511] Processing CreateTablet for tablet fb1b71c94d284d209da03c159c07316f (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:58.202432  7729 tablet_bootstrap.cc:492] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:15:58.208619  7517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 120b8b81bd894896b1bdf58d7b461d41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.223117  7451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 868663ec219f46a5abe840f8d43158e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.229070  7520 tablet_service.cc:1511] Processing CreateTablet for tablet 6d716d1bf1004e7ca0d255d7d9c50835 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:58.240046  7518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ce2cd95149b4e5999f7b078e668f5b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.225021  7446 tablet_service.cc:1511] Processing CreateTablet for tablet 82d28d9895a5469db67cd40794083e95 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:58.240945  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecfe0c23a9c54b2dbe03deca022a9123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.236191  7596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58b825b38d394fbfbdf8cb645514c782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.234838  7729 ts_tablet_manager.cc:1403] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.323s	user 0.015s	sys 0.039s
I20260709 13:15:58.250838  7561 heartbeater.cc:499] Master 127.31.17.190:35391 was elected leader, sending a full tablet report...
I20260709 13:15:58.255918  7600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 868663ec219f46a5abe840f8d43158e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.207648  7667 tablet_service.cc:1511] Processing CreateTablet for tablet e250baa9f7b44f2fb0002ff47f7c34db (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:58.268910  7449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1b71c94d284d209da03c159c07316f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.204283  7668 tablet_service.cc:1511] Processing CreateTablet for tablet 868663ec219f46a5abe840f8d43158e7 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:58.280378  7674 tablet_service.cc:1511] Processing CreateTablet for tablet 82d28d9895a5469db67cd40794083e95 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:58.262938  7591 tablet_service.cc:1511] Processing CreateTablet for tablet 6d716d1bf1004e7ca0d255d7d9c50835 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:58.283061  7526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58b825b38d394fbfbdf8cb645514c782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.279049  7597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1b71c94d284d209da03c159c07316f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.280926  7729 raft_consensus.cc:359] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:58.303540  7520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d716d1bf1004e7ca0d255d7d9c50835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.295704  7673 tablet_service.cc:1511] Processing CreateTablet for tablet ee023e046cb943559b9daae3b76c4adf (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:58.295819  7593 tablet_service.cc:1511] Processing CreateTablet for tablet de79ef75f6ba41b4a0e56ba851add378 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:58.311123  7525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d28d9895a5469db67cd40794083e95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.313355  7730 tablet_bootstrap.cc:492] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:15:58.315650  7593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de79ef75f6ba41b4a0e56ba851add378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.316363  7523 tablet_service.cc:1511] Processing CreateTablet for tablet ee023e046cb943559b9daae3b76c4adf (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:58.317775  7523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee023e046cb943559b9daae3b76c4adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.293509  7446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d28d9895a5469db67cd40794083e95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.319531  7591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d716d1bf1004e7ca0d255d7d9c50835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.323462  7665 tablet_service.cc:1511] Processing CreateTablet for tablet fb1b71c94d284d209da03c159c07316f (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:58.331535  7445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 120b8b81bd894896b1bdf58d7b461d41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.292533  7729 raft_consensus.cc:385] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.336630  7729 raft_consensus.cc:740] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.336918  7599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33e9e771ee0f4cb6b649f9ebc0056443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.338682  7448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a899962d588849ccb4af0f8cb06c07d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.341569  7594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e250baa9f7b44f2fb0002ff47f7c34db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.297974  7672 tablet_service.cc:1511] Processing CreateTablet for tablet 58b825b38d394fbfbdf8cb645514c782 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:58.314724  7730 ts_tablet_manager.cc:1403] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.216s	user 0.017s	sys 0.000s
I20260709 13:15:58.354090  7600 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8887c1835b4d5b9697b6a44f0efd7e (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:58.354452  7729 consensus_queue.cc:260] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:58.355513  7600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8887c1835b4d5b9697b6a44f0efd7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.347882  7447 tablet_service.cc:1511] Processing CreateTablet for tablet 6d716d1bf1004e7ca0d255d7d9c50835 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:58.361660  7635 heartbeater.cc:499] Master 127.31.17.190:35391 was elected leader, sending a full tablet report...
I20260709 13:15:58.295384  7734 tablet_bootstrap.cc:492] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:15:58.363787  7443 tablet_service.cc:1511] Processing CreateTablet for tablet de79ef75f6ba41b4a0e56ba851add378 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:58.364210  7667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e250baa9f7b44f2fb0002ff47f7c34db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.365226  7444 tablet_service.cc:1511] Processing CreateTablet for tablet ee023e046cb943559b9daae3b76c4adf (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:58.373145  7731 tablet_bootstrap.cc:654] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.363097  7526 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8887c1835b4d5b9697b6a44f0efd7e (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:58.390638  7526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8887c1835b4d5b9697b6a44f0efd7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.369820  7730 raft_consensus.cc:359] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:58.390651  7735 raft_consensus.cc:493] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.394469  7735 raft_consensus.cc:515] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:58.382103  7671 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8887c1835b4d5b9697b6a44f0efd7e (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:58.367146  7670 tablet_service.cc:1511] Processing CreateTablet for tablet de79ef75f6ba41b4a0e56ba851add378 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:58.379153  7443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de79ef75f6ba41b4a0e56ba851add378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.428690  7447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d716d1bf1004e7ca0d255d7d9c50835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.434499  7444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee023e046cb943559b9daae3b76c4adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.393476  7730 raft_consensus.cc:385] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.435051  7673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee023e046cb943559b9daae3b76c4adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.435003  7730 raft_consensus.cc:740] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.436300  7668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 868663ec219f46a5abe840f8d43158e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.447494  7730 consensus_queue.cc:260] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:58.455224  7665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1b71c94d284d209da03c159c07316f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.463315  7729 ts_tablet_manager.cc:1434] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.213s	user 0.015s	sys 0.003s
I20260709 13:15:58.464522  7729 tablet_bootstrap.cc:492] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:15:58.464814  7450 tablet_service.cc:1511] Processing CreateTablet for tablet 5266494b97e8402b9696d8771ca7e9f0 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:58.466167  7450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5266494b97e8402b9696d8771ca7e9f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.468066  7709 heartbeater.cc:499] Master 127.31.17.190:35391 was elected leader, sending a full tablet report...
I20260709 13:15:58.471410  7735 leader_election.cc:290] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:15:58.484669  7672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58b825b38d394fbfbdf8cb645514c782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.503765  7521 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4e6876d12b4cf6ad01688451c1b033 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:58.505213  7521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4e6876d12b4cf6ad01688451c1b033. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.502389  7449 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4e6876d12b4cf6ad01688451c1b033 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:58.511596  7449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4e6876d12b4cf6ad01688451c1b033. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.514782  7734 tablet_bootstrap.cc:654] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.515802  7666 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4e6876d12b4cf6ad01688451c1b033 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:58.517251  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4e6876d12b4cf6ad01688451c1b033. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.548205  7740 raft_consensus.cc:493] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.548763  7740 raft_consensus.cc:515] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:58.551054  7596 tablet_service.cc:1511] Processing CreateTablet for tablet 343cf82796c24137960d60c292b5dd42 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:58.551469  7740 leader_election.cc:290] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:15:58.546984  7670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de79ef75f6ba41b4a0e56ba851add378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.565860  7729 tablet_bootstrap.cc:654] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.577037  7731 tablet_bootstrap.cc:492] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:15:58.608640  7448 tablet_service.cc:1511] Processing CreateTablet for tablet 343cf82796c24137960d60c292b5dd42 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:58.610090  7448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 343cf82796c24137960d60c292b5dd42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.609542  7669 tablet_service.cc:1511] Processing CreateTablet for tablet 343cf82796c24137960d60c292b5dd42 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:58.615449  7731 ts_tablet_manager.cc:1403] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.392s	user 0.019s	sys 0.004s
I20260709 13:15:58.591799  7596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 343cf82796c24137960d60c292b5dd42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.627341  7674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d28d9895a5469db67cd40794083e95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.628441  7730 ts_tablet_manager.cc:1434] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.284s	user 0.000s	sys 0.019s
W20260709 13:15:58.628630  7636 tablet.cc:2406] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:58.630106  7730 tablet_bootstrap.cc:492] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:15:58.626924  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96e53ac6d4a4521824a0eef2bf0400b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:15:58.618749  7731 raft_consensus.cc:359] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:58.644874  7597 tablet_service.cc:1511] Processing CreateTablet for tablet 5266494b97e8402b9696d8771ca7e9f0 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:58.646301  7597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5266494b97e8402b9696d8771ca7e9f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.628415  7669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 343cf82796c24137960d60c292b5dd42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.566565  7518 tablet_service.cc:1511] Processing CreateTablet for tablet 5266494b97e8402b9696d8771ca7e9f0 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
W20260709 13:15:58.659401  7574 leader_election.cc:343] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.659710  7518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5266494b97e8402b9696d8771ca7e9f0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:58.660260  7343 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.31.17.131:46815, user_credentials={real_user=slave}} blocked reactor thread for 54131.4us
I20260709 13:15:58.641486  7731 raft_consensus.cc:385] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.677130  7731 raft_consensus.cc:740] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
W20260709 13:15:58.677376  7346 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.31.17.130:45835, user_credentials={real_user=slave}} blocked reactor thread for 64901.2us
I20260709 13:15:58.678261  7731 consensus_queue.cc:260] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:58.718791  7671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8887c1835b4d5b9697b6a44f0efd7e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:58.731457  7344 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.31.17.129:35515, user_credentials={real_user=slave}} blocked reactor thread for 48979us
I20260709 13:15:58.754562  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa473d10c0ad424f8268c67efcccccff" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:15:58.754993  7517 tablet_service.cc:1511] Processing CreateTablet for tablet e0e1f08d649449a6a1a39b78f0b7adff (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:58.756472  7517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e1f08d649449a6a1a39b78f0b7adff. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:58.760125  7500 leader_election.cc:343] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.762123  7595 tablet_service.cc:1511] Processing CreateTablet for tablet e0e1f08d649449a6a1a39b78f0b7adff (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:58.763497  7595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e1f08d649449a6a1a39b78f0b7adff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.760442  7734 tablet_bootstrap.cc:492] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:15:58.765535  7734 ts_tablet_manager.cc:1403] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.482s	user 0.011s	sys 0.031s
I20260709 13:15:58.797556  7595 tablet_service.cc:1511] Processing CreateTablet for tablet 98892caf6b1549c8a1906b47c1298334 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:58.800304  7731 ts_tablet_manager.cc:1434] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.184s	user 0.010s	sys 0.020s
I20260709 13:15:58.804347  7731 tablet_bootstrap.cc:492] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:15:58.802676  7600 tablet_service.cc:1511] Processing CreateTablet for tablet 81703e5e726a4905a8cff753fe076535 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:58.805565  7600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81703e5e726a4905a8cff753fe076535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.801496  7521 tablet_service.cc:1511] Processing CreateTablet for tablet b215f304c98341bebbc937add44da99d (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:58.808085  7521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b215f304c98341bebbc937add44da99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.810066  7592 tablet_service.cc:1511] Processing CreateTablet for tablet e8380470ec0d46c1914152ad9818bab7 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:58.811446  7592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8380470ec0d46c1914152ad9818bab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.811990  7523 tablet_service.cc:1511] Processing CreateTablet for tablet 98892caf6b1549c8a1906b47c1298334 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:58.815690  7523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98892caf6b1549c8a1906b47c1298334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.816210  7522 tablet_service.cc:1511] Processing CreateTablet for tablet e8380470ec0d46c1914152ad9818bab7 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:58.815104  7731 tablet_bootstrap.cc:654] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.818845  7526 tablet_service.cc:1511] Processing CreateTablet for tablet 54c4242890a943ec865bafae33141d3b (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:58.816231  7591 tablet_service.cc:1511] Processing CreateTablet for tablet 54c4242890a943ec865bafae33141d3b (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:58.821635  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa473d10c0ad424f8268c67efcccccff" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
W20260709 13:15:58.823580  7499 leader_election.cc:343] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.824366  7499 leader_election.cc:304] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:15:58.824231  7525 tablet_service.cc:1511] Processing CreateTablet for tablet c9b5ae77739f4adca66b64acf11c42ce (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:58.825927  7743 raft_consensus.cc:2749] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:58.768625  7734 raft_consensus.cc:359] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:15:58.827682  7734 raft_consensus.cc:385] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.828044  7734 raft_consensus.cc:740] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.827929  7594 tablet_service.cc:1511] Processing CreateTablet for tablet aa56ac7185b84a7ba5fdc8f39e5de8f3 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:58.828879  7734 consensus_queue.cc:260] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:15:58.832597  7520 tablet_service.cc:1511] Processing CreateTablet for tablet 1ce8654527b4453bab2b63775a4e2601 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:58.837707  7522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8380470ec0d46c1914152ad9818bab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.839569  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96e53ac6d4a4521824a0eef2bf0400b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:15:58.842190  7599 tablet_service.cc:1511] Processing CreateTablet for tablet 1ce8654527b4453bab2b63775a4e2601 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 13:15:58.844146  7576 leader_election.cc:343] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.844772  7576 leader_election.cc:304] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:15:58.846186  7736 raft_consensus.cc:2749] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:58.843096  7344 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.31.17.132:35931, user_credentials={real_user=slave}} blocked reactor thread for 52652.7us
I20260709 13:15:58.850488  7448 tablet_service.cc:1511] Processing CreateTablet for tablet 98892caf6b1549c8a1906b47c1298334 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:58.851379  7667 tablet_service.cc:1511] Processing CreateTablet for tablet b215f304c98341bebbc937add44da99d (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:58.851898  7448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98892caf6b1549c8a1906b47c1298334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.852916  7667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b215f304c98341bebbc937add44da99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.853561  7730 tablet_bootstrap.cc:654] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.855942  7525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9b5ae77739f4adca66b64acf11c42ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.857057  7729 tablet_bootstrap.cc:492] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:15:58.856305  7666 tablet_service.cc:1511] Processing CreateTablet for tablet e0e1f08d649449a6a1a39b78f0b7adff (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:58.857643  7729 ts_tablet_manager.cc:1403] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.393s	user 0.011s	sys 0.029s
I20260709 13:15:58.858348  7666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e1f08d649449a6a1a39b78f0b7adff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.859813  7520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ce8654527b4453bab2b63775a4e2601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.869272  7729 raft_consensus.cc:359] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:58.873587  7729 raft_consensus.cc:385] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.873991  7729 raft_consensus.cc:740] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.877665  7668 tablet_service.cc:1511] Processing CreateTablet for tablet e8380470ec0d46c1914152ad9818bab7 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:58.879029  7665 tablet_service.cc:1511] Processing CreateTablet for tablet c9b5ae77739f4adca66b64acf11c42ce (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:58.879612  7444 tablet_service.cc:1511] Processing CreateTablet for tablet c9b5ae77739f4adca66b64acf11c42ce (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:58.880963  7444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9b5ae77739f4adca66b64acf11c42ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.881326  7443 tablet_service.cc:1511] Processing CreateTablet for tablet aa56ac7185b84a7ba5fdc8f39e5de8f3 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:58.882716  7443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa56ac7185b84a7ba5fdc8f39e5de8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.884235  7672 tablet_service.cc:1511] Processing CreateTablet for tablet aa56ac7185b84a7ba5fdc8f39e5de8f3 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:58.885924  7731 tablet_bootstrap.cc:492] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:15:58.886585  7731 ts_tablet_manager.cc:1403] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.082s	user 0.020s	sys 0.002s
I20260709 13:15:58.889940  7731 raft_consensus.cc:359] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:15:58.894378  7731 raft_consensus.cc:385] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.894855  7731 raft_consensus.cc:740] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.891865  7591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54c4242890a943ec865bafae33141d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.895965  7594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa56ac7185b84a7ba5fdc8f39e5de8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.898056  7595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98892caf6b1549c8a1906b47c1298334. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:58.902213  7407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:58.903106  7525 tablet_service.cc:1511] Processing CreateTablet for tablet e1b1bccbb9eb4fc7987174b429fce6d4 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:58.903762  7593 tablet_service.cc:1511] Processing CreateTablet for tablet e1b1bccbb9eb4fc7987174b429fce6d4 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:58.904592  7599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ce8654527b4453bab2b63775a4e2601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.904270  7673 tablet_service.cc:1511] Processing CreateTablet for tablet 81703e5e726a4905a8cff753fe076535 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:58.905337  7593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1b1bccbb9eb4fc7987174b429fce6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.906654  7447 tablet_service.cc:1511] Processing CreateTablet for tablet b215f304c98341bebbc937add44da99d (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:58.907968  7447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b215f304c98341bebbc937add44da99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.892345  7449 tablet_service.cc:1511] Processing CreateTablet for tablet 54c4242890a943ec865bafae33141d3b (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:58.893671  7665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9b5ae77739f4adca66b64acf11c42ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.890898  7730 tablet_bootstrap.cc:492] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:15:58.914568  7730 ts_tablet_manager.cc:1403] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.285s	user 0.016s	sys 0.002s
I20260709 13:15:58.916265  7450 tablet_service.cc:1511] Processing CreateTablet for tablet 81703e5e726a4905a8cff753fe076535 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:58.917681  7450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81703e5e726a4905a8cff753fe076535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.917958  7730 raft_consensus.cc:359] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:58.918798  7730 raft_consensus.cc:385] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.879540  7729 consensus_queue.cc:260] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:58.921904  7729 ts_tablet_manager.cc:1434] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.004s
I20260709 13:15:58.922837  7449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54c4242890a943ec865bafae33141d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.923718  7731 consensus_queue.cc:260] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:15:58.926131  7731 ts_tablet_manager.cc:1434] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.039s	user 0.000s	sys 0.005s
I20260709 13:15:58.904600  7525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1b1bccbb9eb4fc7987174b429fce6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.930388  7750 raft_consensus.cc:493] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.930927  7750 raft_consensus.cc:515] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:58.919113  7730 raft_consensus.cc:740] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.923023  7729 tablet_bootstrap.cc:492] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:15:58.941144  7526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54c4242890a943ec865bafae33141d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.927186  7731 tablet_bootstrap.cc:492] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:15:58.950382  7598 tablet_service.cc:1511] Processing CreateTablet for tablet 11909bda591f4d61a9817bd3575748b5 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:58.951946  7598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11909bda591f4d61a9817bd3575748b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.956175  7517 tablet_service.cc:1511] Processing CreateTablet for tablet 8219a2ee929d4169bde0d0eaf559f7d9 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:58.957451  7517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8219a2ee929d4169bde0d0eaf559f7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.958668  7523 tablet_service.cc:1511] Processing CreateTablet for tablet 58c780fdb61048ac8f4c44481a73f9ff (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:58.959283  7672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa56ac7185b84a7ba5fdc8f39e5de8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.960109  7523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c780fdb61048ac8f4c44481a73f9ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.963447  7730 consensus_queue.cc:260] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:58.965780  7673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81703e5e726a4905a8cff753fe076535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.966056  7730 ts_tablet_manager.cc:1434] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:15:58.936213  7750 leader_election.cc:290] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:15:58.976048  7668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8380470ec0d46c1914152ad9818bab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:58.980824  7752 raft_consensus.cc:493] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.987624  7752 raft_consensus.cc:515] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:15:58.996485  7750 raft_consensus.cc:493] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.998473  7730 tablet_bootstrap.cc:492] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:15:59.016593  7593 tablet_service.cc:1511] Processing CreateTablet for tablet 58c780fdb61048ac8f4c44481a73f9ff (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:59.018110  7593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c780fdb61048ac8f4c44481a73f9ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.020237  7669 tablet_service.cc:1511] Processing CreateTablet for tablet 11909bda591f4d61a9817bd3575748b5 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:59.021883  7669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11909bda591f4d61a9817bd3575748b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.000834  7750 raft_consensus.cc:515] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:15:59.054989  7674 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37012 (request call id 15) took 1059 ms. Trace:
I20260709 13:15:59.056137  7750 leader_election.cc:290] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:15:59.063190  7729 tablet_bootstrap.cc:654] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.062206  7752 leader_election.cc:290] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:15:59.087803  7670 tablet_service.cc:1511] Processing CreateTablet for tablet 8219a2ee929d4169bde0d0eaf559f7d9 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 13:15:59.061571  7344 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.31.17.132:35931, user_credentials={real_user=slave}} blocked reactor thread for 46429.4us
I20260709 13:15:59.099045  7518 tablet_service.cc:1511] Processing CreateTablet for tablet 8e6382ace6264a0db74146326b719f7b (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:59.107007  7518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6382ace6264a0db74146326b719f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.056140  7674 rpcz_store.cc:276] 0709 13:15:57.995698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.219541 (+223843us) service_pool.cc:224] Handling call
0709 13:15:58.286804 (+ 67263us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:58.290873 (+  4069us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:58.832475 (+541602us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:59.044722 (+212247us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:59.054838 (+ 10116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4696}
I20260709 13:15:59.124503  7600 tablet_service.cc:1511] Processing CreateTablet for tablet 8e6382ace6264a0db74146326b719f7b (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:59.125059  7731 tablet_bootstrap.cc:654] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.125934  7600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6382ace6264a0db74146326b719f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.132315  7671 tablet_service.cc:1511] Processing CreateTablet for tablet 1ce8654527b4453bab2b63775a4e2601 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:59.134403  7444 tablet_service.cc:1511] Processing CreateTablet for tablet e1b1bccbb9eb4fc7987174b429fce6d4 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:59.135771  7444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1b1bccbb9eb4fc7987174b429fce6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.135810  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:15:59.137529  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
W20260709 13:15:59.138859  7427 leader_election.cc:343] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:59.139768  7427 leader_election.cc:343] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.140818  7445 tablet_service.cc:1511] Processing CreateTablet for tablet 11909bda591f4d61a9817bd3575748b5 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:59.141471  7446 tablet_service.cc:1511] Processing CreateTablet for tablet 0e442d8263394fa7bd9df6ee46bb246e (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:59.142164  7445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11909bda591f4d61a9817bd3575748b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.142987  7670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8219a2ee929d4169bde0d0eaf559f7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.144196  7451 tablet_service.cc:1511] Processing CreateTablet for tablet 8e6382ace6264a0db74146326b719f7b (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:59.145659  7451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6382ace6264a0db74146326b719f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.147534  7671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ce8654527b4453bab2b63775a4e2601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.149441  7446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e442d8263394fa7bd9df6ee46bb246e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.160801  7673 tablet_service.cc:1511] Processing CreateTablet for tablet 58c780fdb61048ac8f4c44481a73f9ff (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:59.163591  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:15:59.167012  7610 raft_consensus.cc:2468] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:15:59.167439  7673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c780fdb61048ac8f4c44481a73f9ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.168664  7734 ts_tablet_manager.cc:1434] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.403s	user 0.011s	sys 0.002s
I20260709 13:15:59.169955  7734 tablet_bootstrap.cc:492] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:15:59.170318  7674 tablet_service.cc:1511] Processing CreateTablet for tablet 0e442d8263394fa7bd9df6ee46bb246e (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:59.172067  7674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e442d8263394fa7bd9df6ee46bb246e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.175719  7424 leader_election.cc:304] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:15:59.176714  7750 raft_consensus.cc:2804] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:59.177093  7750 raft_consensus.cc:493] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.177448  7750 raft_consensus.cc:3060] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:59.182857  7448 tablet_service.cc:1511] Processing CreateTablet for tablet 8219a2ee929d4169bde0d0eaf559f7d9 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:59.184415  7448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8219a2ee929d4169bde0d0eaf559f7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.204020  7594 tablet_service.cc:1511] Processing CreateTablet for tablet a87af8743bc441c28b895aa411d33f2a (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:59.190276  7750 raft_consensus.cc:515] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:59.205498  7594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a87af8743bc441c28b895aa411d33f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.204061  7730 tablet_bootstrap.cc:654] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.208704  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:15:59.209334  7610 raft_consensus.cc:3060] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:59.212634  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
W20260709 13:15:59.214330  7427 leader_election.cc:343] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.216244  7517 tablet_service.cc:1511] Processing CreateTablet for tablet 0e442d8263394fa7bd9df6ee46bb246e (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:59.217569  7517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e442d8263394fa7bd9df6ee46bb246e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.218879  7610 raft_consensus.cc:2468] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:15:59.219424  7750 leader_election.cc:290] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:15:59.221410  7734 tablet_bootstrap.cc:654] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.221968  7424 leader_election.cc:304] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:15:59.224426  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:15:59.225450  7665 tablet_service.cc:1511] Processing CreateTablet for tablet a87af8743bc441c28b895aa411d33f2a (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:59.227891  7665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a87af8743bc441c28b895aa411d33f2a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:59.225860  7650 leader_election.cc:343] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.242734  7731 tablet_bootstrap.cc:492] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:15:59.243350  7731 ts_tablet_manager.cc:1403] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.316s	user 0.012s	sys 0.003s
I20260709 13:15:59.242985  7598 tablet_service.cc:1511] Processing CreateTablet for tablet d351dea40bb24488b7159df0e49bb759 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:59.243997  7750 raft_consensus.cc:2804] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:59.252979  7750 raft_consensus.cc:697] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:15:59.252526  7447 tablet_service.cc:1511] Processing CreateTablet for tablet a87af8743bc441c28b895aa411d33f2a (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:59.254776  7447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a87af8743bc441c28b895aa411d33f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.259974  7526 tablet_service.cc:1511] Processing CreateTablet for tablet d351dea40bb24488b7159df0e49bb759 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:59.261289  7526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d351dea40bb24488b7159df0e49bb759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.261667  7450 tablet_service.cc:1511] Processing CreateTablet for tablet 1560149675ca410fa6cbef0e9eb5bb22 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:59.254251  7750 consensus_queue.cc:237] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:59.293676  7522 tablet_service.cc:1511] Processing CreateTablet for tablet 1560149675ca410fa6cbef0e9eb5bb22 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:59.295058  7522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1560149675ca410fa6cbef0e9eb5bb22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.301796  7669 tablet_service.cc:1511] Processing CreateTablet for tablet d351dea40bb24488b7159df0e49bb759 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:59.289803  7450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1560149675ca410fa6cbef0e9eb5bb22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.303300  7669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d351dea40bb24488b7159df0e49bb759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.289613  7598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d351dea40bb24488b7159df0e49bb759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.318945  7672 tablet_service.cc:1511] Processing CreateTablet for tablet b50e7db706514f8bb0b8885fca0868d3 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:59.320181  7451 tablet_service.cc:1511] Processing CreateTablet for tablet b50e7db706514f8bb0b8885fca0868d3 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:59.320990  7672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b50e7db706514f8bb0b8885fca0868d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.321489  7451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b50e7db706514f8bb0b8885fca0868d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.327121  7525 tablet_service.cc:1511] Processing CreateTablet for tablet b50e7db706514f8bb0b8885fca0868d3 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:59.328518  7525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b50e7db706514f8bb0b8885fca0868d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.336723  7730 tablet_bootstrap.cc:492] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:15:59.337322  7730 ts_tablet_manager.cc:1403] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.368s	user 0.012s	sys 0.000s
I20260709 13:15:59.339386  7731 raft_consensus.cc:359] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.340162  7731 raft_consensus.cc:385] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.340451  7731 raft_consensus.cc:740] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.341301  7731 consensus_queue.cc:260] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.344516  7731 ts_tablet_manager.cc:1434] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.001s
I20260709 13:15:59.345578  7731 tablet_bootstrap.cc:492] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:15:59.350898  7729 tablet_bootstrap.cc:492] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:15:59.351831  7729 ts_tablet_manager.cc:1403] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.429s	user 0.043s	sys 0.012s
I20260709 13:15:59.352537  7731 tablet_bootstrap.cc:654] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.352339  7593 tablet_service.cc:1511] Processing CreateTablet for tablet 6a5f0a58d050468dae029bfd50e74d02 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:59.353852  7593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a5f0a58d050468dae029bfd50e74d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.360955  7734 tablet_bootstrap.cc:492] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:15:59.361665  7734 ts_tablet_manager.cc:1403] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.192s	user 0.041s	sys 0.020s
I20260709 13:15:59.368623  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:15:59.369386  7461 raft_consensus.cc:2468] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:15:59.371271  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:15:59.371557  7648 leader_election.cc:304] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:15:59.372066  7684 raft_consensus.cc:2468] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:15:59.373029  7752 raft_consensus.cc:2804] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:59.373447  7425 leader_election.cc:304] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:15:59.374843  7757 raft_consensus.cc:2804] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:59.375206  7757 raft_consensus.cc:493] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.375577  7757 raft_consensus.cc:3060] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:59.373452  7752 raft_consensus.cc:493] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.354954  7729 raft_consensus.cc:359] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:15:59.382251  7752 raft_consensus.cc:3060] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:59.388019  7729 raft_consensus.cc:385] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.402675  7729 raft_consensus.cc:740] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.402091  7445 tablet_service.cc:1511] Processing CreateTablet for tablet 2a6621f1923f4b5b9885003705a57309 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:59.403903  7445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a6621f1923f4b5b9885003705a57309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.403656  7729 consensus_queue.cc:260] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:15:59.394958  7594 tablet_service.cc:1511] Processing CreateTablet for tablet 1560149675ca410fa6cbef0e9eb5bb22 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:59.394958  7674 tablet_service.cc:1511] Processing CreateTablet for tablet 6a5f0a58d050468dae029bfd50e74d02 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:59.408565  7594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1560149675ca410fa6cbef0e9eb5bb22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.408747  7674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a5f0a58d050468dae029bfd50e74d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.404237  7517 tablet_service.cc:1511] Processing CreateTablet for tablet 2a6621f1923f4b5b9885003705a57309 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:59.395053  7600 tablet_service.cc:1511] Processing CreateTablet for tablet bf1e31a4767d403688a20b985eb0ab79 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:59.411758  7729 ts_tablet_manager.cc:1434] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:15:59.412427  7517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a6621f1923f4b5b9885003705a57309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.412515  7600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf1e31a4767d403688a20b985eb0ab79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.396461  7446 tablet_service.cc:1511] Processing CreateTablet for tablet 6a5f0a58d050468dae029bfd50e74d02 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:59.414058  7446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a5f0a58d050468dae029bfd50e74d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.415307  7729 tablet_bootstrap.cc:492] T 4d154a19800f414dbaec32117c0ca6bd P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:15:59.397337  7358 catalog_manager.cc:5697] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 0 to 1, leader changed from <none> to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:59.417035  7757 raft_consensus.cc:515] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:15:59.420357  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:15:59.421512  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
W20260709 13:15:59.422720  7427 leader_election.cc:343] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.423880  7752 raft_consensus.cc:515] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:15:59.425042  7684 raft_consensus.cc:2393] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d54f6e4b9e604cd78c48a1828cd3b23a in current term 1: Already voted for candidate e733469bde7c479a916acbbe84b5f342 in this term.
I20260709 13:15:59.428098  7730 raft_consensus.cc:359] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:59.428913  7730 raft_consensus.cc:385] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.429250  7730 raft_consensus.cc:740] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.428323  7425 leader_election.cc:304] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342
I20260709 13:15:59.430397  7750 raft_consensus.cc:2749] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:59.430747  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:15:59.431908  7743 raft_consensus.cc:493] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.431770  7730 consensus_queue.cc:260] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:59.432420  7743 raft_consensus.cc:515] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.434012  7729 tablet_bootstrap.cc:654] T 4d154a19800f414dbaec32117c0ca6bd P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.437129  7743 leader_election.cc:290] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:15:59.441800  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:15:59.442711  7461 raft_consensus.cc:2393] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e733469bde7c479a916acbbe84b5f342 in current term 1: Already voted for candidate d54f6e4b9e604cd78c48a1828cd3b23a in this term.
I20260709 13:15:59.419229  7757 leader_election.cc:290] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
W20260709 13:15:59.446751  7650 leader_election.cc:343] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.447757  7648 leader_election.cc:304] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:15:59.449404  7756 raft_consensus.cc:2749] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:59.446970  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e84fe9726f946d2b3552cd90cf46b98" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
W20260709 13:15:59.451601  7499 leader_election.cc:343] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.402155  7671 tablet_service.cc:1511] Processing CreateTablet for tablet bf1e31a4767d403688a20b985eb0ab79 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:59.454393  7671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf1e31a4767d403688a20b985eb0ab79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.457405  7731 tablet_bootstrap.cc:492] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:15:59.462735  7731 ts_tablet_manager.cc:1403] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.117s	user 0.021s	sys 0.019s
I20260709 13:15:59.463135  7734 raft_consensus.cc:359] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.463955  7734 raft_consensus.cc:385] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.466289  7731 raft_consensus.cc:359] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:59.464232  7734 raft_consensus.cc:740] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.467489  7731 raft_consensus.cc:385] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.468012  7731 raft_consensus.cc:740] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.443944  7752 leader_election.cc:290] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:15:59.468648  7734 consensus_queue.cc:260] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.471406  7731 consensus_queue.cc:260] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:59.472205  7734 ts_tablet_manager.cc:1434] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.110s	user 0.010s	sys 0.000s
I20260709 13:15:59.482057  7734 tablet_bootstrap.cc:492] T 1ea546eef5aa4273af08f1b3468c5369 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:15:59.475298  7729 tablet_bootstrap.cc:492] T 4d154a19800f414dbaec32117c0ca6bd P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:15:59.483462  7729 ts_tablet_manager.cc:1403] T 4d154a19800f414dbaec32117c0ca6bd P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.068s	user 0.009s	sys 0.010s
I20260709 13:15:59.479974  7525 tablet_service.cc:1511] Processing CreateTablet for tablet bf1e31a4767d403688a20b985eb0ab79 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:59.490679  7525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf1e31a4767d403688a20b985eb0ab79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.483471  7731 ts_tablet_manager.cc:1434] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:15:59.495687  7731 tablet_bootstrap.cc:492] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:15:59.502112  7729 raft_consensus.cc:359] T 4d154a19800f414dbaec32117c0ca6bd P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.502938  7729 raft_consensus.cc:385] T 4d154a19800f414dbaec32117c0ca6bd P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.503266  7729 raft_consensus.cc:740] T 4d154a19800f414dbaec32117c0ca6bd P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.504088  7729 consensus_queue.cc:260] T 4d154a19800f414dbaec32117c0ca6bd P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.509430  7594 tablet_service.cc:1511] Processing CreateTablet for tablet 2a6621f1923f4b5b9885003705a57309 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:59.514256  7670 tablet_service.cc:1511] Processing CreateTablet for tablet 2234d05a2ffa48c18ad9af837d067f5a (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:59.515082  7729 ts_tablet_manager.cc:1434] T 4d154a19800f414dbaec32117c0ca6bd P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:15:59.512109  7730 ts_tablet_manager.cc:1434] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.174s	user 0.012s	sys 0.015s
I20260709 13:15:59.512735  7447 tablet_service.cc:1511] Processing CreateTablet for tablet 2234d05a2ffa48c18ad9af837d067f5a (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:59.516072  7594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a6621f1923f4b5b9885003705a57309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.517776  7447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2234d05a2ffa48c18ad9af837d067f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.523849  7729 tablet_bootstrap.cc:492] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:15:59.523991  7673 tablet_service.cc:1511] Processing CreateTablet for tablet 81671c7a827b47caac30f622c4407bf4 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:59.521195  7670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2234d05a2ffa48c18ad9af837d067f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.527961  7673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81671c7a827b47caac30f622c4407bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.520200  7600 tablet_service.cc:1511] Processing CreateTablet for tablet 81671c7a827b47caac30f622c4407bf4 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:59.531565  7600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81671c7a827b47caac30f622c4407bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.537843  7731 tablet_bootstrap.cc:654] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.540244  7517 tablet_service.cc:1511] Processing CreateTablet for tablet 2234d05a2ffa48c18ad9af837d067f5a (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:59.541378  7734 tablet_bootstrap.cc:654] T 1ea546eef5aa4273af08f1b3468c5369 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.541812  7517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2234d05a2ffa48c18ad9af837d067f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.548391  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e84fe9726f946d2b3552cd90cf46b98" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:15:59.548864  7451 tablet_service.cc:1511] Processing CreateTablet for tablet 81671c7a827b47caac30f622c4407bf4 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:59.550195  7451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81671c7a827b47caac30f622c4407bf4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:59.550071  7500 leader_election.cc:343] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.551981  7730 tablet_bootstrap.cc:492] T 4d154a19800f414dbaec32117c0ca6bd P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:15:59.551440  7500 leader_election.cc:304] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342
I20260709 13:15:59.558422  7729 tablet_bootstrap.cc:654] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.559561  7770 raft_consensus.cc:2749] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:59.573834  7522 tablet_service.cc:1511] Processing CreateTablet for tablet 0433292c261b4a29b57235e8647c5db8 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:59.574822  7593 tablet_service.cc:1511] Processing CreateTablet for tablet 0433292c261b4a29b57235e8647c5db8 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:59.575299  7522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0433292c261b4a29b57235e8647c5db8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.576188  7593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0433292c261b4a29b57235e8647c5db8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.582536  7670 tablet_service.cc:1511] Processing CreateTablet for tablet 0433292c261b4a29b57235e8647c5db8 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:59.584086  7670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0433292c261b4a29b57235e8647c5db8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.587874  7734 tablet_bootstrap.cc:492] T 1ea546eef5aa4273af08f1b3468c5369 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:15:59.588466  7734 ts_tablet_manager.cc:1403] T 1ea546eef5aa4273af08f1b3468c5369 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.107s	user 0.020s	sys 0.000s
I20260709 13:15:59.591123  7734 raft_consensus.cc:359] T 1ea546eef5aa4273af08f1b3468c5369 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.591869  7734 raft_consensus.cc:385] T 1ea546eef5aa4273af08f1b3468c5369 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.592172  7734 raft_consensus.cc:740] T 1ea546eef5aa4273af08f1b3468c5369 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.594540  7734 consensus_queue.cc:260] T 1ea546eef5aa4273af08f1b3468c5369 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.597061  7734 ts_tablet_manager.cc:1434] T 1ea546eef5aa4273af08f1b3468c5369 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:15:59.597944  7446 tablet_service.cc:1511] Processing CreateTablet for tablet 29addb5a68094e16887e2c843d5b1ef5 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:59.599308  7446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29addb5a68094e16887e2c843d5b1ef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.604943  7518 tablet_service.cc:1511] Processing CreateTablet for tablet 29addb5a68094e16887e2c843d5b1ef5 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:59.606747  7518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29addb5a68094e16887e2c843d5b1ef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.608583  7734 tablet_bootstrap.cc:492] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:15:59.608485  7598 tablet_service.cc:1511] Processing CreateTablet for tablet 29addb5a68094e16887e2c843d5b1ef5 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:59.609882  7598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29addb5a68094e16887e2c843d5b1ef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.612188  7671 tablet_service.cc:1511] Processing CreateTablet for tablet ce18aefbfb644eeab2cfc05f961b1771 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:59.613554  7671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce18aefbfb644eeab2cfc05f961b1771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.615085  7729 tablet_bootstrap.cc:492] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:15:59.615105  7734 tablet_bootstrap.cc:654] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.615808  7729 ts_tablet_manager.cc:1403] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.005s
I20260709 13:15:59.618795  7729 raft_consensus.cc:359] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.619779  7729 raft_consensus.cc:385] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.623795  7729 raft_consensus.cc:740] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.629691  7729 consensus_queue.cc:260] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.628017  7526 tablet_service.cc:1511] Processing CreateTablet for tablet ce18aefbfb644eeab2cfc05f961b1771 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:59.632913  7526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce18aefbfb644eeab2cfc05f961b1771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.628594  7450 tablet_service.cc:1511] Processing CreateTablet for tablet ce18aefbfb644eeab2cfc05f961b1771 (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:59.640471  7450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce18aefbfb644eeab2cfc05f961b1771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.650259  7729 ts_tablet_manager.cc:1434] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:15:59.657037  7730 tablet_bootstrap.cc:654] T 4d154a19800f414dbaec32117c0ca6bd P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.662221  7595 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4267f73a67486e8568dfa6c4a0bd7b (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:59.663659  7595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4267f73a67486e8568dfa6c4a0bd7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.666102  7729 tablet_bootstrap.cc:492] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:15:59.675650  7674 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4267f73a67486e8568dfa6c4a0bd7b (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:59.678103  7674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4267f73a67486e8568dfa6c4a0bd7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.676661  7445 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4267f73a67486e8568dfa6c4a0bd7b (DEFAULT_TABLE table=test-workload [id=dbe1de1df3ab49b787bafbae329a165b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:59.680361  7445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4267f73a67486e8568dfa6c4a0bd7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.681031  7731 tablet_bootstrap.cc:492] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:15:59.683908  7731 ts_tablet_manager.cc:1403] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.189s	user 0.027s	sys 0.032s
I20260709 13:15:59.719579  7736 raft_consensus.cc:493] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.720104  7736 raft_consensus.cc:515] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:15:59.721236  7729 tablet_bootstrap.cc:654] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.722479  7736 leader_election.cc:290] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:15:59.731734  7731 raft_consensus.cc:359] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:59.735661  7734 tablet_bootstrap.cc:492] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:15:59.736256  7734 ts_tablet_manager.cc:1403] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.128s	user 0.016s	sys 0.003s
I20260709 13:15:59.736891  7730 tablet_bootstrap.cc:492] T 4d154a19800f414dbaec32117c0ca6bd P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
W20260709 13:15:59.737493  7427 consensus_peers.cc:597] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.737491  7730 ts_tablet_manager.cc:1403] T 4d154a19800f414dbaec32117c0ca6bd P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.186s	user 0.017s	sys 0.005s
I20260709 13:15:59.732645  7731 raft_consensus.cc:385] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.749960  7752 raft_consensus.cc:493] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.750540  7752 raft_consensus.cc:515] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.751701  7734 raft_consensus.cc:359] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.752561  7734 raft_consensus.cc:385] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.752897  7734 raft_consensus.cc:740] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.755693  7729 tablet_bootstrap.cc:492] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:15:59.753207  7752 leader_election.cc:290] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:15:59.758424  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d154a19800f414dbaec32117c0ca6bd" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:15:59.774001  7734 consensus_queue.cc:260] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
W20260709 13:15:59.774487  7650 leader_election.cc:343] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.748654  7731 raft_consensus.cc:740] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.776739  7734 ts_tablet_manager.cc:1434] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.040s	user 0.013s	sys 0.002s
I20260709 13:15:59.778093  7734 tablet_bootstrap.cc:492] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:15:59.777977  7730 raft_consensus.cc:359] T 4d154a19800f414dbaec32117c0ca6bd P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.778309  7757 raft_consensus.cc:493] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.778796  7730 raft_consensus.cc:385] T 4d154a19800f414dbaec32117c0ca6bd P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.778512  7731 consensus_queue.cc:260] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:59.779139  7730 raft_consensus.cc:740] T 4d154a19800f414dbaec32117c0ca6bd P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.779011  7757 raft_consensus.cc:515] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.779973  7730 consensus_queue.cc:260] T 4d154a19800f414dbaec32117c0ca6bd P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.773085  7729 ts_tablet_manager.cc:1403] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.107s	user 0.021s	sys 0.005s
I20260709 13:15:59.781308  7757 leader_election.cc:290] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:15:59.782335  7730 ts_tablet_manager.cc:1434] T 4d154a19800f414dbaec32117c0ca6bd P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.000s
I20260709 13:15:59.783329  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2119d52e4a048ebb803fffdf77b85c2" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:15:59.783965  7684 raft_consensus.cc:2468] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:15:59.785426  7425 leader_election.cc:304] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:15:59.785204  7731 ts_tablet_manager.cc:1434] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.086s	user 0.000s	sys 0.007s
I20260709 13:15:59.787057  7750 raft_consensus.cc:2804] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:59.787523  7750 raft_consensus.cc:493] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.786142  7757 raft_consensus.cc:493] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.788025  7750 raft_consensus.cc:3060] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:59.788182  7757 raft_consensus.cc:515] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:59.787952  7731 tablet_bootstrap.cc:492] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:15:59.792725  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7bab86470a74fdfb18b961658f9e371" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:15:59.791149  7730 tablet_bootstrap.cc:492] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:15:59.802626  7757 leader_election.cc:290] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
W20260709 13:15:59.809230  7574 leader_election.cc:343] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.810318  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa473d10c0ad424f8268c67efcccccff" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:15:59.811085  7536 raft_consensus.cc:2468] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:15:59.811395  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7bab86470a74fdfb18b961658f9e371" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:15:59.812958  7427 leader_election.cc:304] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:15:59.814033  7757 raft_consensus.cc:2804] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:59.814548  7757 raft_consensus.cc:493] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.814790  7609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2119d52e4a048ebb803fffdf77b85c2" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:15:59.816267  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa473d10c0ad424f8268c67efcccccff" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:15:59.817194  7750 raft_consensus.cc:515] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
W20260709 13:15:59.817821  7574 leader_election.cc:343] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.818281  7574 leader_election.cc:304] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342
I20260709 13:15:59.819434  7736 raft_consensus.cc:2749] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:59.814968  7757 raft_consensus.cc:3060] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:59.820262  7750 leader_election.cc:290] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:15:59.821907  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2119d52e4a048ebb803fffdf77b85c2" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:15:59.822669  7684 raft_consensus.cc:3060] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:59.823846  7424 leader_election.cc:343] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:59.825297  7424 leader_election.cc:343] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.827744  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2119d52e4a048ebb803fffdf77b85c2" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
W20260709 13:15:59.829175  7424 leader_election.cc:343] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.823871  7734 tablet_bootstrap.cc:654] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.830499  7730 tablet_bootstrap.cc:654] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.831439  7750 consensus_queue.cc:1048] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:59.838971  7731 tablet_bootstrap.cc:654] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.838807  7757 raft_consensus.cc:515] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:59.842099  7684 raft_consensus.cc:2468] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:15:59.843611  7425 leader_election.cc:304] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06
I20260709 13:15:59.842397  7729 raft_consensus.cc:359] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.852007  7729 raft_consensus.cc:385] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.852373  7729 raft_consensus.cc:740] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.853456  7734 tablet_bootstrap.cc:492] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:15:59.853240  7729 consensus_queue.cc:260] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.854001  7734 ts_tablet_manager.cc:1403] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.076s	user 0.008s	sys 0.011s
I20260709 13:15:59.856657  7750 raft_consensus.cc:2804] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:59.862468  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa473d10c0ad424f8268c67efcccccff" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:15:59.862995  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa473d10c0ad424f8268c67efcccccff" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:15:59.863659  7536 raft_consensus.cc:3060] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:59.860643  7734 raft_consensus.cc:359] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:15:59.864300  7734 raft_consensus.cc:385] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.862912  7750 raft_consensus.cc:697] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
W20260709 13:15:59.864666  7424 leader_election.cc:343] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.865566  7750 consensus_queue.cc:237] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.867000  7730 tablet_bootstrap.cc:492] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:15:59.867605  7730 ts_tablet_manager.cc:1403] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.084s	user 0.016s	sys 0.001s
I20260709 13:15:59.864668  7734 raft_consensus.cc:740] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.874135  7734 consensus_queue.cc:260] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:15:59.877025  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d154a19800f414dbaec32117c0ca6bd" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:15:59.872162  7731 tablet_bootstrap.cc:492] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:15:59.877753  7608 raft_consensus.cc:2468] T 4d154a19800f414dbaec32117c0ca6bd P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:15:59.875303  7757 leader_election.cc:290] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:15:59.873150  7730 raft_consensus.cc:359] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:15:59.879211  7730 raft_consensus.cc:385] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.879622  7730 raft_consensus.cc:740] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.879842  7647 leader_election.cc:304] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:15:59.880918  7752 raft_consensus.cc:2804] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:59.880019  7734 ts_tablet_manager.cc:1434] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.004s
I20260709 13:15:59.881572  7752 raft_consensus.cc:493] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.882135  7752 raft_consensus.cc:3060] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:59.882570  7734 tablet_bootstrap.cc:492] T cfd5d05ff1384d2c9c133fdb0483f29a P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:15:59.880756  7730 consensus_queue.cc:260] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:15:59.877897  7731 ts_tablet_manager.cc:1403] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.021s
I20260709 13:15:59.891183  7729 ts_tablet_manager.cc:1434] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.110s	user 0.006s	sys 0.002s
I20260709 13:15:59.892860  7729 tablet_bootstrap.cc:492] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:15:59.897058  7731 raft_consensus.cc:359] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
W20260709 13:15:59.905536  7407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:15:59.889073  7425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:35931, user_credentials={real_user=slave}} blocked reactor thread for 45581.2us
I20260709 13:15:59.910277  7770 raft_consensus.cc:493] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.910815  7770 raft_consensus.cc:515] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:59.898079  7731 raft_consensus.cc:385] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.912602  7731 raft_consensus.cc:740] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.913225  7770 leader_election.cc:290] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:15:59.913770  7770 raft_consensus.cc:493] T 4d154a19800f414dbaec32117c0ca6bd P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.913481  7731 consensus_queue.cc:260] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:15:59.914192  7770 raft_consensus.cc:515] T 4d154a19800f414dbaec32117c0ca6bd P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.916405  7731 ts_tablet_manager.cc:1434] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 13:15:59.916815  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361e20d70ddc4e43b3dcbe2e9ca30f50" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:15:59.917578  7731 tablet_bootstrap.cc:492] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:15:59.920574  7736 raft_consensus.cc:493] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.921069  7736 raft_consensus.cc:515] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
W20260709 13:15:59.927356  7499 leader_election.cc:343] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.929358  7736 leader_election.cc:290] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:15:59.930123  7734 tablet_bootstrap.cc:654] T cfd5d05ff1384d2c9c133fdb0483f29a P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.928433  7356 catalog_manager.cc:5697] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 0 to 1, leader changed from <none> to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:59.932186  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2119d52e4a048ebb803fffdf77b85c2" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:15:59.933861  7750 raft_consensus.cc:493] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.934412  7750 raft_consensus.cc:515] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:15:59.934993  7730 ts_tablet_manager.cc:1434] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.067s	user 0.003s	sys 0.004s
I20260709 13:15:59.936223  7730 tablet_bootstrap.cc:492] T 1ea546eef5aa4273af08f1b3468c5369 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:15:59.938212  7750 leader_election.cc:290] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:15:59.939057  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2119d52e4a048ebb803fffdf77b85c2" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:15:59.939352  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96e53ac6d4a4521824a0eef2bf0400b" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:15:59.940012  7684 raft_consensus.cc:2393] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 382e1f4385ac4066b7098e4fd1f5df06 in current term 1: Already voted for candidate d54f6e4b9e604cd78c48a1828cd3b23a in this term.
I20260709 13:15:59.940340  7608 raft_consensus.cc:2468] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:15:59.942057  7574 leader_election.cc:304] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342
I20260709 13:15:59.942142  7424 leader_election.cc:304] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:15:59.943365  7736 raft_consensus.cc:3060] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:59.944614  7729 tablet_bootstrap.cc:654] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.947415  7750 raft_consensus.cc:2804] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:59.947881  7750 raft_consensus.cc:493] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.929504  7752 raft_consensus.cc:515] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:15:59.948283  7750 raft_consensus.cc:3060] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:59.952461  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d154a19800f414dbaec32117c0ca6bd" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:15:59.954509  7752 leader_election.cc:290] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:15:59.955693  7535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96e53ac6d4a4521824a0eef2bf0400b" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:15:59.954530  7534 raft_consensus.cc:3060] T 4d154a19800f414dbaec32117c0ca6bd P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:59.959537  7427 leader_election.cc:343] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.957842  7536 raft_consensus.cc:2468] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:15:59.942195  7731 tablet_bootstrap.cc:654] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.964705  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d154a19800f414dbaec32117c0ca6bd" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:15:59.966765  7610 raft_consensus.cc:3060] T 4d154a19800f414dbaec32117c0ca6bd P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:59.967062  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361e20d70ddc4e43b3dcbe2e9ca30f50" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:15:59.967128  7427 leader_election.cc:304] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 382e1f4385ac4066b7098e4fd1f5df06
I20260709 13:15:59.968794  7757 raft_consensus.cc:2804] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:59.974354  7500 leader_election.cc:343] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.975152  7500 leader_election.cc:304] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:15:59.983319  7609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d154a19800f414dbaec32117c0ca6bd" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:15:59.983546  7790 raft_consensus.cc:2749] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:59.985299  7610 raft_consensus.cc:2468] T 4d154a19800f414dbaec32117c0ca6bd P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:15:59.986613  7647 leader_election.cc:304] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:15:59.986629  7729 tablet_bootstrap.cc:492] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:15:59.977268  7757 raft_consensus.cc:697] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:15:59.988312  7752 raft_consensus.cc:2804] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:59.989575  7729 ts_tablet_manager.cc:1403] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.007s
I20260709 13:16:00.000269  7734 tablet_bootstrap.cc:492] T cfd5d05ff1384d2c9c133fdb0483f29a P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:00.000998  7734 ts_tablet_manager.cc:1403] T cfd5d05ff1384d2c9c133fdb0483f29a P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.015s
I20260709 13:16:00.002851  7770 leader_election.cc:290] T 4d154a19800f414dbaec32117c0ca6bd P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:15:59.994247  7730 tablet_bootstrap.cc:654] T 1ea546eef5aa4273af08f1b3468c5369 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.004014  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d154a19800f414dbaec32117c0ca6bd" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:00.008742  7795 raft_consensus.cc:493] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.009461  7795 raft_consensus.cc:515] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:00.012485  7795 leader_election.cc:290] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:00.013906  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ea546eef5aa4273af08f1b3468c5369" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
W20260709 13:16:00.015529  7576 leader_election.cc:343] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.016062  7534 raft_consensus.cc:2468] T 4d154a19800f414dbaec32117c0ca6bd P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:00.018321  7683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ea546eef5aa4273af08f1b3468c5369" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:00.018246  7750 raft_consensus.cc:515] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:00.019503  7683 raft_consensus.cc:2468] T 1ea546eef5aa4273af08f1b3468c5369 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 0.
I20260709 13:16:00.020172  7757 consensus_queue.cc:237] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:00.022701  7750 leader_election.cc:290] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:00.024008  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96e53ac6d4a4521824a0eef2bf0400b" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:00.029590  7729 raft_consensus.cc:359] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:00.030381  7729 raft_consensus.cc:385] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.030704  7729 raft_consensus.cc:740] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.031423  7610 raft_consensus.cc:3060] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.031512  7729 consensus_queue.cc:260] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:00.027160  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96e53ac6d4a4521824a0eef2bf0400b" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:00.036052  7574 leader_election.cc:304] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:16:00.025188  7752 raft_consensus.cc:697] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:00.044245  7752 consensus_queue.cc:237] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:00.041088  7795 raft_consensus.cc:2804] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:00.050077  7736 raft_consensus.cc:2749] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:00.050451  7427 leader_election.cc:343] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.037284  7734 raft_consensus.cc:359] T cfd5d05ff1384d2c9c133fdb0483f29a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.051508  7734 raft_consensus.cc:385] T cfd5d05ff1384d2c9c133fdb0483f29a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.051849  7734 raft_consensus.cc:740] T cfd5d05ff1384d2c9c133fdb0483f29a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.052640  7734 consensus_queue.cc:260] T cfd5d05ff1384d2c9c133fdb0483f29a P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.049602  7795 raft_consensus.cc:493] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.056303  7356 catalog_manager.cc:5697] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 0 to 1, leader changed from <none> to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.062705  7729 ts_tablet_manager.cc:1434] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.007s
I20260709 13:16:00.063853  7610 raft_consensus.cc:2468] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:00.065092  7424 leader_election.cc:304] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:16:00.065362  7730 tablet_bootstrap.cc:492] T 1ea546eef5aa4273af08f1b3468c5369 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:00.066332  7729 tablet_bootstrap.cc:492] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:00.066776  7730 ts_tablet_manager.cc:1403] T 1ea546eef5aa4273af08f1b3468c5369 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.131s	user 0.015s	sys 0.020s
I20260709 13:16:00.066794  7757 raft_consensus.cc:2804] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:00.059056  7795 raft_consensus.cc:3060] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.069519  7731 tablet_bootstrap.cc:492] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:00.070071  7731 ts_tablet_manager.cc:1403] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.153s	user 0.009s	sys 0.007s
I20260709 13:16:00.074004  7729 tablet_bootstrap.cc:654] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.073535  7731 raft_consensus.cc:359] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.077559  7731 raft_consensus.cc:385] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.078084  7731 raft_consensus.cc:740] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.079391  7731 consensus_queue.cc:260] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.082005  7795 raft_consensus.cc:515] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:00.083514  7731 ts_tablet_manager.cc:1434] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:16:00.085983  7731 tablet_bootstrap.cc:492] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:00.086006  7729 tablet_bootstrap.cc:492] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:00.084496  7730 raft_consensus.cc:359] T 1ea546eef5aa4273af08f1b3468c5369 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:00.086661  7730 raft_consensus.cc:385] T 1ea546eef5aa4273af08f1b3468c5369 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.086735  7729 ts_tablet_manager.cc:1403] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.001s
I20260709 13:16:00.089767  7730 raft_consensus.cc:740] T 1ea546eef5aa4273af08f1b3468c5369 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.090796  7730 consensus_queue.cc:260] T 1ea546eef5aa4273af08f1b3468c5369 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:00.092377  7729 raft_consensus.cc:359] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.093125  7729 raft_consensus.cc:385] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.093370  7729 raft_consensus.cc:740] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.093993  7729 consensus_queue.cc:260] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.094983  7500 leader_election.cc:304] T 4d154a19800f414dbaec32117c0ca6bd P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:00.096040  7729 ts_tablet_manager.cc:1434] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:16:00.096268  7770 raft_consensus.cc:2749] T 4d154a19800f414dbaec32117c0ca6bd P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:00.097069  7729 tablet_bootstrap.cc:492] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:00.087152  7795 leader_election.cc:290] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:00.099004  7730 ts_tablet_manager.cc:1434] T 1ea546eef5aa4273af08f1b3468c5369 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:16:00.087754  7757 raft_consensus.cc:697] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:00.089052  7683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ea546eef5aa4273af08f1b3468c5369" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:00.099689  7683 raft_consensus.cc:3060] T 1ea546eef5aa4273af08f1b3468c5369 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.098256  7356 catalog_manager.cc:5697] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 0 to 1, leader changed from <none> to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 1 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:00.088317  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ea546eef5aa4273af08f1b3468c5369" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:00.103519  7731 tablet_bootstrap.cc:654] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.103772  7534 raft_consensus.cc:3060] T 1ea546eef5aa4273af08f1b3468c5369 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.105969  7757 consensus_queue.cc:237] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:00.106773  7730 tablet_bootstrap.cc:492] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:00.111055  7534 raft_consensus.cc:2468] T 1ea546eef5aa4273af08f1b3468c5369 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:00.103186  7729 tablet_bootstrap.cc:654] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.112867  7576 leader_election.cc:304] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: 
I20260709 13:16:00.114547  7795 raft_consensus.cc:2804] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:00.115165  7795 raft_consensus.cc:697] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:00.116247  7795 consensus_queue.cc:237] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:00.118485  7734 ts_tablet_manager.cc:1434] T cfd5d05ff1384d2c9c133fdb0483f29a P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.117s	user 0.006s	sys 0.012s
I20260709 13:16:00.119657  7734 tablet_bootstrap.cc:492] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:00.122402  7683 raft_consensus.cc:2468] T 1ea546eef5aa4273af08f1b3468c5369 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:00.133705  7734 tablet_bootstrap.cc:654] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.134178  7730 tablet_bootstrap.cc:654] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.137852  7729 tablet_bootstrap.cc:492] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:00.138561  7729 ts_tablet_manager.cc:1403] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.012s
I20260709 13:16:00.140739  7356 catalog_manager.cc:5697] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.141305  7729 raft_consensus.cc:359] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.142119  7729 raft_consensus.cc:385] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.142421  7729 raft_consensus.cc:740] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.141502  7359 catalog_manager.cc:5697] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 0 to 1, leader changed from <none> to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.143280  7729 consensus_queue.cc:260] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.144810  7804 raft_consensus.cc:493] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.145560  7729 ts_tablet_manager.cc:1434] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:16:00.145300  7804 raft_consensus.cc:515] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.146509  7731 tablet_bootstrap.cc:492] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:00.146515  7729 tablet_bootstrap.cc:492] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:00.147006  7731 ts_tablet_manager.cc:1403] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.061s	user 0.005s	sys 0.009s
I20260709 13:16:00.147558  7804 leader_election.cc:290] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:00.150687  7731 raft_consensus.cc:359] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.151801  7734 tablet_bootstrap.cc:492] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:00.152555  7734 ts_tablet_manager.cc:1403] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.005s
I20260709 13:16:00.153028  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ee12a0193649c295925bc14e57d382" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:00.153481  7729 tablet_bootstrap.cc:654] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:00.154983  7650 leader_election.cc:343] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.150748  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ee12a0193649c295925bc14e57d382" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:00.157063  7734 raft_consensus.cc:359] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.158213  7734 raft_consensus.cc:385] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.158659  7734 raft_consensus.cc:740] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.151763  7731 raft_consensus.cc:385] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.159807  7731 raft_consensus.cc:740] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.160879  7731 consensus_queue.cc:260] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.162221  7461 raft_consensus.cc:2468] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:16:00.164404  7731 ts_tablet_manager.cc:1434] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:16:00.165055  7648 leader_election.cc:304] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:16:00.165935  7731 tablet_bootstrap.cc:492] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:00.166795  7804 raft_consensus.cc:2804] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:00.167402  7804 raft_consensus.cc:493] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.168041  7804 raft_consensus.cc:3060] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.167142  7734 consensus_queue.cc:260] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.171497  7757 raft_consensus.cc:493] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.172196  7757 raft_consensus.cc:515] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.176468  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a389b4005c4d6890f09b248b3e1ad8" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:00.177241  7610 raft_consensus.cc:2468] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:16:00.179831  7424 leader_election.cc:304] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:00.180959  7797 raft_consensus.cc:2804] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:00.181481  7797 raft_consensus.cc:493] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.181881  7797 raft_consensus.cc:3060] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.183509  7757 leader_election.cc:290] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:00.184358  7734 ts_tablet_manager.cc:1434] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.031s	user 0.011s	sys 0.000s
I20260709 13:16:00.185377  7683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a389b4005c4d6890f09b248b3e1ad8" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:00.185838  7734 tablet_bootstrap.cc:492] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
W20260709 13:16:00.187461  7425 leader_election.cc:343] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.195142  7731 tablet_bootstrap.cc:654] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.201578  7734 tablet_bootstrap.cc:654] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.228744  7797 raft_consensus.cc:515] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.232720  7730 tablet_bootstrap.cc:492] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:00.233157  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a389b4005c4d6890f09b248b3e1ad8" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:00.233862  7610 raft_consensus.cc:3060] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.233948  7730 ts_tablet_manager.cc:1403] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.127s	user 0.041s	sys 0.048s
I20260709 13:16:00.237936  7730 raft_consensus.cc:359] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.238852  7730 raft_consensus.cc:385] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.239349  7730 raft_consensus.cc:740] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.240239  7731 tablet_bootstrap.cc:492] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:00.240787  7731 ts_tablet_manager.cc:1403] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.004s
I20260709 13:16:00.240929  7730 consensus_queue.cc:260] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.243623  7731 raft_consensus.cc:359] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.244313  7731 raft_consensus.cc:385] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.244570  7731 raft_consensus.cc:740] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.245307  7731 consensus_queue.cc:260] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.250025  7610 raft_consensus.cc:2468] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:00.254657  7734 tablet_bootstrap.cc:492] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:00.255149  7734 ts_tablet_manager.cc:1403] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.003s
I20260709 13:16:00.255719  7731 ts_tablet_manager.cc:1434] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:16:00.255641  7424 leader_election.cc:304] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:00.257187  7757 raft_consensus.cc:2804] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:00.257843  7757 raft_consensus.cc:697] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:00.258194  7734 raft_consensus.cc:359] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.258911  7757 consensus_queue.cc:237] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.253021  7683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a389b4005c4d6890f09b248b3e1ad8" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:00.260785  7730 ts_tablet_manager.cc:1434] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.002s
W20260709 13:16:00.261713  7425 leader_election.cc:343] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.253727  7797 leader_election.cc:290] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:00.259997  7731 tablet_bootstrap.cc:492] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:00.265225  7730 tablet_bootstrap.cc:492] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:00.258976  7734 raft_consensus.cc:385] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.267525  7734 raft_consensus.cc:740] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.268278  7734 consensus_queue.cc:260] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.268790  7731 tablet_bootstrap.cc:654] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.273509  7734 ts_tablet_manager.cc:1434] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:16:00.274492  7734 tablet_bootstrap.cc:492] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:00.222030  7804 raft_consensus.cc:515] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.276427  7795 raft_consensus.cc:493] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.277016  7795 raft_consensus.cc:515] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.279345  7795 leader_election.cc:290] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:00.279346  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ee12a0193649c295925bc14e57d382" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:00.281742  7461 raft_consensus.cc:3060] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.284291  7752 raft_consensus.cc:493] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.284794  7752 raft_consensus.cc:515] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.281047  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ee12a0193649c295925bc14e57d382" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:00.287155  7752 leader_election.cc:290] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:00.287909  7734 tablet_bootstrap.cc:654] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.288436  7683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfe0c23a9c54b2dbe03deca022a9123" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
W20260709 13:16:00.288654  7650 leader_election.cc:343] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.289549  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d88042080495293c0e772b280f3da" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:00.290455  7459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d88042080495293c0e772b280f3da" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:00.287317  7730 tablet_bootstrap.cc:654] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:00.291132  7650 leader_election.cc:343] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.281769  7460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfe0c23a9c54b2dbe03deca022a9123" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:00.292258  7460 raft_consensus.cc:2468] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 0.
I20260709 13:16:00.292426  7804 leader_election.cc:290] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:00.292413  7731 tablet_bootstrap.cc:492] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:00.293555  7731 ts_tablet_manager.cc:1403] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.003s
I20260709 13:16:00.293506  7770 raft_consensus.cc:493] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.294026  7574 leader_election.cc:304] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:00.294127  7770 raft_consensus.cc:515] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
W20260709 13:16:00.296360  7648 leader_election.cc:343] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.296705  7770 leader_election.cc:290] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:00.296926  7648 leader_election.cc:304] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:00.297773  7683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd5d05ff1384d2c9c133fdb0483f29a" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
W20260709 13:16:00.298151  7574 leader_election.cc:343] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.298416  7683 raft_consensus.cc:2468] T cfd5d05ff1384d2c9c133fdb0483f29a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 0.
I20260709 13:16:00.299669  7500 leader_election.cc:304] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:00.300515  7770 raft_consensus.cc:2804] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:00.299721  7795 raft_consensus.cc:2804] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:00.302157  7795 raft_consensus.cc:493] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.301410  7804 raft_consensus.cc:2749] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:00.302703  7795 raft_consensus.cc:3060] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.301482  7460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd5d05ff1384d2c9c133fdb0483f29a" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:00.303480  7460 raft_consensus.cc:2468] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 0.
I20260709 13:16:00.304754  7356 catalog_manager.cc:5697] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 0 to 1, leader changed from <none> to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:00.300876  7770 raft_consensus.cc:493] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.307505  7770 raft_consensus.cc:3060] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.309753  7795 raft_consensus.cc:515] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.313218  7730 tablet_bootstrap.cc:492] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:00.313130  7683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfe0c23a9c54b2dbe03deca022a9123" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:00.313777  7730 ts_tablet_manager.cc:1403] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.004s
W20260709 13:16:00.314723  7574 leader_election.cc:343] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.299897  7731 raft_consensus.cc:359] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.316947  7731 raft_consensus.cc:385] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.316727  7730 raft_consensus.cc:359] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:00.317167  7460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfe0c23a9c54b2dbe03deca022a9123" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:00.317545  7730 raft_consensus.cc:385] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.318027  7730 raft_consensus.cc:740] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.318572  7729 tablet_bootstrap.cc:492] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:00.319031  7729 ts_tablet_manager.cc:1403] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.173s	user 0.051s	sys 0.063s
I20260709 13:16:00.318818  7803 raft_consensus.cc:493] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.318084  7460 raft_consensus.cc:3060] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.318887  7730 consensus_queue.cc:260] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:00.315881  7461 raft_consensus.cc:2468] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:00.319617  7803 raft_consensus.cc:515] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:00.320762  7648 leader_election.cc:304] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:16:00.321353  7731 raft_consensus.cc:740] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.322147  7731 consensus_queue.cc:260] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.323048  7804 raft_consensus.cc:2804] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:00.323262  7803 leader_election.cc:290] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:00.324260  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa473d10c0ad424f8268c67efcccccff" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:00.327877  7534 raft_consensus.cc:2393] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 382e1f4385ac4066b7098e4fd1f5df06 in current term 1: Already voted for candidate d54f6e4b9e604cd78c48a1828cd3b23a in this term.
I20260709 13:16:00.327821  7804 raft_consensus.cc:697] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:00.328255  7731 ts_tablet_manager.cc:1434] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:16:00.329319  7731 tablet_bootstrap.cc:492] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:00.309784  7734 tablet_bootstrap.cc:492] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:00.330102  7734 ts_tablet_manager.cc:1403] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.002s
I20260709 13:16:00.326449  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa473d10c0ad424f8268c67efcccccff" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:00.330542  7730 ts_tablet_manager.cc:1434] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:16:00.332316  7730 tablet_bootstrap.cc:492] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:00.332518  7574 leader_election.cc:304] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:00.333834  7803 raft_consensus.cc:3060] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.337885  7730 tablet_bootstrap.cc:654] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.339987  7731 tablet_bootstrap.cc:654] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.343210  7803 raft_consensus.cc:2749] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:00.326103  7729 raft_consensus.cc:359] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:00.329037  7804 consensus_queue.cc:237] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.348184  7729 raft_consensus.cc:385] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.346009  7790 raft_consensus.cc:493] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.348593  7729 raft_consensus.cc:740] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.348788  7790 raft_consensus.cc:515] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.349380  7729 consensus_queue.cc:260] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:00.351449  7731 tablet_bootstrap.cc:492] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:00.351521  7729 ts_tablet_manager.cc:1434] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:16:00.352455  7731 ts_tablet_manager.cc:1403] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 13:16:00.352792  7729 tablet_bootstrap.cc:492] T 5e84fe9726f946d2b3552cd90cf46b98 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:00.353261  7683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:00.354049  7683 raft_consensus.cc:2393] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a0eef4c5880424694542637530b55c0 in current term 1: Already voted for candidate e733469bde7c479a916acbbe84b5f342 in this term.
I20260709 13:16:00.350975  7790 leader_election.cc:290] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:00.330442  7795 leader_election.cc:290] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:00.356016  7731 raft_consensus.cc:359] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.356792  7731 raft_consensus.cc:385] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.357105  7731 raft_consensus.cc:740] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.357012  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:00.358183  7461 raft_consensus.cc:2393] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a0eef4c5880424694542637530b55c0 in current term 1: Already voted for candidate d54f6e4b9e604cd78c48a1828cd3b23a in this term.
I20260709 13:16:00.358533  7729 tablet_bootstrap.cc:654] T 5e84fe9726f946d2b3552cd90cf46b98 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.358237  7731 consensus_queue.cc:260] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.359964  7500 leader_election.cc:304] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:00.319563  7770 raft_consensus.cc:515] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.361100  7790 raft_consensus.cc:3060] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.362453  7730 tablet_bootstrap.cc:492] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:00.362926  7730 ts_tablet_manager.cc:1403] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.004s
I20260709 13:16:00.364092  7731 ts_tablet_manager.cc:1434] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:16:00.365149  7731 tablet_bootstrap.cc:492] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:00.365707  7734 raft_consensus.cc:359] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:00.375869  7734 raft_consensus.cc:385] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.376310  7734 raft_consensus.cc:740] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.377151  7734 consensus_queue.cc:260] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:00.366164  7683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd5d05ff1384d2c9c133fdb0483f29a" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:00.367295  7770 leader_election.cc:290] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:00.375275  7460 raft_consensus.cc:2468] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:00.378701  7757 consensus_queue.cc:1048] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:00.365778  7730 raft_consensus.cc:359] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:00.387151  7730 raft_consensus.cc:385] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.387521  7730 raft_consensus.cc:740] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.388150  7734 ts_tablet_manager.cc:1434] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 13:16:00.388164  7574 leader_election.cc:304] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: e733469bde7c479a916acbbe84b5f342
I20260709 13:16:00.388317  7730 consensus_queue.cc:260] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:00.389180  7734 tablet_bootstrap.cc:492] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:00.389663  7803 raft_consensus.cc:2804] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:00.386720  7683 raft_consensus.cc:3060] T cfd5d05ff1384d2c9c133fdb0483f29a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.390808  7730 ts_tablet_manager.cc:1434] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:16:00.391427  7803 raft_consensus.cc:697] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:00.391857  7730 tablet_bootstrap.cc:492] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:00.392489  7803 consensus_queue.cc:237] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.395392  7804 raft_consensus.cc:493] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.395978  7804 raft_consensus.cc:515] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:00.382650  7731 tablet_bootstrap.cc:654] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.399422  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e84fe9726f946d2b3552cd90cf46b98" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:00.400053  7534 raft_consensus.cc:2468] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:16:00.382884  7729 tablet_bootstrap.cc:492] T 5e84fe9726f946d2b3552cd90cf46b98 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:00.401050  7729 ts_tablet_manager.cc:1403] T 5e84fe9726f946d2b3552cd90cf46b98 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.005s
I20260709 13:16:00.404036  7729 raft_consensus.cc:359] T 5e84fe9726f946d2b3552cd90cf46b98 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:00.404771  7729 raft_consensus.cc:385] T 5e84fe9726f946d2b3552cd90cf46b98 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.405774  7804 leader_election.cc:290] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:00.405889  7650 leader_election.cc:304] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:00.405069  7729 raft_consensus.cc:740] T 5e84fe9726f946d2b3552cd90cf46b98 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.407271  7730 tablet_bootstrap.cc:654] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.407518  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e84fe9726f946d2b3552cd90cf46b98" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:00.407346  7729 consensus_queue.cc:260] T 5e84fe9726f946d2b3552cd90cf46b98 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:00.384492  7790 raft_consensus.cc:2749] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:00.385527  7357 catalog_manager.cc:5697] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 0 to 1, leader changed from <none> to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 1 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.408727  7608 raft_consensus.cc:2468] T 5e84fe9726f946d2b3552cd90cf46b98 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:16:00.412945  7729 ts_tablet_manager.cc:1434] T 5e84fe9726f946d2b3552cd90cf46b98 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:16:00.414620  7729 tablet_bootstrap.cc:492] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:00.396415  7734 tablet_bootstrap.cc:654] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.378706  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd5d05ff1384d2c9c133fdb0483f29a" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:00.420032  7461 raft_consensus.cc:3060] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.422295  7804 raft_consensus.cc:2804] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:00.422724  7804 raft_consensus.cc:493] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.423074  7804 raft_consensus.cc:3060] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.424787  7729 tablet_bootstrap.cc:654] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.428013  7731 tablet_bootstrap.cc:492] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:00.428639  7731 ts_tablet_manager.cc:1403] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.005s
I20260709 13:16:00.432379  7734 tablet_bootstrap.cc:492] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:00.432865  7734 ts_tablet_manager.cc:1403] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.001s
I20260709 13:16:00.435222  7731 raft_consensus.cc:359] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:00.436327  7731 raft_consensus.cc:385] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.436518  7730 tablet_bootstrap.cc:492] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:00.436769  7731 raft_consensus.cc:740] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.437071  7730 ts_tablet_manager.cc:1403] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.013s
I20260709 13:16:00.437817  7731 consensus_queue.cc:260] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:00.439208  7797 consensus_queue.cc:1048] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:00.439913  7730 raft_consensus.cc:359] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.440570  7730 raft_consensus.cc:385] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.440843  7730 raft_consensus.cc:740] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.441020  7731 ts_tablet_manager.cc:1434] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:16:00.441519  7730 consensus_queue.cc:260] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.442385  7731 tablet_bootstrap.cc:492] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:00.446832  7750 raft_consensus.cc:493] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.447402  7750 raft_consensus.cc:515] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.445230  7804 raft_consensus.cc:515] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:00.450624  7750 leader_election.cc:290] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:00.450695  7729 tablet_bootstrap.cc:492] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:00.450829  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d88042080495293c0e772b280f3da" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:00.451566  7729 ts_tablet_manager.cc:1403] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.008s
I20260709 13:16:00.451750  7534 raft_consensus.cc:2468] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:16:00.453117  7427 leader_election.cc:304] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:00.453284  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d88042080495293c0e772b280f3da" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:00.454064  7682 raft_consensus.cc:2468] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:16:00.454685  7729 raft_consensus.cc:359] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.455474  7729 raft_consensus.cc:385] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.455758  7729 raft_consensus.cc:740] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.450856  7731 tablet_bootstrap.cc:654] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.456614  7729 consensus_queue.cc:260] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.457830  7683 raft_consensus.cc:2468] T cfd5d05ff1384d2c9c133fdb0483f29a P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:00.459158  7500 leader_election.cc:304] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:00.462124  7790 raft_consensus.cc:2804] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:00.462862  7790 raft_consensus.cc:697] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:00.463084  7797 raft_consensus.cc:2804] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:00.463589  7797 raft_consensus.cc:493] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.463924  7797 raft_consensus.cc:3060] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.464116  7790 consensus_queue.cc:237] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.465211  7356 catalog_manager.cc:5697] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.470877  7729 ts_tablet_manager.cc:1434] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:16:00.471539  7750 consensus_queue.cc:1048] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:00.472440  7729 tablet_bootstrap.cc:492] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:00.474944  7731 tablet_bootstrap.cc:492] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:00.475509  7731 ts_tablet_manager.cc:1403] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.008s
I20260709 13:16:00.478973  7731 raft_consensus.cc:359] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.479669  7731 raft_consensus.cc:385] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.479933  7731 raft_consensus.cc:740] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.480434  7729 tablet_bootstrap.cc:654] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.480872  7731 consensus_queue.cc:260] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.482527  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e84fe9726f946d2b3552cd90cf46b98" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:00.483162  7536 raft_consensus.cc:3060] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.447405  7734 raft_consensus.cc:359] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.488421  7731 ts_tablet_manager.cc:1434] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:16:00.487942  7357 catalog_manager.cc:5697] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a0eef4c5880424694542637530b55c0 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "4a0eef4c5880424694542637530b55c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:00.492102  7734 raft_consensus.cc:385] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.492488  7734 raft_consensus.cc:740] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.501077  7731 tablet_bootstrap.cc:492] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:00.503794  7729 tablet_bootstrap.cc:492] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:00.504312  7729 ts_tablet_manager.cc:1403] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.007s
I20260709 13:16:00.506929  7752 consensus_queue.cc:1048] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:00.507581  7731 tablet_bootstrap.cc:654] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.509758  7729 raft_consensus.cc:359] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:00.510598  7729 raft_consensus.cc:385] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.510975  7729 raft_consensus.cc:740] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.512064  7729 consensus_queue.cc:260] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:00.515116  7729 ts_tablet_manager.cc:1434] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:16:00.494460  7734 consensus_queue.cc:260] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.516778  7729 tablet_bootstrap.cc:492] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:00.522020  7730 ts_tablet_manager.cc:1434] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.000s
I20260709 13:16:00.523198  7734 ts_tablet_manager.cc:1434] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.000s
I20260709 13:16:00.523818  7609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e84fe9726f946d2b3552cd90cf46b98" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:00.523772  7757 raft_consensus.cc:493] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.526438  7730 tablet_bootstrap.cc:492] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:00.526444  7734 tablet_bootstrap.cc:492] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:00.523955  7804 leader_election.cc:290] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:00.512738  7536 raft_consensus.cc:2468] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:00.529018  7609 raft_consensus.cc:3060] T 5e84fe9726f946d2b3552cd90cf46b98 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.530082  7650 leader_election.cc:304] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:00.527417  7461 raft_consensus.cc:2468] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:00.531461  7795 raft_consensus.cc:493] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.532147  7795 raft_consensus.cc:515] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.532500  7797 raft_consensus.cc:515] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.534904  7797 leader_election.cc:290] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:00.535696  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d88042080495293c0e772b280f3da" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:00.537266  7460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868663ec219f46a5abe840f8d43158e7" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:00.525076  7750 consensus_queue.cc:1048] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:16:00.538997  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d88042080495293c0e772b280f3da" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:00.534971  7795 leader_election.cc:290] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:00.540661  7804 raft_consensus.cc:2804] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:00.549459  7684 raft_consensus.cc:3060] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:00.549806  7574 leader_election.cc:343] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.550119  7804 raft_consensus.cc:697] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:00.541705  7683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868663ec219f46a5abe840f8d43158e7" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:00.547065  7734 tablet_bootstrap.cc:654] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.548485  7534 raft_consensus.cc:3060] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.543406  7757 raft_consensus.cc:515] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:00.552664  7804 consensus_queue.cc:237] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:00.568657  7731 tablet_bootstrap.cc:492] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:00.569384  7731 ts_tablet_manager.cc:1403] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.069s	user 0.017s	sys 0.001s
W20260709 13:16:00.560961  7574 leader_election.cc:343] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.574925  7731 raft_consensus.cc:359] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.575868  7731 raft_consensus.cc:385] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.576318  7731 raft_consensus.cc:740] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.577201  7731 consensus_queue.cc:260] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.577956  7574 leader_election.cc:304] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:00.579188  7684 raft_consensus.cc:2468] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:00.583074  7795 raft_consensus.cc:2749] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:00.583557  7425 leader_election.cc:304] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:00.584426  7731 ts_tablet_manager.cc:1434] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:16:00.584564  7750 raft_consensus.cc:2804] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:00.580902  7534 raft_consensus.cc:2468] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:00.585090  7750 raft_consensus.cc:697] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:00.581990  7729 tablet_bootstrap.cc:654] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.558012  7609 raft_consensus.cc:2468] T 5e84fe9726f946d2b3552cd90cf46b98 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:00.585798  7731 tablet_bootstrap.cc:492] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:00.585986  7750 consensus_queue.cc:237] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.602911  7730 tablet_bootstrap.cc:654] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:00.628408  7427 consensus_peers.cc:597] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:00.628645  7757 leader_election.cc:290] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:00.624588  7840 raft_consensus.cc:493] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.630365  7535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361e20d70ddc4e43b3dcbe2e9ca30f50" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:00.630658  7840 raft_consensus.cc:515] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.631323  7535 raft_consensus.cc:2468] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:16:00.635151  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361e20d70ddc4e43b3dcbe2e9ca30f50" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:00.635394  7795 consensus_queue.cc:1048] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:00.635867  7608 raft_consensus.cc:2468] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:16:00.637641  7424 leader_election.cc:304] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:00.638439  7757 raft_consensus.cc:2804] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:00.638816  7757 raft_consensus.cc:493] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.639285  7757 raft_consensus.cc:3060] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.641608  7730 tablet_bootstrap.cc:492] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:00.642494  7730 ts_tablet_manager.cc:1403] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.116s	user 0.010s	sys 0.003s
I20260709 13:16:00.652252  7790 raft_consensus.cc:493] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.652840  7790 raft_consensus.cc:515] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:00.654443  7731 tablet_bootstrap.cc:654] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.654999  7790 leader_election.cc:290] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:00.656773  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9e771ee0f4cb6b649f9ebc0056443" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
W20260709 13:16:00.658329  7500 leader_election.cc:343] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.658854  7734 tablet_bootstrap.cc:492] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:00.659348  7734 ts_tablet_manager.cc:1403] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.133s	user 0.019s	sys 0.004s
I20260709 13:16:00.660032  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9e771ee0f4cb6b649f9ebc0056443" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
W20260709 13:16:00.661365  7499 leader_election.cc:343] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.661789  7499 leader_election.cc:304] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:00.662935  7790 raft_consensus.cc:2749] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:00.663362  7730 raft_consensus.cc:359] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:00.664116  7730 raft_consensus.cc:385] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.664378  7730 raft_consensus.cc:740] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.665216  7730 consensus_queue.cc:260] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:00.666388  7734 raft_consensus.cc:359] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.669014  7790 raft_consensus.cc:493] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.669674  7790 raft_consensus.cc:515] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:00.671868  7358 catalog_manager.cc:5697] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 0 to 1, leader changed from <none> to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.673383  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:00.674767  7790 leader_election.cc:290] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:00.667301  7734 raft_consensus.cc:385] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.674991  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:00.676651  7499 leader_election.cc:304] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:00.677831  7790 raft_consensus.cc:2749] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:00.675408  7734 raft_consensus.cc:740] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.692024  7734 consensus_queue.cc:260] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
W20260709 13:16:00.693626  7427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:45835, user_credentials={real_user=slave}} blocked reactor thread for 55833.2us
I20260709 13:16:00.694800  7734 ts_tablet_manager.cc:1434] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 13:16:00.695863  7734 tablet_bootstrap.cc:492] T ecfe0c23a9c54b2dbe03deca022a9123 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:00.695984  7534 raft_consensus.cc:3060] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.696026  7730 ts_tablet_manager.cc:1434] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.001s
I20260709 13:16:00.699137  7730 tablet_bootstrap.cc:492] T 20ee12a0193649c295925bc14e57d382 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:00.699608  7848 consensus_queue.cc:1048] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:16:00.702924  7750 consensus_queue.cc:1048] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:00.702924  7804 raft_consensus.cc:493] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.705384  7804 raft_consensus.cc:515] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.709200  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce2cd95149b4e5999f7b078e668f5b7" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:00.710177  7461 raft_consensus.cc:2468] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:16:00.711413  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7bab86470a74fdfb18b961658f9e371" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:00.728920  7356 catalog_manager.cc:5697] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 0 to 1, leader changed from <none> to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 1 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:00.730641  7729 tablet_bootstrap.cc:492] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:00.731288  7729 ts_tablet_manager.cc:1403] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.215s	user 0.025s	sys 0.025s
I20260709 13:16:00.739674  7840 leader_election.cc:290] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:00.747383  7731 tablet_bootstrap.cc:492] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:00.748222  7731 ts_tablet_manager.cc:1403] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.163s	user 0.016s	sys 0.005s
I20260709 13:16:00.754117  7731 raft_consensus.cc:359] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.756492  7731 raft_consensus.cc:385] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.756961  7731 raft_consensus.cc:740] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.734171  7608 raft_consensus.cc:2468] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:16:00.758617  7731 consensus_queue.cc:260] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.760229  7647 leader_election.cc:304] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:00.761160  7848 raft_consensus.cc:2804] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:00.761570  7848 raft_consensus.cc:493] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.761921  7848 raft_consensus.cc:3060] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.769816  7795 raft_consensus.cc:493] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.769490  7729 raft_consensus.cc:359] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.770434  7795 raft_consensus.cc:515] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:00.770634  7729 raft_consensus.cc:385] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.773279  7795 leader_election.cc:290] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:00.773496  7729 raft_consensus.cc:740] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.734130  7648 leader_election.cc:304] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:00.775339  7533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b825b38d394fbfbdf8cb645514c782" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
W20260709 13:16:00.775844  7648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:35515, user_credentials={real_user=slave}} blocked reactor thread for 63911.7us
I20260709 13:16:00.776703  7734 tablet_bootstrap.cc:654] T ecfe0c23a9c54b2dbe03deca022a9123 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.777572  7841 raft_consensus.cc:2804] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:00.778012  7841 raft_consensus.cc:493] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.778395  7841 raft_consensus.cc:3060] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.779403  7840 raft_consensus.cc:493] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.779624  7460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7bab86470a74fdfb18b961658f9e371" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
W20260709 13:16:00.779911  7576 leader_election.cc:343] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.780393  7460 raft_consensus.cc:2468] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:16:00.779906  7840 raft_consensus.cc:515] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.782801  7840 leader_election.cc:290] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:00.784468  7533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce2cd95149b4e5999f7b078e668f5b7" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:00.785161  7682 raft_consensus.cc:3060] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.784502  7683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b825b38d394fbfbdf8cb645514c782" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
W20260709 13:16:00.787145  7650 leader_election.cc:343] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.783421  7729 consensus_queue.cc:260] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.788575  7459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a389b4005c4d6890f09b248b3e1ad8" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:00.788797  7803 consensus_queue.cc:1048] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:00.789069  7802 consensus_queue.cc:1048] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:00.778028  7804 leader_election.cc:290] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:00.791785  7729 ts_tablet_manager.cc:1434] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.060s	user 0.002s	sys 0.005s
I20260709 13:16:00.786988  7840 consensus_queue.cc:1048] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:00.795943  7574 leader_election.cc:343] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.796510  7574 leader_election.cc:304] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:00.797353  7802 raft_consensus.cc:2749] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:00.804495  7731 ts_tablet_manager.cc:1434] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.056s	user 0.010s	sys 0.000s
I20260709 13:16:00.805949  7731 tablet_bootstrap.cc:492] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:00.764304  7757 raft_consensus.cc:515] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:00.821384  7795 raft_consensus.cc:493] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.821938  7795 raft_consensus.cc:515] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.822150  7533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361e20d70ddc4e43b3dcbe2e9ca30f50" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:00.823562  7533 raft_consensus.cc:3060] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.827947  7795 leader_election.cc:290] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:00.829373  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1b71c94d284d209da03c159c07316f" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:00.830025  7461 raft_consensus.cc:2468] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 0.
I20260709 13:16:00.831475  7574 leader_election.cc:304] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:00.832507  7795 raft_consensus.cc:2804] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:00.832948  7795 raft_consensus.cc:493] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.833344  7795 raft_consensus.cc:3060] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.839846  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361e20d70ddc4e43b3dcbe2e9ca30f50" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:00.840651  7607 raft_consensus.cc:3060] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.841745  7533 raft_consensus.cc:2468] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:00.841924  7729 tablet_bootstrap.cc:492] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:00.847321  7750 consensus_queue.cc:1048] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:00.847977  7729 tablet_bootstrap.cc:654] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.848359  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1b71c94d284d209da03c159c07316f" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
W20260709 13:16:00.849990  7574 leader_election.cc:343] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.850265  7730 tablet_bootstrap.cc:654] T 20ee12a0193649c295925bc14e57d382 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.815541  7609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a389b4005c4d6890f09b248b3e1ad8" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:00.862756  7427 leader_election.cc:304] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:00.864034  7750 raft_consensus.cc:2804] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:00.864678  7750 raft_consensus.cc:697] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:00.866576  7731 tablet_bootstrap.cc:654] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.866441  7750 consensus_queue.cc:237] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:00.857770  7757 leader_election.cc:290] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:00.854295  7795 raft_consensus.cc:515] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.892899  7797 consensus_queue.cc:1048] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:00.895279  7734 tablet_bootstrap.cc:492] T ecfe0c23a9c54b2dbe03deca022a9123 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:00.895797  7734 ts_tablet_manager.cc:1403] T ecfe0c23a9c54b2dbe03deca022a9123 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.200s	user 0.016s	sys 0.013s
I20260709 13:16:00.897197  7790 consensus_queue.cc:1048] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:00.898638  7734 raft_consensus.cc:359] T ecfe0c23a9c54b2dbe03deca022a9123 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.901059  7734 raft_consensus.cc:385] T ecfe0c23a9c54b2dbe03deca022a9123 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.901409  7734 raft_consensus.cc:740] T ecfe0c23a9c54b2dbe03deca022a9123 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.904294  7734 consensus_queue.cc:260] T ecfe0c23a9c54b2dbe03deca022a9123 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.907055  7734 ts_tablet_manager.cc:1434] T ecfe0c23a9c54b2dbe03deca022a9123 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:16:00.908383  7734 tablet_bootstrap.cc:492] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:00.911410  7729 tablet_bootstrap.cc:492] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:00.911978  7729 ts_tablet_manager.cc:1403] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.003s
I20260709 13:16:00.892970  7647 leader_election.cc:304] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
W20260709 13:16:00.912528  7650 consensus_peers.cc:597] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:00.920351  7734 tablet_bootstrap.cc:654] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.921849  7790 consensus_queue.cc:1048] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:00.922000  7729 raft_consensus.cc:359] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.922955  7729 raft_consensus.cc:385] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.923377  7729 raft_consensus.cc:740] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.926884  7730 tablet_bootstrap.cc:492] T 20ee12a0193649c295925bc14e57d382 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:00.927394  7730 ts_tablet_manager.cc:1403] T 20ee12a0193649c295925bc14e57d382 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.228s	user 0.011s	sys 0.005s
I20260709 13:16:00.929003  7804 raft_consensus.cc:2749] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:00.930063  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1b71c94d284d209da03c159c07316f" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:00.905336  7848 raft_consensus.cc:515] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:00.955816  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7bab86470a74fdfb18b961658f9e371" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:00.956064  7848 leader_election.cc:290] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:00.956483  7610 raft_consensus.cc:3060] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.928009  7729 consensus_queue.cc:260] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
W20260709 13:16:00.933586  7574 leader_election.cc:343] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:00.938728  7856 log.cc:927] Time spent T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
I20260709 13:16:00.948485  7607 raft_consensus.cc:2468] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:00.950193  7730 raft_consensus.cc:359] T 20ee12a0193649c295925bc14e57d382 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.960647  7730 raft_consensus.cc:385] T 20ee12a0193649c295925bc14e57d382 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.961185  7730 raft_consensus.cc:740] T 20ee12a0193649c295925bc14e57d382 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.957088  7458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7bab86470a74fdfb18b961658f9e371" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:00.909672  7841 raft_consensus.cc:515] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
W20260709 13:16:00.958365  7407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:00.966043  7729 ts_tablet_manager.cc:1434] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.004s
I20260709 13:16:00.968459  7730 consensus_queue.cc:260] T 20ee12a0193649c295925bc14e57d382 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.972725  7729 tablet_bootstrap.cc:492] T e250baa9f7b44f2fb0002ff47f7c34db P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:00.975036  7730 ts_tablet_manager.cc:1434] T 20ee12a0193649c295925bc14e57d382 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:16:00.975728  7794 raft_consensus.cc:493] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.976387  7794 raft_consensus.cc:515] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:00.972234  7458 raft_consensus.cc:3060] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.982386  7794 leader_election.cc:290] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:00.984164  7730 tablet_bootstrap.cc:492] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:00.984822  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d28d9895a5469db67cd40794083e95" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:00.993129  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d28d9895a5469db67cd40794083e95" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
W20260709 13:16:00.998571  7427 leader_election.cc:343] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.998778  7731 tablet_bootstrap.cc:492] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
W20260709 13:16:00.999343  7425 leader_election.cc:343] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.999953  7425 leader_election.cc:304] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:01.001049  7841 leader_election.cc:290] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:01.001355  7730 tablet_bootstrap.cc:654] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.001646  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce2cd95149b4e5999f7b078e668f5b7" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:01.001955  7797 raft_consensus.cc:2749] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:00.999339  7731 ts_tablet_manager.cc:1403] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.194s	user 0.023s	sys 0.013s
W20260709 13:16:01.007302  7650 leader_election.cc:343] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:01.012185  7458 raft_consensus.cc:2468] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:01.015410  7795 leader_election.cc:290] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:01.029392  7797 consensus_queue.cc:1048] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:01.030229  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce2cd95149b4e5999f7b078e668f5b7" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:01.030591  7648 leader_election.cc:304] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:01.030946  7461 raft_consensus.cc:3060] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:01.031199  7855 log.cc:927] Time spent T 1ea546eef5aa4273af08f1b3468c5369 P e733469bde7c479a916acbbe84b5f342: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:16:01.031809  7841 raft_consensus.cc:2804] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:01.032326  7841 raft_consensus.cc:697] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:01.033155  7841 consensus_queue.cc:237] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
W20260709 13:16:01.037560  7863 log.cc:927] Time spent T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:16:01.038993  7461 raft_consensus.cc:2468] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:01.044153  7610 raft_consensus.cc:2468] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:01.030634  7458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1b71c94d284d209da03c159c07316f" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:01.047084  7458 raft_consensus.cc:3060] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.050668  7802 raft_consensus.cc:493] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.051201  7802 raft_consensus.cc:515] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.053350  7802 leader_election.cc:290] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:01.055167  7358 catalog_manager.cc:5697] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 0 to 1, leader changed from <none> to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:01.057173  7458 raft_consensus.cc:2468] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:01.017993  7681 raft_consensus.cc:3060] T ecfe0c23a9c54b2dbe03deca022a9123 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.059186  7574 leader_election.cc:304] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: e733469bde7c479a916acbbe84b5f342
I20260709 13:16:01.060595  7795 raft_consensus.cc:2804] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:01.061061  7795 raft_consensus.cc:697] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:01.061915  7795 consensus_queue.cc:237] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.066802  7729 tablet_bootstrap.cc:654] T e250baa9f7b44f2fb0002ff47f7c34db P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.066447  7848 consensus_queue.cc:1048] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:01.061307  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79ef75f6ba41b4a0e56ba851add378" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:01.050303  7731 raft_consensus.cc:359] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.079676  7804 raft_consensus.cc:493] T ecfe0c23a9c54b2dbe03deca022a9123 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.095331  7804 raft_consensus.cc:515] T ecfe0c23a9c54b2dbe03deca022a9123 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.086233  7734 tablet_bootstrap.cc:492] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:01.096820  7734 ts_tablet_manager.cc:1403] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.189s	user 0.019s	sys 0.025s
I20260709 13:16:01.096992  7730 tablet_bootstrap.cc:492] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:01.097465  7730 ts_tablet_manager.cc:1403] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.114s	user 0.036s	sys 0.043s
I20260709 13:16:01.100384  7804 leader_election.cc:290] T ecfe0c23a9c54b2dbe03deca022a9123 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:01.094507  7458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79ef75f6ba41b4a0e56ba851add378" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
W20260709 13:16:01.104192  7574 leader_election.cc:343] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:01.104383  7841 consensus_queue.cc:1048] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:01.100108  7730 raft_consensus.cc:359] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.105471  7730 raft_consensus.cc:385] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.101675  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfe0c23a9c54b2dbe03deca022a9123" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:01.105890  7730 raft_consensus.cc:740] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.101969  7734 raft_consensus.cc:359] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.102633  7731 raft_consensus.cc:385] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.106854  7734 raft_consensus.cc:385] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.106920  7731 raft_consensus.cc:740] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.107273  7734 raft_consensus.cc:740] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.107803  7731 consensus_queue.cc:260] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.108002  7734 consensus_queue.cc:260] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.108912  7730 consensus_queue.cc:260] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.110196  7734 ts_tablet_manager.cc:1434] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:16:01.110608  7730 ts_tablet_manager.cc:1434] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:16:01.111585  7730 tablet_bootstrap.cc:492] T 58b825b38d394fbfbdf8cb645514c782 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:01.113317  7729 tablet_bootstrap.cc:492] T e250baa9f7b44f2fb0002ff47f7c34db P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:01.114071  7729 ts_tablet_manager.cc:1403] T e250baa9f7b44f2fb0002ff47f7c34db P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.143s	user 0.007s	sys 0.003s
I20260709 13:16:01.115422  7734 tablet_bootstrap.cc:492] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:01.116251  7730 tablet_bootstrap.cc:654] T 58b825b38d394fbfbdf8cb645514c782 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:01.117895  7574 leader_election.cc:343] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:01.118453  7574 leader_election.cc:304] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:01.119467  7803 consensus_queue.cc:1048] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:01.121531  7803 raft_consensus.cc:2749] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:01.122102  7734 tablet_bootstrap.cc:654] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.125885  7648 leader_election.cc:304] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:16:01.128505  7794 raft_consensus.cc:493] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.128980  7731 ts_tablet_manager.cc:1434] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.124s	user 0.008s	sys 0.000s
I20260709 13:16:01.130759  7797 consensus_queue.cc:1048] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:01.155850  7794 raft_consensus.cc:515] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.156591  7731 tablet_bootstrap.cc:492] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:01.158179  7794 leader_election.cc:290] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:01.138393  7790 raft_consensus.cc:493] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.148316  7459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfe0c23a9c54b2dbe03deca022a9123" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:01.161995  7790 raft_consensus.cc:515] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.153318  7734 tablet_bootstrap.cc:492] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:01.163193  7734 ts_tablet_manager.cc:1403] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.023s
I20260709 13:16:01.164083  7790 leader_election.cc:290] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:01.165056  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:01.153674  7730 tablet_bootstrap.cc:492] T 58b825b38d394fbfbdf8cb645514c782 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:01.165727  7534 raft_consensus.cc:2468] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:01.165990  7730 ts_tablet_manager.cc:1403] T 58b825b38d394fbfbdf8cb645514c782 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.027s
I20260709 13:16:01.165843  7734 raft_consensus.cc:359] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.166535  7734 raft_consensus.cc:385] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.166920  7734 raft_consensus.cc:740] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.166421  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96e53ac6d4a4521824a0eef2bf0400b" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:01.167583  7734 consensus_queue.cc:260] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.168046  7459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96e53ac6d4a4521824a0eef2bf0400b" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:01.154886  7729 raft_consensus.cc:359] T e250baa9f7b44f2fb0002ff47f7c34db P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.168675  7729 raft_consensus.cc:385] T e250baa9f7b44f2fb0002ff47f7c34db P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.168959  7729 raft_consensus.cc:740] T e250baa9f7b44f2fb0002ff47f7c34db P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.169193  7848 raft_consensus.cc:2804] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:01.169674  7848 raft_consensus.cc:697] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:01.170341  7729 consensus_queue.cc:260] T e250baa9f7b44f2fb0002ff47f7c34db P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.170476  7848 consensus_queue.cc:237] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:01.170733  7355 catalog_manager.cc:5697] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 0 to 1, leader changed from <none> to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 1 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:01.172804  7729 ts_tablet_manager.cc:1434] T e250baa9f7b44f2fb0002ff47f7c34db P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.002s
I20260709 13:16:01.173751  7729 tablet_bootstrap.cc:492] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:01.173878  7500 leader_election.cc:304] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:01.175051  7770 raft_consensus.cc:2749] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:01.176544  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:01.177225  7680 raft_consensus.cc:2468] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:01.177491  7730 raft_consensus.cc:359] T 58b825b38d394fbfbdf8cb645514c782 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.178273  7730 raft_consensus.cc:385] T 58b825b38d394fbfbdf8cb645514c782 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.178535  7730 raft_consensus.cc:740] T 58b825b38d394fbfbdf8cb645514c782 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.179183  7730 consensus_queue.cc:260] T 58b825b38d394fbfbdf8cb645514c782 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.182303  7730 ts_tablet_manager.cc:1434] T 58b825b38d394fbfbdf8cb645514c782 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:16:01.183547  7730 tablet_bootstrap.cc:492] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:01.184619  7427 leader_election.cc:304] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:01.186165  7750 raft_consensus.cc:2804] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:01.186566  7750 raft_consensus.cc:493] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.186944  7750 raft_consensus.cc:3060] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.188290  7731 tablet_bootstrap.cc:654] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.190380  7730 tablet_bootstrap.cc:654] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.201242  7729 tablet_bootstrap.cc:654] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.203119  7648 leader_election.cc:304] T ecfe0c23a9c54b2dbe03deca022a9123 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:01.196764  7750 raft_consensus.cc:515] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.201512  7533 raft_consensus.cc:3060] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.211648  7770 raft_consensus.cc:493] T 20ee12a0193649c295925bc14e57d382 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.212365  7770 raft_consensus.cc:515] T 20ee12a0193649c295925bc14e57d382 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:01.213178  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:01.213809  7534 raft_consensus.cc:3060] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.217005  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ee12a0193649c295925bc14e57d382" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:01.217388  7459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ee12a0193649c295925bc14e57d382" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:01.219913  7500 leader_election.cc:304] T 20ee12a0193649c295925bc14e57d382 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:01.221035  7790 raft_consensus.cc:2749] T 20ee12a0193649c295925bc14e57d382 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:01.221035  7534 raft_consensus.cc:2468] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 2.
I20260709 13:16:01.223418  7427 leader_election.cc:304] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:01.224604  7757 raft_consensus.cc:2804] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:01.225407  7757 raft_consensus.cc:697] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:01.226466  7757 consensus_queue.cc:237] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.215090  7770 leader_election.cc:290] T 20ee12a0193649c295925bc14e57d382 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:01.231360  7730 tablet_bootstrap.cc:492] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:01.231920  7730 ts_tablet_manager.cc:1403] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.010s
I20260709 13:16:01.235155  7730 raft_consensus.cc:359] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:01.235872  7730 raft_consensus.cc:385] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.236145  7730 raft_consensus.cc:740] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.237851  7730 consensus_queue.cc:260] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:01.238209  7731 tablet_bootstrap.cc:492] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:01.241245  7730 ts_tablet_manager.cc:1434] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:16:01.242300  7730 tablet_bootstrap.cc:492] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:01.251448  7804 raft_consensus.cc:2749] T ecfe0c23a9c54b2dbe03deca022a9123 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:01.251953  7734 ts_tablet_manager.cc:1434] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.000s
I20260709 13:16:01.253772  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:01.255266  7730 tablet_bootstrap.cc:654] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.255613  7682 raft_consensus.cc:3060] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.255108  7356 catalog_manager.cc:5697] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:01.265170  7682 raft_consensus.cc:2468] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 2.
I20260709 13:16:01.266758  7734 tablet_bootstrap.cc:492] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:01.254846  7750 leader_election.cc:290] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:01.288440  7734 tablet_bootstrap.cc:654] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.291429  7731 ts_tablet_manager.cc:1403] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.135s	user 0.014s	sys 0.000s
I20260709 13:16:01.301379  7734 tablet_bootstrap.cc:492] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:01.302219  7734 ts_tablet_manager.cc:1403] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.009s
I20260709 13:16:01.303082  7750 raft_consensus.cc:493] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.311712  7750 raft_consensus.cc:515] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.315747  7533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899962d588849ccb4af0f8cb06c07d0" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:01.316439  7533 raft_consensus.cc:2468] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:16:01.316736  7750 leader_election.cc:290] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:01.317492  7734 raft_consensus.cc:359] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.317564  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899962d588849ccb4af0f8cb06c07d0" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:01.318290  7734 raft_consensus.cc:385] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.318866  7734 raft_consensus.cc:740] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.317744  7427 leader_election.cc:304] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
W20260709 13:16:01.320420  7424 leader_election.cc:343] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:01.320001  7734 consensus_queue.cc:260] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.321205  7750 raft_consensus.cc:2804] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:01.321949  7750 raft_consensus.cc:493] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.322475  7750 raft_consensus.cc:3060] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.323890  7734 ts_tablet_manager.cc:1434] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:16:01.325229  7734 tablet_bootstrap.cc:492] T fb1b71c94d284d209da03c159c07316f P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:01.333240  7734 tablet_bootstrap.cc:654] T fb1b71c94d284d209da03c159c07316f P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.339097  7731 raft_consensus.cc:359] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.352015  7731 raft_consensus.cc:385] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.352562  7731 raft_consensus.cc:740] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.342068  7848 raft_consensus.cc:493] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.342468  7358 catalog_manager.cc:5697] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 0 to 2, leader changed from <none> to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 2 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.353670  7731 consensus_queue.cc:260] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.349696  7757 consensus_queue.cc:1048] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:01.350479  7533 raft_consensus.cc:3060] T 20ee12a0193649c295925bc14e57d382 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.359509  7770 raft_consensus.cc:493] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.360055  7770 raft_consensus.cc:515] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:01.357944  7750 raft_consensus.cc:515] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.363703  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce2cd95149b4e5999f7b078e668f5b7" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:01.366541  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899962d588849ccb4af0f8cb06c07d0" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:01.367307  7534 raft_consensus.cc:3060] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.351610  7729 tablet_bootstrap.cc:492] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:01.373279  7729 ts_tablet_manager.cc:1403] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.200s	user 0.059s	sys 0.074s
I20260709 13:16:01.353629  7848 raft_consensus.cc:515] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.379926  7731 ts_tablet_manager.cc:1434] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.088s	user 0.013s	sys 0.004s
I20260709 13:16:01.381227  7731 tablet_bootstrap.cc:492] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:01.381907  7459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce2cd95149b4e5999f7b078e668f5b7" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:01.382228  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b825b38d394fbfbdf8cb645514c782" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:01.382839  7459 raft_consensus.cc:2393] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a0eef4c5880424694542637530b55c0 in current term 1: Already voted for candidate e733469bde7c479a916acbbe84b5f342 in this term.
I20260709 13:16:01.383090  7536 raft_consensus.cc:2468] T 58b825b38d394fbfbdf8cb645514c782 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:16:01.384231  7500 leader_election.cc:304] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:01.384639  7650 leader_election.cc:304] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:01.385362  7790 raft_consensus.cc:3060] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.386227  7848 leader_election.cc:290] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:01.386788  7848 raft_consensus.cc:2804] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:01.387118  7848 raft_consensus.cc:493] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.387468  7848 raft_consensus.cc:3060] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.388404  7750 leader_election.cc:290] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:01.389410  7731 tablet_bootstrap.cc:654] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.392256  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b825b38d394fbfbdf8cb645514c782" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:01.393142  7610 raft_consensus.cc:2468] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:16:01.394711  7729 raft_consensus.cc:359] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.395450  7729 raft_consensus.cc:385] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.395740  7729 raft_consensus.cc:740] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.395731  7355 catalog_manager.cc:5697] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 0 to 1, leader changed from <none> to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 1 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:01.396759  7729 consensus_queue.cc:260] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.396775  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899962d588849ccb4af0f8cb06c07d0" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:01.398226  7610 raft_consensus.cc:3060] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.399372  7790 raft_consensus.cc:2749] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:01.400345  7770 leader_election.cc:290] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:01.380048  7730 tablet_bootstrap.cc:492] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:01.402104  7730 ts_tablet_manager.cc:1403] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.160s	user 0.031s	sys 0.060s
I20260709 13:16:01.405771  7730 raft_consensus.cc:359] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.406263  7750 consensus_queue.cc:1048] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:01.408084  7730 raft_consensus.cc:385] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.408571  7730 raft_consensus.cc:740] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.409543  7730 consensus_queue.cc:260] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.413226  7729 ts_tablet_manager.cc:1434] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 13:16:01.414228  7729 tablet_bootstrap.cc:492] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:01.421824  7848 raft_consensus.cc:515] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.367408  7734 tablet_bootstrap.cc:492] T fb1b71c94d284d209da03c159c07316f P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:01.429023  7730 ts_tablet_manager.cc:1434] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:16:01.430159  7730 tablet_bootstrap.cc:492] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:01.430310  7535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b825b38d394fbfbdf8cb645514c782" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:01.430500  7804 consensus_queue.cc:1048] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:01.431017  7535 raft_consensus.cc:3060] T 58b825b38d394fbfbdf8cb645514c782 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.432801  7734 ts_tablet_manager.cc:1403] T fb1b71c94d284d209da03c159c07316f P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.108s	user 0.016s	sys 0.004s
I20260709 13:16:01.436102  7730 tablet_bootstrap.cc:654] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.436712  7734 raft_consensus.cc:359] T fb1b71c94d284d209da03c159c07316f P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.437642  7734 raft_consensus.cc:385] T fb1b71c94d284d209da03c159c07316f P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.437916  7734 raft_consensus.cc:740] T fb1b71c94d284d209da03c159c07316f P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.441489  7534 raft_consensus.cc:2468] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:01.443105  7427 leader_election.cc:304] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:01.444490  7750 raft_consensus.cc:2804] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:01.445173  7750 raft_consensus.cc:697] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:01.445704  7535 raft_consensus.cc:2468] T 58b825b38d394fbfbdf8cb645514c782 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:01.446276  7750 consensus_queue.cc:237] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.447921  7650 leader_election.cc:304] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:01.448837  7804 raft_consensus.cc:2804] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:01.449350  7804 raft_consensus.cc:697] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:01.450196  7804 consensus_queue.cc:237] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
W20260709 13:16:01.454866  7574 consensus_peers.cc:597] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Couldn't send request to peer e733469bde7c479a916acbbe84b5f342. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:01.459860  7734 consensus_queue.cc:260] T fb1b71c94d284d209da03c159c07316f P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.462033  7734 ts_tablet_manager.cc:1434] T fb1b71c94d284d209da03c159c07316f P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:16:01.463001  7734 tablet_bootstrap.cc:492] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:01.473767  7734 tablet_bootstrap.cc:654] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.479099  7729 tablet_bootstrap.cc:654] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.479423  7731 tablet_bootstrap.cc:492] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:01.483579  7731 ts_tablet_manager.cc:1403] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.103s	user 0.020s	sys 0.027s
I20260709 13:16:01.480011  7794 raft_consensus.cc:493] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.485960  7794 raft_consensus.cc:515] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.487051  7730 tablet_bootstrap.cc:492] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:01.487548  7730 ts_tablet_manager.cc:1403] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.006s
I20260709 13:16:01.488080  7794 leader_election.cc:290] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:01.488936  7841 consensus_queue.cc:1048] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:01.489473  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868663ec219f46a5abe840f8d43158e7" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:01.490191  7731 raft_consensus.cc:359] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.490931  7609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b825b38d394fbfbdf8cb645514c782" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:01.491595  7609 raft_consensus.cc:3060] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.492784  7731 raft_consensus.cc:385] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.480188  7848 leader_election.cc:290] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:01.481668  7610 raft_consensus.cc:2468] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:01.493129  7731 raft_consensus.cc:740] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.497294  7730 raft_consensus.cc:359] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:01.498672  7730 raft_consensus.cc:385] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.498924  7731 consensus_queue.cc:260] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.498955  7730 raft_consensus.cc:740] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.502396  7730 consensus_queue.cc:260] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:01.507413  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868663ec219f46a5abe840f8d43158e7" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:01.508124  7608 raft_consensus.cc:2468] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
W20260709 13:16:01.505939  7425 leader_election.cc:343] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:01.519515  7731 ts_tablet_manager.cc:1434] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:16:01.519723  7730 ts_tablet_manager.cc:1434] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 13:16:01.520646  7730 tablet_bootstrap.cc:492] T 7b4e6876d12b4cf6ad01688451c1b033 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:01.520648  7731 tablet_bootstrap.cc:492] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:01.523196  7609 raft_consensus.cc:2468] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:01.527872  7424 leader_election.cc:304] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: e733469bde7c479a916acbbe84b5f342
I20260709 13:16:01.528842  7794 raft_consensus.cc:2804] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:01.529525  7794 raft_consensus.cc:493] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.529966  7794 raft_consensus.cc:3060] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.520766  7848 raft_consensus.cc:493] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.535583  7848 raft_consensus.cc:515] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.520896  7358 catalog_manager.cc:5697] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 0 to 1, leader changed from <none> to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:01.547771  7730 tablet_bootstrap.cc:654] T 7b4e6876d12b4cf6ad01688451c1b033 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.551631  7734 tablet_bootstrap.cc:492] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:01.555490  7731 tablet_bootstrap.cc:654] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.555603  7734 ts_tablet_manager.cc:1403] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.093s	user 0.024s	sys 0.022s
I20260709 13:16:01.558925  7734 raft_consensus.cc:359] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:01.561882  7734 raft_consensus.cc:385] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.562165  7734 raft_consensus.cc:740] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.562781  7734 consensus_queue.cc:260] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:01.565308  7734 ts_tablet_manager.cc:1434] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:16:01.573685  7734 tablet_bootstrap.cc:492] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:01.574841  7752 raft_consensus.cc:493] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.575618  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e250baa9f7b44f2fb0002ff47f7c34db" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:01.575397  7752 raft_consensus.cc:515] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.580739  7734 tablet_bootstrap.cc:654] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.581658  7795 consensus_queue.cc:1048] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:01.582321  7752 leader_election.cc:290] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:01.584452  7609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9e771ee0f4cb6b649f9ebc0056443" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:01.585760  7752 consensus_queue.cc:1048] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:16:01.590796  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9e771ee0f4cb6b649f9ebc0056443" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
W20260709 13:16:01.590359  7647 leader_election.cc:343] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:01.592470  7848 leader_election.cc:290] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:01.597846  7731 tablet_bootstrap.cc:492] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:01.600865  7534 raft_consensus.cc:2468] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:16:01.601394  7731 ts_tablet_manager.cc:1403] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.005s
I20260709 13:16:01.602891  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e250baa9f7b44f2fb0002ff47f7c34db" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
W20260709 13:16:01.603958  7650 leader_election.cc:343] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:01.604038  7731 raft_consensus.cc:359] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.603827  7610 raft_consensus.cc:2468] T e250baa9f7b44f2fb0002ff47f7c34db P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:16:01.604878  7731 raft_consensus.cc:385] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.605309  7731 raft_consensus.cc:740] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.598070  7729 tablet_bootstrap.cc:492] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:01.605531  7650 leader_election.cc:304] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06
I20260709 13:16:01.606173  7729 ts_tablet_manager.cc:1403] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.192s	user 0.012s	sys 0.003s
I20260709 13:16:01.606603  7804 raft_consensus.cc:2804] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:01.606535  7647 leader_election.cc:304] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:16:01.607196  7804 raft_consensus.cc:493] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.608232  7841 raft_consensus.cc:2804] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:01.608319  7804 raft_consensus.cc:3060] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.608989  7839 consensus_queue.cc:1048] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:01.609086  7731 consensus_queue.cc:260] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.611588  7731 ts_tablet_manager.cc:1434] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:16:01.613335  7731 tablet_bootstrap.cc:492] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:01.608791  7729 raft_consensus.cc:359] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.614635  7729 raft_consensus.cc:385] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.614924  7729 raft_consensus.cc:740] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.615706  7682 raft_consensus.cc:1275] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:16:01.615625  7729 consensus_queue.cc:260] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.617391  7750 consensus_queue.cc:1048] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:01.617978  7729 ts_tablet_manager.cc:1434] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:16:01.618922  7729 tablet_bootstrap.cc:492] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:01.608659  7841 raft_consensus.cc:493] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.620137  7841 raft_consensus.cc:3060] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.589784  7355 catalog_manager.cc:5697] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 0 to 1, leader changed from <none> to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 1 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.624552  7729 tablet_bootstrap.cc:654] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.629484  7795 raft_consensus.cc:493] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.631919  7795 raft_consensus.cc:515] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.655417  7730 tablet_bootstrap.cc:492] T 7b4e6876d12b4cf6ad01688451c1b033 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:01.656237  7730 ts_tablet_manager.cc:1403] T 7b4e6876d12b4cf6ad01688451c1b033 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.136s	user 0.012s	sys 0.006s
I20260709 13:16:01.664366  7770 raft_consensus.cc:493] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.665136  7770 raft_consensus.cc:515] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.665716  7795 leader_election.cc:290] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:01.666785  7731 tablet_bootstrap.cc:654] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.669211  7734 tablet_bootstrap.cc:492] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:01.669662  7734 ts_tablet_manager.cc:1403] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.096s	user 0.012s	sys 0.001s
I20260709 13:16:01.671005  7681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8887c1835b4d5b9697b6a44f0efd7e" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:01.671779  7770 leader_election.cc:290] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:01.672405  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d716d1bf1004e7ca0d255d7d9c50835" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
W20260709 13:16:01.673130  7574 leader_election.cc:343] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:01.674049  7499 leader_election.cc:343] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:01.677238  7460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d716d1bf1004e7ca0d255d7d9c50835" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:01.678836  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8887c1835b4d5b9697b6a44f0efd7e" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
W20260709 13:16:01.681383  7576 leader_election.cc:343] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:01.681874  7576 leader_election.cc:304] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:01.678642  7794 raft_consensus.cc:515] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.682694  7870 raft_consensus.cc:2749] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:01.682547  7730 raft_consensus.cc:359] T 7b4e6876d12b4cf6ad01688451c1b033 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:01.684576  7794 leader_election.cc:290] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:01.687508  7681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868663ec219f46a5abe840f8d43158e7" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:01.685603  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868663ec219f46a5abe840f8d43158e7" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:01.703778  7610 raft_consensus.cc:3060] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.712594  7610 raft_consensus.cc:2468] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:01.693148  7536 raft_consensus.cc:1275] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 13:16:01.684360  7500 leader_election.cc:343] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:01.713848  7500 leader_election.cc:304] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:01.714650  7729 tablet_bootstrap.cc:492] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:01.715178  7729 ts_tablet_manager.cc:1403] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.096s	user 0.021s	sys 0.037s
I20260709 13:16:01.715492  7770 raft_consensus.cc:2749] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:01.717203  7797 consensus_queue.cc:1048] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:01.718052  7729 raft_consensus.cc:359] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.718747  7729 raft_consensus.cc:385] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.719012  7729 raft_consensus.cc:740] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.719851  7729 consensus_queue.cc:260] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.699184  7841 raft_consensus.cc:515] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.689214  7734 raft_consensus.cc:359] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.729192  7734 raft_consensus.cc:385] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.729526  7734 raft_consensus.cc:740] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
W20260709 13:16:01.701174  7647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:46815, user_credentials={real_user=slave}} blocked reactor thread for 94762.2us
I20260709 13:16:01.730183  7734 consensus_queue.cc:260] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.730180  7729 ts_tablet_manager.cc:1434] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:16:01.701637  7804 raft_consensus.cc:515] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.692519  7730 raft_consensus.cc:385] T 7b4e6876d12b4cf6ad01688451c1b033 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.728350  7797 raft_consensus.cc:493] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.735208  7797 raft_consensus.cc:515] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.736573  7734 ts_tablet_manager.cc:1434] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.001s
I20260709 13:16:01.737742  7734 tablet_bootstrap.cc:492] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:01.737666  7797 leader_election.cc:290] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:01.739503  7730 raft_consensus.cc:740] T 7b4e6876d12b4cf6ad01688451c1b033 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.741159  7606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79ef75f6ba41b4a0e56ba851add378" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:01.741856  7606 raft_consensus.cc:2468] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:16:01.740183  7681 raft_consensus.cc:3060] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.743230  7424 leader_election.cc:304] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:01.744388  7797 raft_consensus.cc:2804] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:01.744762  7797 raft_consensus.cc:493] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.745085  7797 raft_consensus.cc:3060] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.746006  7734 tablet_bootstrap.cc:654] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.746436  7730 consensus_queue.cc:260] T 7b4e6876d12b4cf6ad01688451c1b033 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:01.747717  7729 tablet_bootstrap.cc:492] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:01.747898  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79ef75f6ba41b4a0e56ba851add378" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
W20260709 13:16:01.752094  7425 leader_election.cc:343] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:01.752888  7730 ts_tablet_manager.cc:1434] T 7b4e6876d12b4cf6ad01688451c1b033 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.000s
I20260709 13:16:01.754077  7730 tablet_bootstrap.cc:492] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:01.758700  7729 tablet_bootstrap.cc:654] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.760676  7424 leader_election.cc:304] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:01.761888  7731 tablet_bootstrap.cc:492] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:01.762393  7731 ts_tablet_manager.cc:1403] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.149s	user 0.012s	sys 0.007s
I20260709 13:16:01.765221  7731 raft_consensus.cc:359] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:01.765947  7731 raft_consensus.cc:385] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.767585  7794 raft_consensus.cc:2804] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:01.768108  7794 raft_consensus.cc:697] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:01.766222  7731 raft_consensus.cc:740] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.769902  7752 raft_consensus.cc:493] T fb1b71c94d284d209da03c159c07316f P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.770437  7730 tablet_bootstrap.cc:654] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.770524  7752 raft_consensus.cc:515] T fb1b71c94d284d209da03c159c07316f P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.773607  7731 consensus_queue.cc:260] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:01.774070  7752 leader_election.cc:290] T fb1b71c94d284d209da03c159c07316f P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:01.776348  7731 ts_tablet_manager.cc:1434] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:16:01.768946  7794 consensus_queue.cc:237] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.777905  7731 tablet_bootstrap.cc:492] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:01.781306  7459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1b71c94d284d209da03c159c07316f" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:01.793166  7729 tablet_bootstrap.cc:492] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:01.793730  7729 ts_tablet_manager.cc:1403] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.000s
I20260709 13:16:01.799366  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9e771ee0f4cb6b649f9ebc0056443" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:01.800132  7534 raft_consensus.cc:3060] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.801008  7841 leader_election.cc:290] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:01.801234  7804 leader_election.cc:290] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:01.807489  7729 raft_consensus.cc:359] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.808483  7729 raft_consensus.cc:385] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.808825  7729 raft_consensus.cc:740] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.809901  7729 consensus_queue.cc:260] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.812182  7533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e250baa9f7b44f2fb0002ff47f7c34db" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
W20260709 13:16:01.813737  7650 leader_election.cc:343] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:01.816596  7730 tablet_bootstrap.cc:492] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:01.817284  7730 ts_tablet_manager.cc:1403] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.063s	user 0.005s	sys 0.008s
I20260709 13:16:01.819561  7752 raft_consensus.cc:493] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.820124  7752 raft_consensus.cc:515] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:01.821543  7534 raft_consensus.cc:2468] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:01.822064  7730 raft_consensus.cc:359] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.822670  7752 leader_election.cc:290] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:01.823726  7458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4e6876d12b4cf6ad01688451c1b033" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
W20260709 13:16:01.832723  7648 leader_election.cc:343] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:01.824148  7681 raft_consensus.cc:2468] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:01.824378  7532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4e6876d12b4cf6ad01688451c1b033" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:01.833520  7734 tablet_bootstrap.cc:492] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:01.833659  7532 raft_consensus.cc:2468] T 7b4e6876d12b4cf6ad01688451c1b033 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:16:01.834268  7734 ts_tablet_manager.cc:1403] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.097s	user 0.017s	sys 0.023s
I20260709 13:16:01.826716  7729 ts_tablet_manager.cc:1434] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.002s
I20260709 13:16:01.830986  7730 raft_consensus.cc:385] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.835018  7650 leader_election.cc:304] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:01.835606  7730 raft_consensus.cc:740] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.826093  7770 raft_consensus.cc:493] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.836369  7770 raft_consensus.cc:515] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:01.836421  7730 consensus_queue.cc:260] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.837052  7734 raft_consensus.cc:359] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:01.837766  7734 raft_consensus.cc:385] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.838042  7734 raft_consensus.cc:740] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.838344  7730 ts_tablet_manager.cc:1434] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.002s
I20260709 13:16:01.838833  7770 leader_election.cc:290] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:01.838969  7734 consensus_queue.cc:260] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:01.840130  7752 raft_consensus.cc:2804] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:01.840562  7752 raft_consensus.cc:493] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.840915  7683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d28d9895a5469db67cd40794083e95" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:01.841567  7750 raft_consensus.cc:493] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.842224  7750 raft_consensus.cc:515] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.843393  7458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d28d9895a5469db67cd40794083e95" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:01.844821  7729 tablet_bootstrap.cc:492] T 33e9e771ee0f4cb6b649f9ebc0056443 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:01.847811  7750 leader_election.cc:290] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
W20260709 13:16:01.844856  7500 leader_election.cc:343] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:01.850380  7730 tablet_bootstrap.cc:492] T ee023e046cb943559b9daae3b76c4adf P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:01.850236  7458 raft_consensus.cc:2468] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 0.
I20260709 13:16:01.852260  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b8b81bd894896b1bdf58d7b461d41" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:01.852528  7734 ts_tablet_manager.cc:1434] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:16:01.852953  7610 raft_consensus.cc:2468] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:16:01.841001  7752 raft_consensus.cc:3060] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.853184  7500 leader_election.cc:304] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: e733469bde7c479a916acbbe84b5f342
I20260709 13:16:01.856065  7770 raft_consensus.cc:2804] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:01.857034  7424 leader_election.cc:304] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:01.857486  7683 raft_consensus.cc:3060] T fb1b71c94d284d209da03c159c07316f P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.857973  7750 raft_consensus.cc:2804] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:01.858382  7750 raft_consensus.cc:493] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.858700  7750 raft_consensus.cc:3060] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.856508  7770 raft_consensus.cc:493] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.860687  7770 raft_consensus.cc:3060] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.866093  7650 leader_election.cc:304] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:01.868180  7734 tablet_bootstrap.cc:492] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:01.874677  7734 tablet_bootstrap.cc:654] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.876243  7804 raft_consensus.cc:2804] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:01.877204  7804 raft_consensus.cc:697] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:01.878193  7804 consensus_queue.cc:237] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.806368  7797 raft_consensus.cc:515] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:01.890055  7750 raft_consensus.cc:515] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.890777  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79ef75f6ba41b4a0e56ba851add378" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:01.925228  7610 raft_consensus.cc:3060] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.892371  7606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1b71c94d284d209da03c159c07316f" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:01.930362  7356 catalog_manager.cc:5697] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 0 to 1, leader changed from <none> to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.893561  7681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79ef75f6ba41b4a0e56ba851add378" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:01.933458  7734 tablet_bootstrap.cc:492] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:01.933990  7734 ts_tablet_manager.cc:1403] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.003s
I20260709 13:16:01.934779  7647 leader_election.cc:304] T fb1b71c94d284d209da03c159c07316f P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:01.894158  7609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e250baa9f7b44f2fb0002ff47f7c34db" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:01.936656  7609 raft_consensus.cc:3060] T e250baa9f7b44f2fb0002ff47f7c34db P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.937002  7839 raft_consensus.cc:2749] T fb1b71c94d284d209da03c159c07316f P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:01.937489  7610 raft_consensus.cc:2468] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:01.939957  7750 leader_election.cc:290] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:01.941619  7424 leader_election.cc:304] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:01.894439  7797 leader_election.cc:290] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:01.895910  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9e771ee0f4cb6b649f9ebc0056443" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:01.903510  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b8b81bd894896b1bdf58d7b461d41" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:01.906076  7729 tablet_bootstrap.cc:654] T 33e9e771ee0f4cb6b649f9ebc0056443 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.943405  7534 raft_consensus.cc:2468] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:16:01.943791  7797 raft_consensus.cc:2804] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:01.944290  7797 raft_consensus.cc:697] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:01.945081  7797 consensus_queue.cc:237] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
W20260709 13:16:01.947274  7425 leader_election.cc:343] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:01.953092  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b8b81bd894896b1bdf58d7b461d41" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:01.953704  7534 raft_consensus.cc:3060] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.910000  7731 tablet_bootstrap.cc:654] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.910413  7752 raft_consensus.cc:515] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:01.940747  7734 raft_consensus.cc:359] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.957546  7458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4e6876d12b4cf6ad01688451c1b033" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:01.957967  7734 raft_consensus.cc:385] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:01.912727  7730 tablet_bootstrap.cc:654] T ee023e046cb943559b9daae3b76c4adf P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.958323  7609 raft_consensus.cc:2468] T e250baa9f7b44f2fb0002ff47f7c34db P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
W20260709 13:16:01.958968  7648 leader_election.cc:343] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:01.958348  7734 raft_consensus.cc:740] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:01.960402  7734 consensus_queue.cc:260] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.961755  7795 raft_consensus.cc:493] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.962247  7795 raft_consensus.cc:515] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:01.962715  7734 ts_tablet_manager.cc:1434] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:16:01.963729  7734 tablet_bootstrap.cc:492] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:01.965726  7609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b8b81bd894896b1bdf58d7b461d41" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:01.968472  7795 leader_election.cc:290] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:01.969245  7609 raft_consensus.cc:3060] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.970167  7458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d716d1bf1004e7ca0d255d7d9c50835" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:01.971766  7752 leader_election.cc:290] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:01.972015  7535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d716d1bf1004e7ca0d255d7d9c50835" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
W20260709 13:16:01.972162  7574 leader_election.cc:343] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:01.972711  7535 raft_consensus.cc:2468] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 0.
I20260709 13:16:01.973727  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4e6876d12b4cf6ad01688451c1b033" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:01.974385  7536 raft_consensus.cc:3060] T 7b4e6876d12b4cf6ad01688451c1b033 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:01.975020  7734 tablet_bootstrap.cc:654] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:01.985302  7576 leader_election.cc:304] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:01.986270  7795 raft_consensus.cc:2804] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:01.986847  7795 raft_consensus.cc:493] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.987203  7795 raft_consensus.cc:3060] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:01.988605  7647 leader_election.cc:343] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:01.988497  7750 consensus_queue.cc:1048] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:01.989682  7647 leader_election.cc:304] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:16:01.990410  7841 raft_consensus.cc:2804] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:01.990872  7841 raft_consensus.cc:697] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:01.991933  7841 consensus_queue.cc:237] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:01.998164  7795 raft_consensus.cc:515] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:02.001194  7534 raft_consensus.cc:2468] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:01.924212  7770 raft_consensus.cc:515] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:02.002097  7458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d716d1bf1004e7ca0d255d7d9c50835" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:02.003427  7804 consensus_queue.cc:1048] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:02.023972  7427 leader_election.cc:304] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:02.025394  7683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d28d9895a5469db67cd40794083e95" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:02.025656  7797 raft_consensus.cc:2804] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:02.026682  7797 raft_consensus.cc:697] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
W20260709 13:16:02.027118  7500 leader_election.cc:343] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.027690  7797 consensus_queue.cc:237] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:02.004226  7795 leader_election.cc:290] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
W20260709 13:16:02.028935  7407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:16:02.029567  7574 leader_election.cc:343] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.008102  7535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d716d1bf1004e7ca0d255d7d9c50835" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:02.030462  7458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d28d9895a5469db67cd40794083e95" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:02.031275  7535 raft_consensus.cc:3060] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.031340  7458 raft_consensus.cc:3060] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.010438  7609 raft_consensus.cc:2468] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:02.041582  7535 raft_consensus.cc:2468] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:02.020052  7730 tablet_bootstrap.cc:492] T ee023e046cb943559b9daae3b76c4adf P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:02.042702  7730 ts_tablet_manager.cc:1403] T ee023e046cb943559b9daae3b76c4adf P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.204s	user 0.018s	sys 0.000s
I20260709 13:16:02.042784  7770 leader_election.cc:290] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:02.022100  7731 tablet_bootstrap.cc:492] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:02.044070  7731 ts_tablet_manager.cc:1403] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.267s	user 0.011s	sys 0.004s
I20260709 13:16:02.046277  7734 tablet_bootstrap.cc:492] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:02.047672  7734 ts_tablet_manager.cc:1403] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.023s
I20260709 13:16:02.048195  7458 raft_consensus.cc:2468] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:02.049747  7500 leader_election.cc:304] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: e733469bde7c479a916acbbe84b5f342
I20260709 13:16:02.050243  7752 raft_consensus.cc:493] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.050743  7752 raft_consensus.cc:515] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:02.051870  7576 leader_election.cc:304] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:02.052446  7750 consensus_queue.cc:1048] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:02.052970  7752 leader_election.cc:290] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:02.046314  7730 raft_consensus.cc:359] T ee023e046cb943559b9daae3b76c4adf P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:02.053757  7535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8887c1835b4d5b9697b6a44f0efd7e" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:02.053972  7730 raft_consensus.cc:385] T ee023e046cb943559b9daae3b76c4adf P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.054332  7730 raft_consensus.cc:740] T ee023e046cb943559b9daae3b76c4adf P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.052681  7795 raft_consensus.cc:2804] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:02.055039  7795 raft_consensus.cc:697] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:02.055164  7730 consensus_queue.cc:260] T ee023e046cb943559b9daae3b76c4adf P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:02.055977  7795 consensus_queue.cc:237] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:02.057632  7536 raft_consensus.cc:2468] T 7b4e6876d12b4cf6ad01688451c1b033 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
W20260709 13:16:02.058609  7650 leader_election.cc:343] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.058487  7734 raft_consensus.cc:359] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:02.060101  7734 raft_consensus.cc:385] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.060115  7650 leader_election.cc:304] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:02.060675  7734 raft_consensus.cc:740] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.061699  7752 raft_consensus.cc:2804] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:02.062140  7804 consensus_queue.cc:1048] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:02.062198  7752 raft_consensus.cc:697] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:02.067364  7729 tablet_bootstrap.cc:492] T 33e9e771ee0f4cb6b649f9ebc0056443 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:02.067273  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8887c1835b4d5b9697b6a44f0efd7e" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:02.067080  7752 consensus_queue.cc:237] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:02.068424  7607 raft_consensus.cc:2468] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:16:02.072429  7804 raft_consensus.cc:493] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.074404  7729 ts_tablet_manager.cc:1403] T 33e9e771ee0f4cb6b649f9ebc0056443 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.230s	user 0.014s	sys 0.006s
I20260709 13:16:02.067567  7359 catalog_manager.cc:5697] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 0 to 1, leader changed from <none> to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 1 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:02.077003  7804 raft_consensus.cc:515] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:02.080356  7804 leader_election.cc:290] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:02.073850  7731 raft_consensus.cc:359] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:02.081091  7731 raft_consensus.cc:385] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.081393  7731 raft_consensus.cc:740] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.081768  7458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee023e046cb943559b9daae3b76c4adf" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:02.085853  7458 raft_consensus.cc:2468] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:16:02.087114  7648 leader_election.cc:304] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:02.087774  7647 leader_election.cc:304] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:16:02.088521  7841 raft_consensus.cc:2804] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:02.088964  7841 raft_consensus.cc:493] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.089335  7841 raft_consensus.cc:3060] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.091630  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee023e046cb943559b9daae3b76c4adf" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:02.092664  7536 raft_consensus.cc:2468] T ee023e046cb943559b9daae3b76c4adf P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:16:02.093111  7848 raft_consensus.cc:2804] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:02.093591  7848 raft_consensus.cc:493] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.094041  7848 raft_consensus.cc:3060] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.101931  7731 consensus_queue.cc:260] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:02.104297  7731 ts_tablet_manager.cc:1434] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.001s
I20260709 13:16:02.087157  7734 consensus_queue.cc:260] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:02.109655  7729 raft_consensus.cc:359] T 33e9e771ee0f4cb6b649f9ebc0056443 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:02.050982  7770 raft_consensus.cc:2804] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:02.111196  7841 raft_consensus.cc:515] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:02.114775  7770 raft_consensus.cc:697] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:02.116408  7770 consensus_queue.cc:237] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:02.117466  7458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee023e046cb943559b9daae3b76c4adf" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:02.116906  7355 catalog_manager.cc:5697] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 0 to 1, leader changed from <none> to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:02.118155  7458 raft_consensus.cc:3060] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.118558  7848 raft_consensus.cc:515] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:02.110476  7729 raft_consensus.cc:385] T 33e9e771ee0f4cb6b649f9ebc0056443 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.145740  7729 raft_consensus.cc:740] T 33e9e771ee0f4cb6b649f9ebc0056443 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.147606  7848 leader_election.cc:290] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:02.147964  7729 consensus_queue.cc:260] T 33e9e771ee0f4cb6b649f9ebc0056443 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:02.148064  7532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8887c1835b4d5b9697b6a44f0efd7e" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:02.148684  7355 catalog_manager.cc:5697] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a0eef4c5880424694542637530b55c0 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "4a0eef4c5880424694542637530b55c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:02.150362  7650 leader_election.cc:343] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.151069  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8887c1835b4d5b9697b6a44f0efd7e" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:02.151760  7607 raft_consensus.cc:3060] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.124852  7731 tablet_bootstrap.cc:492] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:02.126616  7458 raft_consensus.cc:2468] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:02.129964  7841 leader_election.cc:290] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:02.130156  7535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee023e046cb943559b9daae3b76c4adf" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:02.162024  7535 raft_consensus.cc:3060] T ee023e046cb943559b9daae3b76c4adf P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.162276  7607 raft_consensus.cc:2468] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:02.163437  7647 leader_election.cc:304] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:16:02.164592  7752 raft_consensus.cc:2804] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:02.165093  7752 raft_consensus.cc:697] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:02.165504  7648 leader_election.cc:304] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:02.165984  7752 consensus_queue.cc:237] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:02.166523  7804 raft_consensus.cc:2804] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:02.130582  7734 ts_tablet_manager.cc:1434] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.083s	user 0.003s	sys 0.005s
I20260709 13:16:02.168018  7734 tablet_bootstrap.cc:492] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:02.168393  7358 catalog_manager.cc:5697] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 0 to 1, leader changed from <none> to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 1 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:02.132910  7730 ts_tablet_manager.cc:1434] T ee023e046cb943559b9daae3b76c4adf P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.090s	user 0.012s	sys 0.002s
I20260709 13:16:02.171547  7730 tablet_bootstrap.cc:492] T 3e8887c1835b4d5b9697b6a44f0efd7e P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:02.171030  7358 catalog_manager.cc:5697] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 0 to 1, leader changed from <none> to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 1 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:02.167030  7804 raft_consensus.cc:697] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:02.175915  7804 consensus_queue.cc:237] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:02.181226  7359 catalog_manager.cc:5697] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:02.150388  7729 ts_tablet_manager.cc:1434] T 33e9e771ee0f4cb6b649f9ebc0056443 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.001s
I20260709 13:16:02.197211  7729 tablet_bootstrap.cc:492] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:02.208297  7734 tablet_bootstrap.cc:654] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.213852  7797 consensus_queue.cc:1048] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:02.216339  7355 catalog_manager.cc:5697] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 0 to 1, leader changed from <none> to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:02.217566  7535 raft_consensus.cc:2468] T ee023e046cb943559b9daae3b76c4adf P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:02.221637  7731 tablet_bootstrap.cc:654] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.223414  7730 tablet_bootstrap.cc:654] T 3e8887c1835b4d5b9697b6a44f0efd7e P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.230297  7729 tablet_bootstrap.cc:654] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.235191  7913 consensus_queue.cc:1048] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:02.236537  7731 tablet_bootstrap.cc:492] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:02.237072  7731 ts_tablet_manager.cc:1403] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.132s	user 0.008s	sys 0.004s
I20260709 13:16:02.238875  7848 raft_consensus.cc:493] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.239514  7848 raft_consensus.cc:515] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:02.240586  7730 tablet_bootstrap.cc:492] T 3e8887c1835b4d5b9697b6a44f0efd7e P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:02.241164  7730 ts_tablet_manager.cc:1403] T 3e8887c1835b4d5b9697b6a44f0efd7e P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.000s
I20260709 13:16:02.243788  7731 raft_consensus.cc:359] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:02.244586  7731 raft_consensus.cc:385] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.244845  7731 raft_consensus.cc:740] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.245721  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343cf82796c24137960d60c292b5dd42" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:02.246234  7731 consensus_queue.cc:260] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
W20260709 13:16:02.251503  7647 leader_election.cc:343] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.253887  7731 ts_tablet_manager.cc:1434] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:16:02.254925  7731 tablet_bootstrap.cc:492] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:02.263959  7734 tablet_bootstrap.cc:492] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:02.264780  7734 ts_tablet_manager.cc:1403] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.097s	user 0.017s	sys 0.005s
I20260709 13:16:02.270838  7458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343cf82796c24137960d60c292b5dd42" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:02.271716  7458 raft_consensus.cc:2468] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:16:02.269140  7848 leader_election.cc:290] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:02.276095  7648 leader_election.cc:304] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06
I20260709 13:16:02.275864  7730 raft_consensus.cc:359] T 3e8887c1835b4d5b9697b6a44f0efd7e P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:02.276515  7359 catalog_manager.cc:5697] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 0 to 1, leader changed from <none> to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 1 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:02.277530  7730 raft_consensus.cc:385] T 3e8887c1835b4d5b9697b6a44f0efd7e P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.277932  7730 raft_consensus.cc:740] T 3e8887c1835b4d5b9697b6a44f0efd7e P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.278575  7848 raft_consensus.cc:2804] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:02.279094  7848 raft_consensus.cc:493] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.281356  7848 raft_consensus.cc:3060] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.281733  7731 tablet_bootstrap.cc:654] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.282364  7730 consensus_queue.cc:260] T 3e8887c1835b4d5b9697b6a44f0efd7e P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:02.290062  7729 tablet_bootstrap.cc:492] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:02.290753  7729 ts_tablet_manager.cc:1403] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.094s	user 0.015s	sys 0.021s
I20260709 13:16:02.292982  7730 ts_tablet_manager.cc:1434] T 3e8887c1835b4d5b9697b6a44f0efd7e P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.001s
I20260709 13:16:02.294066  7730 tablet_bootstrap.cc:492] T e250baa9f7b44f2fb0002ff47f7c34db P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:02.295855  7729 raft_consensus.cc:359] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:02.296555  7729 raft_consensus.cc:385] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.296824  7729 raft_consensus.cc:740] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.281272  7734 raft_consensus.cc:359] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:02.279871  7359 catalog_manager.cc:5697] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 0 to 1, leader changed from <none> to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 1 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:02.297559  7734 raft_consensus.cc:385] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.297510  7729 consensus_queue.cc:260] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:02.298139  7734 raft_consensus.cc:740] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.299317  7734 consensus_queue.cc:260] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:02.299912  7729 ts_tablet_manager.cc:1434] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:16:02.301010  7729 tablet_bootstrap.cc:492] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:02.301731  7795 raft_consensus.cc:493] T 33e9e771ee0f4cb6b649f9ebc0056443 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.302232  7795 raft_consensus.cc:515] T 33e9e771ee0f4cb6b649f9ebc0056443 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:02.305902  7532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9e771ee0f4cb6b649f9ebc0056443" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:02.306886  7532 raft_consensus.cc:2393] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 382e1f4385ac4066b7098e4fd1f5df06 in current term 1: Already voted for candidate e733469bde7c479a916acbbe84b5f342 in this term.
I20260709 13:16:02.308846  7848 raft_consensus.cc:515] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:02.310817  7683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9e771ee0f4cb6b649f9ebc0056443" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:02.313050  7734 ts_tablet_manager.cc:1434] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:16:02.314337  7734 tablet_bootstrap.cc:492] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:02.317157  7848 leader_election.cc:290] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:02.315811  7795 leader_election.cc:290] T 33e9e771ee0f4cb6b649f9ebc0056443 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:02.318663  7574 leader_election.cc:304] T 33e9e771ee0f4cb6b649f9ebc0056443 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:02.315995  7729 tablet_bootstrap.cc:654] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.312237  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343cf82796c24137960d60c292b5dd42" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:02.320343  7458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343cf82796c24137960d60c292b5dd42" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:02.325520  7458 raft_consensus.cc:3060] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:02.326232  7647 leader_election.cc:343] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.333056  7734 tablet_bootstrap.cc:654] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.338438  7730 tablet_bootstrap.cc:654] T e250baa9f7b44f2fb0002ff47f7c34db P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.345774  7607 raft_consensus.cc:3060] T 33e9e771ee0f4cb6b649f9ebc0056443 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.349781  7458 raft_consensus.cc:2468] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:02.351789  7648 leader_election.cc:304] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06
I20260709 13:16:02.353552  7848 raft_consensus.cc:2804] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:02.354216  7848 raft_consensus.cc:697] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:02.355396  7848 consensus_queue.cc:237] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:02.363507  7804 consensus_queue.cc:1048] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:02.364622  7841 raft_consensus.cc:493] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.365307  7841 raft_consensus.cc:515] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:02.369944  7841 leader_election.cc:290] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:02.374138  7459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79ef75f6ba41b4a0e56ba851add378" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:02.374676  7797 raft_consensus.cc:493] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.374836  7731 tablet_bootstrap.cc:492] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:02.375268  7797 raft_consensus.cc:515] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:02.376750  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79ef75f6ba41b4a0e56ba851add378" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:02.377538  7607 raft_consensus.cc:2393] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e733469bde7c479a916acbbe84b5f342 in current term 1: Already voted for candidate d54f6e4b9e604cd78c48a1828cd3b23a in this term.
I20260709 13:16:02.378314  7535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5266494b97e8402b9696d8771ca7e9f0" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
W20260709 13:16:02.380019  7427 leader_election.cc:343] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.384419  7647 leader_election.cc:304] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:02.386246  7841 raft_consensus.cc:3060] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.389351  7730 tablet_bootstrap.cc:492] T e250baa9f7b44f2fb0002ff47f7c34db P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:02.389492  7731 ts_tablet_manager.cc:1403] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.135s	user 0.024s	sys 0.011s
I20260709 13:16:02.389933  7730 ts_tablet_manager.cc:1403] T e250baa9f7b44f2fb0002ff47f7c34db P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.096s	user 0.011s	sys 0.006s
I20260709 13:16:02.394995  7797 leader_election.cc:290] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:02.404178  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5266494b97e8402b9696d8771ca7e9f0" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:02.396348  7729 tablet_bootstrap.cc:492] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:02.406577  7729 ts_tablet_manager.cc:1403] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.106s	user 0.008s	sys 0.013s
W20260709 13:16:02.410369  7424 leader_election.cc:343] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.411854  7424 leader_election.cc:304] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0
I20260709 13:16:02.418505  7797 raft_consensus.cc:2749] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:02.397818  7730 raft_consensus.cc:359] T e250baa9f7b44f2fb0002ff47f7c34db P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:02.420266  7797 consensus_queue.cc:1048] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:02.412189  7729 raft_consensus.cc:359] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:02.421686  7729 raft_consensus.cc:385] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.394088  7734 tablet_bootstrap.cc:492] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:02.422008  7729 raft_consensus.cc:740] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.422791  7734 ts_tablet_manager.cc:1403] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.109s	user 0.015s	sys 0.002s
I20260709 13:16:02.422919  7729 consensus_queue.cc:260] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:02.425192  7729 ts_tablet_manager.cc:1434] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:16:02.425977  7731 raft_consensus.cc:359] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:02.413492  7841 raft_consensus.cc:2749] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:02.426762  7731 raft_consensus.cc:385] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.430321  7731 raft_consensus.cc:740] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.426777  7734 raft_consensus.cc:359] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:02.420303  7730 raft_consensus.cc:385] T e250baa9f7b44f2fb0002ff47f7c34db P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.431118  7734 raft_consensus.cc:385] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.431450  7730 raft_consensus.cc:740] T e250baa9f7b44f2fb0002ff47f7c34db P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.431767  7734 raft_consensus.cc:740] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.432790  7770 raft_consensus.cc:493] T 3e8887c1835b4d5b9697b6a44f0efd7e P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.432860  7734 consensus_queue.cc:260] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:02.433633  7770 raft_consensus.cc:515] T 3e8887c1835b4d5b9697b6a44f0efd7e P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:02.433039  7355 catalog_manager.cc:5697] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 0 to 1, leader changed from <none> to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 1 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:02.435948  7734 ts_tablet_manager.cc:1434] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:16:02.439066  7770 leader_election.cc:290] T 3e8887c1835b4d5b9697b6a44f0efd7e P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:02.444077  7730 consensus_queue.cc:260] T e250baa9f7b44f2fb0002ff47f7c34db P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:02.431059  7731 consensus_queue.cc:260] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:02.445376  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8887c1835b4d5b9697b6a44f0efd7e" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:02.445881  7683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8887c1835b4d5b9697b6a44f0efd7e" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:02.446198  7610 raft_consensus.cc:2393] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a0eef4c5880424694542637530b55c0 in current term 1: Already voted for candidate e733469bde7c479a916acbbe84b5f342 in this term.
I20260709 13:16:02.447793  7500 leader_election.cc:304] T 3e8887c1835b4d5b9697b6a44f0efd7e P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:02.448252  7848 raft_consensus.cc:493] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.448848  7848 raft_consensus.cc:515] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:02.449261  7770 raft_consensus.cc:3060] T 3e8887c1835b4d5b9697b6a44f0efd7e P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.451306  7848 leader_election.cc:290] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:02.453200  7535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d28d9895a5469db67cd40794083e95" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:02.454115  7458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d28d9895a5469db67cd40794083e95" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:02.454984  7458 raft_consensus.cc:2393] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e733469bde7c479a916acbbe84b5f342 in current term 1: Already voted for candidate 4a0eef4c5880424694542637530b55c0 in this term.
I20260709 13:16:02.455042  7730 ts_tablet_manager.cc:1434] T e250baa9f7b44f2fb0002ff47f7c34db P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.002s
I20260709 13:16:02.456159  7730 tablet_bootstrap.cc:492] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:02.456768  7648 leader_election.cc:304] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:02.461344  7942 raft_consensus.cc:2749] T 33e9e771ee0f4cb6b649f9ebc0056443 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:02.463651  7848 raft_consensus.cc:3060] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.458030  7734 tablet_bootstrap.cc:492] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:02.471349  7535 raft_consensus.cc:3060] T e250baa9f7b44f2fb0002ff47f7c34db P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.473299  7848 raft_consensus.cc:2749] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:02.480882  7730 tablet_bootstrap.cc:654] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.481441  7841 consensus_queue.cc:1048] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:02.460774  7770 raft_consensus.cc:2749] T 3e8887c1835b4d5b9697b6a44f0efd7e P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:02.429811  7729 tablet_bootstrap.cc:492] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:02.447300  7731 ts_tablet_manager.cc:1434] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:16:02.485193  7731 tablet_bootstrap.cc:492] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:02.526693  7841 consensus_queue.cc:1048] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:02.536379  7731 tablet_bootstrap.cc:654] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.562764  7942 raft_consensus.cc:493] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.563680  7942 raft_consensus.cc:515] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:02.644201  7870 raft_consensus.cc:493] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.644946  7870 raft_consensus.cc:515] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:02.645473  7848 consensus_queue.cc:1048] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:02.647176  7870 leader_election.cc:290] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:02.648429  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e1f08d649449a6a1a39b78f0b7adff" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:02.651556  7942 leader_election.cc:290] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:02.657008  7458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b1bccbb9eb4fc7987174b429fce6d4" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
W20260709 13:16:02.657779  7574 leader_election.cc:343] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.652154  7770 consensus_queue.cc:1048] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260709 13:16:02.668365  7574 leader_election.cc:343] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.669652  7839 consensus_queue.cc:1048] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:16:02.671627  7574 consensus_peers.cc:597] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:02.681847  7734 tablet_bootstrap.cc:654] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.710137  7729 tablet_bootstrap.cc:654] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.722600  7535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b1bccbb9eb4fc7987174b429fce6d4" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:02.704877  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e1f08d649449a6a1a39b78f0b7adff" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
W20260709 13:16:02.717625  7650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:45835, user_credentials={real_user=slave}} blocked reactor thread for 50170.2us
I20260709 13:16:02.761252  7730 tablet_bootstrap.cc:492] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:02.761987  7730 ts_tablet_manager.cc:1403] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.306s	user 0.014s	sys 0.000s
I20260709 13:16:02.765475  7730 raft_consensus.cc:359] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:02.766156  7730 raft_consensus.cc:385] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.766428  7730 raft_consensus.cc:740] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.767225  7730 consensus_queue.cc:260] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
W20260709 13:16:02.778959  7576 leader_election.cc:343] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.779482  7576 leader_election.cc:304] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:02.779659  7942 consensus_queue.cc:1048] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:02.780678  7576 leader_election.cc:343] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:02.780369  7870 raft_consensus.cc:2749] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:02.781147  7576 leader_election.cc:304] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:02.782253  7870 raft_consensus.cc:2749] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:02.798113  7731 tablet_bootstrap.cc:492] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:02.807363  7959 consensus_queue.cc:1048] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:02.810936  7848 consensus_queue.cc:1048] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:02.803050  7458 raft_consensus.cc:3060] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:02.816980  7731 ts_tablet_manager.cc:1403] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.332s	user 0.015s	sys 0.027s
I20260709 13:16:02.828459  7794 consensus_queue.cc:1048] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:02.830404  7734 tablet_bootstrap.cc:492] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:02.831077  7734 ts_tablet_manager.cc:1403] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.394s	user 0.029s	sys 0.039s
I20260709 13:16:02.835670  7794 consensus_queue.cc:1048] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:02.838284  7734 raft_consensus.cc:359] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:02.839152  7734 raft_consensus.cc:385] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.839959  7734 raft_consensus.cc:740] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.840817  7734 consensus_queue.cc:260] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:02.842902  7734 ts_tablet_manager.cc:1434] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:16:02.843758  7734 tablet_bootstrap.cc:492] T c9b5ae77739f4adca66b64acf11c42ce P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:02.854390  7730 ts_tablet_manager.cc:1434] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.092s	user 0.019s	sys 0.023s
I20260709 13:16:02.862239  7730 tablet_bootstrap.cc:492] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
W20260709 13:16:02.845309  7500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:35931, user_credentials={real_user=slave}} blocked reactor thread for 61755.3us
I20260709 13:16:02.871210  7730 tablet_bootstrap.cc:654] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.873806  7839 consensus_queue.cc:1048] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:16:02.891623  7848 consensus_queue.cc:1048] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:16:02.913643  7731 raft_consensus.cc:359] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:02.914374  7731 raft_consensus.cc:385] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.914633  7731 raft_consensus.cc:740] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.915694  7731 consensus_queue.cc:260] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:02.917886  7731 ts_tablet_manager.cc:1434] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.001s
I20260709 13:16:02.918597  7729 tablet_bootstrap.cc:492] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:02.919142  7729 ts_tablet_manager.cc:1403] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.490s	user 0.026s	sys 0.023s
I20260709 13:16:02.919267  7731 tablet_bootstrap.cc:492] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:02.931106  7734 tablet_bootstrap.cc:654] T c9b5ae77739f4adca66b64acf11c42ce P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:02.925794  7797 raft_consensus.cc:493] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.941900  7797 raft_consensus.cc:515] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:02.980798  7730 tablet_bootstrap.cc:492] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:02.981715  7730 ts_tablet_manager.cc:1403] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.123s	user 0.013s	sys 0.022s
I20260709 13:16:02.985579  7730 raft_consensus.cc:359] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:02.986722  7730 raft_consensus.cc:385] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:02.987478  7730 raft_consensus.cc:740] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:02.988586  7730 consensus_queue.cc:260] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:02.991691  7730 ts_tablet_manager.cc:1434] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:16:02.998605  7730 tablet_bootstrap.cc:492] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:03.001781  7797 leader_election.cc:290] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:03.009260  7730 tablet_bootstrap.cc:654] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.012466  7839 consensus_queue.cc:1048] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:03.055661  7794 raft_consensus.cc:493] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.056491  7794 raft_consensus.cc:515] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:02.972580  7913 consensus_queue.cc:1048] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.074s
I20260709 13:16:03.024446  7848 raft_consensus.cc:493] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:03.081859  7425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:35931, user_credentials={real_user=slave}} blocked reactor thread for 115093us
I20260709 13:16:03.112351  7729 raft_consensus.cc:359] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:03.115190  7729 raft_consensus.cc:385] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.115654  7729 raft_consensus.cc:740] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.118506  7729 consensus_queue.cc:260] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:03.122673  7533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4e6876d12b4cf6ad01688451c1b033" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:03.122821  7839 consensus_queue.cc:1048] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:03.134011  7794 leader_election.cc:290] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:03.085188  7848 raft_consensus.cc:515] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:03.157553  7730 tablet_bootstrap.cc:492] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:03.158143  7730 ts_tablet_manager.cc:1403] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.160s	user 0.012s	sys 0.011s
I20260709 13:16:03.159678  7731 tablet_bootstrap.cc:654] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.160022  7729 ts_tablet_manager.cc:1434] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.240s	user 0.008s	sys 0.000s
I20260709 13:16:03.161258  7729 tablet_bootstrap.cc:492] T e8380470ec0d46c1914152ad9818bab7 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:03.171061  7734 tablet_bootstrap.cc:492] T c9b5ae77739f4adca66b64acf11c42ce P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:03.171708  7734 ts_tablet_manager.cc:1403] T c9b5ae77739f4adca66b64acf11c42ce P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.328s	user 0.022s	sys 0.014s
W20260709 13:16:03.164750  7647 consensus_peers.cc:597] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 -> Peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Couldn't send request to peer 382e1f4385ac4066b7098e4fd1f5df06. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:03.178222  7970 raft_consensus.cc:493] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.178779  7970 raft_consensus.cc:515] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:03.187559  7734 raft_consensus.cc:359] T c9b5ae77739f4adca66b64acf11c42ce P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:03.188563  7734 raft_consensus.cc:385] T c9b5ae77739f4adca66b64acf11c42ce P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.188838  7734 raft_consensus.cc:740] T c9b5ae77739f4adca66b64acf11c42ce P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.189435  7734 consensus_queue.cc:260] T c9b5ae77739f4adca66b64acf11c42ce P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:03.194576  7734 ts_tablet_manager.cc:1434] T c9b5ae77739f4adca66b64acf11c42ce P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:16:03.195611  7734 tablet_bootstrap.cc:492] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:03.208014  7965 raft_consensus.cc:493] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.208781  7965 raft_consensus.cc:515] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:03.210137  7734 tablet_bootstrap.cc:654] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.211855  7965 leader_election.cc:290] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:03.214211  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9b5ae77739f4adca66b64acf11c42ce" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:03.214816  7460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9b5ae77739f4adca66b64acf11c42ce" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:03.214888  7682 raft_consensus.cc:2468] T c9b5ae77739f4adca66b64acf11c42ce P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 0.
I20260709 13:16:03.217877  7730 raft_consensus.cc:359] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:03.218881  7730 raft_consensus.cc:385] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.219282  7730 raft_consensus.cc:740] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.217334  7500 leader_election.cc:304] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:03.227458  7962 consensus_queue.cc:1048] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:16:03.229198  7500 leader_election.cc:343] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:03.230906  7529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d716d1bf1004e7ca0d255d7d9c50835" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:03.232897  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4e6876d12b4cf6ad01688451c1b033" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:03.238029  7970 leader_election.cc:290] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:03.187768  7848 leader_election.cc:290] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:03.222779  7730 consensus_queue.cc:260] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:03.244455  7730 ts_tablet_manager.cc:1434] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.086s	user 0.010s	sys 0.000s
I20260709 13:16:03.251879  7729 tablet_bootstrap.cc:654] T e8380470ec0d46c1914152ad9818bab7 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.238723  7970 raft_consensus.cc:2804] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:03.268695  7970 raft_consensus.cc:493] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.269124  7970 raft_consensus.cc:3060] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:03.284726  7425 leader_election.cc:304] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:03.287176  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81703e5e726a4905a8cff753fe076535" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
W20260709 13:16:03.290159  7648 leader_election.cc:343] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:03.294097  7461 raft_consensus.cc:3060] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:03.294788  7980 log.cc:927] Time spent T 3e8887c1835b4d5b9697b6a44f0efd7e P 4a0eef4c5880424694542637530b55c0: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:16:03.303866  7606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d716d1bf1004e7ca0d255d7d9c50835" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:03.332746  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e1f08d649449a6a1a39b78f0b7adff" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:03.337148  7603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e1f08d649449a6a1a39b78f0b7adff" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:03.338148  7603 raft_consensus.cc:2468] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 0.
W20260709 13:16:03.346406  7500 leader_election.cc:343] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:03.310640  7970 raft_consensus.cc:515] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:03.324295  7604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81703e5e726a4905a8cff753fe076535" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:03.360585  7970 leader_election.cc:290] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
W20260709 13:16:03.361013  7647 leader_election.cc:343] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:03.361140  7499 leader_election.cc:304] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: e733469bde7c479a916acbbe84b5f342
I20260709 13:16:03.361809  7647 leader_election.cc:304] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:03.363314  7848 raft_consensus.cc:2749] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:03.364109  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9b5ae77739f4adca66b64acf11c42ce" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:03.364813  7682 raft_consensus.cc:3060] T c9b5ae77739f4adca66b64acf11c42ce P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:03.367743  7963 raft_consensus.cc:2804] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:03.368235  7963 raft_consensus.cc:493] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.368561  7963 raft_consensus.cc:3060] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:03.368613  7942 raft_consensus.cc:493] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.369194  7942 raft_consensus.cc:515] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:03.378865  7459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9b5ae77739f4adca66b64acf11c42ce" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:03.386613  7459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54c4242890a943ec865bafae33141d3b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
W20260709 13:16:03.388393  7574 leader_election.cc:343] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:03.379185  7963 raft_consensus.cc:515] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:03.389441  7942 leader_election.cc:290] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:03.392971  7604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e1f08d649449a6a1a39b78f0b7adff" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:03.393739  7604 raft_consensus.cc:3060] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:03.400974  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54c4242890a943ec865bafae33141d3b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
W20260709 13:16:03.402750  7576 leader_election.cc:343] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:03.403227  7576 leader_election.cc:304] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:03.404425  7942 raft_consensus.cc:2749] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:03.407321  7604 raft_consensus.cc:2468] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:03.409070  7499 leader_election.cc:304] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: 
I20260709 13:16:03.410331  7970 raft_consensus.cc:2804] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:03.410928  7970 raft_consensus.cc:697] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:03.385946  7682 raft_consensus.cc:2468] T c9b5ae77739f4adca66b64acf11c42ce P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:03.412047  7970 consensus_queue.cc:237] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:03.414206  7963 leader_election.cc:290] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:03.417716  7500 leader_election.cc:304] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:03.418298  7683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e1f08d649449a6a1a39b78f0b7adff" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:03.419106  7968 raft_consensus.cc:2804] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:03.419762  7968 raft_consensus.cc:697] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:03.420787  7968 consensus_queue.cc:237] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
W20260709 13:16:03.423656  7500 leader_election.cc:343] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:03.430488  7407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:03.438205  7959 raft_consensus.cc:493] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.438782  7959 raft_consensus.cc:515] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:03.441422  7959 leader_election.cc:290] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:03.443408  7605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98892caf6b1549c8a1906b47c1298334" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
W20260709 13:16:03.445108  7499 leader_election.cc:343] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:03.424981  7500 leader_election.cc:343] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:03.467257  7459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98892caf6b1549c8a1906b47c1298334" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:03.475462  7730 tablet_bootstrap.cc:492] T 5266494b97e8402b9696d8771ca7e9f0 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
W20260709 13:16:03.485996  7500 leader_election.cc:343] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:03.486711  7500 leader_election.cc:304] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:03.488078  7959 raft_consensus.cc:2749] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:03.494544  7734 tablet_bootstrap.cc:492] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:03.496001  7734 ts_tablet_manager.cc:1403] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.301s	user 0.018s	sys 0.065s
I20260709 13:16:03.498374  7794 raft_consensus.cc:2749] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:03.499012  7734 raft_consensus.cc:359] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:03.499917  7734 raft_consensus.cc:385] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.500228  7734 raft_consensus.cc:740] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.501001  7734 consensus_queue.cc:260] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:03.504633  7734 ts_tablet_manager.cc:1434] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:03.505646  7734 tablet_bootstrap.cc:492] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:03.509665  7427 leader_election.cc:304] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0
I20260709 13:16:03.511716  7734 tablet_bootstrap.cc:654] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.522914  7734 tablet_bootstrap.cc:492] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:03.523414  7734 ts_tablet_manager.cc:1403] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.007s
I20260709 13:16:03.532488  7734 raft_consensus.cc:359] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:03.533350  7734 raft_consensus.cc:385] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.533684  7734 raft_consensus.cc:740] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.534667  7734 consensus_queue.cc:260] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:03.538640  7734 ts_tablet_manager.cc:1434] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:16:03.540180  7734 tablet_bootstrap.cc:492] T e0e1f08d649449a6a1a39b78f0b7adff P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:03.561894  7731 tablet_bootstrap.cc:492] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:03.562963  7731 ts_tablet_manager.cc:1403] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.644s	user 0.022s	sys 0.034s
I20260709 13:16:03.575704  7731 raft_consensus.cc:359] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:03.576732  7731 raft_consensus.cc:385] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.577075  7731 raft_consensus.cc:740] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.577687  7734 tablet_bootstrap.cc:654] T e0e1f08d649449a6a1a39b78f0b7adff P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.578095  7731 consensus_queue.cc:260] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:03.581717  7729 tablet_bootstrap.cc:492] T e8380470ec0d46c1914152ad9818bab7 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:03.582204  7729 ts_tablet_manager.cc:1403] T e8380470ec0d46c1914152ad9818bab7 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.421s	user 0.011s	sys 0.002s
I20260709 13:16:03.593683  7730 tablet_bootstrap.cc:700] T 5266494b97e8402b9696d8771ca7e9f0 P 4a0eef4c5880424694542637530b55c0: Time spent opening tablet: real 0.111s	user 0.004s	sys 0.000s
I20260709 13:16:03.594031  7729 raft_consensus.cc:359] T e8380470ec0d46c1914152ad9818bab7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:03.595062  7729 raft_consensus.cc:385] T e8380470ec0d46c1914152ad9818bab7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.595475  7729 raft_consensus.cc:740] T e8380470ec0d46c1914152ad9818bab7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.594901  7730 tablet_bootstrap.cc:654] T 5266494b97e8402b9696d8771ca7e9f0 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.596377  7729 consensus_queue.cc:260] T e8380470ec0d46c1914152ad9818bab7 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:03.602607  7729 ts_tablet_manager.cc:1434] T e8380470ec0d46c1914152ad9818bab7 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 13:16:03.604045  7729 tablet_bootstrap.cc:492] T 343cf82796c24137960d60c292b5dd42 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:03.610797  7731 ts_tablet_manager.cc:1434] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
W20260709 13:16:03.624068  7992 log.cc:927] Time spent T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a: Append to log took a long time: real 0.078s	user 0.004s	sys 0.000s
I20260709 13:16:03.625221  7729 tablet_bootstrap.cc:654] T 343cf82796c24137960d60c292b5dd42 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.628785  7731 tablet_bootstrap.cc:492] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:03.653719  7734 tablet_bootstrap.cc:492] T e0e1f08d649449a6a1a39b78f0b7adff P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:03.654779  7734 ts_tablet_manager.cc:1403] T e0e1f08d649449a6a1a39b78f0b7adff P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.115s	user 0.007s	sys 0.019s
I20260709 13:16:03.664872  7731 tablet_bootstrap.cc:654] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.679004  7730 tablet_bootstrap.cc:492] T 5266494b97e8402b9696d8771ca7e9f0 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:03.679525  7730 ts_tablet_manager.cc:1403] T 5266494b97e8402b9696d8771ca7e9f0 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.204s	user 0.021s	sys 0.021s
I20260709 13:16:03.680220  7734 raft_consensus.cc:359] T e0e1f08d649449a6a1a39b78f0b7adff P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:03.681011  7734 raft_consensus.cc:385] T e0e1f08d649449a6a1a39b78f0b7adff P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.681305  7734 raft_consensus.cc:740] T e0e1f08d649449a6a1a39b78f0b7adff P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.682015  7734 consensus_queue.cc:260] T e0e1f08d649449a6a1a39b78f0b7adff P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:03.682031  7730 raft_consensus.cc:359] T 5266494b97e8402b9696d8771ca7e9f0 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:03.684128  7730 raft_consensus.cc:385] T 5266494b97e8402b9696d8771ca7e9f0 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.684415  7730 raft_consensus.cc:740] T 5266494b97e8402b9696d8771ca7e9f0 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.685146  7734 ts_tablet_manager.cc:1434] T e0e1f08d649449a6a1a39b78f0b7adff P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:16:03.686384  7734 tablet_bootstrap.cc:492] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:03.690817  7730 consensus_queue.cc:260] T 5266494b97e8402b9696d8771ca7e9f0 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:03.693984  7734 tablet_bootstrap.cc:654] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.696084  7729 tablet_bootstrap.cc:492] T 343cf82796c24137960d60c292b5dd42 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:03.696584  7729 ts_tablet_manager.cc:1403] T 343cf82796c24137960d60c292b5dd42 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.093s	user 0.024s	sys 0.022s
I20260709 13:16:03.694211  7730 ts_tablet_manager.cc:1434] T 5266494b97e8402b9696d8771ca7e9f0 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:16:03.699594  7730 tablet_bootstrap.cc:492] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:03.701776  7964 raft_consensus.cc:2749] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:03.702172  7729 raft_consensus.cc:359] T 343cf82796c24137960d60c292b5dd42 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:03.702872  7729 raft_consensus.cc:385] T 343cf82796c24137960d60c292b5dd42 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.703119  7729 raft_consensus.cc:740] T 343cf82796c24137960d60c292b5dd42 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.703874  7729 consensus_queue.cc:260] T 343cf82796c24137960d60c292b5dd42 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:03.705907  7729 ts_tablet_manager.cc:1434] T 343cf82796c24137960d60c292b5dd42 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:16:03.706624  7729 tablet_bootstrap.cc:492] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:03.721400  7730 tablet_bootstrap.cc:654] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.726210  7731 tablet_bootstrap.cc:492] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:03.727550  7731 ts_tablet_manager.cc:1403] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.005s
I20260709 13:16:03.729614  7729 tablet_bootstrap.cc:654] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.730454  7731 raft_consensus.cc:359] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:03.731318  7731 raft_consensus.cc:385] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.731628  7731 raft_consensus.cc:740] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.732484  7731 consensus_queue.cc:260] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:03.730398  7839 raft_consensus.cc:493] T e0e1f08d649449a6a1a39b78f0b7adff P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.733997  7839 raft_consensus.cc:515] T e0e1f08d649449a6a1a39b78f0b7adff P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:03.734373  7731 ts_tablet_manager.cc:1434] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:16:03.735451  7731 tablet_bootstrap.cc:492] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:03.736761  7734 tablet_bootstrap.cc:492] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:03.737224  7795 raft_consensus.cc:493] T 343cf82796c24137960d60c292b5dd42 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.737763  7839 leader_election.cc:290] T e0e1f08d649449a6a1a39b78f0b7adff P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:03.737757  7795 raft_consensus.cc:515] T 343cf82796c24137960d60c292b5dd42 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:03.738161  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e1f08d649449a6a1a39b78f0b7adff" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:03.739486  7608 raft_consensus.cc:2393] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e733469bde7c479a916acbbe84b5f342 in current term 1: Already voted for candidate 4a0eef4c5880424694542637530b55c0 in this term.
I20260709 13:16:03.740041  7795 leader_election.cc:290] T 343cf82796c24137960d60c292b5dd42 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:03.740875  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e1f08d649449a6a1a39b78f0b7adff" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:03.742381  7460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343cf82796c24137960d60c292b5dd42" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:03.742754  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343cf82796c24137960d60c292b5dd42" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:03.743144  7358 catalog_manager.cc:5697] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a0eef4c5880424694542637530b55c0 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "4a0eef4c5880424694542637530b55c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:03.745334  7650 leader_election.cc:304] T e0e1f08d649449a6a1a39b78f0b7adff P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0
I20260709 13:16:03.746533  7574 leader_election.cc:304] T 343cf82796c24137960d60c292b5dd42 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:03.737453  7734 ts_tablet_manager.cc:1403] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.010s
I20260709 13:16:03.749624  7848 raft_consensus.cc:3060] T e0e1f08d649449a6a1a39b78f0b7adff P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:03.753038  7734 raft_consensus.cc:359] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:03.754027  7734 raft_consensus.cc:385] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.754361  7734 raft_consensus.cc:740] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.754523  7795 raft_consensus.cc:2749] T 343cf82796c24137960d60c292b5dd42 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:03.755465  7734 consensus_queue.cc:260] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:03.757711  7734 ts_tablet_manager.cc:1434] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:16:03.758950  7734 tablet_bootstrap.cc:492] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:03.761005  7731 tablet_bootstrap.cc:654] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.763587  7848 raft_consensus.cc:2749] T e0e1f08d649449a6a1a39b78f0b7adff P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:03.764871  7729 tablet_bootstrap.cc:492] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:03.765511  7729 ts_tablet_manager.cc:1403] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.004s
I20260709 13:16:03.769829  7729 raft_consensus.cc:359] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:03.770741  7729 raft_consensus.cc:385] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.771080  7729 raft_consensus.cc:740] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.777464  7734 tablet_bootstrap.cc:654] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.772315  7729 consensus_queue.cc:260] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:03.782830  7729 ts_tablet_manager.cc:1434] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:16:03.784405  7729 tablet_bootstrap.cc:492] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:03.745563  7358 catalog_manager.cc:5697] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a0eef4c5880424694542637530b55c0 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "4a0eef4c5880424694542637530b55c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:03.792156  7729 tablet_bootstrap.cc:654] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.809211  7730 tablet_bootstrap.cc:492] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:03.809890  7730 ts_tablet_manager.cc:1403] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.110s	user 0.037s	sys 0.043s
I20260709 13:16:03.812016  7731 tablet_bootstrap.cc:492] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:03.812721  7731 ts_tablet_manager.cc:1403] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.077s	user 0.024s	sys 0.009s
I20260709 13:16:03.813284  7730 raft_consensus.cc:359] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:03.814782  7730 raft_consensus.cc:385] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.815129  7730 raft_consensus.cc:740] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.815975  7730 consensus_queue.cc:260] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:03.818977  7730 ts_tablet_manager.cc:1434] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:16:03.820138  7730 tablet_bootstrap.cc:492] T b215f304c98341bebbc937add44da99d P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:03.820655  7731 raft_consensus.cc:359] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:03.821298  7731 raft_consensus.cc:385] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.821552  7731 raft_consensus.cc:740] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.822350  7731 consensus_queue.cc:260] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:03.824290  7731 ts_tablet_manager.cc:1434] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:16:03.824586  7970 raft_consensus.cc:493] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.825265  7970 raft_consensus.cc:515] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:03.827749  7970 leader_election.cc:290] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:03.829389  7730 tablet_bootstrap.cc:654] T b215f304c98341bebbc937add44da99d P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.830236  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce8654527b4453bab2b63775a4e2601" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
W20260709 13:16:03.831817  7500 leader_election.cc:343] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:03.831957  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce8654527b4453bab2b63775a4e2601" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:03.835228  7729 tablet_bootstrap.cc:492] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:03.835781  7729 ts_tablet_manager.cc:1403] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.020s
I20260709 13:16:03.838748  7729 raft_consensus.cc:359] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
W20260709 13:16:03.839074  7499 leader_election.cc:343] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:03.839509  7729 raft_consensus.cc:385] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.839622  7499 leader_election.cc:304] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:03.839843  7729 raft_consensus.cc:740] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.840517  7970 raft_consensus.cc:2749] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:03.841313  7968 consensus_queue.cc:1048] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:03.841686  7729 consensus_queue.cc:260] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:03.850438  7729 ts_tablet_manager.cc:1434] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:16:03.851537  7729 tablet_bootstrap.cc:492] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:03.854559  7734 tablet_bootstrap.cc:492] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:03.855101  7734 ts_tablet_manager.cc:1403] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.096s	user 0.027s	sys 0.025s
I20260709 13:16:03.825219  7731 tablet_bootstrap.cc:492] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:03.858458  7734 raft_consensus.cc:359] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:03.859403  7734 raft_consensus.cc:385] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.859745  7734 raft_consensus.cc:740] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.860607  7734 consensus_queue.cc:260] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:03.862155  7959 consensus_queue.cc:1048] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:03.877990  7731 tablet_bootstrap.cc:654] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.880594  7839 raft_consensus.cc:493] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.881386  7839 raft_consensus.cc:515] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:03.881951  7848 raft_consensus.cc:493] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.882649  7848 raft_consensus.cc:515] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:03.885389  7848 leader_election.cc:290] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:03.886256  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8380470ec0d46c1914152ad9818bab7" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:03.887063  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8380470ec0d46c1914152ad9818bab7" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:03.887826  7608 raft_consensus.cc:2468] T e8380470ec0d46c1914152ad9818bab7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
W20260709 13:16:03.888185  7650 leader_election.cc:343] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:03.889247  7647 leader_election.cc:304] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:16:03.890268  7730 tablet_bootstrap.cc:492] T b215f304c98341bebbc937add44da99d P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:03.885178  7460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b215f304c98341bebbc937add44da99d" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:03.890793  7730 ts_tablet_manager.cc:1403] T b215f304c98341bebbc937add44da99d P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.071s	user 0.024s	sys 0.032s
I20260709 13:16:03.891252  7848 raft_consensus.cc:2804] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:03.892992  7848 raft_consensus.cc:493] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.893447  7848 raft_consensus.cc:3060] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:03.892505  7648 leader_election.cc:343] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:03.881902  7729 tablet_bootstrap.cc:654] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.902300  7731 tablet_bootstrap.cc:492] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:03.902485  7460 raft_consensus.cc:3060] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:03.902801  7731 ts_tablet_manager.cc:1403] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.000s
I20260709 13:16:03.893777  7730 raft_consensus.cc:359] T b215f304c98341bebbc937add44da99d P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:03.903465  7730 raft_consensus.cc:385] T b215f304c98341bebbc937add44da99d P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.903770  7730 raft_consensus.cc:740] T b215f304c98341bebbc937add44da99d P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.904541  7730 consensus_queue.cc:260] T b215f304c98341bebbc937add44da99d P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:03.905609  7608 raft_consensus.cc:3060] T 343cf82796c24137960d60c292b5dd42 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:03.906944  7730 ts_tablet_manager.cc:1434] T b215f304c98341bebbc937add44da99d P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:16:03.907967  7730 tablet_bootstrap.cc:492] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:03.912261  7942 raft_consensus.cc:493] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.912798  7942 raft_consensus.cc:515] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:03.914731  7730 tablet_bootstrap.cc:654] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:03.914933  7942 leader_election.cc:290] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:03.916157  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5266494b97e8402b9696d8771ca7e9f0" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:03.923287  7536 raft_consensus.cc:2468] T 5266494b97e8402b9696d8771ca7e9f0 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 0.
I20260709 13:16:03.917026  7734 ts_tablet_manager.cc:1434] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
I20260709 13:16:03.917827  7839 leader_election.cc:290] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:03.919962  7527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b215f304c98341bebbc937add44da99d" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:03.917253  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5266494b97e8402b9696d8771ca7e9f0" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:03.935185  7461 raft_consensus.cc:2468] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 0.
I20260709 13:16:03.940368  7527 raft_consensus.cc:2468] T b215f304c98341bebbc937add44da99d P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:16:03.943554  7650 leader_election.cc:304] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:03.944664  7576 leader_election.cc:304] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: 
I20260709 13:16:03.945246  7981 raft_consensus.cc:2804] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:03.945832  7981 raft_consensus.cc:493] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.946290  7981 raft_consensus.cc:3060] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:03.947301  7942 raft_consensus.cc:2804] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:03.947930  7942 raft_consensus.cc:493] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.948379  7942 raft_consensus.cc:3060] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:03.905725  7731 raft_consensus.cc:359] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:03.928587  7734 tablet_bootstrap.cc:492] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:03.952805  7731 raft_consensus.cc:385] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:03.953269  7731 raft_consensus.cc:740] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:03.920469  7848 raft_consensus.cc:515] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
W20260709 13:16:04.030879  7650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:45835, user_credentials={real_user=slave}} blocked reactor thread for 87191.9us
I20260709 13:16:04.032769  7731 consensus_queue.cc:260] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:04.036818  7839 raft_consensus.cc:493] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.038604  7839 raft_consensus.cc:515] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:04.041247  7959 consensus_queue.cc:1048] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:04.042870  7839 leader_election.cc:290] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:04.048528  7731 ts_tablet_manager.cc:1434] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.145s	user 0.013s	sys 0.006s
I20260709 13:16:04.041649  7757 raft_consensus.cc:493] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.044585  7797 raft_consensus.cc:493] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.059032  7963 consensus_queue.cc:1048] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:04.075522  7964 raft_consensus.cc:493] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.076627  7964 raft_consensus.cc:515] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:04.084942  7757 raft_consensus.cc:515] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:04.089115  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa56ac7185b84a7ba5fdc8f39e5de8f3" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:04.097425  7964 leader_election.cc:290] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
W20260709 13:16:04.101131  7647 leader_election.cc:343] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.103272  7848 leader_election.cc:290] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:04.103448  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54c4242890a943ec865bafae33141d3b" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:04.110963  7757 leader_election.cc:290] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
W20260709 13:16:04.112965  7427 leader_election.cc:343] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.117313  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8380470ec0d46c1914152ad9818bab7" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:04.118467  7610 raft_consensus.cc:3060] T e8380470ec0d46c1914152ad9818bab7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:04.101504  7797 raft_consensus.cc:515] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:04.120613  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54c4242890a943ec865bafae33141d3b" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:04.121532  7607 raft_consensus.cc:2468] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:16:04.123205  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa56ac7185b84a7ba5fdc8f39e5de8f3" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:04.123750  7804 raft_consensus.cc:493] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.126052  7797 leader_election.cc:290] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:04.125288  7804 raft_consensus.cc:515] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:04.134452  7527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8380470ec0d46c1914152ad9818bab7" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:04.135686  7804 leader_election.cc:290] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:04.142712  7795 raft_consensus.cc:493] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.143549  7795 raft_consensus.cc:515] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:04.146664  7795 leader_election.cc:290] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
W20260709 13:16:04.137317  7650 leader_election.cc:343] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.148507  7683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81703e5e726a4905a8cff753fe076535" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:04.149580  7683 raft_consensus.cc:2468] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 0.
I20260709 13:16:04.150343  7424 leader_election.cc:304] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:16:04.152129  7574 leader_election.cc:304] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:04.153874  7795 raft_consensus.cc:2804] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:04.154489  7795 raft_consensus.cc:493] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:04.153430  7424 leader_election.cc:343] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.154395  7460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81703e5e726a4905a8cff753fe076535" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:04.155262  7795 raft_consensus.cc:3060] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:04.156744  7574 leader_election.cc:343] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.157927  7981 raft_consensus.cc:515] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:04.157917  7797 raft_consensus.cc:2804] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:04.159289  7797 raft_consensus.cc:493] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.159711  7797 raft_consensus.cc:3060] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:04.160739  7730 tablet_bootstrap.cc:492] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:04.163658  7729 tablet_bootstrap.cc:492] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:04.171815  7729 ts_tablet_manager.cc:1403] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.320s	user 0.012s	sys 0.014s
I20260709 13:16:04.183072  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa56ac7185b84a7ba5fdc8f39e5de8f3" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:04.183753  7731 tablet_bootstrap.cc:492] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:04.184007  7680 raft_consensus.cc:2468] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:16:04.187469  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9b5ae77739f4adca66b64acf11c42ce" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:04.190841  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9b5ae77739f4adca66b64acf11c42ce" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:04.192672  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11909bda591f4d61a9817bd3575748b5" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
W20260709 13:16:04.194530  7647 leader_election.cc:343] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.195093  7730 ts_tablet_manager.cc:1403] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.287s	user 0.019s	sys 0.033s
I20260709 13:16:04.192713  7729 raft_consensus.cc:359] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:04.198406  7729 raft_consensus.cc:385] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:04.201646  7729 raft_consensus.cc:740] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:04.207700  7729 consensus_queue.cc:260] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:04.158771  7610 raft_consensus.cc:2468] T e8380470ec0d46c1914152ad9818bab7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:04.174234  7942 raft_consensus.cc:515] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:04.226619  7456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11909bda591f4d61a9817bd3575748b5" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:04.226092  7458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa56ac7185b84a7ba5fdc8f39e5de8f3" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:04.230845  7458 raft_consensus.cc:2468] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:16:04.233266  7942 leader_election.cc:290] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:04.234256  7457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5266494b97e8402b9696d8771ca7e9f0" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:04.235270  7457 raft_consensus.cc:3060] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:04.237089  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5266494b97e8402b9696d8771ca7e9f0" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:04.237815  7536 raft_consensus.cc:3060] T 5266494b97e8402b9696d8771ca7e9f0 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:04.237906  7734 tablet_bootstrap.cc:654] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:04.246415  7425 leader_election.cc:304] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06
I20260709 13:16:04.248247  7425 leader_election.cc:304] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:04.248502  7794 raft_consensus.cc:2804] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:04.249562  7794 raft_consensus.cc:493] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.249980  7794 raft_consensus.cc:3060] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:04.257254  7731 tablet_bootstrap.cc:654] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:04.281563  7647 leader_election.cc:304] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:16:04.284734  7804 raft_consensus.cc:2804] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:04.285467  7804 raft_consensus.cc:697] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:04.289026  7804 consensus_queue.cc:237] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:04.297936  7795 raft_consensus.cc:515] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:04.304831  7729 ts_tablet_manager.cc:1434] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.133s	user 0.012s	sys 0.000s
I20260709 13:16:04.306944  7729 tablet_bootstrap.cc:492] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:04.307940  7730 raft_consensus.cc:359] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:04.309755  7976 raft_consensus.cc:493] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.345377  7730 raft_consensus.cc:385] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:04.345990  7730 raft_consensus.cc:740] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:04.318666  7648 leader_election.cc:304] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06
I20260709 13:16:04.334945  7460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b215f304c98341bebbc937add44da99d" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:04.267884  7794 raft_consensus.cc:515] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:04.358153  7730 consensus_queue.cc:260] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:04.356725  7752 raft_consensus.cc:2804] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:04.365301  7752 raft_consensus.cc:493] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.365760  7752 raft_consensus.cc:3060] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:04.366168  7527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b215f304c98341bebbc937add44da99d" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:04.366869  7527 raft_consensus.cc:3060] T b215f304c98341bebbc937add44da99d P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:04.369557  7795 leader_election.cc:290] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:04.357753  7981 leader_election.cc:290] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:04.358178  7797 raft_consensus.cc:515] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:04.357941  7536 raft_consensus.cc:2468] T 5266494b97e8402b9696d8771ca7e9f0 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:04.376032  7750 raft_consensus.cc:2749] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:04.376897  7730 ts_tablet_manager.cc:1434] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.181s	user 0.007s	sys 0.003s
I20260709 13:16:04.355832  7976 raft_consensus.cc:515] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:04.386801  7731 tablet_bootstrap.cc:492] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:04.387403  7731 ts_tablet_manager.cc:1403] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.204s	user 0.048s	sys 0.045s
I20260709 13:16:04.389324  7976 leader_election.cc:290] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:04.389935  7795 raft_consensus.cc:493] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.390393  7797 leader_election.cc:290] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:04.385166  7460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81703e5e726a4905a8cff753fe076535" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:04.401188  7795 raft_consensus.cc:515] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:04.387168  7457 raft_consensus.cc:2468] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:04.390281  7731 raft_consensus.cc:359] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:04.392014  7794 leader_election.cc:290] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:04.392820  7605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98892caf6b1549c8a1906b47c1298334" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:04.393054  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa56ac7185b84a7ba5fdc8f39e5de8f3" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:04.393847  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54c4242890a943ec865bafae33141d3b" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:04.394134  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54c4242890a943ec865bafae33141d3b" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
W20260709 13:16:04.382769  7648 leader_election.cc:343] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.409701  7731 raft_consensus.cc:385] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:04.406965  7529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98892caf6b1549c8a1906b47c1298334" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:04.414939  7731 raft_consensus.cc:740] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:04.412468  7730 tablet_bootstrap.cc:492] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:04.415616  7610 raft_consensus.cc:3060] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:04.416828  7529 raft_consensus.cc:2468] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:16:04.420955  7576 leader_election.cc:304] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: 
I20260709 13:16:04.421833  7942 raft_consensus.cc:2804] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:04.422345  7942 raft_consensus.cc:697] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:04.423410  7942 consensus_queue.cc:237] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
W20260709 13:16:04.414649  7424 leader_election.cc:343] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.428562  7734 tablet_bootstrap.cc:492] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
W20260709 13:16:04.429132  7424 leader_election.cc:343] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.431728  7731 consensus_queue.cc:260] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:04.433983  7427 leader_election.cc:304] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 382e1f4385ac4066b7098e4fd1f5df06
I20260709 13:16:04.435138  7729 tablet_bootstrap.cc:654] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:04.438570  7797 raft_consensus.cc:2804] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:04.439028  7797 raft_consensus.cc:493] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.439188  7460 raft_consensus.cc:3060] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:04.444492  7797 raft_consensus.cc:3060] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:04.447794  7427 leader_election.cc:343] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.429808  7648 leader_election.cc:304] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:04.453715  7981 raft_consensus.cc:2749] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:04.454602  7648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:35515, user_credentials={real_user=slave}} blocked reactor thread for 73738.3us
W20260709 13:16:04.458777  7648 leader_election.cc:343] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.459105  7797 raft_consensus.cc:515] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:04.468840  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98892caf6b1549c8a1906b47c1298334" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:04.469540  7534 raft_consensus.cc:3060] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:04.471333  7797 leader_election.cc:290] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:04.475481  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98892caf6b1549c8a1906b47c1298334" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:04.476590  7731 ts_tablet_manager.cc:1434] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.000s
I20260709 13:16:04.483253  7795 leader_election.cc:290] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:04.483453  7734 ts_tablet_manager.cc:1403] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.555s	user 0.046s	sys 0.065s
W20260709 13:16:04.484333  7424 leader_election.cc:343] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.484712  7529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b1bccbb9eb4fc7987174b429fce6d4" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
W20260709 13:16:04.486415  7576 leader_election.cc:343] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.462090  7460 raft_consensus.cc:2468] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:04.487201  7610 raft_consensus.cc:2468] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:04.487974  7456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b1bccbb9eb4fc7987174b429fce6d4" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
W20260709 13:16:04.489888  7574 leader_election.cc:343] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.490317  7424 leader_election.cc:304] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:16:04.490335  7574 leader_election.cc:304] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:04.491828  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa56ac7185b84a7ba5fdc8f39e5de8f3" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:04.492233  7794 raft_consensus.cc:2804] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:04.492784  7794 raft_consensus.cc:697] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:04.493618  7794 consensus_queue.cc:237] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:04.495143  7574 leader_election.cc:304] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:04.496155  7731 tablet_bootstrap.cc:492] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:04.496498  7870 raft_consensus.cc:2749] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:04.496950  7795 raft_consensus.cc:2804] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:04.505229  7359 catalog_manager.cc:5697] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 0 to 1, leader changed from <none> to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 1 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:04.506083  7795 raft_consensus.cc:697] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:04.497362  7730 tablet_bootstrap.cc:654] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:04.500767  7734 raft_consensus.cc:359] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:04.503109  7358 catalog_manager.cc:5697] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:04.508349  7734 raft_consensus.cc:385] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:04.507150  7795 consensus_queue.cc:237] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:04.508801  7734 raft_consensus.cc:740] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:04.491412  7752 raft_consensus.cc:515] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:04.484818  7527 raft_consensus.cc:2468] T b215f304c98341bebbc937add44da99d P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:04.515512  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81703e5e726a4905a8cff753fe076535" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:04.516192  7682 raft_consensus.cc:3060] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:04.517695  7650 leader_election.cc:304] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:04.520057  7734 consensus_queue.cc:260] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:04.519194  7804 raft_consensus.cc:2804] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:04.521150  7804 raft_consensus.cc:697] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:04.518989  7534 raft_consensus.cc:2468] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:04.522629  7734 ts_tablet_manager.cc:1434] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 13:16:04.522127  7804 consensus_queue.cc:237] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:04.538621  7729 tablet_bootstrap.cc:492] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:04.539532  7729 ts_tablet_manager.cc:1403] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.233s	user 0.024s	sys 0.013s
I20260709 13:16:04.522759  7427 leader_election.cc:304] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 382e1f4385ac4066b7098e4fd1f5df06
I20260709 13:16:04.543854  7750 raft_consensus.cc:2804] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:04.544570  7750 raft_consensus.cc:697] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:04.545595  7750 consensus_queue.cc:237] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:04.547405  7680 raft_consensus.cc:2393] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d54f6e4b9e604cd78c48a1828cd3b23a in current term 1: Already voted for candidate e733469bde7c479a916acbbe84b5f342 in this term.
I20260709 13:16:04.546657  7729 raft_consensus.cc:359] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:04.548457  7729 raft_consensus.cc:385] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:04.557993  7425 leader_election.cc:304] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:04.559048  7797 raft_consensus.cc:2749] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:04.559307  7734 tablet_bootstrap.cc:492] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:04.556018  7730 tablet_bootstrap.cc:492] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:04.560122  7730 ts_tablet_manager.cc:1403] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.165s	user 0.015s	sys 0.002s
I20260709 13:16:04.564743  7730 raft_consensus.cc:359] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:04.565652  7730 raft_consensus.cc:385] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:04.566066  7730 raft_consensus.cc:740] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:04.567163  7730 consensus_queue.cc:260] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:04.569384  7731 tablet_bootstrap.cc:654] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:04.548964  7729 raft_consensus.cc:740] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:04.573366  7752 leader_election.cc:290] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:04.576320  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa56ac7185b84a7ba5fdc8f39e5de8f3" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:04.577474  7734 tablet_bootstrap.cc:654] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:04.582100  7729 consensus_queue.cc:260] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:04.583019  7610 raft_consensus.cc:3060] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:04.584748  7682 raft_consensus.cc:2468] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:04.590783  7610 raft_consensus.cc:2468] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:04.580850  7457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa56ac7185b84a7ba5fdc8f39e5de8f3" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:04.593359  7457 raft_consensus.cc:2393] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e733469bde7c479a916acbbe84b5f342 in current term 1: Already voted for candidate d54f6e4b9e604cd78c48a1828cd3b23a in this term.
I20260709 13:16:04.598393  7730 ts_tablet_manager.cc:1434] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.002s
I20260709 13:16:04.608777  7647 leader_election.cc:304] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:04.609659  7848 raft_consensus.cc:2804] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:04.610153  7848 raft_consensus.cc:697] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:04.610605  7730 tablet_bootstrap.cc:492] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:04.611049  7848 consensus_queue.cc:237] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:04.613389  7870 raft_consensus.cc:493] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.613903  7870 raft_consensus.cc:515] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:04.616097  7870 leader_election.cc:290] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:04.616585  7729 ts_tablet_manager.cc:1434] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.077s	user 0.005s	sys 0.003s
I20260709 13:16:04.618106  7729 tablet_bootstrap.cc:492] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:04.619218  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce8654527b4453bab2b63775a4e2601" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:04.619908  7534 raft_consensus.cc:2468] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 0.
I20260709 13:16:04.622453  7681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce8654527b4453bab2b63775a4e2601" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:04.623656  7576 leader_election.cc:304] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: 
W20260709 13:16:04.625990  7574 leader_election.cc:343] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.622617  7355 catalog_manager.cc:5697] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 0 to 1, leader changed from <none> to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:04.632898  7870 raft_consensus.cc:2804] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:04.633397  7870 raft_consensus.cc:493] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.633694  7870 raft_consensus.cc:3060] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:04.646299  7870 raft_consensus.cc:515] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:04.650537  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce8654527b4453bab2b63775a4e2601" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:04.651408  7534 raft_consensus.cc:3060] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:04.664880  7870 leader_election.cc:290] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:04.666355  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce8654527b4453bab2b63775a4e2601" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
W20260709 13:16:04.668215  7574 leader_election.cc:343] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.673125  7730 tablet_bootstrap.cc:654] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:04.674619  7731 tablet_bootstrap.cc:492] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:04.675321  7731 ts_tablet_manager.cc:1403] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.179s	user 0.027s	sys 0.026s
W20260709 13:16:04.676751  7407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:04.676155  7534 raft_consensus.cc:2468] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:04.677871  7734 tablet_bootstrap.cc:492] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:04.682237  7576 leader_election.cc:304] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: e733469bde7c479a916acbbe84b5f342
I20260709 13:16:04.682662  7734 ts_tablet_manager.cc:1403] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.124s	user 0.012s	sys 0.006s
I20260709 13:16:04.683480  7870 raft_consensus.cc:2804] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:04.683984  7870 raft_consensus.cc:697] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:04.678969  7731 raft_consensus.cc:359] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:04.684576  7731 raft_consensus.cc:385] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:04.684834  7731 raft_consensus.cc:740] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:04.684942  7870 consensus_queue.cc:237] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:04.685500  7731 consensus_queue.cc:260] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:04.680150  7729 tablet_bootstrap.cc:654] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:04.691033  7734 raft_consensus.cc:359] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:04.692145  7734 raft_consensus.cc:385] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:04.692567  7734 raft_consensus.cc:740] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:04.693245  7848 raft_consensus.cc:493] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.693828  7848 raft_consensus.cc:515] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:04.698113  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87af8743bc441c28b895aa411d33f2a" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:04.698449  7457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87af8743bc441c28b895aa411d33f2a" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
W20260709 13:16:04.700029  7647 leader_election.cc:343] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.700531  7848 leader_election.cc:290] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
W20260709 13:16:04.700706  7648 leader_election.cc:343] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.701196  7648 leader_election.cc:304] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:04.701723  7734 consensus_queue.cc:260] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:04.702610  7848 raft_consensus.cc:2749] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:04.704811  7734 ts_tablet_manager.cc:1434] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.002s
I20260709 13:16:04.706190  7734 tablet_bootstrap.cc:492] T 1ce8654527b4453bab2b63775a4e2601 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:04.713524  7734 tablet_bootstrap.cc:654] T 1ce8654527b4453bab2b63775a4e2601 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:04.714910  7730 tablet_bootstrap.cc:492] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:04.715482  7730 ts_tablet_manager.cc:1403] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.105s	user 0.007s	sys 0.008s
I20260709 13:16:04.718971  7730 raft_consensus.cc:359] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:04.719631  7734 tablet_bootstrap.cc:492] T 1ce8654527b4453bab2b63775a4e2601 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:04.719713  7730 raft_consensus.cc:385] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:04.712321  7731 ts_tablet_manager.cc:1434] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:16:04.720189  7730 raft_consensus.cc:740] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:04.720306  7734 ts_tablet_manager.cc:1403] T 1ce8654527b4453bab2b63775a4e2601 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:16:04.723075  7731 tablet_bootstrap.cc:492] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:04.722816  7730 consensus_queue.cc:260] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:04.725239  7730 ts_tablet_manager.cc:1434] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:16:04.721575  7729 tablet_bootstrap.cc:492] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:04.726046  7729 ts_tablet_manager.cc:1403] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.108s	user 0.014s	sys 0.001s
I20260709 13:16:04.726599  7730 tablet_bootstrap.cc:492] T e8380470ec0d46c1914152ad9818bab7 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:04.725958  7734 raft_consensus.cc:359] T 1ce8654527b4453bab2b63775a4e2601 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:04.731155  7734 raft_consensus.cc:385] T 1ce8654527b4453bab2b63775a4e2601 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:04.731484  7734 raft_consensus.cc:740] T 1ce8654527b4453bab2b63775a4e2601 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:04.732149  7734 consensus_queue.cc:260] T 1ce8654527b4453bab2b63775a4e2601 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:04.736593  7730 tablet_bootstrap.cc:654] T e8380470ec0d46c1914152ad9818bab7 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:04.740520  7734 ts_tablet_manager.cc:1434] T 1ce8654527b4453bab2b63775a4e2601 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:16:04.742053  7734 tablet_bootstrap.cc:492] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:04.745544  7359 catalog_manager.cc:5697] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 0 to 1, leader changed from <none> to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 1 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:04.747668  7359 catalog_manager.cc:5697] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 0 to 1, leader changed from <none> to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 1 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:04.753029  7734 tablet_bootstrap.cc:654] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:04.755196  7731 tablet_bootstrap.cc:654] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:04.757401  7729 raft_consensus.cc:359] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:04.758136  7729 raft_consensus.cc:385] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:04.758404  7729 raft_consensus.cc:740] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:04.759204  7729 consensus_queue.cc:260] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:04.761967  7729 ts_tablet_manager.cc:1434] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.004s
I20260709 13:16:04.762952  7734 tablet_bootstrap.cc:492] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:04.763759  7734 ts_tablet_manager.cc:1403] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
I20260709 13:16:04.767514  7734 raft_consensus.cc:359] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:04.768571  7734 raft_consensus.cc:385] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:04.768970  7734 raft_consensus.cc:740] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:04.770275  7734 consensus_queue.cc:260] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:04.772521  7734 ts_tablet_manager.cc:1434] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:16:04.772953  7731 tablet_bootstrap.cc:492] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:04.773555  7731 ts_tablet_manager.cc:1403] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.010s
I20260709 13:16:04.773841  7734 tablet_bootstrap.cc:492] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:04.781086  7731 raft_consensus.cc:359] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:04.784696  7358 catalog_manager.cc:5697] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:04.787823  7357 catalog_manager.cc:5697] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 0 to 1, leader changed from <none> to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:04.792829  7734 tablet_bootstrap.cc:654] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:04.797680  7358 catalog_manager.cc:5697] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:04.800232  7963 raft_consensus.cc:493] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.806162  7963 raft_consensus.cc:515] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:04.802188  7794 raft_consensus.cc:493] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.807529  7794 raft_consensus.cc:515] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:04.808279  7963 leader_election.cc:290] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:04.809713  7794 leader_election.cc:290] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:04.810132  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c780fdb61048ac8f4c44481a73f9ff" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
W20260709 13:16:04.811961  7499 leader_election.cc:343] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.812197  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b215f304c98341bebbc937add44da99d" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:04.813158  7534 raft_consensus.cc:2393] T b215f304c98341bebbc937add44da99d P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d54f6e4b9e604cd78c48a1828cd3b23a in current term 1: Already voted for candidate e733469bde7c479a916acbbe84b5f342 in this term.
I20260709 13:16:04.812876  7681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b215f304c98341bebbc937add44da99d" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:04.819070  7427 leader_election.cc:304] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:04.820772  7794 raft_consensus.cc:3060] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:04.821251  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c780fdb61048ac8f4c44481a73f9ff" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
W20260709 13:16:04.822970  7500 leader_election.cc:343] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.823441  7500 leader_election.cc:304] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:04.827397  7963 raft_consensus.cc:2749] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:04.829945  7794 raft_consensus.cc:2749] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:04.829985  7959 raft_consensus.cc:493] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.832945  7959 raft_consensus.cc:515] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:04.835059  7959 leader_election.cc:290] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:04.781796  7731 raft_consensus.cc:385] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:04.836450  7731 raft_consensus.cc:740] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:04.836833  7457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b1bccbb9eb4fc7987174b429fce6d4" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:04.837260  7729 tablet_bootstrap.cc:492] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:04.837412  7731 consensus_queue.cc:260] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
W20260709 13:16:04.838328  7500 leader_election.cc:343] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.840291  7730 tablet_bootstrap.cc:492] T e8380470ec0d46c1914152ad9818bab7 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:04.840418  7731 ts_tablet_manager.cc:1434] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.001s
I20260709 13:16:04.840780  7730 ts_tablet_manager.cc:1403] T e8380470ec0d46c1914152ad9818bab7 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.114s	user 0.029s	sys 0.054s
I20260709 13:16:04.805527  7734 tablet_bootstrap.cc:492] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:04.842214  7734 ts_tablet_manager.cc:1403] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.000s
I20260709 13:16:04.843633  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b1bccbb9eb4fc7987174b429fce6d4" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:04.844018  7730 raft_consensus.cc:359] T e8380470ec0d46c1914152ad9818bab7 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:04.844534  7610 raft_consensus.cc:2468] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 0.
I20260709 13:16:04.844890  7730 raft_consensus.cc:385] T e8380470ec0d46c1914152ad9818bab7 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:04.845237  7730 raft_consensus.cc:740] T e8380470ec0d46c1914152ad9818bab7 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:04.845889  7499 leader_election.cc:304] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:04.846084  7730 consensus_queue.cc:260] T e8380470ec0d46c1914152ad9818bab7 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:04.846338  7734 raft_consensus.cc:359] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:04.847047  7734 raft_consensus.cc:385] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:04.847289  7968 raft_consensus.cc:2804] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:04.847376  7734 raft_consensus.cc:740] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:04.847833  7968 raft_consensus.cc:493] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.848205  7968 raft_consensus.cc:3060] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:04.849064  7729 tablet_bootstrap.cc:654] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:04.850703  7731 tablet_bootstrap.cc:492] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:04.854864  7848 consensus_queue.cc:1048] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:04.856315  7734 consensus_queue.cc:260] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:04.859898  7968 raft_consensus.cc:515] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:04.862879  7730 ts_tablet_manager.cc:1434] T e8380470ec0d46c1914152ad9818bab7 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.002s
I20260709 13:16:04.865022  7734 ts_tablet_manager.cc:1434] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:16:04.865336  7457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b1bccbb9eb4fc7987174b429fce6d4" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:04.865995  7734 tablet_bootstrap.cc:492] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
W20260709 13:16:04.866786  7500 leader_election.cc:343] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.869174  7870 consensus_queue.cc:1048] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:04.870297  7968 leader_election.cc:290] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:04.871166  7730 tablet_bootstrap.cc:492] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:04.873091  7729 tablet_bootstrap.cc:492] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:04.873556  7729 ts_tablet_manager.cc:1403] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.006s
I20260709 13:16:04.876163  7605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b1bccbb9eb4fc7987174b429fce6d4" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:04.876850  7605 raft_consensus.cc:3060] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:04.876607  7729 raft_consensus.cc:359] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:04.877327  7729 raft_consensus.cc:385] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:04.877614  7729 raft_consensus.cc:740] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:04.878449  7729 consensus_queue.cc:260] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:04.880218  7534 raft_consensus.cc:3060] T e8380470ec0d46c1914152ad9818bab7 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:04.888952  7804 consensus_queue.cc:1048] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:04.893445  7734 tablet_bootstrap.cc:654] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:04.880349  7729 ts_tablet_manager.cc:1434] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:16:04.899181  7605 raft_consensus.cc:2468] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:04.900939  7729 tablet_bootstrap.cc:492] T 58c780fdb61048ac8f4c44481a73f9ff P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:04.901052  7499 leader_election.cc:304] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:04.902542  7731 tablet_bootstrap.cc:654] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:04.911196  7427 consensus_peers.cc:597] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:04.919816  7794 raft_consensus.cc:493] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.920356  7794 raft_consensus.cc:515] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:04.922757  7794 leader_election.cc:290] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:04.924665  7605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6382ace6264a0db74146326b719f7b" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
W20260709 13:16:04.927183  7424 leader_election.cc:343] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.932217  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6382ace6264a0db74146326b719f7b" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
W20260709 13:16:04.933759  7427 leader_election.cc:343] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.934427  7427 leader_election.cc:304] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0
I20260709 13:16:04.935441  7968 raft_consensus.cc:2804] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:04.935652  7794 raft_consensus.cc:2749] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:04.936365  7968 raft_consensus.cc:697] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:04.937486  7968 consensus_queue.cc:237] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:04.938830  7963 raft_consensus.cc:493] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.939463  7963 raft_consensus.cc:515] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:04.947883  7804 raft_consensus.cc:493] T 1ce8654527b4453bab2b63775a4e2601 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.948697  7804 raft_consensus.cc:515] T 1ce8654527b4453bab2b63775a4e2601 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:04.963779  7870 raft_consensus.cc:493] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.964488  7870 raft_consensus.cc:515] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:04.963266  7794 consensus_queue.cc:1048] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:16:04.982831  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8219a2ee929d4169bde0d0eaf559f7d9" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
W20260709 13:16:04.984524  7500 leader_election.cc:343] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:04.984731  7804 leader_election.cc:290] T 1ce8654527b4453bab2b63775a4e2601 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:04.986073  7795 consensus_queue.cc:1048] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:04.987207  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce8654527b4453bab2b63775a4e2601" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:04.988359  7536 raft_consensus.cc:2393] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e733469bde7c479a916acbbe84b5f342 in current term 1: Already voted for candidate 382e1f4385ac4066b7098e4fd1f5df06 in this term.
W20260709 13:16:04.985677  7427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:45835, user_credentials={real_user=slave}} blocked reactor thread for 51977.2us
I20260709 13:16:04.986487  7963 leader_election.cc:290] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:05.018944  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce8654527b4453bab2b63775a4e2601" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:05.019920  7734 tablet_bootstrap.cc:492] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:05.020412  7734 ts_tablet_manager.cc:1403] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.155s	user 0.014s	sys 0.012s
I20260709 13:16:05.023108  7734 raft_consensus.cc:359] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:05.023815  7734 raft_consensus.cc:385] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:05.024062  7734 raft_consensus.cc:740] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:05.024637  7734 consensus_queue.cc:260] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:05.026803  7734 ts_tablet_manager.cc:1434] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:16:05.028048  7734 tablet_bootstrap.cc:492] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:05.029218  7729 tablet_bootstrap.cc:654] T 58c780fdb61048ac8f4c44481a73f9ff P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:05.033046  7731 tablet_bootstrap.cc:492] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:05.053488  7731 ts_tablet_manager.cc:1403] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.203s	user 0.015s	sys 0.021s
I20260709 13:16:05.053673  7734 tablet_bootstrap.cc:654] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:05.033799  7607 raft_consensus.cc:3060] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:05.064996  7848 consensus_queue.cc:1048] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:05.038635  7460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8219a2ee929d4169bde0d0eaf559f7d9" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:05.067422  7730 tablet_bootstrap.cc:654] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:05.069269  7500 leader_election.cc:343] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:05.069802  7500 leader_election.cc:304] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:05.070573  7959 raft_consensus.cc:2749] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:05.062863  7647 leader_election.cc:304] T 1ce8654527b4453bab2b63775a4e2601 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0
I20260709 13:16:05.076625  7795 consensus_queue.cc:1048] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:05.083535  7870 leader_election.cc:290] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:05.083537  7752 raft_consensus.cc:493] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.084450  7752 raft_consensus.cc:515] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:05.087348  7731 raft_consensus.cc:359] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:05.088128  7731 raft_consensus.cc:385] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:05.088471  7731 raft_consensus.cc:740] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:05.088719  7848 raft_consensus.cc:493] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.089170  7848 raft_consensus.cc:515] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:05.089447  7731 consensus_queue.cc:260] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:05.104908  7848 leader_election.cc:290] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:05.106132  7730 tablet_bootstrap.cc:492] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:05.091061  7804 raft_consensus.cc:3060] T 1ce8654527b4453bab2b63775a4e2601 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:05.106781  7730 ts_tablet_manager.cc:1403] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.236s	user 0.022s	sys 0.047s
I20260709 13:16:05.108295  7529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50e7db706514f8bb0b8885fca0868d3" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:05.108852  7460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50e7db706514f8bb0b8885fca0868d3" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:05.110093  7456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e442d8263394fa7bd9df6ee46bb246e" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:05.094499  7752 leader_election.cc:290] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:05.121228  7730 raft_consensus.cc:359] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:05.122705  7731 ts_tablet_manager.cc:1434] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 13:16:05.122790  7730 raft_consensus.cc:385] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:05.123893  7730 raft_consensus.cc:740] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:05.124259  7359 catalog_manager.cc:5697] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a0eef4c5880424694542637530b55c0 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "4a0eef4c5880424694542637530b55c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:05.126632  7730 consensus_queue.cc:260] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:05.129410  7968 raft_consensus.cc:493] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.129868  7968 raft_consensus.cc:515] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:05.137742  7731 tablet_bootstrap.cc:492] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:05.128458  7729 tablet_bootstrap.cc:492] T 58c780fdb61048ac8f4c44481a73f9ff P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
W20260709 13:16:05.141537  7576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:45835, user_credentials={real_user=slave}} blocked reactor thread for 68664.5us
I20260709 13:16:05.142597  7729 ts_tablet_manager.cc:1403] T 58c780fdb61048ac8f4c44481a73f9ff P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.242s	user 0.014s	sys 0.006s
I20260709 13:16:05.159485  7730 ts_tablet_manager.cc:1434] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.003s
I20260709 13:16:05.161211  7730 tablet_bootstrap.cc:492] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:05.140064  7968 leader_election.cc:290] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:05.169601  7456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54c4242890a943ec865bafae33141d3b" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:05.170149  7605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54c4242890a943ec865bafae33141d3b" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:05.172871  7734 tablet_bootstrap.cc:492] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:05.173827  7734 ts_tablet_manager.cc:1403] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.146s	user 0.021s	sys 0.014s
I20260709 13:16:05.183007  7729 raft_consensus.cc:359] T 58c780fdb61048ac8f4c44481a73f9ff P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:05.183435  7527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e442d8263394fa7bd9df6ee46bb246e" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:05.183806  7729 raft_consensus.cc:385] T 58c780fdb61048ac8f4c44481a73f9ff P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:05.184085  7729 raft_consensus.cc:740] T 58c780fdb61048ac8f4c44481a73f9ff P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:05.185093  7528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98892caf6b1549c8a1906b47c1298334" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:05.185883  7528 raft_consensus.cc:2393] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 382e1f4385ac4066b7098e4fd1f5df06 in current term 1: Already voted for candidate d54f6e4b9e604cd78c48a1828cd3b23a in this term.
I20260709 13:16:05.186980  7499 leader_election.cc:304] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:05.188782  7729 consensus_queue.cc:260] T 58c780fdb61048ac8f4c44481a73f9ff P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:05.190228  7959 raft_consensus.cc:2749] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:05.191385  7729 ts_tablet_manager.cc:1434] T 58c780fdb61048ac8f4c44481a73f9ff P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.001s
I20260709 13:16:05.206723  7794 consensus_queue.cc:1048] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:05.208276  7839 raft_consensus.cc:493] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.208810  7839 raft_consensus.cc:515] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:05.210592  7804 raft_consensus.cc:2749] T 1ce8654527b4453bab2b63775a4e2601 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:05.212141  7731 tablet_bootstrap.cc:654] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:05.212776  7729 tablet_bootstrap.cc:492] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
W20260709 13:16:05.223891  7574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:35515, user_credentials={real_user=slave}} blocked reactor thread for 151517us
W20260709 13:16:05.238760  7424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:46815, user_credentials={real_user=slave}} blocked reactor thread for 61871.8us
I20260709 13:16:05.230556  7752 raft_consensus.cc:493] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:05.245666  7650 leader_election.cc:343] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:05.245546  8073 consensus_queue.cc:1048] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:16:05.246610  7650 leader_election.cc:343] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:05.250947  7528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c780fdb61048ac8f4c44481a73f9ff" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:05.251922  7528 raft_consensus.cc:2468] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:16:05.241819  7750 consensus_queue.cc:1048] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:16:05.262001  7729 tablet_bootstrap.cc:654] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:05.252959  8069 consensus_queue.cc:1048] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:16:05.265122  7839 leader_election.cc:290] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:05.241760  7752 raft_consensus.cc:515] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:05.267640  7752 leader_election.cc:290] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:05.271602  7456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98892caf6b1549c8a1906b47c1298334" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:05.274796  7839 consensus_queue.cc:1048] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:05.279156  7648 leader_election.cc:343] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:05.286960  7648 leader_election.cc:304] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:05.279682  7650 leader_election.cc:304] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:05.285163  8069 consensus_queue.cc:1048] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:05.285456  7734 raft_consensus.cc:359] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:05.292796  7734 raft_consensus.cc:385] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:05.293179  7734 raft_consensus.cc:740] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:05.286257  7730 tablet_bootstrap.cc:654] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:05.284983  7574 leader_election.cc:304] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:05.288188  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d351dea40bb24488b7159df0e49bb759" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
W20260709 13:16:05.291003  7648 leader_election.cc:343] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:05.294673  7648 leader_election.cc:304] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:05.294094  7734 consensus_queue.cc:260] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:05.302837  7734 ts_tablet_manager.cc:1434] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.129s	user 0.008s	sys 0.000s
I20260709 13:16:05.296756  7752 raft_consensus.cc:2749] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:05.297135  7839 raft_consensus.cc:2749] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:05.303148  7870 raft_consensus.cc:2749] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:05.316907  7795 raft_consensus.cc:493] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.317178  7734 tablet_bootstrap.cc:492] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:05.317426  7795 raft_consensus.cc:515] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:05.320420  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c780fdb61048ac8f4c44481a73f9ff" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:05.320863  7604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d351dea40bb24488b7159df0e49bb759" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:05.321305  7610 raft_consensus.cc:2468] T 58c780fdb61048ac8f4c44481a73f9ff P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
I20260709 13:16:05.310611  8075 raft_consensus.cc:2804] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:05.328908  8075 raft_consensus.cc:493] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.329388  8075 raft_consensus.cc:3060] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:05.312698  8073 consensus_queue.cc:1048] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:16:05.349758  7795 leader_election.cc:290] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:05.352377  7797 raft_consensus.cc:493] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.353302  7797 raft_consensus.cc:515] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:05.371497  7731 tablet_bootstrap.cc:492] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:05.372056  7731 ts_tablet_manager.cc:1403] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.235s	user 0.017s	sys 0.000s
I20260709 13:16:05.388942  7731 raft_consensus.cc:359] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:05.399710  7731 raft_consensus.cc:385] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:05.400058  7731 raft_consensus.cc:740] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:05.402091  7729 tablet_bootstrap.cc:492] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:05.426131  7729 ts_tablet_manager.cc:1403] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.214s	user 0.013s	sys 0.015s
I20260709 13:16:05.428570  8068 consensus_queue.cc:1048] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:16:05.435047  7729 raft_consensus.cc:359] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:05.435832  7729 raft_consensus.cc:385] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:05.437475  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11909bda591f4d61a9817bd3575748b5" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:05.436100  7729 raft_consensus.cc:740] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:05.438208  7684 raft_consensus.cc:2468] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 0.
I20260709 13:16:05.403934  7731 consensus_queue.cc:260] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:05.412642  8072 raft_consensus.cc:493] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.413249  7458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11909bda591f4d61a9817bd3575748b5" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
W20260709 13:16:05.420984  7650 leader_election.cc:343] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:05.453032  8072 raft_consensus.cc:515] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:05.454579  8075 raft_consensus.cc:515] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:05.455287  8072 leader_election.cc:290] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:05.439080  7963 consensus_queue.cc:1048] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:16:05.461162  7729 consensus_queue.cc:260] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:05.465736  7734 tablet_bootstrap.cc:654] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:05.467197  7574 leader_election.cc:304] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:05.467518  7731 ts_tablet_manager.cc:1434] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.000s
I20260709 13:16:05.456753  8075 leader_election.cc:290] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:05.470878  7795 raft_consensus.cc:2804] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:05.471386  7795 raft_consensus.cc:493] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.471741  7795 raft_consensus.cc:3060] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:05.474408  7729 ts_tablet_manager.cc:1434] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 13:16:05.475593  7729 tablet_bootstrap.cc:492] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:05.476445  7731 tablet_bootstrap.cc:492] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
W20260709 13:16:05.493048  7647 leader_election.cc:343] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:05.493373  7574 leader_election.cc:343] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:05.493827  7647 leader_election.cc:304] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0
I20260709 13:16:05.494732  7804 raft_consensus.cc:2749] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:05.497468  7459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8219a2ee929d4169bde0d0eaf559f7d9" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:05.498175  7459 raft_consensus.cc:2468] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 0.
W20260709 13:16:05.504371  7424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:46815, user_credentials={real_user=slave}} blocked reactor thread for 84625.8us
I20260709 13:16:05.504802  7648 leader_election.cc:304] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:05.505721  7804 raft_consensus.cc:2804] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:05.506088  7804 raft_consensus.cc:493] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.506415  7804 raft_consensus.cc:3060] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:05.510558  7795 raft_consensus.cc:515] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:05.511027  7731 tablet_bootstrap.cc:654] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:05.512004  7804 raft_consensus.cc:515] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:05.512578  7795 leader_election.cc:290] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:05.513777  7804 leader_election.cc:290] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:05.513664  7529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c780fdb61048ac8f4c44481a73f9ff" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:05.514401  7529 raft_consensus.cc:3060] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:05.515053  7797 leader_election.cc:290] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:05.523298  7458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8219a2ee929d4169bde0d0eaf559f7d9" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:05.523523  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b1bccbb9eb4fc7987174b429fce6d4" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:05.523984  7458 raft_consensus.cc:3060] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:05.525210  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11909bda591f4d61a9817bd3575748b5" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:05.525821  7682 raft_consensus.cc:3060] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:05.525768  7528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1b1bccbb9eb4fc7987174b429fce6d4" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:05.530382  7530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8219a2ee929d4169bde0d0eaf559f7d9" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:05.530596  7533 raft_consensus.cc:3060] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:05.531013  7530 raft_consensus.cc:3060] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:05.531294  7461 raft_consensus.cc:3060] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:05.539865  7536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8219a2ee929d4169bde0d0eaf559f7d9" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:05.544827  7427 leader_election.cc:304] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0
I20260709 13:16:05.547937  7459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11909bda591f4d61a9817bd3575748b5" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:05.548388  7530 raft_consensus.cc:2468] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:05.552246  7605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c780fdb61048ac8f4c44481a73f9ff" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:05.552889  7605 raft_consensus.cc:3060] T 58c780fdb61048ac8f4c44481a73f9ff P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:05.553107  7574 leader_election.cc:343] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:05.566497  7650 leader_election.cc:304] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:05.572814  8075 raft_consensus.cc:2804] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:05.573305  8075 raft_consensus.cc:697] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:05.574096  8075 consensus_queue.cc:237] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:05.569902  7797 raft_consensus.cc:2749] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:05.580755  7605 raft_consensus.cc:2468] T 58c780fdb61048ac8f4c44481a73f9ff P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:05.566532  7730 tablet_bootstrap.cc:492] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:05.585439  7730 ts_tablet_manager.cc:1403] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.425s	user 0.012s	sys 0.012s
I20260709 13:16:05.590298  7730 raft_consensus.cc:359] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:05.591434  7959 consensus_queue.cc:1048] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:05.593580  7730 raft_consensus.cc:385] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:05.594293  7730 raft_consensus.cc:740] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:05.595600  7730 consensus_queue.cc:260] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:05.597823  7682 raft_consensus.cc:2468] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:05.599099  7574 leader_election.cc:304] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:05.599593  7730 ts_tablet_manager.cc:1434] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:16:05.601542  7730 tablet_bootstrap.cc:492] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:05.602360  7795 raft_consensus.cc:2804] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:05.603102  7795 raft_consensus.cc:697] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:05.603920  7795 consensus_queue.cc:237] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:05.610661  7647 leader_election.cc:304] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:05.611670  8072 raft_consensus.cc:2804] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:05.612145  8072 raft_consensus.cc:697] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:05.612818  7458 raft_consensus.cc:2468] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:05.612954  8072 consensus_queue.cc:237] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:05.618826  7729 tablet_bootstrap.cc:654] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:05.597169  7529 raft_consensus.cc:2468] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:05.652340  7734 tablet_bootstrap.cc:492] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:05.652917  7734 ts_tablet_manager.cc:1403] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.347s	user 0.014s	sys 0.013s
I20260709 13:16:05.657771  7734 raft_consensus.cc:359] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:05.658484  7734 raft_consensus.cc:385] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:05.658769  7734 raft_consensus.cc:740] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:05.659600  7734 consensus_queue.cc:260] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
W20260709 13:16:05.662071  8094 log.cc:927] Time spent T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:05.662307  7734 ts_tablet_manager.cc:1434] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:16:05.663483  7734 tablet_bootstrap.cc:492] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:05.678566  7730 tablet_bootstrap.cc:654] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:05.688673  7729 tablet_bootstrap.cc:492] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:05.690804  7729 ts_tablet_manager.cc:1403] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.215s	user 0.013s	sys 0.003s
I20260709 13:16:05.691674  7731 tablet_bootstrap.cc:492] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:05.692235  7731 ts_tablet_manager.cc:1403] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.216s	user 0.016s	sys 0.000s
I20260709 13:16:05.693511  7729 raft_consensus.cc:359] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:05.694217  7729 raft_consensus.cc:385] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:05.694494  7729 raft_consensus.cc:740] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:05.695119  7729 consensus_queue.cc:260] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:05.696667  7731 raft_consensus.cc:359] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:05.697590  7731 raft_consensus.cc:385] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:05.698009  7731 raft_consensus.cc:740] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:05.704238  7357 catalog_manager.cc:5697] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 0 to 1, leader changed from <none> to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 1 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:05.723011  7734 tablet_bootstrap.cc:654] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:05.711617  7357 catalog_manager.cc:5697] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 0 to 1, leader changed from <none> to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 1 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:05.723721  7729 ts_tablet_manager.cc:1434] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.002s
I20260709 13:16:05.714596  7358 catalog_manager.cc:5697] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:05.728520  7729 tablet_bootstrap.cc:492] T d351dea40bb24488b7159df0e49bb759 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:05.733894  7730 tablet_bootstrap.cc:492] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:05.734423  7730 ts_tablet_manager.cc:1403] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.133s	user 0.010s	sys 0.023s
I20260709 13:16:05.734748  7729 tablet_bootstrap.cc:654] T d351dea40bb24488b7159df0e49bb759 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:05.738493  7795 raft_consensus.cc:493] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.738970  7795 raft_consensus.cc:515] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:05.741132  7795 leader_election.cc:290] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:05.743012  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87af8743bc441c28b895aa411d33f2a" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:05.743167  7730 raft_consensus.cc:359] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:05.743470  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87af8743bc441c28b895aa411d33f2a" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:05.743904  7730 raft_consensus.cc:385] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:05.744189  7730 raft_consensus.cc:740] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:05.744299  7682 raft_consensus.cc:2468] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 0.
W20260709 13:16:05.744556  7574 leader_election.cc:343] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:05.745427  7407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:05.745630  7574 leader_election.cc:304] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:05.746552  7795 raft_consensus.cc:2804] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:05.747108  7795 raft_consensus.cc:493] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.747496  7795 raft_consensus.cc:3060] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:05.749895  7729 tablet_bootstrap.cc:492] T d351dea40bb24488b7159df0e49bb759 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:05.750393  7729 ts_tablet_manager.cc:1403] T d351dea40bb24488b7159df0e49bb759 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.002s
I20260709 13:16:05.753095  7729 raft_consensus.cc:359] T d351dea40bb24488b7159df0e49bb759 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:05.753829  7729 raft_consensus.cc:385] T d351dea40bb24488b7159df0e49bb759 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:05.752758  7730 consensus_queue.cc:260] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:05.754086  7729 raft_consensus.cc:740] T d351dea40bb24488b7159df0e49bb759 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:05.754808  7729 consensus_queue.cc:260] T d351dea40bb24488b7159df0e49bb759 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:05.756736  7730 ts_tablet_manager.cc:1434] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 13:16:05.757450  7734 tablet_bootstrap.cc:492] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:05.757246  7795 raft_consensus.cc:515] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:05.757913  7734 ts_tablet_manager.cc:1403] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.003s
I20260709 13:16:05.760461  7795 leader_election.cc:290] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:05.760710  7734 raft_consensus.cc:359] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:05.761502  7734 raft_consensus.cc:385] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:05.761796  7734 raft_consensus.cc:740] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:05.762496  7734 consensus_queue.cc:260] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:05.763623  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87af8743bc441c28b895aa411d33f2a" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:05.764231  7682 raft_consensus.cc:3060] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:05.764806  7734 ts_tablet_manager.cc:1434] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:05.765591  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87af8743bc441c28b895aa411d33f2a" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:05.767117  7734 tablet_bootstrap.cc:492] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
W20260709 13:16:05.767580  7574 leader_election.cc:343] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:05.770028  7729 ts_tablet_manager.cc:1434] T d351dea40bb24488b7159df0e49bb759 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:16:05.773758  7729 tablet_bootstrap.cc:492] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:05.774328  7734 tablet_bootstrap.cc:654] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:05.763176  7730 tablet_bootstrap.cc:492] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:05.706156  7731 consensus_queue.cc:260] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:05.785845  7730 tablet_bootstrap.cc:654] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:05.795182  7731 ts_tablet_manager.cc:1434] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.000s
I20260709 13:16:05.797565  7731 tablet_bootstrap.cc:492] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:05.799635  7682 raft_consensus.cc:2468] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:05.801983  7734 tablet_bootstrap.cc:492] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:05.802505  7734 ts_tablet_manager.cc:1403] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.012s
I20260709 13:16:05.803121  7574 leader_election.cc:304] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:05.804450  7795 raft_consensus.cc:2804] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:05.804881  7795 raft_consensus.cc:697] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:05.805645  7734 raft_consensus.cc:359] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:05.805809  7795 consensus_queue.cc:237] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:05.806461  7734 raft_consensus.cc:385] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:05.806771  7734 raft_consensus.cc:740] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:05.807965  7729 tablet_bootstrap.cc:654] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:05.807848  7734 consensus_queue.cc:260] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:05.811520  7959 raft_consensus.cc:493] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.812245  7959 raft_consensus.cc:515] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:05.821465  7460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6382ace6264a0db74146326b719f7b" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:05.822489  7460 raft_consensus.cc:2468] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 0.
I20260709 13:16:05.825489  7500 leader_election.cc:304] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:05.826495  7731 tablet_bootstrap.cc:654] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:05.826835  7963 raft_consensus.cc:2804] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:05.827481  7963 raft_consensus.cc:493] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.827984  7963 raft_consensus.cc:3060] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:05.831895  8069 raft_consensus.cc:493] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.832612  8069 raft_consensus.cc:515] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:05.838162  7605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6382ace6264a0db74146326b719f7b" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:05.839181  7605 raft_consensus.cc:2468] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 0.
I20260709 13:16:05.845417  7460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6382ace6264a0db74146326b719f7b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:05.846226  7460 raft_consensus.cc:2468] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 0.
I20260709 13:16:05.847549  7574 leader_election.cc:304] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:05.848479  8068 raft_consensus.cc:2804] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:05.848951  8068 raft_consensus.cc:493] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.849345  8068 raft_consensus.cc:3060] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:05.831384  7959 leader_election.cc:290] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:05.852177  8069 leader_election.cc:290] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:05.854322  7527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6382ace6264a0db74146326b719f7b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:05.855989  7959 raft_consensus.cc:493] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.856685  7959 raft_consensus.cc:515] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:05.860051  7959 leader_election.cc:290] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:05.860397  7605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d351dea40bb24488b7159df0e49bb759" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:05.863207  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d351dea40bb24488b7159df0e49bb759" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:05.864424  7682 raft_consensus.cc:2468] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 0.
I20260709 13:16:05.866060  8068 raft_consensus.cc:515] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:05.866163  7500 leader_election.cc:304] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:05.866956  7605 raft_consensus.cc:2468] T d351dea40bb24488b7159df0e49bb759 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 0.
I20260709 13:16:05.868098  7968 raft_consensus.cc:2804] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:05.868474  7968 raft_consensus.cc:493] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.868772  7968 raft_consensus.cc:3060] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:05.875589  7734 ts_tablet_manager.cc:1434] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.073s	user 0.001s	sys 0.008s
I20260709 13:16:05.882100  7729 tablet_bootstrap.cc:492] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:05.888875  7729 ts_tablet_manager.cc:1403] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.115s	user 0.010s	sys 0.005s
I20260709 13:16:05.888592  7963 raft_consensus.cc:515] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:05.881994  7730 tablet_bootstrap.cc:492] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:05.889822  7730 ts_tablet_manager.cc:1403] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.127s	user 0.020s	sys 0.022s
I20260709 13:16:05.890973  7963 leader_election.cc:290] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:05.893628  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6382ace6264a0db74146326b719f7b" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:05.894217  7527 raft_consensus.cc:2393] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 382e1f4385ac4066b7098e4fd1f5df06 in current term 1: Already voted for candidate 4a0eef4c5880424694542637530b55c0 in this term.
I20260709 13:16:05.895681  7729 raft_consensus.cc:359] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:05.896433  7729 raft_consensus.cc:385] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:05.896737  7729 raft_consensus.cc:740] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:05.886930  7731 tablet_bootstrap.cc:492] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:05.898720  7731 ts_tablet_manager.cc:1403] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.101s	user 0.006s	sys 0.009s
I20260709 13:16:05.898061  7605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6382ace6264a0db74146326b719f7b" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:05.900732  7605 raft_consensus.cc:2393] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a0eef4c5880424694542637530b55c0 in current term 1: Already voted for candidate 382e1f4385ac4066b7098e4fd1f5df06 in this term.
I20260709 13:16:05.886725  7529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6382ace6264a0db74146326b719f7b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:05.903654  7529 raft_consensus.cc:2393] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 382e1f4385ac4066b7098e4fd1f5df06 in current term 1: Already voted for candidate 4a0eef4c5880424694542637530b55c0 in this term.
I20260709 13:16:05.901194  7729 consensus_queue.cc:260] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:05.888206  7734 tablet_bootstrap.cc:492] T 6a5f0a58d050468dae029bfd50e74d02 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:05.894261  7461 raft_consensus.cc:3060] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:05.886557  7460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6382ace6264a0db74146326b719f7b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:05.908697  7574 leader_election.cc:304] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:05.911854  7731 raft_consensus.cc:359] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:05.912968  7731 raft_consensus.cc:385] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:05.913365  7731 raft_consensus.cc:740] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:05.914161  7734 tablet_bootstrap.cc:654] T 6a5f0a58d050468dae029bfd50e74d02 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:05.886803  8068 leader_election.cc:290] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:05.915380  7731 consensus_queue.cc:260] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:05.917395  7731 ts_tablet_manager.cc:1434] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 13:16:05.918380  7731 tablet_bootstrap.cc:492] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:05.924893  7731 tablet_bootstrap.cc:654] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:05.927657  7358 catalog_manager.cc:5697] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:05.931816  7461 raft_consensus.cc:2468] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:05.930812  7734 tablet_bootstrap.cc:492] T 6a5f0a58d050468dae029bfd50e74d02 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:05.933280  7734 ts_tablet_manager.cc:1403] T 6a5f0a58d050468dae029bfd50e74d02 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.004s
I20260709 13:16:05.937034  7795 raft_consensus.cc:2749] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:05.937235  7729 ts_tablet_manager.cc:1434] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.001s
I20260709 13:16:05.938365  7729 tablet_bootstrap.cc:492] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:05.940698  7500 leader_election.cc:304] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 382e1f4385ac4066b7098e4fd1f5df06
I20260709 13:16:05.881131  7968 raft_consensus.cc:515] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:05.943663  7968 leader_election.cc:290] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:05.944245  7734 raft_consensus.cc:359] T 6a5f0a58d050468dae029bfd50e74d02 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:05.945083  7734 raft_consensus.cc:385] T 6a5f0a58d050468dae029bfd50e74d02 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:05.945372  7734 raft_consensus.cc:740] T 6a5f0a58d050468dae029bfd50e74d02 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:05.946213  7963 raft_consensus.cc:2804] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:05.946955  7963 raft_consensus.cc:697] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:05.947759  7605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d351dea40bb24488b7159df0e49bb759" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:05.947695  7730 raft_consensus.cc:359] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:05.950573  7730 raft_consensus.cc:385] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:05.950866  7730 raft_consensus.cc:740] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:05.951136  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d351dea40bb24488b7159df0e49bb759" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:05.951536  7730 consensus_queue.cc:260] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:05.952045  7684 raft_consensus.cc:3060] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:05.953173  7730 ts_tablet_manager.cc:1434] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.001s
I20260709 13:16:05.948019  7963 consensus_queue.cc:237] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:05.955936  7605 raft_consensus.cc:3060] T d351dea40bb24488b7159df0e49bb759 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:05.956730  7730 tablet_bootstrap.cc:492] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:05.946053  7734 consensus_queue.cc:260] T 6a5f0a58d050468dae029bfd50e74d02 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:05.969237  7870 raft_consensus.cc:493] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.969672  7684 raft_consensus.cc:2468] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:05.969942  7870 raft_consensus.cc:515] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:05.971134  7500 leader_election.cc:304] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:05.974457  7734 ts_tablet_manager.cc:1434] T 6a5f0a58d050468dae029bfd50e74d02 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.001s
I20260709 13:16:05.975574  7734 tablet_bootstrap.cc:492] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:05.978788  7963 raft_consensus.cc:2804] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:05.980784  7870 leader_election.cc:290] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:05.981539  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5f0a58d050468dae029bfd50e74d02" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
W20260709 13:16:05.983124  7574 leader_election.cc:343] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:05.983904  7963 raft_consensus.cc:697] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:05.984839  7963 consensus_queue.cc:237] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:05.985968  7358 catalog_manager.cc:5697] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a0eef4c5880424694542637530b55c0 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "4a0eef4c5880424694542637530b55c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:05.986738  7804 consensus_queue.cc:1048] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:05.986735  7729 tablet_bootstrap.cc:654] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:05.989612  7730 tablet_bootstrap.cc:654] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:05.995461  7731 tablet_bootstrap.cc:492] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:05.995927  7731 ts_tablet_manager.cc:1403] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.078s	user 0.027s	sys 0.007s
I20260709 13:16:06.001389  7734 tablet_bootstrap.cc:654] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:06.007144  7797 raft_consensus.cc:493] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.007849  7797 raft_consensus.cc:515] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:06.010779  7731 raft_consensus.cc:359] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:06.011898  7604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11909bda591f4d61a9817bd3575748b5" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:06.012473  7731 raft_consensus.cc:385] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:06.012953  7731 raft_consensus.cc:740] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:06.015998  7797 leader_election.cc:290] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:06.016249  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11909bda591f4d61a9817bd3575748b5" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:06.018253  7682 raft_consensus.cc:2393] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d54f6e4b9e604cd78c48a1828cd3b23a in current term 1: Already voted for candidate 382e1f4385ac4066b7098e4fd1f5df06 in this term.
I20260709 13:16:06.019495  7425 leader_election.cc:304] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:06.020939  7964 raft_consensus.cc:3060] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:06.020352  7731 consensus_queue.cc:260] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:06.028537  7730 tablet_bootstrap.cc:492] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:06.029063  7730 ts_tablet_manager.cc:1403] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.000s
I20260709 13:16:06.029484  7734 tablet_bootstrap.cc:492] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:06.030212  7734 ts_tablet_manager.cc:1403] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.022s
I20260709 13:16:06.033546  7734 raft_consensus.cc:359] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:06.034225  7734 raft_consensus.cc:385] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:06.034557  7734 raft_consensus.cc:740] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:06.035310  7734 consensus_queue.cc:260] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:06.036559  8072 consensus_queue.cc:1048] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:06.037426  7730 raft_consensus.cc:359] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:06.038158  7730 raft_consensus.cc:385] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:06.038442  7730 raft_consensus.cc:740] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:06.042529  7730 consensus_queue.cc:260] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:06.044672  7605 raft_consensus.cc:2468] T d351dea40bb24488b7159df0e49bb759 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:06.048729  7731 ts_tablet_manager.cc:1434] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.001s
I20260709 13:16:06.057209  7964 raft_consensus.cc:2749] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:06.057919  8075 consensus_queue.cc:1048] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:06.058425  7731 tablet_bootstrap.cc:492] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:06.058333  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5f0a58d050468dae029bfd50e74d02" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:06.059733  7684 raft_consensus.cc:2468] T 6a5f0a58d050468dae029bfd50e74d02 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 0.
I20260709 13:16:06.060449  7734 ts_tablet_manager.cc:1434] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:16:06.060968  7574 leader_election.cc:304] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:06.062193  7359 catalog_manager.cc:5697] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a0eef4c5880424694542637530b55c0 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "4a0eef4c5880424694542637530b55c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:06.064128  7870 raft_consensus.cc:2804] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:06.064532  7870 raft_consensus.cc:493] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.064880  7870 raft_consensus.cc:3060] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:06.061815  7734 tablet_bootstrap.cc:492] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:06.075521  7729 tablet_bootstrap.cc:492] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:06.076072  7729 ts_tablet_manager.cc:1403] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.138s	user 0.011s	sys 0.009s
I20260709 13:16:06.078889  7729 raft_consensus.cc:359] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:06.079734  7729 raft_consensus.cc:385] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:06.080020  7729 raft_consensus.cc:740] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:06.081108  7729 consensus_queue.cc:260] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:06.083211  7729 ts_tablet_manager.cc:1434] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:06.092772  7729 tablet_bootstrap.cc:492] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:06.095976  7870 raft_consensus.cc:515] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:06.087087  7734 tablet_bootstrap.cc:654] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:06.102773  7870 leader_election.cc:290] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:06.104283  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5f0a58d050468dae029bfd50e74d02" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:06.104920  7684 raft_consensus.cc:3060] T 6a5f0a58d050468dae029bfd50e74d02 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:06.105557  7730 ts_tablet_manager.cc:1434] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.007s
I20260709 13:16:06.106619  7730 tablet_bootstrap.cc:492] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:06.107829  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5f0a58d050468dae029bfd50e74d02" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
W20260709 13:16:06.109206  7574 leader_election.cc:343] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:06.090114  7731 tablet_bootstrap.cc:654] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:06.116034  7684 raft_consensus.cc:2468] T 6a5f0a58d050468dae029bfd50e74d02 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:06.117280  7574 leader_election.cc:304] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:06.118350  7729 tablet_bootstrap.cc:654] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:06.119333  8069 raft_consensus.cc:2804] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:06.119977  8069 raft_consensus.cc:697] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:06.120977  8069 consensus_queue.cc:237] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:06.147339  7804 raft_consensus.cc:493] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.147977  7804 raft_consensus.cc:515] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:06.166381  7730 tablet_bootstrap.cc:654] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:06.183900  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2234d05a2ffa48c18ad9af837d067f5a" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:06.172387  8073 consensus_queue.cc:1048] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
W20260709 13:16:06.191464  7648 leader_election.cc:343] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:06.196915  8068 consensus_queue.cc:1048] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:06.222118  8068 consensus_queue.cc:1048] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:06.225987  8073 raft_consensus.cc:493] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.235873  7804 leader_election.cc:290] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:06.227818  8075 raft_consensus.cc:493] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.238478  8075 raft_consensus.cc:515] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:06.244395  8075 leader_election.cc:290] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:06.246055  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1e31a4767d403688a20b985eb0ab79" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:06.249405  7529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1e31a4767d403688a20b985eb0ab79" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
W20260709 13:16:06.250877  7650 leader_election.cc:343] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:06.251995  7870 consensus_queue.cc:1048] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:06.252902  7734 tablet_bootstrap.cc:492] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:06.253115  7731 tablet_bootstrap.cc:492] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:06.253417  7734 ts_tablet_manager.cc:1403] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.192s	user 0.010s	sys 0.012s
I20260709 13:16:06.253568  7731 ts_tablet_manager.cc:1403] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.195s	user 0.015s	sys 0.014s
I20260709 13:16:06.256702  7734 raft_consensus.cc:359] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
W20260709 13:16:06.257174  7647 leader_election.cc:343] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:06.257465  7734 raft_consensus.cc:385] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:06.257764  7734 raft_consensus.cc:740] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:06.257719  7647 leader_election.cc:304] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0
I20260709 13:16:06.260164  7731 raft_consensus.cc:359] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:06.260983  7731 raft_consensus.cc:385] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:06.237586  7527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2234d05a2ffa48c18ad9af837d067f5a" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:06.261271  7731 raft_consensus.cc:740] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:06.259146  8072 raft_consensus.cc:2749] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:06.264092  7734 consensus_queue.cc:260] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:06.267050  7731 consensus_queue.cc:260] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:06.240653  8073 raft_consensus.cc:515] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:06.275722  8026 raft_consensus.cc:493] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:06.280177  7650 leader_election.cc:343] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:06.281291  7650 leader_election.cc:304] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:06.287437  7734 ts_tablet_manager.cc:1434] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.002s
I20260709 13:16:06.291823  7731 ts_tablet_manager.cc:1434] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:16:06.294713  7734 tablet_bootstrap.cc:492] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342: Bootstrap starting.
I20260709 13:16:06.284507  8075 raft_consensus.cc:2749] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:06.283913  8026 raft_consensus.cc:515] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:06.298832  8026 leader_election.cc:290] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:06.314478  7797 raft_consensus.cc:493] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.314939  7797 raft_consensus.cc:515] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:06.315819  7734 tablet_bootstrap.cc:654] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:06.316818  7797 leader_election.cc:290] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:06.317480  7529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560149675ca410fa6cbef0e9eb5bb22" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:06.319392  7527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e442d8263394fa7bd9df6ee46bb246e" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:06.320051  7527 raft_consensus.cc:2468] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:16:06.321969  7731 tablet_bootstrap.cc:492] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:06.322997  7729 tablet_bootstrap.cc:492] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:06.323495  7729 ts_tablet_manager.cc:1403] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.231s	user 0.045s	sys 0.043s
I20260709 13:16:06.322088  7357 catalog_manager.cc:5697] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:06.337321  7729 raft_consensus.cc:359] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:06.338060  7729 raft_consensus.cc:385] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:06.338312  7729 raft_consensus.cc:740] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:06.338961  7729 consensus_queue.cc:260] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:06.340984  7729 ts_tablet_manager.cc:1434] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:16:06.341048  8073 leader_election.cc:290] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
W20260709 13:16:06.341935  7427 leader_election.cc:343] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:06.342623  7427 leader_election.cc:304] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:06.343407  8077 raft_consensus.cc:2804] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:06.343896  8077 raft_consensus.cc:493] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.344331  8077 raft_consensus.cc:3060] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:06.352922  7730 tablet_bootstrap.cc:492] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:06.353600  7730 ts_tablet_manager.cc:1403] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.247s	user 0.014s	sys 0.010s
I20260709 13:16:06.361835  7730 raft_consensus.cc:359] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:06.372000  7730 raft_consensus.cc:385] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:06.372319  7730 raft_consensus.cc:740] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:06.376092  7730 consensus_queue.cc:260] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:06.378822  7730 ts_tablet_manager.cc:1434] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 13:16:06.379817  7730 tablet_bootstrap.cc:492] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:06.380462  7729 tablet_bootstrap.cc:492] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:06.367760  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560149675ca410fa6cbef0e9eb5bb22" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:06.384266  7608 raft_consensus.cc:2468] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
W20260709 13:16:06.385648  7574 consensus_peers.cc:597] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:06.387177  7604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81671c7a827b47caac30f622c4407bf4" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:06.349748  8073 raft_consensus.cc:493] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.393028  8073 raft_consensus.cc:515] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:06.397228  7424 leader_election.cc:304] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:16:06.401383  8073 leader_election.cc:290] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:06.406632  7750 raft_consensus.cc:2804] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:06.408293  7729 tablet_bootstrap.cc:654] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:06.407070  7750 raft_consensus.cc:493] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.411373  7750 raft_consensus.cc:3060] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:06.413977  7730 tablet_bootstrap.cc:654] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:06.431526  7647 leader_election.cc:343] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:06.421576  8077 raft_consensus.cc:515] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:06.467525  8124 raft_consensus.cc:493] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.477308  7533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0433292c261b4a29b57235e8647c5db8" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:06.481074  7734 tablet_bootstrap.cc:492] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342: No bootstrap required, opened a new log
I20260709 13:16:06.481587  7734 ts_tablet_manager.cc:1403] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342: Time spent bootstrapping tablet: real 0.187s	user 0.024s	sys 0.038s
I20260709 13:16:06.492483  7734 raft_consensus.cc:359] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:06.493271  7734 raft_consensus.cc:385] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:06.493527  7734 raft_consensus.cc:740] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Initialized, Role: FOLLOWER
I20260709 13:16:06.494038  7750 raft_consensus.cc:515] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:06.494148  7734 consensus_queue.cc:260] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:06.495059  7731 tablet_bootstrap.cc:654] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:06.462615  7604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0433292c261b4a29b57235e8647c5db8" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:06.500938  7734 ts_tablet_manager.cc:1434] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.005s
W20260709 13:16:06.501281  7648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:35515, user_credentials={real_user=slave}} blocked reactor thread for 168159us
I20260709 13:16:06.503672  7750 leader_election.cc:290] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:06.505178  7610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560149675ca410fa6cbef0e9eb5bb22" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:06.505769  7610 raft_consensus.cc:3060] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:06.487128  8124 raft_consensus.cc:515] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:06.514268  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e442d8263394fa7bd9df6ee46bb246e" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:06.514974  7682 raft_consensus.cc:2468] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:16:06.520916  7610 raft_consensus.cc:2468] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:06.512068  8073 raft_consensus.cc:493] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.522974  7424 leader_election.cc:304] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:06.528281  8077 leader_election.cc:290] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:06.529454  7729 tablet_bootstrap.cc:492] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:06.532325  7729 ts_tablet_manager.cc:1403] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.152s	user 0.013s	sys 0.018s
W20260709 13:16:06.532552  7647 leader_election.cc:343] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:06.535921  7964 raft_consensus.cc:2804] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:06.554481  7730 tablet_bootstrap.cc:492] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:06.555032  7730 ts_tablet_manager.cc:1403] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.175s	user 0.013s	sys 0.027s
I20260709 13:16:06.555595  7964 raft_consensus.cc:697] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:06.558952  7964 consensus_queue.cc:237] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:06.538286  8073 raft_consensus.cc:515] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:06.563578  7681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e442d8263394fa7bd9df6ee46bb246e" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:06.570454  7963 consensus_queue.cc:1048] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:16:06.572419  7681 raft_consensus.cc:3060] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:06.593760  7729 raft_consensus.cc:359] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:06.595604  7730 raft_consensus.cc:359] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:06.603531  7729 raft_consensus.cc:385] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:06.603636  7730 raft_consensus.cc:385] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:06.603931  7729 raft_consensus.cc:740] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:06.604214  7730 raft_consensus.cc:740] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:06.607546  7730 consensus_queue.cc:260] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:06.612660  7729 consensus_queue.cc:260] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
W20260709 13:16:06.621788  7650 leader_election.cc:343] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:06.622506  7650 leader_election.cc:304] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0
I20260709 13:16:06.618759  7528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560149675ca410fa6cbef0e9eb5bb22" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:06.624751  7730 ts_tablet_manager.cc:1434] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 13:16:06.629835  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e442d8263394fa7bd9df6ee46bb246e" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:06.630654  7534 raft_consensus.cc:3060] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:06.627540  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50e7db706514f8bb0b8885fca0868d3" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:06.631975  8072 raft_consensus.cc:2749] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:06.632140  7684 raft_consensus.cc:2468] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 0.
I20260709 13:16:06.627739  7528 raft_consensus.cc:3060] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:06.614688  8124 leader_election.cc:290] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
W20260709 13:16:06.642249  7574 consensus_peers.cc:597] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:06.644088  7730 tablet_bootstrap.cc:492] T bf1e31a4767d403688a20b985eb0ab79 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:06.648406  7731 tablet_bootstrap.cc:492] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:06.649012  7731 ts_tablet_manager.cc:1403] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.327s	user 0.022s	sys 0.021s
I20260709 13:16:06.649168  8073 leader_election.cc:290] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:06.653200  7729 ts_tablet_manager.cc:1434] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.120s	user 0.005s	sys 0.003s
I20260709 13:16:06.659505  7681 raft_consensus.cc:2468] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:06.661049  8069 raft_consensus.cc:493] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.661562  8069 raft_consensus.cc:515] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:06.662062  7731 raft_consensus.cc:359] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:06.662743  7731 raft_consensus.cc:385] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:06.662994  7731 raft_consensus.cc:740] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:06.665683  7731 consensus_queue.cc:260] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:06.663754  8069 leader_election.cc:290] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:06.664390  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81671c7a827b47caac30f622c4407bf4" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:06.668246  7458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4267f73a67486e8568dfa6c4a0bd7b" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:06.670954  7731 ts_tablet_manager.cc:1434] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 13:16:06.673203  7731 tablet_bootstrap.cc:492] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:06.674314  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1e31a4767d403688a20b985eb0ab79" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:06.675019  7684 raft_consensus.cc:2468] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 0.
I20260709 13:16:06.667723  7425 leader_election.cc:304] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:06.680413  7534 raft_consensus.cc:2468] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:06.681536  7750 raft_consensus.cc:2804] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:06.682046  7750 raft_consensus.cc:697] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:06.682956  7750 consensus_queue.cc:237] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
W20260709 13:16:06.684026  7648 leader_election.cc:343] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:06.684684  7648 leader_election.cc:304] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
W20260709 13:16:06.685608  7648 leader_election.cc:343] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:06.693095  8073 raft_consensus.cc:2749] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:06.707039  7729 tablet_bootstrap.cc:492] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:06.712231  7731 tablet_bootstrap.cc:654] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:06.677415  7574 leader_election.cc:304] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:06.704617  7604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4267f73a67486e8568dfa6c4a0bd7b" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:06.732187  7359 catalog_manager.cc:5697] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 0 to 1, leader changed from <none> to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:06.734406  7647 leader_election.cc:343] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:06.734858  7647 leader_election.cc:304] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:06.737907  8140 raft_consensus.cc:2749] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:06.740764  8143 raft_consensus.cc:2804] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:06.741357  8143 raft_consensus.cc:493] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.741839  8143 raft_consensus.cc:3060] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:06.681408  7499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:46815, user_credentials={real_user=slave}} blocked reactor thread for 91394.2us
I20260709 13:16:06.725411  7500 leader_election.cc:304] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:06.727613  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50e7db706514f8bb0b8885fca0868d3" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:06.730873  7528 raft_consensus.cc:2468] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
W20260709 13:16:06.762308  7650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:45835, user_credentials={real_user=slave}} blocked reactor thread for 134715us
I20260709 13:16:06.764503  7959 raft_consensus.cc:2804] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:06.764950  7959 raft_consensus.cc:493] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:06.751503  7574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.132:35931, user_credentials={real_user=slave}} blocked reactor thread for 74045.4us
I20260709 13:16:06.721974  7729 tablet_bootstrap.cc:654] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:06.759389  7730 tablet_bootstrap.cc:654] T bf1e31a4767d403688a20b985eb0ab79 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:06.765285  7959 raft_consensus.cc:3060] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:06.765969  8145 raft_consensus.cc:493] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.766117  8124 consensus_queue.cc:1048] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:06.764083  8126 raft_consensus.cc:493] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.913869  8126 raft_consensus.cc:515] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:06.761399  7750 raft_consensus.cc:493] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.915588  7750 raft_consensus.cc:515] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:06.918026  7750 leader_election.cc:290] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
W20260709 13:16:06.887539  7650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:45835, user_credentials={real_user=slave}} blocked reactor thread for 110585us
I20260709 13:16:06.898131  7359 catalog_manager.cc:5697] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 0 to 1, leader changed from <none> to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:06.782160  8145 raft_consensus.cc:515] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:06.903430  8154 consensus_queue.cc:1048] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:06.905026  7731 tablet_bootstrap.cc:492] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:06.921412  7731 ts_tablet_manager.cc:1403] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.248s	user 0.016s	sys 0.007s
I20260709 13:16:06.905761  8143 raft_consensus.cc:515] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
W20260709 13:16:06.906836  7574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:35931, user_credentials={real_user=slave}} blocked reactor thread for 132282us
I20260709 13:16:06.922186  7461 raft_consensus.cc:2468] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 0.
I20260709 13:16:06.934756  8134 raft_consensus.cc:493] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.935325  8134 raft_consensus.cc:515] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:06.925530  7731 raft_consensus.cc:359] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:06.936748  7731 raft_consensus.cc:385] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:06.912228  8069 consensus_queue.cc:1048] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:06.940253  7731 raft_consensus.cc:740] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:06.924417  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50e7db706514f8bb0b8885fca0868d3" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:06.941977  7682 raft_consensus.cc:2468] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:16:06.939769  8145 leader_election.cc:290] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:06.947209  8143 leader_election.cc:290] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:06.941618  7731 consensus_queue.cc:260] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:06.947575  7458 raft_consensus.cc:3060] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:06.949117  7731 ts_tablet_manager.cc:1434] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.004s
I20260709 13:16:06.950158  7731 tablet_bootstrap.cc:492] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:06.939482  8134 leader_election.cc:290] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:06.953104  8126 leader_election.cc:290] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:06.885861  7870 raft_consensus.cc:493] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.954919  7870 raft_consensus.cc:515] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:06.958325  7870 leader_election.cc:290] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
W20260709 13:16:06.910349  7499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:46815, user_credentials={real_user=slave}} blocked reactor thread for 135119us
I20260709 13:16:06.964447  7425 leader_election.cc:304] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:06.966022  7750 raft_consensus.cc:2804] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:06.966383  7750 raft_consensus.cc:493] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.966799  7750 raft_consensus.cc:3060] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:06.971742  7407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:06.979148  7683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1e31a4767d403688a20b985eb0ab79" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:06.979924  7683 raft_consensus.cc:3060] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:06.980216  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0433292c261b4a29b57235e8647c5db8" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:06.980891  7679 raft_consensus.cc:2468] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 0.
I20260709 13:16:06.892164  7959 raft_consensus.cc:515] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:06.983865  7959 leader_election.cc:290] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:06.987541  7457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6621f1923f4b5b9885003705a57309" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:06.987962  7731 tablet_bootstrap.cc:654] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:06.988296  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce18aefbfb644eeab2cfc05f961b1771" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:06.989234  7455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560149675ca410fa6cbef0e9eb5bb22" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
W20260709 13:16:06.994773  7648 leader_election.cc:343] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:06.996269  7574 leader_election.cc:304] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:07.000349  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560149675ca410fa6cbef0e9eb5bb22" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:07.013425  7607 raft_consensus.cc:2468] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:06.997298  7959 consensus_queue.cc:1048] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:16:07.003125  8068 raft_consensus.cc:2804] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:07.019610  8068 raft_consensus.cc:493] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.019997  8068 raft_consensus.cc:3060] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:07.012108  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6621f1923f4b5b9885003705a57309" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:07.033028  7460 raft_consensus.cc:3060] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:07.036005  7729 tablet_bootstrap.cc:492] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:07.036330  7455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50e7db706514f8bb0b8885fca0868d3" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:07.042227  7683 raft_consensus.cc:2468] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:07.044975  7528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50e7db706514f8bb0b8885fca0868d3" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:07.066999  7730 tablet_bootstrap.cc:492] T bf1e31a4767d403688a20b985eb0ab79 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:07.067915  7730 ts_tablet_manager.cc:1403] T bf1e31a4767d403688a20b985eb0ab79 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.424s	user 0.018s	sys 0.015s
I20260709 13:16:07.048859  7729 ts_tablet_manager.cc:1403] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.342s	user 0.006s	sys 0.012s
I20260709 13:16:07.050203  7750 raft_consensus.cc:515] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:07.080763  7574 leader_election.cc:304] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:07.081655  7795 raft_consensus.cc:2804] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:07.082284  7795 raft_consensus.cc:697] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:07.083279  7795 consensus_queue.cc:237] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:07.098333  7750 leader_election.cc:290] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:07.076835  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50e7db706514f8bb0b8885fca0868d3" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:07.103329  7528 raft_consensus.cc:2393] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d54f6e4b9e604cd78c48a1828cd3b23a in current term 1: Already voted for candidate 4a0eef4c5880424694542637530b55c0 in this term.
I20260709 13:16:07.112161  7455 raft_consensus.cc:2393] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a0eef4c5880424694542637530b55c0 in current term 1: Already voted for candidate d54f6e4b9e604cd78c48a1828cd3b23a in this term.
I20260709 13:16:07.116693  7530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce18aefbfb644eeab2cfc05f961b1771" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:07.112409  7679 raft_consensus.cc:3060] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:07.113011  7683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50e7db706514f8bb0b8885fca0868d3" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
W20260709 13:16:07.135365  7650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:45835, user_credentials={real_user=slave}} blocked reactor thread for 83857.2us
W20260709 13:16:07.120401  7500 leader_election.cc:343] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:07.152791  7750 consensus_queue.cc:1048] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:07.164417  7731 tablet_bootstrap.cc:492] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:07.165164  7731 ts_tablet_manager.cc:1403] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.215s	user 0.025s	sys 0.031s
W20260709 13:16:07.179657  7650 leader_election.cc:343] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:07.180152  7650 leader_election.cc:304] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:07.183382  7804 raft_consensus.cc:2749] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:07.185690  8158 log.cc:927] Time spent T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:16:07.192384  7729 raft_consensus.cc:359] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:07.200803  7729 raft_consensus.cc:385] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:07.201121  7729 raft_consensus.cc:740] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:07.192803  7535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50e7db706514f8bb0b8885fca0868d3" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:07.193456  7730 raft_consensus.cc:359] T bf1e31a4767d403688a20b985eb0ab79 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:07.201932  7730 raft_consensus.cc:385] T bf1e31a4767d403688a20b985eb0ab79 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:07.198161  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1e31a4767d403688a20b985eb0ab79" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:07.198589  7528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0433292c261b4a29b57235e8647c5db8" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:07.196789  7499 leader_election.cc:304] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:07.202607  7730 raft_consensus.cc:740] T bf1e31a4767d403688a20b985eb0ab79 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:07.204258  7730 consensus_queue.cc:260] T bf1e31a4767d403688a20b985eb0ab79 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:07.205026  7534 raft_consensus.cc:3060] T bf1e31a4767d403688a20b985eb0ab79 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:07.206728  7531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1e31a4767d403688a20b985eb0ab79" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:07.205724  7729 consensus_queue.cc:260] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:07.184558  8068 raft_consensus.cc:515] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:07.208410  8145 raft_consensus.cc:2804] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:07.208858  8145 raft_consensus.cc:493] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.209069  7729 ts_tablet_manager.cc:1434] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.139s	user 0.004s	sys 0.002s
I20260709 13:16:07.209234  8145 raft_consensus.cc:3060] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:07.209973  8068 leader_election.cc:290] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:07.211901  7535 raft_consensus.cc:2393] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d54f6e4b9e604cd78c48a1828cd3b23a in current term 1: Already voted for candidate 4a0eef4c5880424694542637530b55c0 in this term.
I20260709 13:16:07.211747  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0433292c261b4a29b57235e8647c5db8" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:07.212654  7684 raft_consensus.cc:3060] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:07.222016  7731 raft_consensus.cc:359] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:07.222819  7731 raft_consensus.cc:385] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:07.224267  7729 tablet_bootstrap.cc:492] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:07.232244  8148 consensus_queue.cc:1048] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:07.223084  7731 raft_consensus.cc:740] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:07.297806  7731 consensus_queue.cc:260] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:07.299806  7731 ts_tablet_manager.cc:1434] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.134s	user 0.010s	sys 0.002s
I20260709 13:16:07.304877  7534 raft_consensus.cc:2468] T bf1e31a4767d403688a20b985eb0ab79 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
W20260709 13:16:07.306434  7648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:35515, user_credentials={real_user=slave}} blocked reactor thread for 62663.3us
W20260709 13:16:07.313350  7576 leader_election.cc:343] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:07.316982  7730 ts_tablet_manager.cc:1434] T bf1e31a4767d403688a20b985eb0ab79 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.249s	user 0.006s	sys 0.005s
W20260709 13:16:07.319484  7647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:46815, user_credentials={real_user=slave}} blocked reactor thread for 70056.4us
W20260709 13:16:07.318974  7499 leader_election.cc:343] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:07.375823  7499 leader_election.cc:304] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
W20260709 13:16:07.380303  7499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:46815, user_credentials={real_user=slave}} blocked reactor thread for 127225us
W20260709 13:16:07.316687  7427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:45835, user_credentials={real_user=slave}} blocked reactor thread for 102248us
I20260709 13:16:07.420027  7731 tablet_bootstrap.cc:492] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
W20260709 13:16:07.462325  8165 log.cc:927] Time spent T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:16:07.507907  7729 tablet_bootstrap.cc:700] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent opening tablet: real 0.155s	user 0.005s	sys 0.014s
I20260709 13:16:07.508085  7684 raft_consensus.cc:2468] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:07.508616  7729 tablet_bootstrap.cc:654] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:07.519456  7730 tablet_bootstrap.cc:492] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:07.521168  7797 consensus_queue.cc:1048] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:07.521884  7679 raft_consensus.cc:2468] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:07.523902  8145 raft_consensus.cc:515] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:07.523000  7427 leader_election.cc:304] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:07.539909  8170 raft_consensus.cc:2749] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:16:07.550239  7650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:45835, user_credentials={real_user=slave}} blocked reactor thread for 242405us
I20260709 13:16:07.579356  8145 leader_election.cc:290] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:07.591753  8124 raft_consensus.cc:2749] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:07.600247  7729 tablet_bootstrap.cc:492] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:07.600916  7729 ts_tablet_manager.cc:1403] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.377s	user 0.010s	sys 0.028s
W20260709 13:16:07.601845  7425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:35931, user_credentials={real_user=slave}} blocked reactor thread for 63386us
I20260709 13:16:07.601874  7731 tablet_bootstrap.cc:654] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:07.611171  7357 catalog_manager.cc:5697] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:07.608820  7730 tablet_bootstrap.cc:654] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:07.622745  7500 leader_election.cc:304] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:07.617950  7797 raft_consensus.cc:493] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.624744  8145 raft_consensus.cc:2804] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:07.624841  7797 raft_consensus.cc:515] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:07.625479  8145 raft_consensus.cc:697] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:07.627023  7797 leader_election.cc:290] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:07.636243  7729 raft_consensus.cc:359] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
W20260709 13:16:07.637449  7499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:46815, user_credentials={real_user=slave}} blocked reactor thread for 256162us
I20260709 13:16:07.645882  7729 raft_consensus.cc:385] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:07.646247  7729 raft_consensus.cc:740] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:07.647070  7729 consensus_queue.cc:260] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
W20260709 13:16:07.655360  7650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:45835, user_credentials={real_user=slave}} blocked reactor thread for 53344.2us
I20260709 13:16:07.669183  8145 consensus_queue.cc:237] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:07.671424  7456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560149675ca410fa6cbef0e9eb5bb22" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:07.677469  7729 ts_tablet_manager.cc:1434] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.002s
I20260709 13:16:07.685343  7609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29addb5a68094e16887e2c843d5b1ef5" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:07.685945  7534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0433292c261b4a29b57235e8647c5db8" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:07.679057  7729 tablet_bootstrap.cc:492] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:07.703953  7574 leader_election.cc:304] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:07.707394  8069 raft_consensus.cc:493] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.708068  8143 raft_consensus.cc:2804] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:07.708854  8143 raft_consensus.cc:697] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:07.710341  7729 tablet_bootstrap.cc:654] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:07.710038  8143 consensus_queue.cc:237] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:07.712704  7602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560149675ca410fa6cbef0e9eb5bb22" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:07.707959  8069 raft_consensus.cc:515] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:07.742486  8069 leader_election.cc:290] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:07.742647  7730 tablet_bootstrap.cc:492] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:07.743986  7730 ts_tablet_manager.cc:1403] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.225s	user 0.015s	sys 0.023s
I20260709 13:16:07.747677  7730 raft_consensus.cc:359] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:07.756915  7730 raft_consensus.cc:385] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:07.757467  7730 raft_consensus.cc:740] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:07.758455  7730 consensus_queue.cc:260] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
W20260709 13:16:07.790596  7424 leader_election.cc:343] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:07.804540  7730 ts_tablet_manager.cc:1434] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:16:07.814211  7532 raft_consensus.cc:1240] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Rejecting Update request from peer d54f6e4b9e604cd78c48a1828cd3b23a for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:07.816987  7529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29addb5a68094e16887e2c843d5b1ef5" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:07.819623  7461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81671c7a827b47caac30f622c4407bf4" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:07.821130  7730 tablet_bootstrap.cc:492] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:07.821763  7731 tablet_bootstrap.cc:492] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:07.822225  7731 ts_tablet_manager.cc:1403] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.497s	user 0.010s	sys 0.011s
I20260709 13:16:07.828574  7730 tablet_bootstrap.cc:654] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:07.829190  7499 leader_election.cc:304] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:07.830143  8154 raft_consensus.cc:2749] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:07.830725  7729 tablet_bootstrap.cc:492] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:07.831284  7729 ts_tablet_manager.cc:1403] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.153s	user 0.019s	sys 0.008s
W20260709 13:16:07.827008  7576 leader_election.cc:343] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:07.834087  7729 raft_consensus.cc:359] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:07.834813  7729 raft_consensus.cc:385] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:07.835088  7729 raft_consensus.cc:740] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
W20260709 13:16:07.841271  7574 leader_election.cc:343] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:07.843490  7729 consensus_queue.cc:260] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
W20260709 13:16:07.847725  7427 leader_election.cc:343] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:07.848433  7427 leader_election.cc:304] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0
I20260709 13:16:07.847594  8077 consensus_queue.cc:1059] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:07.849675  8077 raft_consensus.cc:2749] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:07.850055  7797 raft_consensus.cc:3055] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:07.850451  7797 raft_consensus.cc:740] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:07.851181  7797 consensus_queue.cc:260] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:07.852422  7797 raft_consensus.cc:3060] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:07.857020  7731 raft_consensus.cc:359] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:07.858544  7729 ts_tablet_manager.cc:1434] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:16:07.859680  8153 consensus_queue.cc:1048] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:07.865442  7730 tablet_bootstrap.cc:492] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:07.869069  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81671c7a827b47caac30f622c4407bf4" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:07.872210  7730 ts_tablet_manager.cc:1403] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.004s
I20260709 13:16:07.873731  7731 raft_consensus.cc:385] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:07.874114  7731 raft_consensus.cc:740] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:07.872277  7680 raft_consensus.cc:2468] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 0.
I20260709 13:16:07.874864  7731 consensus_queue.cc:260] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:07.874971  7730 raft_consensus.cc:359] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:07.875739  7730 raft_consensus.cc:385] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:07.876029  7730 raft_consensus.cc:740] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:07.876659  7730 consensus_queue.cc:260] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:07.881176  7729 tablet_bootstrap.cc:492] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06: Bootstrap starting.
I20260709 13:16:07.883921  7731 ts_tablet_manager.cc:1434] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.003s
I20260709 13:16:07.886336  8152 raft_consensus.cc:493] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.886866  8152 raft_consensus.cc:515] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:07.888950  7730 ts_tablet_manager.cc:1434] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:16:07.892246  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0433292c261b4a29b57235e8647c5db8" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:07.889966  8152 leader_election.cc:290] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:07.891317  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0433292c261b4a29b57235e8647c5db8" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:07.893157  7680 raft_consensus.cc:2393] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a0eef4c5880424694542637530b55c0 in current term 1: Already voted for candidate 382e1f4385ac4066b7098e4fd1f5df06 in this term.
I20260709 13:16:07.895509  7499 leader_election.cc:304] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:07.897111  8152 raft_consensus.cc:3060] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:07.897255  7730 tablet_bootstrap.cc:492] T 29addb5a68094e16887e2c843d5b1ef5 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:07.902921  8153 raft_consensus.cc:493] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.903550  8153 raft_consensus.cc:515] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:07.905911  7730 tablet_bootstrap.cc:654] T 29addb5a68094e16887e2c843d5b1ef5 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:07.906204  8153 leader_election.cc:290] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:07.906891  7459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6621f1923f4b5b9885003705a57309" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:07.907598  7459 raft_consensus.cc:2468] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 0.
I20260709 13:16:07.908921  7574 leader_election.cc:304] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:07.910244  8153 raft_consensus.cc:2804] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:07.910773  8153 raft_consensus.cc:493] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.911181  8153 raft_consensus.cc:3060] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:07.918985  7529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6621f1923f4b5b9885003705a57309" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:07.919799  7529 raft_consensus.cc:2468] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 0.
I20260709 13:16:07.925844  7731 tablet_bootstrap.cc:492] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:07.897058  7729 tablet_bootstrap.cc:654] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:07.946627  8145 raft_consensus.cc:493] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.947391  8145 raft_consensus.cc:515] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:07.950075  8145 leader_election.cc:290] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:07.950852  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2234d05a2ffa48c18ad9af837d067f5a" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:07.951527  7680 raft_consensus.cc:2468] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 0.
I20260709 13:16:07.951862  7459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2234d05a2ffa48c18ad9af837d067f5a" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:07.957031  7574 leader_election.cc:304] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:07.958714  7795 raft_consensus.cc:2804] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:07.959182  7795 raft_consensus.cc:493] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.959650  7795 raft_consensus.cc:3060] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:07.961707  7870 consensus_queue.cc:1048] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:16:07.952666  7500 leader_election.cc:304] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
W20260709 13:16:07.973661  7500 leader_election.cc:343] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:07.973886  8145 raft_consensus.cc:2804] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:07.974452  8145 raft_consensus.cc:493] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.974849  8145 raft_consensus.cc:3060] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:07.979339  8152 raft_consensus.cc:2749] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:07.992512  7357 catalog_manager.cc:5697] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:08.007723  7795 raft_consensus.cc:515] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:08.010109  8145 raft_consensus.cc:515] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:08.013291  7729 tablet_bootstrap.cc:492] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06: No bootstrap required, opened a new log
I20260709 13:16:08.014772  7729 ts_tablet_manager.cc:1403] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06: Time spent bootstrapping tablet: real 0.134s	user 0.011s	sys 0.004s
I20260709 13:16:08.016824  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81671c7a827b47caac30f622c4407bf4" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:08.017580  7682 raft_consensus.cc:3060] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:08.021306  7731 tablet_bootstrap.cc:654] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:08.011571  8153 raft_consensus.cc:515] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:08.024447  7459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6621f1923f4b5b9885003705a57309" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:08.025085  7459 raft_consensus.cc:3060] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:08.024835  7729 raft_consensus.cc:359] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:08.025767  7729 raft_consensus.cc:385] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:08.026351  7729 raft_consensus.cc:740] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Initialized, Role: FOLLOWER
I20260709 13:16:08.027155  7729 consensus_queue.cc:260] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:08.029938  7729 ts_tablet_manager.cc:1434] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:16:08.030917  7529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6621f1923f4b5b9885003705a57309" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:08.028415  8153 leader_election.cc:290] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:08.031625  7529 raft_consensus.cc:3060] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:08.035498  7456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81671c7a827b47caac30f622c4407bf4" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
W20260709 13:16:08.037235  7574 leader_election.cc:343] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:08.037817  7795 leader_election.cc:290] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:08.028434  7682 raft_consensus.cc:2468] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:08.029749  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2234d05a2ffa48c18ad9af837d067f5a" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:08.039572  7574 leader_election.cc:304] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:08.039875  8145 leader_election.cc:290] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:08.041114  7456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2234d05a2ffa48c18ad9af837d067f5a" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
W20260709 13:16:08.043277  7407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:16:08.043161  7500 leader_election.cc:343] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:08.039608  7684 raft_consensus.cc:3060] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:08.050590  7459 raft_consensus.cc:2468] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:08.056921  8153 raft_consensus.cc:493] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.057587  8153 raft_consensus.cc:515] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:08.040697  7795 raft_consensus.cc:2804] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:08.058846  7795 raft_consensus.cc:697] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:08.062476  7456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29addb5a68094e16887e2c843d5b1ef5" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:08.063127  7456 raft_consensus.cc:2468] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 0.
I20260709 13:16:08.064232  7574 leader_election.cc:304] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:08.065181  8184 raft_consensus.cc:2804] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:08.065543  8184 raft_consensus.cc:493] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.065881  8184 raft_consensus.cc:3060] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:08.059767  8153 leader_election.cc:290] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:08.066991  7530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29addb5a68094e16887e2c843d5b1ef5" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
W20260709 13:16:08.072023  7576 leader_election.cc:343] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:08.067713  7359 catalog_manager.cc:5697] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a0eef4c5880424694542637530b55c0 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "4a0eef4c5880424694542637530b55c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:08.096028  8152 consensus_queue.cc:1048] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:08.096626  7730 tablet_bootstrap.cc:492] T 29addb5a68094e16887e2c843d5b1ef5 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:08.097162  7730 ts_tablet_manager.cc:1403] T 29addb5a68094e16887e2c843d5b1ef5 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.204s	user 0.029s	sys 0.056s
I20260709 13:16:08.061014  7795 consensus_queue.cc:237] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:08.102865  7529 raft_consensus.cc:2468] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:08.116179  7684 raft_consensus.cc:2468] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:08.118690  7730 raft_consensus.cc:359] T 29addb5a68094e16887e2c843d5b1ef5 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:08.119596  7730 raft_consensus.cc:385] T 29addb5a68094e16887e2c843d5b1ef5 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:08.119889  7730 raft_consensus.cc:740] T 29addb5a68094e16887e2c843d5b1ef5 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:08.120522  7730 consensus_queue.cc:260] T 29addb5a68094e16887e2c843d5b1ef5 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:08.123869  7730 ts_tablet_manager.cc:1434] T 29addb5a68094e16887e2c843d5b1ef5 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:16:08.114681  7574 leader_election.cc:304] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:08.129791  8153 raft_consensus.cc:2804] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:08.166149  8153 raft_consensus.cc:697] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:08.167215  8153 consensus_queue.cc:237] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:08.168054  7500 leader_election.cc:304] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:08.155468  8154 consensus_queue.cc:1048] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:16:08.114693  8184 raft_consensus.cc:515] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:08.171864  8126 raft_consensus.cc:2804] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:08.175331  8126 raft_consensus.cc:697] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Becoming Leader. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:08.176172  8126 consensus_queue.cc:237] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:08.177806  8184 leader_election.cc:290] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:08.178440  7459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29addb5a68094e16887e2c843d5b1ef5" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:08.189505  7459 raft_consensus.cc:3060] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:08.193867  7730 tablet_bootstrap.cc:492] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0: Bootstrap starting.
I20260709 13:16:08.233881  7358 catalog_manager.cc:5697] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:08.228906  7532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29addb5a68094e16887e2c843d5b1ef5" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:08.237329  7532 raft_consensus.cc:3060] T 29addb5a68094e16887e2c843d5b1ef5 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:08.243884  8068 consensus_queue.cc:1048] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:08.246630  7730 tablet_bootstrap.cc:654] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:08.249856  7731 tablet_bootstrap.cc:492] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:08.250330  7731 ts_tablet_manager.cc:1403] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.325s	user 0.025s	sys 0.019s
I20260709 13:16:08.285542  7532 raft_consensus.cc:2468] T 29addb5a68094e16887e2c843d5b1ef5 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:08.287622  7576 leader_election.cc:304] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: 
I20260709 13:16:08.288483  8153 raft_consensus.cc:2804] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:08.288977  8153 raft_consensus.cc:697] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:08.289844  8153 consensus_queue.cc:237] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:08.297345  7459 raft_consensus.cc:2468] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:08.302606  7731 raft_consensus.cc:359] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:08.317268  8184 consensus_queue.cc:1048] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:16:08.325407  8208 log.cc:927] Time spent T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:16:08.328368  7730 tablet_bootstrap.cc:492] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0: No bootstrap required, opened a new log
I20260709 13:16:08.333702  7730 ts_tablet_manager.cc:1403] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0: Time spent bootstrapping tablet: real 0.150s	user 0.021s	sys 0.008s
I20260709 13:16:08.340822  7730 raft_consensus.cc:359] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:08.342850  7730 raft_consensus.cc:385] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:08.343274  7730 raft_consensus.cc:740] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:08.344172  7730 consensus_queue.cc:260] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:08.346804  7731 raft_consensus.cc:385] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:08.347124  7731 raft_consensus.cc:740] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:08.350925  7731 consensus_queue.cc:260] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:08.352907  7731 ts_tablet_manager.cc:1434] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.102s	user 0.008s	sys 0.000s
I20260709 13:16:08.354830  7731 tablet_bootstrap.cc:492] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:08.355319  7359 catalog_manager.cc:5697] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:08.365288  7731 tablet_bootstrap.cc:654] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:08.375802  7730 ts_tablet_manager.cc:1434] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:16:08.392791  8184 raft_consensus.cc:493] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.406148  8184 raft_consensus.cc:515] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:08.408886  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4267f73a67486e8568dfa6c4a0bd7b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:08.392885  7731 tablet_bootstrap.cc:492] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:08.409515  7680 raft_consensus.cc:2468] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 0.
I20260709 13:16:08.410077  7731 ts_tablet_manager.cc:1403] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.003s
I20260709 13:16:08.411146  7574 leader_election.cc:304] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:08.411963  8068 raft_consensus.cc:2804] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:08.412328  8068 raft_consensus.cc:493] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.412657  8068 raft_consensus.cc:3060] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:08.413208  7731 raft_consensus.cc:359] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:08.413949  7731 raft_consensus.cc:385] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:08.414208  7731 raft_consensus.cc:740] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:08.414939  7731 consensus_queue.cc:260] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:08.399351  7359 catalog_manager.cc:5697] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:08.417073  8184 leader_election.cc:290] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:08.417891  7459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4267f73a67486e8568dfa6c4a0bd7b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
W20260709 13:16:08.419148  7574 leader_election.cc:343] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:08.421197  7731 ts_tablet_manager.cc:1434] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:16:08.423856  7731 tablet_bootstrap.cc:492] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:08.425942  8068 raft_consensus.cc:515] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:08.428164  8068 leader_election.cc:290] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:08.430219  7358 catalog_manager.cc:5697] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a0eef4c5880424694542637530b55c0 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "4a0eef4c5880424694542637530b55c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:08.430941  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4267f73a67486e8568dfa6c4a0bd7b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:08.431933  7459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4267f73a67486e8568dfa6c4a0bd7b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:08.432056  7680 raft_consensus.cc:3060] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:08.434011  7574 leader_election.cc:343] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:08.442679  7731 tablet_bootstrap.cc:654] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:08.451308  7680 raft_consensus.cc:2468] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:08.468572  7574 leader_election.cc:304] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:08.477705  7731 tablet_bootstrap.cc:492] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:08.478225  7731 ts_tablet_manager.cc:1403] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.007s
I20260709 13:16:08.479619  8068 raft_consensus.cc:2804] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:08.481521  8068 raft_consensus.cc:697] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:08.481842  7731 raft_consensus.cc:359] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:08.482654  7731 raft_consensus.cc:385] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:08.482945  7731 raft_consensus.cc:740] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:08.482836  8068 consensus_queue.cc:237] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:08.484169  7731 consensus_queue.cc:260] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:08.487320  7731 ts_tablet_manager.cc:1434] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:16:08.488765  7731 tablet_bootstrap.cc:492] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:08.496783  7731 tablet_bootstrap.cc:654] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:08.521591  7731 tablet_bootstrap.cc:492] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a: No bootstrap required, opened a new log
I20260709 13:16:08.523343  7731 ts_tablet_manager.cc:1403] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.004s
I20260709 13:16:08.526217  7731 raft_consensus.cc:359] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:08.526993  7731 raft_consensus.cc:385] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:08.527298  7731 raft_consensus.cc:740] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:08.528143  7731 consensus_queue.cc:260] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:08.532683  7731 ts_tablet_manager.cc:1434] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:16:08.531617  7355 catalog_manager.cc:5697] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:08.613718  8077 raft_consensus.cc:493] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.614324  8077 raft_consensus.cc:515] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:08.616156  8077 leader_election.cc:290] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:08.616850  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81671c7a827b47caac30f622c4407bf4" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:08.617498  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81671c7a827b47caac30f622c4407bf4" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:08.618324  7682 raft_consensus.cc:2393] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d54f6e4b9e604cd78c48a1828cd3b23a in current term 1: Already voted for candidate 382e1f4385ac4066b7098e4fd1f5df06 in this term.
I20260709 13:16:08.619356  7425 leader_election.cc:304] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:08.620159  8077 raft_consensus.cc:3060] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:08.620990  8068 consensus_queue.cc:1048] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:08.627004  8077 raft_consensus.cc:2749] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:08.628189  8077 raft_consensus.cc:493] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.628683  8077 raft_consensus.cc:515] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:08.635687  7795 consensus_queue.cc:1048] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:08.631968  8077 leader_election.cc:290] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:08.637786  7530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce18aefbfb644eeab2cfc05f961b1771" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:08.638484  7530 raft_consensus.cc:2468] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:16:08.638926  7795 consensus_queue.cc:1048] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:08.640391  7427 leader_election.cc:304] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:08.643138  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce18aefbfb644eeab2cfc05f961b1771" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:08.643779  7682 raft_consensus.cc:2468] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 0.
I20260709 13:16:08.654668  7795 consensus_queue.cc:1048] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:08.641466  8077 raft_consensus.cc:2804] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:08.658164  8077 raft_consensus.cc:493] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.658550  8077 raft_consensus.cc:3060] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:08.678575  8077 raft_consensus.cc:515] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:08.681488  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce18aefbfb644eeab2cfc05f961b1771" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:08.687983  8077 leader_election.cc:290] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:08.689718  7530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce18aefbfb644eeab2cfc05f961b1771" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:08.690397  7682 raft_consensus.cc:3060] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:08.690408  7530 raft_consensus.cc:3060] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:08.698781  7530 raft_consensus.cc:2468] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:08.701987  7682 raft_consensus.cc:2468] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 1.
I20260709 13:16:08.701925  7427 leader_election.cc:304] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:08.702807  8077 raft_consensus.cc:2804] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:08.703393  8077 raft_consensus.cc:697] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:08.705356  7456 raft_consensus.cc:3060] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:08.705575  8077 consensus_queue.cc:237] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:08.719901  8126 consensus_queue.cc:1048] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:08.720592  7355 catalog_manager.cc:5697] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 0 to 1, leader changed from <none> to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:08.733235  8152 consensus_queue.cc:1048] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:08.747422  8077 raft_consensus.cc:493] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.748097  8077 raft_consensus.cc:515] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:08.751302  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4267f73a67486e8568dfa6c4a0bd7b" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:08.754521  7795 consensus_queue.cc:1048] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:08.755049  8077 leader_election.cc:290] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:08.759860  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4267f73a67486e8568dfa6c4a0bd7b" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:08.760731  7680 raft_consensus.cc:2393] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d54f6e4b9e604cd78c48a1828cd3b23a in current term 1: Already voted for candidate 382e1f4385ac4066b7098e4fd1f5df06 in this term.
I20260709 13:16:08.762506  7425 leader_election.cc:304] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:08.769629  8077 raft_consensus.cc:3060] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:08.774356  8153 consensus_queue.cc:1048] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:08.777612  8077 raft_consensus.cc:2749] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:09.064541  8068 consensus_queue.cc:1048] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:09.080765  8184 consensus_queue.cc:1048] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:09.163888  8077 consensus_queue.cc:1048] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:09.175705  8178 consensus_queue.cc:1048] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:09.188069  7795 raft_consensus.cc:493] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:09.188566  7795 raft_consensus.cc:515] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:09.190444  7795 leader_election.cc:290] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:09.192742  7530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560149675ca410fa6cbef0e9eb5bb22" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:09.193650  7530 raft_consensus.cc:2393] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 382e1f4385ac4066b7098e4fd1f5df06 in current term 2: Already voted for candidate 4a0eef4c5880424694542637530b55c0 in this term.
I20260709 13:16:09.194010  7455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560149675ca410fa6cbef0e9eb5bb22" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:09.194665  7455 raft_consensus.cc:2468] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 2.
I20260709 13:16:09.196647  7574 leader_election.cc:304] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:16:09.198271  8184 raft_consensus.cc:2804] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:09.198665  8184 raft_consensus.cc:493] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:09.199030  8184 raft_consensus.cc:3060] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.205927  8184 raft_consensus.cc:515] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:09.208148  8184 leader_election.cc:290] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:09.209319  7455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560149675ca410fa6cbef0e9eb5bb22" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:09.210031  7530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560149675ca410fa6cbef0e9eb5bb22" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:09.210980  7530 raft_consensus.cc:2393] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 382e1f4385ac4066b7098e4fd1f5df06 in current term 2: Already voted for candidate 4a0eef4c5880424694542637530b55c0 in this term.
I20260709 13:16:09.218732  7455 raft_consensus.cc:2468] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 2.
I20260709 13:16:09.220150  7574 leader_election.cc:304] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:16:09.221487  8184 raft_consensus.cc:2804] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:09.222245  8184 raft_consensus.cc:697] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:09.223680  8184 consensus_queue.cc:237] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:09.242870  7355 catalog_manager.cc:5697] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 1 to 2, leader changed from d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129) to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 2 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:09.624799  7530 raft_consensus.cc:1275] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Refusing update from remote peer 382e1f4385ac4066b7098e4fd1f5df06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:09.626063  8184 consensus_queue.cc:1048] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:09.642565  7455 raft_consensus.cc:1275] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Refusing update from remote peer 382e1f4385ac4066b7098e4fd1f5df06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:09.643909  8153 consensus_queue.cc:1048] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:09.914535 31814 tablet_server.cc:179] TabletServer@127.31.17.129:0 shutting down...
W20260709 13:16:09.938657  7648 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 323 similar messages]
W20260709 13:16:09.947228  7648 consensus_peers.cc:597] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:09.949339  7574 consensus_peers.cc:597] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:09.965341 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:09.966279 31814 tablet_replica.cc:333] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:09.967005 31814 raft_consensus.cc:2243] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:09.968008 31814 raft_consensus.cc:2272] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:09.970968 31814 tablet_replica.cc:333] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:09.971735 31814 raft_consensus.cc:2243] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:09.972292 31814 raft_consensus.cc:2272] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:09.974718 31814 tablet_replica.cc:333] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:09.975818 31814 raft_consensus.cc:2243] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:09.976366 31814 raft_consensus.cc:2272] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:09.978066  7574 consensus_peers.cc:597] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:09.978683 31814 tablet_replica.cc:333] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:09.979513 31814 raft_consensus.cc:2243] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:09.980020 31814 raft_consensus.cc:2272] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:09.982622 31814 tablet_replica.cc:333] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:09.985065 31814 raft_consensus.cc:2243] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:09.985618 31814 raft_consensus.cc:2272] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:09.987622 31814 tablet_replica.cc:333] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:09.988395 31814 raft_consensus.cc:2243] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:09.988881 31814 raft_consensus.cc:2272] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:09.989996  7648 consensus_peers.cc:597] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:09.991431 31814 tablet_replica.cc:333] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:09.992280 31814 raft_consensus.cc:2243] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:09.992769 31814 raft_consensus.cc:2272] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:09.995052 31814 tablet_replica.cc:333] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:09.995930 31814 raft_consensus.cc:2243] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:09.996402 31814 raft_consensus.cc:2272] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:09.999219 31814 tablet_replica.cc:333] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
W20260709 13:16:09.999593  7500 consensus_peers.cc:597] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.000042 31814 raft_consensus.cc:2243] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.000559 31814 raft_consensus.cc:2272] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.002362 31814 tablet_replica.cc:333] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.002959 31814 raft_consensus.cc:2243] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.003429 31814 raft_consensus.cc:2272] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.005453 31814 tablet_replica.cc:333] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.006049 31814 raft_consensus.cc:2243] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.006464 31814 raft_consensus.cc:2272] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.008229 31814 tablet_replica.cc:333] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.008994 31814 raft_consensus.cc:2243] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:10.010349 31814 raft_consensus.cc:2272] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.013038 31814 tablet_replica.cc:333] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.013753 31814 raft_consensus.cc:2243] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:10.014046  7574 consensus_peers.cc:597] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.014249 31814 raft_consensus.cc:2272] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.017025 31814 tablet_replica.cc:333] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.017814 31814 raft_consensus.cc:2243] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.018296 31814 raft_consensus.cc:2272] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.020619 31814 tablet_replica.cc:333] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.021391 31814 raft_consensus.cc:2243] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.021857 31814 raft_consensus.cc:2272] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.024371 31814 tablet_replica.cc:333] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.025259 31814 raft_consensus.cc:2243] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:10.026292 31814 raft_consensus.cc:2272] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:10.026839  7648 consensus_peers.cc:597] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:10.028909  7648 consensus_peers.cc:597] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.029181 31814 tablet_replica.cc:333] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.029996 31814 raft_consensus.cc:2243] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.030426 31814 raft_consensus.cc:2272] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.032337 31814 tablet_replica.cc:333] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.032896 31814 raft_consensus.cc:2243] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:10.033645 31814 raft_consensus.cc:2272] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.035742 31814 tablet_replica.cc:333] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.036317 31814 raft_consensus.cc:2243] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:10.037091 31814 raft_consensus.cc:2272] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.038913 31814 tablet_replica.cc:333] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.039849 31814 raft_consensus.cc:2243] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.040369 31814 raft_consensus.cc:2272] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.042807 31814 tablet_replica.cc:333] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
W20260709 13:16:10.043735  7648 consensus_peers.cc:597] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.043794 31814 raft_consensus.cc:2243] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:10.045177 31814 raft_consensus.cc:2272] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.047900 31814 tablet_replica.cc:333] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.048733 31814 raft_consensus.cc:2243] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:10.049715 31814 raft_consensus.cc:2272] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:10.049788  7574 consensus_peers.cc:597] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.052145 31814 tablet_replica.cc:333] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.052762 31814 raft_consensus.cc:2243] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.053203 31814 raft_consensus.cc:2272] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.055172 31814 tablet_replica.cc:333] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.055724 31814 raft_consensus.cc:2243] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.056109 31814 raft_consensus.cc:2272] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.057868 31814 tablet_replica.cc:333] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.058416 31814 raft_consensus.cc:2243] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.058871 31814 raft_consensus.cc:2272] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.060921 31814 tablet_replica.cc:333] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.061798 31814 raft_consensus.cc:2243] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:10.062805 31814 raft_consensus.cc:2272] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.065966 31814 tablet_replica.cc:333] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
W20260709 13:16:10.066172  7574 consensus_peers.cc:597] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.066743 31814 raft_consensus.cc:2243] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:10.067656 31814 raft_consensus.cc:2272] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.070250 31814 tablet_replica.cc:333] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.071062 31814 raft_consensus.cc:2243] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.071699 31814 raft_consensus.cc:2272] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.074550 31814 tablet_replica.cc:333] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.075383 31814 raft_consensus.cc:2243] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:10.076400 31814 raft_consensus.cc:2272] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.079154 31814 tablet_replica.cc:333] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.079998 31814 raft_consensus.cc:2243] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:10.081079 31814 raft_consensus.cc:2272] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:10.081297  7574 consensus_peers.cc:597] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:10.081894  7574 consensus_peers.cc:597] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.083700 31814 tablet_replica.cc:333] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
W20260709 13:16:10.084164  7574 consensus_peers.cc:597] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.084515 31814 raft_consensus.cc:2243] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.085004 31814 raft_consensus.cc:2272] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:10.087044  7500 consensus_peers.cc:597] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.087379 31814 tablet_replica.cc:333] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.087989 31814 raft_consensus.cc:2243] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.088353 31814 raft_consensus.cc:2272] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.090127 31814 tablet_replica.cc:333] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.090607 31814 raft_consensus.cc:2243] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.090939 31814 raft_consensus.cc:2272] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.092706 31814 tablet_replica.cc:333] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.093298 31814 raft_consensus.cc:2243] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:10.094137 31814 raft_consensus.cc:2272] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.096163 31814 tablet_replica.cc:333] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.096670 31814 raft_consensus.cc:2243] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.097113 31814 raft_consensus.cc:2272] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.099109 31814 tablet_replica.cc:333] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.099647 31814 raft_consensus.cc:2243] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.100062 31814 raft_consensus.cc:2272] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.101953 31814 tablet_replica.cc:333] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.102519 31814 raft_consensus.cc:2243] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.102953 31814 raft_consensus.cc:2272] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.104759 31814 tablet_replica.cc:333] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.105278 31814 raft_consensus.cc:2243] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.105858 31814 raft_consensus.cc:2272] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.108276 31814 tablet_replica.cc:333] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.109010 31814 raft_consensus.cc:2243] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:10.110272 31814 raft_consensus.cc:2272] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.112313 31814 tablet_replica.cc:333] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.112815 31814 raft_consensus.cc:2243] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:10.113538 31814 raft_consensus.cc:2272] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.115296 31814 tablet_replica.cc:333] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.115801 31814 raft_consensus.cc:2243] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.116230 31814 raft_consensus.cc:2272] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.118158 31814 tablet_replica.cc:333] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.118793 31814 raft_consensus.cc:2243] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.119288 31814 raft_consensus.cc:2272] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.121567 31814 tablet_replica.cc:333] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
W20260709 13:16:10.121620  7574 consensus_peers.cc:597] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.122315 31814 raft_consensus.cc:2243] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.122870 31814 raft_consensus.cc:2272] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.124954 31814 tablet_replica.cc:333] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.125516 31814 raft_consensus.cc:2243] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:10.126391 31814 raft_consensus.cc:2272] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.128453 31814 tablet_replica.cc:333] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a: stopping tablet replica
I20260709 13:16:10.128994 31814 raft_consensus.cc:2243] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:10.129976 31814 raft_consensus.cc:2272] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:10.151436  7500 consensus_peers.cc:597] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:10.187366  7500 consensus_peers.cc:597] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.213852 31814 tablet_server.cc:196] TabletServer@127.31.17.129:0 shutdown complete.
W20260709 13:16:10.220325  7574 consensus_peers.cc:597] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:10.225360  7648 consensus_peers.cc:597] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:10.246743  7574 consensus_peers.cc:597] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:10.269614  7500 consensus_peers.cc:597] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:10.270179  7500 consensus_peers.cc:597] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:10.289005  7648 consensus_peers.cc:597] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.292274 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:10.301433  8244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:10.302600  8245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:10.303699  8247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:10.306567  7574 consensus_peers.cc:597] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.307644 31814 server_base.cc:1061] running on GCE node
W20260709 13:16:10.308327  7648 consensus_peers.cc:597] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:10.314462  7648 consensus_peers.cc:597] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:10.314621  7500 consensus_peers.cc:597] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.315549 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:10.316071 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:10.316323 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602970316302 us; error 0 us; skew 500 ppm
I20260709 13:16:10.316972 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:10.320447 31814 webserver.cc:533] Webserver started at http://127.31.17.129:40057/ using document root <none> and password file <none>
I20260709 13:16:10.321028 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:10.321200 31814 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:16:10.326434 31814 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:16:10.337232  8252 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:10.338317 31814 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.000s	sys 0.003s
I20260709 13:16:10.338730 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-0-root
uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
format_stamp: "Formatted at 2026-07-09 13:15:56 on dist-test-slave-zhw8"
I20260709 13:16:10.339332 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602713491408-31814-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:10.357589 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:10.359189 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:10.361104 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:10.368191  8259 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:16:10.388320  7574 consensus_peers.cc:597] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.639525 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:16:10.639909 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.274s	user 0.010s	sys 0.001s
I20260709 13:16:10.640224 31814 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:16:10.646956  8259 tablet_bootstrap.cc:492] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:10.662253  8259 tablet_bootstrap.cc:492] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:10.663278  8259 tablet_bootstrap.cc:492] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:10.663942  8259 ts_tablet_manager.cc:1403] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:16:10.666385  8259 raft_consensus.cc:359] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:10.667063  8259 raft_consensus.cc:740] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:10.667800  8259 consensus_queue.cc:260] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:10.670138  8259 ts_tablet_manager.cc:1434] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:10.670902  8259 tablet_bootstrap.cc:492] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:10.710557  8259 tablet_bootstrap.cc:492] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:10.712293  8259 tablet_bootstrap.cc:492] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:10.712891  8259 ts_tablet_manager.cc:1403] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.019s
I20260709 13:16:10.715088  8259 raft_consensus.cc:359] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:10.715767  8259 raft_consensus.cc:740] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:10.716368  8259 consensus_queue.cc:260] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:10.718051  8259 ts_tablet_manager.cc:1434] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:10.718773  8259 tablet_bootstrap.cc:492] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:10.730616  8259 tablet_bootstrap.cc:492] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:10.731426  8259 tablet_bootstrap.cc:492] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:10.732015  8259 ts_tablet_manager.cc:1403] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.004s
I20260709 13:16:10.734323  8259 raft_consensus.cc:359] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:10.734972  8259 raft_consensus.cc:740] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:10.735601  8259 consensus_queue.cc:260] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:10.737418  8259 ts_tablet_manager.cc:1434] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:10.738152  8259 tablet_bootstrap.cc:492] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:10.751920  8259 tablet_bootstrap.cc:492] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:10.752795  8259 tablet_bootstrap.cc:492] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:10.753357  8259 ts_tablet_manager.cc:1403] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:16:10.755493  8259 raft_consensus.cc:359] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:10.756153  8259 raft_consensus.cc:740] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:10.756775  8259 consensus_queue.cc:260] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:10.758615  8259 ts_tablet_manager.cc:1434] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:10.759407  8259 tablet_bootstrap.cc:492] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:10.772698  8259 tablet_bootstrap.cc:492] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:10.773598  8259 tablet_bootstrap.cc:492] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:10.774184  8259 ts_tablet_manager.cc:1403] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:16:10.776484  8259 raft_consensus.cc:359] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:10.777123  8259 raft_consensus.cc:740] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:10.777748  8259 consensus_queue.cc:260] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:10.779556  8259 ts_tablet_manager.cc:1434] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:16:10.780251  8259 tablet_bootstrap.cc:492] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:10.852780  8259 tablet_bootstrap.cc:492] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:10.853695  8259 tablet_bootstrap.cc:492] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:10.854301  8259 ts_tablet_manager.cc:1403] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.074s	user 0.029s	sys 0.027s
I20260709 13:16:10.856657  8259 raft_consensus.cc:359] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:10.857295  8259 raft_consensus.cc:740] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:10.857952  8259 consensus_queue.cc:260] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:10.859910  8259 ts_tablet_manager.cc:1434] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:16:10.860633  8259 tablet_bootstrap.cc:492] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:10.874424  8259 tablet_bootstrap.cc:492] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:10.875357  8259 tablet_bootstrap.cc:492] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:10.875952  8259 ts_tablet_manager.cc:1403] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 13:16:10.880966  8259 raft_consensus.cc:359] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:10.881711  8259 raft_consensus.cc:740] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:10.882315  8259 consensus_queue.cc:260] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:10.884270  8259 ts_tablet_manager.cc:1434] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:10.885013  8259 tablet_bootstrap.cc:492] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:10.898782  8259 tablet_bootstrap.cc:492] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:10.899729  8259 tablet_bootstrap.cc:492] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:10.900329  8259 ts_tablet_manager.cc:1403] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:16:10.903533  8259 raft_consensus.cc:359] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:10.904191  8259 raft_consensus.cc:740] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:10.904911  8259 consensus_queue.cc:260] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:10.906708  8259 ts_tablet_manager.cc:1434] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:10.907444  8259 tablet_bootstrap.cc:492] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:10.920614  8259 tablet_bootstrap.cc:492] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:10.921509  8259 tablet_bootstrap.cc:492] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:10.922124  8259 ts_tablet_manager.cc:1403] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:16:10.924305  8259 raft_consensus.cc:359] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:10.924978  8259 raft_consensus.cc:740] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:10.925621  8259 consensus_queue.cc:260] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:10.927467  8259 ts_tablet_manager.cc:1434] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:16:10.928200  8259 tablet_bootstrap.cc:492] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:10.940469 31814 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:16:10.940840 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.301s	user 0.250s	sys 0.009s
I20260709 13:16:10.942404  8259 tablet_bootstrap.cc:492] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:10.943356  8259 tablet_bootstrap.cc:492] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:10.943943  8259 ts_tablet_manager.cc:1403] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:16:10.945815  8259 raft_consensus.cc:359] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:10.946534  8259 raft_consensus.cc:740] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:10.947121  8259 consensus_queue.cc:260] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:10.948851  8259 ts_tablet_manager.cc:1434] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:10.949543  8259 tablet_bootstrap.cc:492] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:10.958317  8261 raft_consensus.cc:493] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:10.958945  8261 raft_consensus.cc:515] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:10.964147  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b8b81bd894896b1bdf58d7b461d41" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
W20260709 13:16:10.969915  7500 leader_election.cc:336] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111)
I20260709 13:16:10.970562  7500 leader_election.cc:304] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:10.973649  8262 raft_consensus.cc:2749] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:10.976621  8261 leader_election.cc:290] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:10.983664  8259 tablet_bootstrap.cc:492] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:10.985127  8259 tablet_bootstrap.cc:492] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:10.986012  8259 ts_tablet_manager.cc:1403] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.007s
I20260709 13:16:10.989462  8259 raft_consensus.cc:359] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:10.990397  8259 raft_consensus.cc:740] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:10.991379  8259 consensus_queue.cc:260] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:10.994266  8259 ts_tablet_manager.cc:1434] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:10.995352  8259 tablet_bootstrap.cc:492] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:11.018662  8259 tablet_bootstrap.cc:492] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:11.019807  8259 tablet_bootstrap.cc:492] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:11.020576  8259 ts_tablet_manager.cc:1403] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.003s
I20260709 13:16:11.024457  8259 raft_consensus.cc:359] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:11.025315  8259 raft_consensus.cc:740] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:11.026144  8259 consensus_queue.cc:260] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:11.029328  8259 ts_tablet_manager.cc:1434] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:16:11.030306  8259 tablet_bootstrap.cc:492] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:11.032100 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.129:35515
I20260709 13:16:11.032197  8332 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.129:35515 every 8 connection(s)
I20260709 13:16:11.047025  8259 tablet_bootstrap.cc:492] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:11.048067  8259 tablet_bootstrap.cc:492] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:11.048789  8259 ts_tablet_manager.cc:1403] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:16:11.052358  8259 raft_consensus.cc:359] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.052888  8259 raft_consensus.cc:740] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:11.053412  8259 consensus_queue.cc:260] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.054819  8259 ts_tablet_manager.cc:1434] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:11.055598  8259 tablet_bootstrap.cc:492] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:11.067342  8333 heartbeater.cc:344] Connected to a master server at 127.31.17.190:35391
I20260709 13:16:11.067927  8333 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:11.069074  8333 heartbeater.cc:507] Master 127.31.17.190:35391 requested a full tablet report, sending...
I20260709 13:16:11.084410  8262 raft_consensus.cc:493] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.085335  8262 raft_consensus.cc:515] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.094846  7795 raft_consensus.cc:493] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.096326  8261 raft_consensus.cc:493] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.097307  8261 raft_consensus.cc:515] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.095484  7795 raft_consensus.cc:515] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.107707  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899962d588849ccb4af0f8cb06c07d0" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:11.108626  7608 raft_consensus.cc:2468] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:11.111159  7499 leader_election.cc:304] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: 
I20260709 13:16:11.111982  8262 leader_election.cc:290] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:11.112573  8262 raft_consensus.cc:2804] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.112936  8262 raft_consensus.cc:493] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.113322  8262 raft_consensus.cc:3060] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.114763  7795 leader_election.cc:290] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:11.114544  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96e53ac6d4a4521824a0eef2bf0400b" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:11.121951  7532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899962d588849ccb4af0f8cb06c07d0" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:11.124501  8261 leader_election.cc:290] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:11.124737  8263 raft_consensus.cc:493] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.127406  8263 raft_consensus.cc:515] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.129798  8263 leader_election.cc:290] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.131762  8262 raft_consensus.cc:515] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.132982  7532 raft_consensus.cc:2393] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 382e1f4385ac4066b7098e4fd1f5df06 in current term 2: Already voted for candidate 4a0eef4c5880424694542637530b55c0 in this term.
I20260709 13:16:11.138897  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868663ec219f46a5abe840f8d43158e7" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:11.138509  8126 raft_consensus.cc:493] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.151667  8263 raft_consensus.cc:493] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.153982  8184 raft_consensus.cc:493] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.155248  8184 raft_consensus.cc:515] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.152490  8263 raft_consensus.cc:515] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.158427  7532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:11.159754  8305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899962d588849ccb4af0f8cb06c07d0" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.160468  8305 raft_consensus.cc:2468] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:11.161269  7358 ts_manager.cc:194] Re-registered known tserver with Master: d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.161661  8304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868663ec219f46a5abe840f8d43158e7" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.161952  8303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899962d588849ccb4af0f8cb06c07d0" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.153234  8126 raft_consensus.cc:515] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.162899  8303 raft_consensus.cc:2468] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:11.166437  7574 leader_election.cc:304] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:16:11.167733  7532 raft_consensus.cc:2468] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:11.169672  7795 raft_consensus.cc:2804] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.170250  7795 raft_consensus.cc:493] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.170845  7795 raft_consensus.cc:3060] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.172217  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:11.179621  7608 raft_consensus.cc:2468] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:11.164769  8126 leader_election.cc:290] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:11.184183  7499 leader_election.cc:304] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: 
I20260709 13:16:11.186661  8184 leader_election.cc:290] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:11.187178  8184 raft_consensus.cc:493] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.182121  8306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96e53ac6d4a4521824a0eef2bf0400b" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.184767  8263 leader_election.cc:290] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.196822  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.202270  7576 leader_election.cc:304] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: 
I20260709 13:16:11.188164  8126 raft_consensus.cc:2804] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.203649  8126 raft_consensus.cc:493] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.204079  8126 raft_consensus.cc:3060] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.210038  8307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899962d588849ccb4af0f8cb06c07d0" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:11.210702  8307 raft_consensus.cc:3060] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.215139  7532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98892caf6b1549c8a1906b47c1298334" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:11.203012  8184 raft_consensus.cc:515] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.217953  8184 leader_election.cc:290] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.215256  8343 raft_consensus.cc:493] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.218432  8184 raft_consensus.cc:2804] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.218497  8176 raft_consensus.cc:493] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.206300  8263 raft_consensus.cc:493] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.218742  8343 raft_consensus.cc:515] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.219901  8263 raft_consensus.cc:515] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.221845  8263 leader_election.cc:290] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:11.222121  8261 raft_consensus.cc:493] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
W20260709 13:16:11.222371  7500 leader_election.cc:343] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.222806  7500 leader_election.cc:304] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.223013  8259 tablet_bootstrap.cc:492] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:11.222681  8261 raft_consensus.cc:515] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
W20260709 13:16:11.223940  7500 leader_election.cc:343] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.224817  8261 leader_election.cc:290] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.219165  8176 raft_consensus.cc:515] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:11.222121  8262 leader_election.cc:290] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:11.225639  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce18aefbfb644eeab2cfc05f961b1771" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:11.218912  8184 raft_consensus.cc:493] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.226302  8184 raft_consensus.cc:3060] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.226354  7680 raft_consensus.cc:2468] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:11.224023  8259 tablet_bootstrap.cc:492] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:11.227895  8259 ts_tablet_manager.cc:1403] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.173s	user 0.048s	sys 0.041s
I20260709 13:16:11.228668  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce18aefbfb644eeab2cfc05f961b1771" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.230254  7500 leader_election.cc:304] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:11.225303  8261 raft_consensus.cc:2749] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:11.230988  8262 raft_consensus.cc:2804] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.231581  8262 raft_consensus.cc:493] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.231951  8262 raft_consensus.cc:3060] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.235984  8304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce18aefbfb644eeab2cfc05f961b1771" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.221812  8343 leader_election.cc:290] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:11.237653  7795 raft_consensus.cc:515] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
W20260709 13:16:11.239423  7648 leader_election.cc:343] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.240111  8262 raft_consensus.cc:515] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:11.242069  8262 leader_election.cc:290] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.232753  8259 raft_consensus.cc:359] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:11.228746  8176 leader_election.cc:290] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:11.245463  8259 raft_consensus.cc:740] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:11.246642  8259 consensus_queue.cc:260] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:11.247738  8126 raft_consensus.cc:515] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.249679  8259 ts_tablet_manager.cc:1434] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:16:11.250831  7795 leader_election.cc:290] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:11.251058  8263 raft_consensus.cc:493] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
W20260709 13:16:11.251569  7650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:45835, user_credentials={real_user=slave}} blocked reactor thread for 51914.7us
I20260709 13:16:11.264775  8259 tablet_bootstrap.cc:492] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:11.264698  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:11.253975  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899962d588849ccb4af0f8cb06c07d0" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:11.266330  7608 raft_consensus.cc:2393] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a0eef4c5880424694542637530b55c0 in current term 2: Already voted for candidate 382e1f4385ac4066b7098e4fd1f5df06 in this term.
I20260709 13:16:11.267583  7529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce18aefbfb644eeab2cfc05f961b1771" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:11.254475  8184 raft_consensus.cc:515] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.268393  7529 raft_consensus.cc:2393] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e733469bde7c479a916acbbe84b5f342 in current term 2: Already voted for candidate 4a0eef4c5880424694542637530b55c0 in this term.
I20260709 13:16:11.254963  7532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b8b81bd894896b1bdf58d7b461d41" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:11.269245  7532 raft_consensus.cc:2468] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:11.269562  7650 leader_election.cc:304] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.256088  7530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54c4242890a943ec865bafae33141d3b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:11.256624  7528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899962d588849ccb4af0f8cb06c07d0" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:11.270622  8073 raft_consensus.cc:3060] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.271368  7528 raft_consensus.cc:2393] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 382e1f4385ac4066b7098e4fd1f5df06 in current term 2: Already voted for candidate 4a0eef4c5880424694542637530b55c0 in this term.
I20260709 13:16:11.272632  8263 raft_consensus.cc:515] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.273362  8126 leader_election.cc:290] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:11.275542  7607 raft_consensus.cc:2393] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a0eef4c5880424694542637530b55c0 in current term 2: Already voted for candidate 382e1f4385ac4066b7098e4fd1f5df06 in this term.
I20260709 13:16:11.275643  7528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361e20d70ddc4e43b3dcbe2e9ca30f50" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:11.276188  8184 leader_election.cc:290] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.278115  7528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:11.278918  7528 raft_consensus.cc:2393] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 382e1f4385ac4066b7098e4fd1f5df06 in current term 2: Already voted for candidate 4a0eef4c5880424694542637530b55c0 in this term.
I20260709 13:16:11.281848  7576 leader_election.cc:304] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: 
W20260709 13:16:11.231129  7500 leader_election.cc:343] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.282560  8263 leader_election.cc:290] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
W20260709 13:16:11.282699  7500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.129:35515, user_credentials={real_user=slave}} blocked reactor thread for 51599.9us
I20260709 13:16:11.283138  8263 raft_consensus.cc:2804] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.283486  8126 raft_consensus.cc:493] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
W20260709 13:16:11.258157  7574 leader_election.cc:343] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.284611  7574 leader_election.cc:304] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:11.284444  8126 raft_consensus.cc:515] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.288174  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a389b4005c4d6890f09b248b3e1ad8" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:11.290024  8126 leader_election.cc:290] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:11.258863  8307 raft_consensus.cc:2468] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 2.
I20260709 13:16:11.289947  8306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98892caf6b1549c8a1906b47c1298334" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.290755  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa473d10c0ad424f8268c67efcccccff" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:11.290298  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899962d588849ccb4af0f8cb06c07d0" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:11.291009  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.293723  8301 raft_consensus.cc:2393] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 382e1f4385ac4066b7098e4fd1f5df06 in current term 2: Already voted for candidate 4a0eef4c5880424694542637530b55c0 in this term.
I20260709 13:16:11.295843  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce18aefbfb644eeab2cfc05f961b1771" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:11.291503  8305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54c4242890a943ec865bafae33141d3b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.292114  8184 raft_consensus.cc:2749] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:11.292181  8303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b8b81bd894896b1bdf58d7b461d41" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.298290  8305 raft_consensus.cc:2468] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:11.283526  8263 raft_consensus.cc:493] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.299173  8263 raft_consensus.cc:3060] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.300220  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:11.303555  7500 leader_election.cc:304] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 382e1f4385ac4066b7098e4fd1f5df06
W20260709 13:16:11.305073  7500 leader_election.cc:343] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.305469  7500 leader_election.cc:304] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.306111  8347 raft_consensus.cc:2804] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.306571  8347 raft_consensus.cc:697] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [term 2 LEADER]: Becoming Leader. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:11.292812  8304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a389b4005c4d6890f09b248b3e1ad8" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.307161  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa473d10c0ad424f8268c67efcccccff" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.308087  8301 raft_consensus.cc:2468] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:11.307397  8347 consensus_queue.cc:237] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.307546  8262 raft_consensus.cc:2749] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:11.311842  8262 raft_consensus.cc:493] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.312325  8262 raft_consensus.cc:515] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.314339  8262 leader_election.cc:290] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.307113  8263 raft_consensus.cc:515] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.318073  8306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361e20d70ddc4e43b3dcbe2e9ca30f50" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.323957  7530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b8b81bd894896b1bdf58d7b461d41" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:11.324560  7530 raft_consensus.cc:3060] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.324391  8306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:11.330225  7680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:11.333565  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.335477  7530 raft_consensus.cc:2468] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 2.
I20260709 13:16:11.336748  7576 leader_election.cc:304] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: 
I20260709 13:16:11.337598  7500 leader_election.cc:304] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 382e1f4385ac4066b7098e4fd1f5df06
I20260709 13:16:11.339959  8184 raft_consensus.cc:2804] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.337430  8263 leader_election.cc:290] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
W20260709 13:16:11.339632  7574 leader_election.cc:343] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.340409  8126 raft_consensus.cc:2804] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.340620  8184 raft_consensus.cc:697] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:11.342128  8126 raft_consensus.cc:493] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.342561  8126 raft_consensus.cc:3060] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.281945  8073 raft_consensus.cc:2749] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:11.342780  7500 leader_election.cc:343] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.342849  8184 consensus_queue.cc:237] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.352991  7682 raft_consensus.cc:2468] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 2.
I20260709 13:16:11.353789  8259 tablet_bootstrap.cc:492] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:11.354707  8259 tablet_bootstrap.cc:492] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:11.355784  8259 ts_tablet_manager.cc:1403] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.091s	user 0.027s	sys 0.012s
I20260709 13:16:11.349025  7358 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58286
I20260709 13:16:11.351035  8126 raft_consensus.cc:515] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.351900  7574 leader_election.cc:304] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.362788  8345 raft_consensus.cc:2749] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:11.364205  7574 leader_election.cc:343] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.365093  7574 leader_election.cc:304] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.366360  8333 heartbeater.cc:499] Master 127.31.17.190:35391 was elected leader, sending a full tablet report...
I20260709 13:16:11.352568  8307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce18aefbfb644eeab2cfc05f961b1771" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:11.367834  7500 leader_election.cc:304] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:11.368607  8262 raft_consensus.cc:2749] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:11.369014  7500 leader_election.cc:304] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:11.369784  8262 raft_consensus.cc:2804] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.370852  8262 raft_consensus.cc:697] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [term 2 LEADER]: Becoming Leader. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:11.370796  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa473d10c0ad424f8268c67efcccccff" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:11.371956  8262 consensus_queue.cc:237] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:11.373462  8307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa473d10c0ad424f8268c67efcccccff" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:11.374086  8307 raft_consensus.cc:3060] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:11.374449  7500 leader_election.cc:343] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.381129  8307 raft_consensus.cc:2468] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 2.
I20260709 13:16:11.369551  8259 raft_consensus.cc:359] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.369853  8126 leader_election.cc:290] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:11.381747  7358 catalog_manager.cc:5697] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 reported cstate change: term changed from 1 to 2, leader changed from d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129) to 4a0eef4c5880424694542637530b55c0 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "4a0eef4c5880424694542637530b55c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:11.383162  8345 raft_consensus.cc:2749] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:11.383968  8347 raft_consensus.cc:493] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.384464  8347 raft_consensus.cc:515] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.382441  7500 leader_election.cc:304] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 382e1f4385ac4066b7098e4fd1f5df06
I20260709 13:16:11.382995  8259 raft_consensus.cc:740] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:11.386358  8259 consensus_queue.cc:260] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.387148  8342 raft_consensus.cc:2804] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.388872  8342 raft_consensus.cc:697] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 2 LEADER]: Becoming Leader. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:11.389880  8347 leader_election.cc:290] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:11.389679  8342 consensus_queue.cc:237] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.390869  7357 catalog_manager.cc:5697] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 1 to 2, leader changed from d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129) to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 2 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.392696  8176 raft_consensus.cc:493] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.393209  8176 raft_consensus.cc:515] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:11.394443  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98892caf6b1549c8a1906b47c1298334" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:11.396276  8347 raft_consensus.cc:493] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.396512  7607 raft_consensus.cc:2468] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:11.399116  7530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e442d8263394fa7bd9df6ee46bb246e" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:11.399483  7499 leader_election.cc:304] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: 
I20260709 13:16:11.399807  8176 leader_election.cc:290] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:11.396803  8347 raft_consensus.cc:515] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:11.397882  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e442d8263394fa7bd9df6ee46bb246e" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.400322  8261 raft_consensus.cc:2804] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.400691  7530 raft_consensus.cc:2468] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:11.400732  8261 raft_consensus.cc:493] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
W20260709 13:16:11.401381  7648 leader_election.cc:343] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.401453  8261 raft_consensus.cc:3060] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.402805  7650 leader_election.cc:304] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.404068  8176 raft_consensus.cc:2804] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.404431  8176 raft_consensus.cc:493] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.405822  8259 ts_tablet_manager.cc:1434] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 13:16:11.383172  7574 leader_election.cc:304] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 4a0eef4c5880424694542637530b55c0
I20260709 13:16:11.406370  8347 leader_election.cc:290] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.406781  8259 tablet_bootstrap.cc:492] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:11.406894  8184 raft_consensus.cc:2804] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.407434  8184 raft_consensus.cc:493] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.407800  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e442d8263394fa7bd9df6ee46bb246e" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:11.408377  8176 raft_consensus.cc:3060] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.407841  8184 raft_consensus.cc:3060] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.408722  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e442d8263394fa7bd9df6ee46bb246e" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.410176  8307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98892caf6b1549c8a1906b47c1298334" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.410676  8073 raft_consensus.cc:493] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.415555  8263 raft_consensus.cc:493] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.416075  8263 raft_consensus.cc:515] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.411204  8073 raft_consensus.cc:515] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
W20260709 13:16:11.422786  7500 leader_election.cc:343] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.437021  8073 leader_election.cc:290] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
W20260709 13:16:11.437688  7500 leader_election.cc:343] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:11.418380  7574 leader_election.cc:343] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.426473  8176 raft_consensus.cc:515] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:11.440615  7530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d88042080495293c0e772b280f3da" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
W20260709 13:16:11.440665  7574 leader_election.cc:343] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.441520  7682 raft_consensus.cc:2393] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a0eef4c5880424694542637530b55c0 in current term 2: Already voted for candidate e733469bde7c479a916acbbe84b5f342 in this term.
I20260709 13:16:11.441903  7574 leader_election.cc:304] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:11.431641  8307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d88042080495293c0e772b280f3da" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.423839  8263 leader_election.cc:290] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
W20260709 13:16:11.446367  7648 leader_election.cc:343] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.446832  7648 leader_election.cc:304] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.447157  8260 raft_consensus.cc:493] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.447726  8260 raft_consensus.cc:515] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.448601  8184 raft_consensus.cc:515] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.450810  8346 raft_consensus.cc:2749] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:11.451654  8184 leader_election.cc:290] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:11.417621  8261 raft_consensus.cc:515] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.452230  7530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54c4242890a943ec865bafae33141d3b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:11.454195  8261 leader_election.cc:290] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:11.455740  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98892caf6b1549c8a1906b47c1298334" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:11.456105  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a389b4005c4d6890f09b248b3e1ad8" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.456328  7607 raft_consensus.cc:3060] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:11.457484  7648 leader_election.cc:343] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.450390  8260 leader_election.cc:290] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.458624  8307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e442d8263394fa7bd9df6ee46bb246e" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:11.459437  8176 leader_election.cc:290] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:11.460361  7530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e442d8263394fa7bd9df6ee46bb246e" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:11.460917  7530 raft_consensus.cc:3060] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:11.463109  7574 leader_election.cc:343] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.463575  7574 leader_election.cc:304] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.464289  8345 raft_consensus.cc:2749] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:11.464833  7574 leader_election.cc:343] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.465236  7574 leader_election.cc:304] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.465413  8345 raft_consensus.cc:2749] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:11.465881  8344 raft_consensus.cc:2749] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:11.443415  7500 leader_election.cc:304] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a0eef4c5880424694542637530b55c0; no voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342
W20260709 13:16:11.469472  7648 leader_election.cc:343] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.470275  8126 raft_consensus.cc:493] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.470600  8303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98892caf6b1549c8a1906b47c1298334" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:11.470924  8126 raft_consensus.cc:515] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:11.472971  7607 raft_consensus.cc:2468] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 2.
I20260709 13:16:11.474726  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d88042080495293c0e772b280f3da" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:11.475457  7499 leader_election.cc:304] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: 
I20260709 13:16:11.475559  7682 raft_consensus.cc:2468] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:11.472878  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b8b81bd894896b1bdf58d7b461d41" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:11.473500  8126 leader_election.cc:290] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.478075  8342 raft_consensus.cc:2804] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.478890  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d88042080495293c0e772b280f3da" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.479656  8342 raft_consensus.cc:697] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 2 LEADER]: Becoming Leader. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:11.480942  7530 raft_consensus.cc:2468] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 2.
W20260709 13:16:11.482053  7500 leader_election.cc:343] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.482788  7650 leader_election.cc:304] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.484212  8073 raft_consensus.cc:2804] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.484702  8073 raft_consensus.cc:697] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
W20260709 13:16:11.484779  7500 leader_election.cc:343] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.485539  8260 raft_consensus.cc:493] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.485594  7500 leader_election.cc:304] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.486128  8260 raft_consensus.cc:515] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.486696  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79ef75f6ba41b4a0e56ba851add378" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:11.487039  8126 raft_consensus.cc:2804] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.487353  7682 raft_consensus.cc:2468] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:11.487474  8126 raft_consensus.cc:493] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.488548  8260 leader_election.cc:290] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.488708  8126 raft_consensus.cc:3060] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.488222  8262 raft_consensus.cc:493] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.489742  8307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79ef75f6ba41b4a0e56ba851add378" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.490092  8262 raft_consensus.cc:515] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.490424  8307 raft_consensus.cc:2468] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:11.492166  7648 leader_election.cc:304] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:11.492358  8262 leader_election.cc:290] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:11.492926  8176 raft_consensus.cc:2804] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.493351  8176 raft_consensus.cc:493] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.493040  8073 consensus_queue.cc:237] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:11.493743  8176 raft_consensus.cc:3060] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.493957  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54c4242890a943ec865bafae33141d3b" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:11.494976  8261 raft_consensus.cc:2749] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:11.494951  7607 raft_consensus.cc:2393] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a0eef4c5880424694542637530b55c0 in current term 2: Already voted for candidate 382e1f4385ac4066b7098e4fd1f5df06 in this term.
I20260709 13:16:11.499210  8307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54c4242890a943ec865bafae33141d3b" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.482826  8342 consensus_queue.cc:237] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.502630  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79ef75f6ba41b4a0e56ba851add378" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.503343  8301 raft_consensus.cc:2468] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:11.503450  8303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54c4242890a943ec865bafae33141d3b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:11.499922  8307 raft_consensus.cc:2468] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
I20260709 13:16:11.506263  7500 leader_election.cc:304] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 382e1f4385ac4066b7098e4fd1f5df06
I20260709 13:16:11.508948  8126 raft_consensus.cc:515] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:11.510892  8126 leader_election.cc:290] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.511437  8259 tablet_bootstrap.cc:492] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:11.512360  8259 tablet_bootstrap.cc:492] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:11.512842  8262 raft_consensus.cc:2804] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.513032  8259 ts_tablet_manager.cc:1403] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.106s	user 0.019s	sys 0.000s
I20260709 13:16:11.513284  8262 raft_consensus.cc:493] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.513711  8262 raft_consensus.cc:3060] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.515499  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a389b4005c4d6890f09b248b3e1ad8" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:11.516361  7607 raft_consensus.cc:2468] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:11.517522  8263 raft_consensus.cc:493] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.518373  8263 raft_consensus.cc:515] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.524067  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d88042080495293c0e772b280f3da" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:11.520752  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79ef75f6ba41b4a0e56ba851add378" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:11.521281  8303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87d88042080495293c0e772b280f3da" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:11.524609  7682 raft_consensus.cc:3060] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.525799  7607 raft_consensus.cc:2468] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
W20260709 13:16:11.525960  7500 leader_election.cc:343] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.528344  8184 raft_consensus.cc:493] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.529016  8184 raft_consensus.cc:515] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.532608  7647 leader_election.cc:304] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.532829  8073 raft_consensus.cc:493] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.536612  8073 raft_consensus.cc:515] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.538793  8073 leader_election.cc:290] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.522831  8262 raft_consensus.cc:515] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.533928  7530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa473d10c0ad424f8268c67efcccccff" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:11.541440  8262 leader_election.cc:290] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:11.535403  7528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96e53ac6d4a4521824a0eef2bf0400b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:11.543862  7528 raft_consensus.cc:2468] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 1.
I20260709 13:16:11.544416  8307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868663ec219f46a5abe840f8d43158e7" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.534631  8184 leader_election.cc:290] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:11.545461  8073 raft_consensus.cc:493] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.535945  8263 leader_election.cc:290] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:11.542150  8303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54c4242890a943ec865bafae33141d3b" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:11.546145  8303 raft_consensus.cc:3060] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.545969  8073 raft_consensus.cc:515] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
W20260709 13:16:11.548502  7648 leader_election.cc:343] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.542999  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868663ec219f46a5abe840f8d43158e7" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:11.555615  7608 raft_consensus.cc:2468] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:11.555783  8303 raft_consensus.cc:2468] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 2.
I20260709 13:16:11.548663  8073 leader_election.cc:290] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.548859  7528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0" is_pre_election: true
I20260709 13:16:11.556694  7528 raft_consensus.cc:2468] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 2.
I20260709 13:16:11.534564  7682 raft_consensus.cc:2468] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 2.
I20260709 13:16:11.557765  8307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.557936  7650 leader_election.cc:304] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:11.558948  8073 raft_consensus.cc:2804] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:11.558980  7500 leader_election.cc:304] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.559435  8073 raft_consensus.cc:493] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.559840  8073 raft_consensus.cc:3060] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:11.560011  7648 leader_election.cc:343] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.560454  7500 leader_election.cc:304] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:11.561014  8342 raft_consensus.cc:2804] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.561880  8357 raft_consensus.cc:2804] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.562412  8357 raft_consensus.cc:697] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [term 2 LEADER]: Becoming Leader. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:11.563355  8357 consensus_queue.cc:237] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.542290  8354 raft_consensus.cc:2804] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.565418  8354 raft_consensus.cc:493] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.565908  8354 raft_consensus.cc:3060] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.550453  8262 raft_consensus.cc:493] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.550796  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54c4242890a943ec865bafae33141d3b" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:11.545035  7576 leader_election.cc:304] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: 
I20260709 13:16:11.567871  8184 raft_consensus.cc:2804] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.568243  8184 raft_consensus.cc:493] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.568555  8184 raft_consensus.cc:3060] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.570152  7607 raft_consensus.cc:2393] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a0eef4c5880424694542637530b55c0 in current term 2: Already voted for candidate 382e1f4385ac4066b7098e4fd1f5df06 in this term.
I20260709 13:16:11.570909  8262 raft_consensus.cc:515] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.575048  8303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361e20d70ddc4e43b3dcbe2e9ca30f50" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
W20260709 13:16:11.576331  7500 leader_election.cc:343] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.576630  7647 leader_election.cc:304] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.577703  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361e20d70ddc4e43b3dcbe2e9ca30f50" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:11.575914  8184 raft_consensus.cc:515] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.578303  8260 raft_consensus.cc:2804] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.578744  7795 raft_consensus.cc:493] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.579219  7795 raft_consensus.cc:515] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:11.579816  8184 leader_election.cc:290] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:11.581070  7795 leader_election.cc:290] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:11.578760  8260 raft_consensus.cc:493] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.581811  7530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96e53ac6d4a4521824a0eef2bf0400b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:11.575702  8262 leader_election.cc:290] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:11.582427  7530 raft_consensus.cc:3060] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.566776  8073 raft_consensus.cc:515] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.581980  8260 raft_consensus.cc:3060] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.590332  8303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:11.589972  7359 catalog_manager.cc:5697] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 1 to 2, leader changed from d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129) to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 2 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:11.578328  7608 raft_consensus.cc:2468] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 1.
W20260709 13:16:11.591894  7648 leader_election.cc:343] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.591743  7357 catalog_manager.cc:5697] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 reported cstate change: term changed from 1 to 2, leader changed from d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129) to 4a0eef4c5880424694542637530b55c0 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "4a0eef4c5880424694542637530b55c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.592478  7499 leader_election.cc:304] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.594118  7528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6aa50aa7a4ad9bbcbb6342bb232f2" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:11.592478  8073 leader_election.cc:290] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.593622  7357 catalog_manager.cc:5697] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 reported cstate change: term changed from 1 to 2, leader changed from d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129) to 4a0eef4c5880424694542637530b55c0 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "4a0eef4c5880424694542637530b55c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:11.594892  7528 raft_consensus.cc:3060] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:11.606065  7357 catalog_manager.cc:5697] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 reported cstate change: term changed from 1 to 2, leader changed from d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129) to 4a0eef4c5880424694542637530b55c0 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "4a0eef4c5880424694542637530b55c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:11.608944  8346 raft_consensus.cc:493] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.593873  8354 raft_consensus.cc:515] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.609521  8346 raft_consensus.cc:515] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:11.612013  8346 leader_election.cc:290] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.612540  7528 raft_consensus.cc:2468] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 3.
I20260709 13:16:11.575801  8342 raft_consensus.cc:697] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [term 2 LEADER]: Becoming Leader. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:11.613754  8307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2119d52e4a048ebb803fffdf77b85c2" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.613677  8342 consensus_queue.cc:237] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:11.614379  7608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a389b4005c4d6890f09b248b3e1ad8" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:11.598783  7530 raft_consensus.cc:2468] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 2.
W20260709 13:16:11.615535  7648 leader_election.cc:343] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.615898  7576 leader_election.cc:304] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: 
I20260709 13:16:11.617216  8263 raft_consensus.cc:2804] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.617654  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2119d52e4a048ebb803fffdf77b85c2" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:11.618403  7607 raft_consensus.cc:2468] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 1.
I20260709 13:16:11.617726  8263 raft_consensus.cc:697] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
W20260709 13:16:11.601060  7574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.132:35931, user_credentials={real_user=slave}} blocked reactor thread for 44884us
I20260709 13:16:11.600812  8260 raft_consensus.cc:515] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.619318  8354 leader_election.cc:290] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.619885  7574 leader_election.cc:304] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:11.619683  8263 consensus_queue.cc:237] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.602932  8259 raft_consensus.cc:359] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.612457  8303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a389b4005c4d6890f09b248b3e1ad8" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:11.620831  7647 leader_election.cc:304] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.621076  8345 raft_consensus.cc:2804] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.621452  8345 raft_consensus.cc:493] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.621775  8345 raft_consensus.cc:3060] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:11.621872  7648 leader_election.cc:343] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.595582  8262 raft_consensus.cc:2804] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.613842  7650 leader_election.cc:304] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.614955  7608 raft_consensus.cc:3060] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.622579  8262 raft_consensus.cc:493] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.623014  8262 raft_consensus.cc:3060] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.623586  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868663ec219f46a5abe840f8d43158e7" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:11.624155  7607 raft_consensus.cc:3060] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.624370  8259 raft_consensus.cc:740] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:11.625154  8259 consensus_queue.cc:260] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.625624  8346 raft_consensus.cc:2804] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:11.626003  8346 raft_consensus.cc:493] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:11.626343  8346 raft_consensus.cc:3060] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.627822  8260 leader_election.cc:290] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.628496  8260 raft_consensus.cc:2804] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:11.628973  8303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868663ec219f46a5abe840f8d43158e7" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
W20260709 13:16:11.634382  7648 leader_election.cc:343] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.635370  8260 raft_consensus.cc:697] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 3 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:11.636029  7608 raft_consensus.cc:2468] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 2.
I20260709 13:16:11.636363  8260 consensus_queue.cc:237] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.637163  7647 leader_election.cc:304] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.638229  8073 raft_consensus.cc:2804] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.638628  8073 raft_consensus.cc:697] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:11.629920  8345 raft_consensus.cc:515] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.535058  8176 raft_consensus.cc:515] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.632652  7607 raft_consensus.cc:2468] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 2.
W20260709 13:16:11.641817  7574 leader_election.cc:343] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.641916  7647 leader_election.cc:304] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.643620  8364 raft_consensus.cc:2804] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.644338  7574 leader_election.cc:304] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.646039  8364 raft_consensus.cc:697] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:11.646202  8263 raft_consensus.cc:2749] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:11.639468  8073 consensus_queue.cc:237] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.665436  7359 catalog_manager.cc:5697] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 1 to 2, leader changed from d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129) to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 2 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.649720  8176 leader_election.cc:290] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.647171  8262 raft_consensus.cc:515] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.665261  7357 catalog_manager.cc:5697] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 reported cstate change: term changed from 1 to 2, leader changed from d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129) to 4a0eef4c5880424694542637530b55c0 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "4a0eef4c5880424694542637530b55c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.699882  7357 catalog_manager.cc:5697] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 reported cstate change: term changed from 1 to 2, leader changed from d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129) to 4a0eef4c5880424694542637530b55c0 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "4a0eef4c5880424694542637530b55c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:11.660832  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79ef75f6ba41b4a0e56ba851add378" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:11.701267  8305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361e20d70ddc4e43b3dcbe2e9ca30f50" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:11.701534  8301 raft_consensus.cc:3060] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:11.702690  7500 leader_election.cc:343] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.636385  8346 raft_consensus.cc:515] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:11.704826  8346 leader_election.cc:290] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.691263  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79ef75f6ba41b4a0e56ba851add378" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:11.705932  7607 raft_consensus.cc:2393] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e733469bde7c479a916acbbe84b5f342 in current term 2: Already voted for candidate 382e1f4385ac4066b7098e4fd1f5df06 in this term.
I20260709 13:16:11.705827  8262 leader_election.cc:290] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:11.692265  8259 ts_tablet_manager.cc:1434] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.179s	user 0.009s	sys 0.000s
I20260709 13:16:11.707775  8259 tablet_bootstrap.cc:492] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:11.693099  8304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2119d52e4a048ebb803fffdf77b85c2" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.680315  8306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96e53ac6d4a4521824a0eef2bf0400b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:11.649138  8303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa473d10c0ad424f8268c67efcccccff" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.695827  8364 consensus_queue.cc:237] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.721251  8306 raft_consensus.cc:1275] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Refusing update from remote peer 4a0eef4c5880424694542637530b55c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.721673  8303 raft_consensus.cc:2393] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 382e1f4385ac4066b7098e4fd1f5df06 in current term 2: Already voted for candidate 4a0eef4c5880424694542637530b55c0 in this term.
I20260709 13:16:11.654209  8307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96e53ac6d4a4521824a0eef2bf0400b" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
I20260709 13:16:11.725972  8262 consensus_queue.cc:1048] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.726526  8304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79ef75f6ba41b4a0e56ba851add378" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:11.726408  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361e20d70ddc4e43b3dcbe2e9ca30f50" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:11.730024  7607 raft_consensus.cc:3060] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.645118  8345 leader_election.cc:290] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:11.736708  7608 raft_consensus.cc:1275] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Refusing update from remote peer 4a0eef4c5880424694542637530b55c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.741324  8342 consensus_queue.cc:1048] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.743556  8303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2119d52e4a048ebb803fffdf77b85c2" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
W20260709 13:16:11.743957  7647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:46815, user_credentials={real_user=slave}} blocked reactor thread for 88626us
I20260709 13:16:11.747475  7603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2119d52e4a048ebb803fffdf77b85c2" candidate_uuid: "e733469bde7c479a916acbbe84b5f342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:11.748135  7603 raft_consensus.cc:3060] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.753566  7682 raft_consensus.cc:1275] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Refusing update from remote peer 4a0eef4c5880424694542637530b55c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.755061  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2119d52e4a048ebb803fffdf77b85c2" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342" is_pre_election: true
I20260709 13:16:11.755760  7682 raft_consensus.cc:2393] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 382e1f4385ac4066b7098e4fd1f5df06 in current term 2: Already voted for candidate e733469bde7c479a916acbbe84b5f342 in this term.
I20260709 13:16:11.757596  7682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79ef75f6ba41b4a0e56ba851add378" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:11.758257  7682 raft_consensus.cc:2393] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 382e1f4385ac4066b7098e4fd1f5df06 in current term 2: Already voted for candidate e733469bde7c479a916acbbe84b5f342 in this term.
I20260709 13:16:11.758884  7528 raft_consensus.cc:1275] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Refusing update from remote peer 382e1f4385ac4066b7098e4fd1f5df06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.758983  8342 consensus_queue.cc:1048] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:16:11.764631  7648 leader_election.cc:343] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.764547  8343 consensus_queue.cc:1048] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.768863  7603 raft_consensus.cc:2468] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 2.
I20260709 13:16:11.773383  7355 catalog_manager.cc:5697] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 2 to 3, leader changed from d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129) to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 3 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:11.770601  7574 leader_election.cc:343] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:11.779654  7574 leader_election.cc:343] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.780766  7574 leader_election.cc:304] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
W20260709 13:16:11.782155  7574 leader_election.cc:343] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:11.782778  8343 raft_consensus.cc:3060] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.779633  8301 raft_consensus.cc:2468] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e733469bde7c479a916acbbe84b5f342 in term 2.
I20260709 13:16:11.791221  7648 leader_election.cc:304] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06
I20260709 13:16:11.797571  7574 leader_election.cc:304] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:11.798870  8345 raft_consensus.cc:2749] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:11.801460  7574 leader_election.cc:304] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06; no voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342
I20260709 13:16:11.802448  8263 raft_consensus.cc:2749] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:11.803220  8073 raft_consensus.cc:2804] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.804807  8073 raft_consensus.cc:697] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:11.806289  8073 consensus_queue.cc:237] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.812793  8259 tablet_bootstrap.cc:492] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:11.815693  8259 tablet_bootstrap.cc:492] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:11.816562  8259 ts_tablet_manager.cc:1403] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.003s
I20260709 13:16:11.813414  8343 raft_consensus.cc:2749] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:11.820545  8259 raft_consensus.cc:359] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.822628  8259 raft_consensus.cc:740] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:11.830585  7603 raft_consensus.cc:1275] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Refusing update from remote peer 4a0eef4c5880424694542637530b55c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.834884  8259 consensus_queue.cc:260] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:11.835896  7607 raft_consensus.cc:2468] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 2.
I20260709 13:16:11.837883  7499 leader_election.cc:304] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.838661  8306 raft_consensus.cc:1275] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Refusing update from remote peer 4a0eef4c5880424694542637530b55c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.846093  8259 ts_tablet_manager.cc:1434] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:16:11.847226  8342 raft_consensus.cc:2804] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.847736  8126 consensus_queue.cc:1048] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.859194  7647 leader_election.cc:304] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, e733469bde7c479a916acbbe84b5f342; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:11.856750  8259 tablet_bootstrap.cc:492] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:11.864112  8073 raft_consensus.cc:2804] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.865219  8073 raft_consensus.cc:697] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Becoming Leader. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
W20260709 13:16:11.874439  7500 consensus_peers.cc:597] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:11.862823  8262 consensus_queue.cc:1048] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:16:11.862509  8342 raft_consensus.cc:697] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [term 2 LEADER]: Becoming Leader. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:11.879024  8342 consensus_queue.cc:237] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:11.879608  8073 consensus_queue.cc:237] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
W20260709 13:16:11.881896  7500 consensus_peers.cc:597] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:11.891878  7359 catalog_manager.cc:5697] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 1 to 2, leader changed from d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129) to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 2 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:11.896963  7359 catalog_manager.cc:5697] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 1 to 2, leader changed from d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129) to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 2 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:11.901855  7359 catalog_manager.cc:5697] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 1 to 2, leader changed from d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129) to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 2 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:11.904141  8378 log.cc:927] Time spent T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:16:11.929204  7528 raft_consensus.cc:1275] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Refusing update from remote peer e733469bde7c479a916acbbe84b5f342: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.931717  8346 consensus_queue.cc:1048] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:11.959345  7648 consensus_peers.cc:597] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:11.963049  7574 consensus_peers.cc:597] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:11.963116  7607 raft_consensus.cc:1275] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Refusing update from remote peer 4a0eef4c5880424694542637530b55c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.968633  8342 consensus_queue.cc:1048] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.982223  7355 catalog_manager.cc:5697] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 reported cstate change: term changed from 1 to 2, leader changed from d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129) to 4a0eef4c5880424694542637530b55c0 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "4a0eef4c5880424694542637530b55c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:11.989486  8301 raft_consensus.cc:1275] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Refusing update from remote peer 4a0eef4c5880424694542637530b55c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.991427  8347 consensus_queue.cc:1048] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.993043  7603 raft_consensus.cc:1275] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Refusing update from remote peer 4a0eef4c5880424694542637530b55c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.994921  8262 consensus_queue.cc:1048] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:12.000133  8259 tablet_bootstrap.cc:492] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:12.001219  8259 tablet_bootstrap.cc:492] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:12.001914  8259 ts_tablet_manager.cc:1403] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.145s	user 0.016s	sys 0.008s
I20260709 13:16:12.004629  8259 raft_consensus.cc:359] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:12.005373  8259 raft_consensus.cc:740] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:12.006135  8259 consensus_queue.cc:260] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:12.010918  8259 ts_tablet_manager.cc:1434] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:16:12.012398  8259 tablet_bootstrap.cc:492] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
W20260709 13:16:12.024163  7500 consensus_peers.cc:597] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:12.020094  7357 catalog_manager.cc:5697] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 reported cstate change: term changed from 1 to 2, leader changed from d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129) to e733469bde7c479a916acbbe84b5f342 (127.31.17.132). New cstate: current_term: 2 leader_uuid: "e733469bde7c479a916acbbe84b5f342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:12.053289  7684 raft_consensus.cc:1275] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Refusing update from remote peer 4a0eef4c5880424694542637530b55c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:12.055249  8342 consensus_queue.cc:1048] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:12.063874  7530 raft_consensus.cc:1275] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Refusing update from remote peer 382e1f4385ac4066b7098e4fd1f5df06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:12.066236  8259 tablet_bootstrap.cc:492] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:12.069396  8259 tablet_bootstrap.cc:492] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:12.070014  8259 ts_tablet_manager.cc:1403] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.037s
I20260709 13:16:12.070245  8345 consensus_queue.cc:1048] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:12.072503  8259 raft_consensus.cc:359] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:12.073208  8259 raft_consensus.cc:740] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:12.073952  8259 consensus_queue.cc:260] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:12.075670  8259 ts_tablet_manager.cc:1434] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:16:12.079705  8259 tablet_bootstrap.cc:492] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
W20260709 13:16:12.120666  7574 consensus_peers.cc:597] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:12.126113  7528 raft_consensus.cc:1275] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 3 FOLLOWER]: Refusing update from remote peer e733469bde7c479a916acbbe84b5f342: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:12.126992  7648 consensus_peers.cc:597] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:12.128437  8073 consensus_queue.cc:1048] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:16:12.229341  7648 consensus_peers.cc:597] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:12.256641  7648 consensus_peers.cc:597] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:12.497884  7648 consensus_peers.cc:597] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:12.498694  7648 consensus_peers.cc:597] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:12.504626  8307 raft_consensus.cc:1275] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Refusing update from remote peer e733469bde7c479a916acbbe84b5f342: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:12.506052  8301 raft_consensus.cc:3060] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:12.539099  7648 consensus_peers.cc:597] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:12.541108  8176 consensus_queue.cc:1048] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:16:12.803395  7576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.011s	sys 0.016s
W20260709 13:16:12.803665  7576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.011s	sys 0.016s
I20260709 13:16:12.814903  7603 raft_consensus.cc:1275] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Refusing update from remote peer e733469bde7c479a916acbbe84b5f342: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:12.817070  7601 raft_consensus.cc:1275] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Refusing update from remote peer e733469bde7c479a916acbbe84b5f342: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:12.821830  7605 raft_consensus.cc:1275] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Refusing update from remote peer e733469bde7c479a916acbbe84b5f342: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:12.840875  8259 log.cc:927] Time spent T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a: Append to log took a long time: real 0.176s	user 0.001s	sys 0.004s
I20260709 13:16:12.842888  8259 tablet_bootstrap.cc:492] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:12.843943  8259 tablet_bootstrap.cc:492] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:12.844590  8259 ts_tablet_manager.cc:1403] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.768s	user 0.092s	sys 0.129s
I20260709 13:16:12.847097  8259 raft_consensus.cc:359] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:12.847790  8259 raft_consensus.cc:740] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:12.848511  8259 consensus_queue.cc:260] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:12.850921  8259 ts_tablet_manager.cc:1434] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:12.851804  8259 tablet_bootstrap.cc:492] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
W20260709 13:16:12.863710  7574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.009s	sys 0.000s
W20260709 13:16:12.864107  7574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.009s	sys 0.000s
W20260709 13:16:12.878419  7500 consensus_peers.cc:597] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:12.879920  7500 consensus_peers.cc:597] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:12.880936  7500 consensus_peers.cc:597] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:12.882727  7575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.000s	sys 0.014s
W20260709 13:16:12.883095  7575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.000s	sys 0.014s
I20260709 13:16:12.867180  8259 tablet_bootstrap.cc:492] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:12.886548  8259 tablet_bootstrap.cc:492] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:12.887334  8259 ts_tablet_manager.cc:1403] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.002s
I20260709 13:16:12.878424  8305 raft_consensus.cc:3060] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.888968  7610 raft_consensus.cc:1275] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Refusing update from remote peer e733469bde7c479a916acbbe84b5f342: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:12.891358  8259 raft_consensus.cc:359] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
W20260709 13:16:12.891928  7574 consensus_peers.cc:597] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:12.892200  8259 raft_consensus.cc:740] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
W20260709 13:16:12.892647  7574 consensus_peers.cc:597] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:12.892997  8259 consensus_queue.cc:260] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
W20260709 13:16:12.894613  7574 consensus_peers.cc:597] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:12.895557  8259 ts_tablet_manager.cc:1434] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:12.896461  8259 tablet_bootstrap.cc:492] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:12.944646  8259 tablet_bootstrap.cc:492] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:12.945911  8259 tablet_bootstrap.cc:492] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:12.946666  8259 ts_tablet_manager.cc:1403] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.050s	user 0.022s	sys 0.025s
W20260709 13:16:12.949599  8343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.005s	sys 0.009s
W20260709 13:16:12.950030  8343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.006s	sys 0.009s
W20260709 13:16:12.950971  7648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:35515, user_credentials={real_user=slave}} blocked reactor thread for 410862us
W20260709 13:16:12.959388  7500 consensus_peers.cc:597] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:12.962155  8259 raft_consensus.cc:359] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:12.968448  8305 raft_consensus.cc:3060] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.968775  7608 raft_consensus.cc:1275] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Refusing update from remote peer 4a0eef4c5880424694542637530b55c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:12.970378  8261 consensus_queue.cc:1048] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:12.963033  8259 raft_consensus.cc:740] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:12.982841  8259 consensus_queue.cc:260] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:12.986477  8259 ts_tablet_manager.cc:1434] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.001s
I20260709 13:16:12.987512  8259 tablet_bootstrap.cc:492] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:12.988042  8342 raft_consensus.cc:493] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.992507  8342 raft_consensus.cc:515] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:13.015216  8342 leader_election.cc:290] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:13.018218  7606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06" is_pre_election: true
I20260709 13:16:13.018949  7606 raft_consensus.cc:2468] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 2.
I20260709 13:16:13.020495  7499 leader_election.cc:304] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: 
I20260709 13:16:13.021279  8342 raft_consensus.cc:2804] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:13.021660  8342 raft_consensus.cc:493] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.021970  8342 raft_consensus.cc:3060] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:13.033715  8073 consensus_queue.cc:1048] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:13.036928  8073 consensus_queue.cc:1048] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:13.038856  8298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" is_pre_election: true
W20260709 13:16:13.045276  7500 leader_election.cc:343] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:13.086743  8364 consensus_queue.cc:1048] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
W20260709 13:16:13.117197  7500 consensus_peers.cc:597] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:13.119800  8342 raft_consensus.cc:515] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:13.122031  8342 leader_election.cc:290] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 3 election: Requested vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:13.131083  7606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:13.131805  7606 raft_consensus.cc:3060] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:13.132884  7647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:46815, user_credentials={real_user=slave}} blocked reactor thread for 62191.5us
I20260709 13:16:13.147365  8259 tablet_bootstrap.cc:492] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:13.156725  8259 tablet_bootstrap.cc:492] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:13.157934  8259 ts_tablet_manager.cc:1403] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.171s	user 0.033s	sys 0.044s
I20260709 13:16:13.162416  8305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
I20260709 13:16:13.150442  8176 consensus_queue.cc:1048] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
W20260709 13:16:13.194018  7648 consensus_peers.cc:597] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:13.199169  8259 raft_consensus.cc:359] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:13.201479  8259 raft_consensus.cc:740] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:13.202080  8259 consensus_queue.cc:260] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
W20260709 13:16:13.204694  7648 consensus_peers.cc:597] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:13.205677  8259 ts_tablet_manager.cc:1434] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
W20260709 13:16:13.205780  7648 consensus_peers.cc:597] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:13.211109  8259 tablet_bootstrap.cc:492] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:13.219149  7606 raft_consensus.cc:2468] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 3.
W20260709 13:16:13.222811  7500 leader_election.cc:343] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:13.244889  7499 leader_election.cc:304] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:13.246440  8261 raft_consensus.cc:2804] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:13.247252  8261 raft_consensus.cc:697] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 3 LEADER]: Becoming Leader. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:13.248811  8261 consensus_queue.cc:237] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
W20260709 13:16:13.274803  7648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:35515, user_credentials={real_user=slave}} blocked reactor thread for 44109.7us
I20260709 13:16:13.340361  7359 catalog_manager.cc:5697] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 reported cstate change: term changed from 1 to 3, leader changed from d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129) to 4a0eef4c5880424694542637530b55c0 (127.31.17.130). New cstate: current_term: 3 leader_uuid: "4a0eef4c5880424694542637530b55c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:13.389729  7574 consensus_peers.cc:597] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:13.439093  8305 raft_consensus.cc:3060] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:13.443432  7648 consensus_peers.cc:597] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:13.450264  7574 consensus_peers.cc:597] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:13.452847  8259 tablet_bootstrap.cc:492] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:13.453871  8259 tablet_bootstrap.cc:492] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:13.454536  8259 ts_tablet_manager.cc:1403] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.244s	user 0.017s	sys 0.012s
I20260709 13:16:13.457114  8259 raft_consensus.cc:359] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:13.457823  8259 raft_consensus.cc:740] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:13.470808  8259 consensus_queue.cc:260] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:13.484443  8259 ts_tablet_manager.cc:1434] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:16:13.493611  8259 tablet_bootstrap.cc:492] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:13.599220  8259 tablet_bootstrap.cc:492] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:13.600174  8259 tablet_bootstrap.cc:492] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:13.600836  8259 ts_tablet_manager.cc:1403] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.108s	user 0.019s	sys 0.068s
I20260709 13:16:13.602901  8259 raft_consensus.cc:359] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:13.603663  8259 raft_consensus.cc:740] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:13.604382  8259 consensus_queue.cc:260] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:13.606675  8259 ts_tablet_manager.cc:1434] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:13.607570  8259 tablet_bootstrap.cc:492] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:13.626295  8259 tablet_bootstrap.cc:492] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:13.627497  8259 tablet_bootstrap.cc:492] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:13.628290  8259 ts_tablet_manager.cc:1403] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.005s
I20260709 13:16:13.631265  8259 raft_consensus.cc:359] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:13.632153  8259 raft_consensus.cc:740] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:13.632908  8259 consensus_queue.cc:260] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:13.635772  8259 ts_tablet_manager.cc:1434] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:16:13.636771  8259 tablet_bootstrap.cc:492] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:13.653950  8259 tablet_bootstrap.cc:492] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:13.655007  8259 tablet_bootstrap.cc:492] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:13.655822  8259 ts_tablet_manager.cc:1403] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:16:13.658614  8259 raft_consensus.cc:359] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:13.659458  8259 raft_consensus.cc:740] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:13.660238  8259 consensus_queue.cc:260] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:13.662616  8259 ts_tablet_manager.cc:1434] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:13.664218  8259 tablet_bootstrap.cc:492] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
W20260709 13:16:13.678341  7557 debug-util.cc:398] Leaking SignalData structure 0x7b08002d5960 after lost signal to thread 31817
W20260709 13:16:13.679557  7557 debug-util.cc:398] Leaking SignalData structure 0x7b080023c420 after lost signal to thread 7393
W20260709 13:16:13.680868  7557 debug-util.cc:398] Leaking SignalData structure 0x7b08002cf8c0 after lost signal to thread 7560
W20260709 13:16:13.682076  7557 debug-util.cc:398] Leaking SignalData structure 0x7b0800286ca0 after lost signal to thread 7634
I20260709 13:16:13.684554  8259 tablet_bootstrap.cc:492] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:13.685668  8259 tablet_bootstrap.cc:492] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:13.686825  8259 ts_tablet_manager.cc:1403] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.013s
I20260709 13:16:13.689628  8259 raft_consensus.cc:359] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:13.690480  8259 raft_consensus.cc:740] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:13.691298  8259 consensus_queue.cc:260] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
W20260709 13:16:13.693434  7557 debug-util.cc:398] Leaking SignalData structure 0x7b0800065360 after lost signal to thread 7708
I20260709 13:16:13.693843  8259 ts_tablet_manager.cc:1434] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 13:16:13.694877  7557 debug-util.cc:398] Leaking SignalData structure 0x7b08003945e0 after lost signal to thread 8332
I20260709 13:16:13.695401  8259 tablet_bootstrap.cc:492] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:13.743381  8259 tablet_bootstrap.cc:492] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:13.744352  8259 tablet_bootstrap.cc:492] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:13.745049  8259 ts_tablet_manager.cc:1403] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.008s
I20260709 13:16:13.746577  7608 raft_consensus.cc:1275] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 3 FOLLOWER]: Refusing update from remote peer 4a0eef4c5880424694542637530b55c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:13.748608  8407 consensus_queue.cc:1048] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:13.748754  8259 raft_consensus.cc:359] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:13.749529  8259 raft_consensus.cc:740] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:13.750257  8259 consensus_queue.cc:260] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:13.752599  8259 ts_tablet_manager.cc:1434] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:13.754202  8259 tablet_bootstrap.cc:492] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:13.796231  8259 tablet_bootstrap.cc:492] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:13.798283  8259 tablet_bootstrap.cc:492] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:13.799206  8259 ts_tablet_manager.cc:1403] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.014s
I20260709 13:16:13.802711  8259 raft_consensus.cc:359] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:13.803467  8259 raft_consensus.cc:740] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:13.804313  8259 consensus_queue.cc:260] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:13.808476  8259 ts_tablet_manager.cc:1434] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
W20260709 13:16:13.815902  7500 consensus_peers.cc:597] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.820221  8259 tablet_bootstrap.cc:492] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:13.848610  8304 raft_consensus.cc:3060] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:13.925179  8259 tablet_bootstrap.cc:492] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:13.926157  8259 tablet_bootstrap.cc:492] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:13.926864  8259 ts_tablet_manager.cc:1403] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.117s	user 0.017s	sys 0.060s
I20260709 13:16:13.929308  8259 raft_consensus.cc:359] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:13.930440  8259 raft_consensus.cc:740] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:13.931056  8259 consensus_queue.cc:260] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:13.933161  8259 ts_tablet_manager.cc:1434] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:13.933925  8259 tablet_bootstrap.cc:492] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:13.971710  8259 tablet_bootstrap.cc:492] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:13.972707  8259 tablet_bootstrap.cc:492] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:13.973351  8259 ts_tablet_manager.cc:1403] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.040s	user 0.024s	sys 0.012s
I20260709 13:16:13.975793  8259 raft_consensus.cc:359] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:13.976433  8259 raft_consensus.cc:740] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:13.977156  8259 consensus_queue.cc:260] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:13.979154  8259 ts_tablet_manager.cc:1434] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:16:14.005013  8259 tablet_bootstrap.cc:492] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:14.027001  8259 tablet_bootstrap.cc:492] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:14.027971  8259 tablet_bootstrap.cc:492] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:14.028615  8259 ts_tablet_manager.cc:1403] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 13:16:14.030907  8259 raft_consensus.cc:359] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:14.031641  8259 raft_consensus.cc:740] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:14.032290  8259 consensus_queue.cc:260] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:14.034399  8259 ts_tablet_manager.cc:1434] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:16:14.038468  8259 tablet_bootstrap.cc:492] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:14.066390  8259 tablet_bootstrap.cc:492] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:14.067108  8259 tablet_bootstrap.cc:492] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:14.067657  8259 ts_tablet_manager.cc:1403] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.005s
I20260709 13:16:14.069429  8259 raft_consensus.cc:359] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:14.070103  8259 raft_consensus.cc:740] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:14.070636  8259 consensus_queue.cc:260] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:14.072532  8259 ts_tablet_manager.cc:1434] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:14.073526  8259 tablet_bootstrap.cc:492] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:14.096022  8259 tablet_bootstrap.cc:492] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:14.096987  8259 tablet_bootstrap.cc:492] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:14.097671  8259 ts_tablet_manager.cc:1403] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.008s
I20260709 13:16:14.099996  8259 raft_consensus.cc:359] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:14.106747  8259 raft_consensus.cc:740] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:14.107458  8259 consensus_queue.cc:260] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:14.109539  8259 ts_tablet_manager.cc:1434] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:16:14.110309  8259 tablet_bootstrap.cc:492] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:14.127601  8259 tablet_bootstrap.cc:492] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:14.128648  8259 tablet_bootstrap.cc:492] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:14.129447  8259 ts_tablet_manager.cc:1403] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:16:14.236021  8259 raft_consensus.cc:359] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:14.248890  8259 raft_consensus.cc:740] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:14.258684  8259 consensus_queue.cc:260] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:14.264775  8259 ts_tablet_manager.cc:1434] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.135s	user 0.007s	sys 0.007s
I20260709 13:16:14.265555  8302 raft_consensus.cc:3060] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:14.289736  8259 tablet_bootstrap.cc:492] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:14.411865  8304 raft_consensus.cc:3060] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.425953  8259 tablet_bootstrap.cc:492] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:14.427088  8259 tablet_bootstrap.cc:492] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:14.427892  8259 ts_tablet_manager.cc:1403] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.139s	user 0.030s	sys 0.024s
I20260709 13:16:14.430752  8259 raft_consensus.cc:359] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:14.431483  8259 raft_consensus.cc:740] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:14.433722  8259 consensus_queue.cc:260] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:14.436632  8259 ts_tablet_manager.cc:1434] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:14.437748  8259 tablet_bootstrap.cc:492] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:14.461525  8259 tablet_bootstrap.cc:492] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:14.462606  8259 tablet_bootstrap.cc:492] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:14.463281  8259 ts_tablet_manager.cc:1403] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.007s
I20260709 13:16:14.466166  8259 raft_consensus.cc:359] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:14.467875  8259 raft_consensus.cc:740] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:14.470894  8259 consensus_queue.cc:260] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:14.473548  8259 ts_tablet_manager.cc:1434] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:16:14.474561  8259 tablet_bootstrap.cc:492] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:14.549119  8259 tablet_bootstrap.cc:492] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:14.550094  8259 tablet_bootstrap.cc:492] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:14.550760  8259 ts_tablet_manager.cc:1403] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.077s	user 0.040s	sys 0.028s
I20260709 13:16:14.553478  8259 raft_consensus.cc:359] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:14.554165  8259 raft_consensus.cc:740] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:14.554924  8259 consensus_queue.cc:260] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:14.561360  8259 ts_tablet_manager.cc:1434] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.006s
I20260709 13:16:14.562224  8259 tablet_bootstrap.cc:492] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:14.579800  8259 tablet_bootstrap.cc:492] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:14.580741  8259 tablet_bootstrap.cc:492] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:14.581421  8259 ts_tablet_manager.cc:1403] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:16:14.584642  8259 raft_consensus.cc:359] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:14.585359  8259 raft_consensus.cc:740] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:14.586097  8259 consensus_queue.cc:260] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:14.588294  8259 ts_tablet_manager.cc:1434] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:16:14.589421  8259 tablet_bootstrap.cc:492] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:14.606691  8259 tablet_bootstrap.cc:492] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:14.607607  8259 tablet_bootstrap.cc:492] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:14.608234  8259 ts_tablet_manager.cc:1403] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:16:14.610746  8259 raft_consensus.cc:359] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:14.611217  8259 raft_consensus.cc:740] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:14.611884  8259 consensus_queue.cc:260] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:14.613611  8259 ts_tablet_manager.cc:1434] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:14.614851  8259 tablet_bootstrap.cc:492] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:14.640532  8305 raft_consensus.cc:3060] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:14.685895  8259 tablet_bootstrap.cc:492] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:14.686831  8259 tablet_bootstrap.cc:492] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:14.687471  8259 ts_tablet_manager.cc:1403] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.073s	user 0.024s	sys 0.042s
I20260709 13:16:14.690145  8259 raft_consensus.cc:359] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:14.690804  8259 raft_consensus.cc:740] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:14.691504  8259 consensus_queue.cc:260] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:14.692978  8259 ts_tablet_manager.cc:1434] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:16:14.693859  8259 tablet_bootstrap.cc:492] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:14.710881  8259 tablet_bootstrap.cc:492] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:14.711881  8259 tablet_bootstrap.cc:492] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:14.712522  8259 ts_tablet_manager.cc:1403] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:16:14.714643  8259 raft_consensus.cc:359] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:14.715152  8259 raft_consensus.cc:740] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:14.715855  8259 consensus_queue.cc:260] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:14.717468  8259 ts_tablet_manager.cc:1434] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:14.718452  8259 tablet_bootstrap.cc:492] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:14.738952  8259 tablet_bootstrap.cc:492] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:14.740356  8259 tablet_bootstrap.cc:492] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:14.741014  8259 ts_tablet_manager.cc:1403] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.001s
I20260709 13:16:14.743383  8259 raft_consensus.cc:359] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:14.743880  8259 raft_consensus.cc:740] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:14.744400  8259 consensus_queue.cc:260] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:14.746284  8259 ts_tablet_manager.cc:1434] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.003s
I20260709 13:16:14.747375  8259 tablet_bootstrap.cc:492] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap starting.
I20260709 13:16:14.825953  8259 tablet_bootstrap.cc:492] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:14.826894  8259 tablet_bootstrap.cc:492] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a: Bootstrap complete.
I20260709 13:16:14.827569  8259 ts_tablet_manager.cc:1403] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent bootstrapping tablet: real 0.080s	user 0.057s	sys 0.014s
I20260709 13:16:14.830142  8259 raft_consensus.cc:359] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:14.830840  8259 raft_consensus.cc:740] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Initialized, Role: FOLLOWER
I20260709 13:16:14.831559  8259 consensus_queue.cc:260] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:14.834218  8259 ts_tablet_manager.cc:1434] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:14.835340  8305 raft_consensus.cc:3060] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.855067  8302 raft_consensus.cc:3060] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.916226  8302 raft_consensus.cc:3060] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.959342  8302 raft_consensus.cc:3060] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.133877 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:21.186690  7609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0433292c261b4a29b57235e8647c5db8"
dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
mode: GRACEFUL
new_leader_uuid: "4a0eef4c5880424694542637530b55c0"
 from {username='slave'} at 127.0.0.1:53214
I20260709 13:16:21.187481  7609 raft_consensus.cc:606] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Received request to transfer leadership to TS 4a0eef4c5880424694542637530b55c0
I20260709 13:16:21.190729  7609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a5f0a58d050468dae029bfd50e74d02"
dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
mode: GRACEFUL
new_leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:53214
I20260709 13:16:21.191395  7609 raft_consensus.cc:606] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Received request to transfer leadership to TS d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:21.193964  7609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d716d1bf1004e7ca0d255d7d9c50835"
dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
mode: GRACEFUL
new_leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:53214
I20260709 13:16:21.194422  7609 raft_consensus.cc:606] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Received request to transfer leadership to TS d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:21.209635  7527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82d28d9895a5469db67cd40794083e95"
dest_uuid: "4a0eef4c5880424694542637530b55c0"
mode: GRACEFUL
new_leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:34048
I20260709 13:16:21.210238  7527 raft_consensus.cc:606] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Received request to transfer leadership to TS d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:21.229743  7684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "868663ec219f46a5abe840f8d43158e7"
dest_uuid: "e733469bde7c479a916acbbe84b5f342"
mode: GRACEFUL
new_leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:54548
I20260709 13:16:21.230361  7684 raft_consensus.cc:606] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Received request to transfer leadership to TS d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:21.233394  7609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a87af8743bc441c28b895aa411d33f2a"
dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
mode: GRACEFUL
new_leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:53214
I20260709 13:16:21.233841  7609 raft_consensus.cc:606] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Received request to transfer leadership to TS d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:21.234799 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:21.236177 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:21.265954  8402 raft_consensus.cc:993] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06: : Instructing follower d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:21.266650  8496 raft_consensus.cc:1081] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Signalling peer d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:21.269272  8305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d716d1bf1004e7ca0d255d7d9c50835"
dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:36674
I20260709 13:16:21.270145  8305 raft_consensus.cc:493] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:21.271477  8305 raft_consensus.cc:3060] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.273273  8490 raft_consensus.cc:993] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342: : Instructing follower d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:21.273880  8492 raft_consensus.cc:1081] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Signalling peer d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:21.275326  8304 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "868663ec219f46a5abe840f8d43158e7"
dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:36694
I20260709 13:16:21.275830  8304 raft_consensus.cc:493] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:21.276140  8304 raft_consensus.cc:3060] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.281461  8304 raft_consensus.cc:515] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:21.281876  8305 raft_consensus.cc:515] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:21.294963  8305 leader_election.cc:290] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:21.303066  8304 leader_election.cc:290] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 3 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:21.343149  7527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d716d1bf1004e7ca0d255d7d9c50835" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:21.344058  7527 raft_consensus.cc:3060] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.348714  7609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d716d1bf1004e7ca0d255d7d9c50835" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:21.349411  7609 raft_consensus.cc:3055] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:21.349691  7609 raft_consensus.cc:740] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:21.350515  7609 consensus_queue.cc:260] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:21.351110  8487 raft_consensus.cc:993] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06: : Instructing follower 4a0eef4c5880424694542637530b55c0 to start an election
I20260709 13:16:21.351945  7609 raft_consensus.cc:3060] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.354205  7527 raft_consensus.cc:2468] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 2.
I20260709 13:16:21.354452  8402 raft_consensus.cc:1081] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Signalling peer 4a0eef4c5880424694542637530b55c0 to start an election
I20260709 13:16:21.355707  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868663ec219f46a5abe840f8d43158e7" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:21.356330  8256 leader_election.cc:304] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:21.357365  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "868663ec219f46a5abe840f8d43158e7" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:21.357947  7684 raft_consensus.cc:3055] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:21.358253  7684 raft_consensus.cc:740] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:21.360057  7527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0433292c261b4a29b57235e8647c5db8"
dest_uuid: "4a0eef4c5880424694542637530b55c0"
 from {username='slave'} at 127.0.0.1:56090
I20260709 13:16:21.356351  7607 raft_consensus.cc:3060] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.360580  7527 raft_consensus.cc:493] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:21.360929  7527 raft_consensus.cc:3060] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.362545  7609 raft_consensus.cc:2468] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 2.
I20260709 13:16:21.359058  7684 consensus_queue.cc:260] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:21.366019  7684 raft_consensus.cc:3060] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.369936  7607 raft_consensus.cc:2468] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 3.
I20260709 13:16:21.371390  8253 leader_election.cc:304] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:21.376030  7684 raft_consensus.cc:2468] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 3.
I20260709 13:16:21.380188  8506 raft_consensus.cc:2804] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:21.380826  7527 raft_consensus.cc:515] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:21.382767  8508 raft_consensus.cc:2804] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:21.385604  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0433292c261b4a29b57235e8647c5db8" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:21.384929  8508 raft_consensus.cc:697] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:21.386524  7684 raft_consensus.cc:3060] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.387620  8488 raft_consensus.cc:993] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0: : Instructing follower d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:21.387393  8508 consensus_queue.cc:237] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:21.385769  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0433292c261b4a29b57235e8647c5db8" candidate_uuid: "4a0eef4c5880424694542637530b55c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:21.388404  7607 raft_consensus.cc:3055] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:21.388721  7607 raft_consensus.cc:740] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:21.388856  8495 raft_consensus.cc:1081] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Signalling peer d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:21.389482  7607 consensus_queue.cc:260] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:21.390588  7607 raft_consensus.cc:3060] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.391187  8304 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82d28d9895a5469db67cd40794083e95"
dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:16:21.391852  8304 raft_consensus.cc:493] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:21.392233  8304 raft_consensus.cc:3060] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.393699  7684 raft_consensus.cc:2468] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 2.
I20260709 13:16:21.383924  7527 leader_election.cc:290] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:21.395534  7500 leader_election.cc:304] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:21.396324  8488 raft_consensus.cc:2804] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:21.396755  8488 raft_consensus.cc:697] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [term 2 LEADER]: Becoming Leader. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:21.397456  8506 raft_consensus.cc:697] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:21.398191  7607 raft_consensus.cc:2468] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0eef4c5880424694542637530b55c0 in term 2.
I20260709 13:16:21.397500  8488 consensus_queue.cc:237] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:21.398411  8506 consensus_queue.cc:237] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:21.400108  8304 raft_consensus.cc:515] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:21.404588  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d28d9895a5469db67cd40794083e95" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:21.405490  7679 raft_consensus.cc:3060] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.419565  8304 leader_election.cc:290] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:21.424788  7527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d28d9895a5469db67cd40794083e95" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:21.425379  7527 raft_consensus.cc:3055] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:21.425796  7527 raft_consensus.cc:740] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:21.425228  7359 catalog_manager.cc:5697] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 reported cstate change: term changed from 1 to 2, leader changed from 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131) to 4a0eef4c5880424694542637530b55c0 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "4a0eef4c5880424694542637530b55c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.426538  7527 consensus_queue.cc:260] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:21.427006  7679 raft_consensus.cc:2468] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 2.
I20260709 13:16:21.427940  7527 raft_consensus.cc:3060] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.431542  8254 leader_election.cc:304] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:21.435858  8506 raft_consensus.cc:2804] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:21.436691  8506 raft_consensus.cc:697] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:21.437950  8506 consensus_queue.cc:237] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:21.441368  7527 raft_consensus.cc:2468] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 2.
I20260709 13:16:21.445811  8487 raft_consensus.cc:993] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06: : Instructing follower d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:21.450932  8496 raft_consensus.cc:1081] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Signalling peer d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:21.452958  8305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a5f0a58d050468dae029bfd50e74d02"
dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:36674
I20260709 13:16:21.453495  8305 raft_consensus.cc:493] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:21.453869  8305 raft_consensus.cc:3060] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.453511  7357 catalog_manager.cc:5697] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 1 to 2, leader changed from 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131) to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 2 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.460870  8305 raft_consensus.cc:515] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:21.463688  8305 leader_election.cc:290] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:21.463671  7607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5f0a58d050468dae029bfd50e74d02" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:21.464505  7607 raft_consensus.cc:3055] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:21.464931  7607 raft_consensus.cc:740] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:21.466017  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5f0a58d050468dae029bfd50e74d02" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:21.465881  7607 consensus_queue.cc:260] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:21.466603  7684 raft_consensus.cc:3060] T 6a5f0a58d050468dae029bfd50e74d02 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.471195  7607 raft_consensus.cc:3060] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.483035  7684 raft_consensus.cc:2468] T 6a5f0a58d050468dae029bfd50e74d02 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 2.
I20260709 13:16:21.484714  7607 raft_consensus.cc:2468] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 2.
I20260709 13:16:21.484736  8254 leader_election.cc:304] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:21.485860  8506 raft_consensus.cc:2804] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:21.486371  8506 raft_consensus.cc:697] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:21.487197  8506 consensus_queue.cc:237] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:21.503728  7357 catalog_manager.cc:5697] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 2 to 3, leader changed from e733469bde7c479a916acbbe84b5f342 (127.31.17.132) to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 3 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:21.505322  7357 catalog_manager.cc:5697] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 1 to 2, leader changed from 4a0eef4c5880424694542637530b55c0 (127.31.17.130) to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 2 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.506261  7357 catalog_manager.cc:5697] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 1 to 2, leader changed from 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131) to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 2 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:21.633865  8402 raft_consensus.cc:993] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06: : Instructing follower d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:21.634472  8505 raft_consensus.cc:1081] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Signalling peer d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:21.636018  8304 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a87af8743bc441c28b895aa411d33f2a"
dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:36674
I20260709 13:16:21.636543  8304 raft_consensus.cc:493] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:21.636906  8304 raft_consensus.cc:3060] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.642834  8304 raft_consensus.cc:515] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:21.644244  8304 leader_election.cc:290] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:21.644837  7609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87af8743bc441c28b895aa411d33f2a" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:21.645092  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87af8743bc441c28b895aa411d33f2a" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:21.645432  7609 raft_consensus.cc:3055] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:21.645613  7684 raft_consensus.cc:3060] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.645802  7609 raft_consensus.cc:740] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:21.646493  7609 consensus_queue.cc:260] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:21.647358  7609 raft_consensus.cc:3060] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.650187  7684 raft_consensus.cc:2468] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 2.
I20260709 13:16:21.651342  8254 leader_election.cc:304] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:21.651873  7609 raft_consensus.cc:2468] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 2.
I20260709 13:16:21.652019  8506 raft_consensus.cc:2804] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:21.652609  8506 raft_consensus.cc:697] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:21.653352  8506 consensus_queue.cc:237] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:21.665051  7357 catalog_manager.cc:5697] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 1 to 2, leader changed from 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131) to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 2 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:21.806520  7684 raft_consensus.cc:1275] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:21.807628  8506 consensus_queue.cc:1048] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:21.821475  7609 raft_consensus.cc:1275] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 3 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:21.823202  8507 consensus_queue.cc:1048] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:21.837874  7684 raft_consensus.cc:1275] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:21.839860  7528 raft_consensus.cc:1275] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:21.842053  7607 raft_consensus.cc:1275] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:21.843372  8506 consensus_queue.cc:1048] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:21.844995  8506 consensus_queue.cc:1048] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:21.849987  8507 consensus_queue.cc:1048] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:21.876490  7679 raft_consensus.cc:1275] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Refusing update from remote peer 4a0eef4c5880424694542637530b55c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:21.880367  7527 raft_consensus.cc:1275] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:21.890741  8508 consensus_queue.cc:1048] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:21.891367  8494 consensus_queue.cc:1048] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:16:21.959802  7609 raft_consensus.cc:1275] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Refusing update from remote peer 4a0eef4c5880424694542637530b55c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:21.961082  8494 consensus_queue.cc:1048] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:21.976874  7684 raft_consensus.cc:1275] T 6a5f0a58d050468dae029bfd50e74d02 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:21.978379  8507 consensus_queue.cc:1048] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:21.995179  7609 raft_consensus.cc:1275] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:21.996701  8508 consensus_queue.cc:1048] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:22.192481  7609 raft_consensus.cc:1275] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:22.193630  8506 consensus_queue.cc:1048] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:22.206869  7684 raft_consensus.cc:1275] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:22.208163  8508 consensus_queue.cc:1048] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:22.237186 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:22.279738 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:22.317179  7684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ce2cd95149b4e5999f7b078e668f5b7"
dest_uuid: "e733469bde7c479a916acbbe84b5f342"
mode: GRACEFUL
new_leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:54548
I20260709 13:16:22.317808  7684 raft_consensus.cc:606] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Received request to transfer leadership to TS d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:22.320942  7684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e442d8263394fa7bd9df6ee46bb246e"
dest_uuid: "e733469bde7c479a916acbbe84b5f342"
mode: GRACEFUL
new_leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:54548
I20260709 13:16:22.321813  7684 raft_consensus.cc:606] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Received request to transfer leadership to TS d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:22.328249  7528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7"
dest_uuid: "4a0eef4c5880424694542637530b55c0"
mode: GRACEFUL
new_leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:34048
I20260709 13:16:22.328974  7528 raft_consensus.cc:606] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 3 LEADER]: Received request to transfer leadership to TS d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:22.332448  7528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2234d05a2ffa48c18ad9af837d067f5a"
dest_uuid: "4a0eef4c5880424694542637530b55c0"
mode: GRACEFUL
new_leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:34048
I20260709 13:16:22.333015  7528 raft_consensus.cc:606] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Received request to transfer leadership to TS d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:22.337981  7684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7bab86470a74fdfb18b961658f9e371"
dest_uuid: "e733469bde7c479a916acbbe84b5f342"
mode: GRACEFUL
new_leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:54548
I20260709 13:16:22.339538  7684 raft_consensus.cc:606] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Received request to transfer leadership to TS d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:22.343416 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:22.345532 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:22.348395  8531 raft_consensus.cc:993] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342: : Instructing follower d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:22.348953  8503 raft_consensus.cc:1081] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Signalling peer d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:22.350811  8304 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ce2cd95149b4e5999f7b078e668f5b7"
dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:36694
I20260709 13:16:22.351480  8304 raft_consensus.cc:493] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:22.351817  8304 raft_consensus.cc:3060] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.358342  8304 raft_consensus.cc:515] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:22.360160  8304 leader_election.cc:290] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:22.360757  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce2cd95149b4e5999f7b078e668f5b7" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:22.361112  7528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce2cd95149b4e5999f7b078e668f5b7" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:22.361291  7684 raft_consensus.cc:3055] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:22.361599  7684 raft_consensus.cc:740] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:22.361661  7528 raft_consensus.cc:3060] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.362280  7684 consensus_queue.cc:260] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:22.363212  7684 raft_consensus.cc:3060] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.369354  7684 raft_consensus.cc:2468] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 2.
I20260709 13:16:22.370297  8254 leader_election.cc:304] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:22.371701  7528 raft_consensus.cc:2468] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 2.
I20260709 13:16:22.372018  8508 raft_consensus.cc:2804] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:22.372503  8508 raft_consensus.cc:697] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:22.373208  8508 consensus_queue.cc:237] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:22.384433  7358 catalog_manager.cc:5697] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 1 to 2, leader changed from e733469bde7c479a916acbbe84b5f342 (127.31.17.132) to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 2 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:22.467046  8495 raft_consensus.cc:993] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0: : Instructing follower d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:22.467607  8494 raft_consensus.cc:1081] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 3 LEADER]: Signalling peer d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:22.469165  8304 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7"
dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:16:22.469697  8304 raft_consensus.cc:493] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:22.470043  8304 raft_consensus.cc:3060] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:22.475638  8304 raft_consensus.cc:515] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:22.477440  8304 leader_election.cc:290] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 4 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:22.478137  7527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:22.478338  7609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e689baf00c741e2ae7e123bad19a9a7" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:22.478761  7527 raft_consensus.cc:3055] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:22.478897  7609 raft_consensus.cc:3060] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:22.479120  7527 raft_consensus.cc:740] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:22.479959  7527 consensus_queue.cc:260] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:22.480868  7527 raft_consensus.cc:3060] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:22.485838  7609 raft_consensus.cc:2468] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 4.
I20260709 13:16:22.487175  7527 raft_consensus.cc:2468] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 4.
I20260709 13:16:22.487298  8253 leader_election.cc:304] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:22.488359  8508 raft_consensus.cc:2804] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:22.488830  8508 raft_consensus.cc:697] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 4 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:22.489650  8508 consensus_queue.cc:237] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:22.505317  8495 raft_consensus.cc:993] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0: : Instructing follower d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:22.511644  8495 raft_consensus.cc:1081] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Signalling peer d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:22.511443  7358 catalog_manager.cc:5697] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 3 to 4, leader changed from 4a0eef4c5880424694542637530b55c0 (127.31.17.130) to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 4 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:22.515754  8305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2234d05a2ffa48c18ad9af837d067f5a"
dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:16:22.516417  8305 raft_consensus.cc:493] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:22.516773  8305 raft_consensus.cc:3060] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.520007  8503 raft_consensus.cc:993] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342: : Instructing follower d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:22.521286  8490 raft_consensus.cc:1081] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Signalling peer d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:22.523435  8302 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e442d8263394fa7bd9df6ee46bb246e"
dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:36694
I20260709 13:16:22.523968  8302 raft_consensus.cc:493] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:22.524323  8302 raft_consensus.cc:3060] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.525982  8305 raft_consensus.cc:515] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:22.527770  8305 leader_election.cc:290] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:22.528476  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2234d05a2ffa48c18ad9af837d067f5a" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:22.528829  7527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2234d05a2ffa48c18ad9af837d067f5a" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:22.529055  7684 raft_consensus.cc:3060] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.529438  7527 raft_consensus.cc:3055] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:22.529850  7527 raft_consensus.cc:740] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a0eef4c5880424694542637530b55c0, State: Running, Role: LEADER
I20260709 13:16:22.529457  8302 raft_consensus.cc:515] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:22.530660  7527 consensus_queue.cc:260] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:22.531772  8302 leader_election.cc:290] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 3 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:22.532215  7527 raft_consensus.cc:3060] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.532634  7528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e442d8263394fa7bd9df6ee46bb246e" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:22.533207  7528 raft_consensus.cc:3060] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.535316  7684 raft_consensus.cc:2468] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 2.
I20260709 13:16:22.535621  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e442d8263394fa7bd9df6ee46bb246e" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:22.536212  7679 raft_consensus.cc:3055] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:22.536499  7679 raft_consensus.cc:740] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:22.537199  7679 consensus_queue.cc:260] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:22.537441  8254 leader_election.cc:304] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:22.538331  8508 raft_consensus.cc:2804] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:22.538470  7679 raft_consensus.cc:3060] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.539058  8508 raft_consensus.cc:697] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:22.539665  7527 raft_consensus.cc:2468] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 2.
I20260709 13:16:22.540035  8508 consensus_queue.cc:237] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:22.545559  7679 raft_consensus.cc:2468] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 3.
I20260709 13:16:22.546799  8254 leader_election.cc:304] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d54f6e4b9e604cd78c48a1828cd3b23a, e733469bde7c479a916acbbe84b5f342; no voters: 
I20260709 13:16:22.547943  8506 raft_consensus.cc:2804] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:22.548545  8506 raft_consensus.cc:697] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:22.549108  7528 raft_consensus.cc:2468] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 3.
I20260709 13:16:22.549453  8506 consensus_queue.cc:237] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:22.558439  7358 catalog_manager.cc:5697] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 1 to 2, leader changed from 4a0eef4c5880424694542637530b55c0 (127.31.17.130) to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 2 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:22.574183  7358 catalog_manager.cc:5697] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 2 to 3, leader changed from e733469bde7c479a916acbbe84b5f342 (127.31.17.132) to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 3 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:22.801975  7684 raft_consensus.cc:1275] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:22.804431  8508 consensus_queue.cc:1048] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:22.807358  8503 raft_consensus.cc:993] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342: : Instructing follower d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:22.809098  8503 raft_consensus.cc:1081] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Signalling peer d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:22.810288  7527 raft_consensus.cc:1275] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:22.813053  8506 consensus_queue.cc:1048] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:22.817129  8302 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7bab86470a74fdfb18b961658f9e371"
dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:36694
I20260709 13:16:22.824548  8302 raft_consensus.cc:493] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:22.825073  8302 raft_consensus.cc:3060] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.840786  8302 raft_consensus.cc:515] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:22.846208  7605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7bab86470a74fdfb18b961658f9e371" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:22.846886  7605 raft_consensus.cc:3060] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.852432  8302 leader_election.cc:290] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:22.853219  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7bab86470a74fdfb18b961658f9e371" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:22.853847  7679 raft_consensus.cc:3055] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:22.854166  7679 raft_consensus.cc:740] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:22.854882  7679 consensus_queue.cc:260] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:22.856040  7605 raft_consensus.cc:2468] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 2.
I20260709 13:16:22.856165  7679 raft_consensus.cc:3060] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.856761  7609 raft_consensus.cc:1240] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Rejecting Update request from peer e733469bde7c479a916acbbe84b5f342 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:22.862900  8253 leader_election.cc:304] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:22.864265  8508 raft_consensus.cc:2804] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:22.864758  8508 raft_consensus.cc:697] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:22.865754  8508 consensus_queue.cc:237] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:22.885154  7679 raft_consensus.cc:2468] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 2.
I20260709 13:16:22.891974  7359 catalog_manager.cc:5697] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 1 to 2, leader changed from e733469bde7c479a916acbbe84b5f342 (127.31.17.132) to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 2 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:22.949900  7609 raft_consensus.cc:1275] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 4 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:22.951148  8508 consensus_queue.cc:1048] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:22.961733  7527 raft_consensus.cc:1275] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [term 3 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:22.962167  7528 raft_consensus.cc:1275] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 4 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:22.963923  8507 consensus_queue.cc:1048] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:22.963807  8508 consensus_queue.cc:1048] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:16:22.976914  7679 raft_consensus.cc:1275] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:22.978557  8506 consensus_queue.cc:1048] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:22.999758  7528 raft_consensus.cc:1275] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:23.002244  8552 consensus_queue.cc:1048] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:23.023443  7679 raft_consensus.cc:1275] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:23.025018  8551 consensus_queue.cc:1048] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:23.346578 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:23.391901 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:23.438369  7679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58b825b38d394fbfbdf8cb645514c782"
dest_uuid: "e733469bde7c479a916acbbe84b5f342"
mode: GRACEFUL
new_leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
 from {username='slave'} at 127.0.0.1:54548
I20260709 13:16:23.439005  7679 raft_consensus.cc:606] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Received request to transfer leadership to TS 382e1f4385ac4066b7098e4fd1f5df06
I20260709 13:16:23.442047  7679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8219a2ee929d4169bde0d0eaf559f7d9"
dest_uuid: "e733469bde7c479a916acbbe84b5f342"
mode: GRACEFUL
new_leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:54548
I20260709 13:16:23.442628  7679 raft_consensus.cc:606] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Received request to transfer leadership to TS d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:23.445210  7679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2119d52e4a048ebb803fffdf77b85c2"
dest_uuid: "e733469bde7c479a916acbbe84b5f342"
mode: GRACEFUL
new_leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:54548
I20260709 13:16:23.445761  7679 raft_consensus.cc:606] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Received request to transfer leadership to TS d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:23.448014  7679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0a389b4005c4d6890f09b248b3e1ad8"
dest_uuid: "e733469bde7c479a916acbbe84b5f342"
mode: GRACEFUL
new_leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:54548
I20260709 13:16:23.448498  7679 raft_consensus.cc:606] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Received request to transfer leadership to TS d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:23.449709 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:16:23.450847 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:23.480918  7679 raft_consensus.cc:1275] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:23.482170  8552 consensus_queue.cc:1048] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:23.491462  7609 raft_consensus.cc:1275] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:23.493134  8506 consensus_queue.cc:1048] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:23.713227  8503 raft_consensus.cc:993] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342: : Instructing follower 382e1f4385ac4066b7098e4fd1f5df06 to start an election
I20260709 13:16:23.713829  8531 raft_consensus.cc:1081] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Signalling peer 382e1f4385ac4066b7098e4fd1f5df06 to start an election
I20260709 13:16:23.716676  7609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58b825b38d394fbfbdf8cb645514c782"
dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
 from {username='slave'} at 127.0.0.1:43502
I20260709 13:16:23.719007  7609 raft_consensus.cc:493] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:23.719437  7609 raft_consensus.cc:3060] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.726037  7609 raft_consensus.cc:515] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:23.728094  7609 leader_election.cc:290] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:23.728732  7527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b825b38d394fbfbdf8cb645514c782" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:23.729351  7527 raft_consensus.cc:3060] T 58b825b38d394fbfbdf8cb645514c782 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.729827  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b825b38d394fbfbdf8cb645514c782" candidate_uuid: "382e1f4385ac4066b7098e4fd1f5df06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:23.730327  7679 raft_consensus.cc:3055] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:23.730599  7679 raft_consensus.cc:740] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:23.731362  7679 consensus_queue.cc:260] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:23.732287  7679 raft_consensus.cc:3060] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.734380  7527 raft_consensus.cc:2468] T 58b825b38d394fbfbdf8cb645514c782 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 2.
I20260709 13:16:23.735560  7576 leader_election.cc:304] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, 4a0eef4c5880424694542637530b55c0; no voters: 
I20260709 13:16:23.736217  8505 raft_consensus.cc:2804] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:23.736599  8505 raft_consensus.cc:697] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 LEADER]: Becoming Leader. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:23.736900  7679 raft_consensus.cc:2468] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 382e1f4385ac4066b7098e4fd1f5df06 in term 2.
I20260709 13:16:23.737447  8505 consensus_queue.cc:237] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:23.751741  7358 catalog_manager.cc:5697] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 reported cstate change: term changed from 1 to 2, leader changed from e733469bde7c479a916acbbe84b5f342 (127.31.17.132) to 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131). New cstate: current_term: 2 leader_uuid: "382e1f4385ac4066b7098e4fd1f5df06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:23.809854  8531 raft_consensus.cc:993] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342: : Instructing follower d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:23.810364  8503 raft_consensus.cc:1081] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Signalling peer d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:23.811718  8302 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0a389b4005c4d6890f09b248b3e1ad8"
dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:36694
I20260709 13:16:23.812181  8302 raft_consensus.cc:493] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:23.812464  8302 raft_consensus.cc:3060] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:23.817039  8302 raft_consensus.cc:515] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:23.818631  8302 leader_election.cc:290] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 3 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:23.819379  7609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a389b4005c4d6890f09b248b3e1ad8" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:23.819669  7684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a389b4005c4d6890f09b248b3e1ad8" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:23.820009  7609 raft_consensus.cc:3060] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:23.820299  7684 raft_consensus.cc:3055] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:23.820611  7684 raft_consensus.cc:740] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:23.821341  7684 consensus_queue.cc:260] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:23.822485  7684 raft_consensus.cc:3060] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:23.824652  7609 raft_consensus.cc:2468] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 3.
I20260709 13:16:23.825832  8253 leader_election.cc:304] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:23.826556  8506 raft_consensus.cc:2804] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:23.827008  8506 raft_consensus.cc:697] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:23.827894  8506 consensus_queue.cc:237] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:23.831920  7684 raft_consensus.cc:2468] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 3.
I20260709 13:16:23.837939  7358 catalog_manager.cc:5697] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 2 to 3, leader changed from e733469bde7c479a916acbbe84b5f342 (127.31.17.132) to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 3 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:23.877048  8531 raft_consensus.cc:993] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342: : Instructing follower d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:23.877557  8503 raft_consensus.cc:1081] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Signalling peer d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:23.879132  8305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2119d52e4a048ebb803fffdf77b85c2"
dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:36694
I20260709 13:16:23.879761  8305 raft_consensus.cc:493] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:23.880064  8305 raft_consensus.cc:3060] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:23.885386  8305 raft_consensus.cc:515] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:23.886853  8305 leader_election.cc:290] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 3 election: Requested vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931)
I20260709 13:16:23.887701  7609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2119d52e4a048ebb803fffdf77b85c2" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:23.888083  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2119d52e4a048ebb803fffdf77b85c2" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:23.888342  7609 raft_consensus.cc:3060] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:23.888675  7679 raft_consensus.cc:3055] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:23.889815  7679 raft_consensus.cc:740] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:23.891008  7679 consensus_queue.cc:260] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:23.892032  7679 raft_consensus.cc:3060] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:23.895715  7609 raft_consensus.cc:2468] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 3.
I20260709 13:16:23.897063  8253 leader_election.cc:304] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:23.897854  8506 raft_consensus.cc:2804] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:23.899083  8506 raft_consensus.cc:697] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:23.899974  8506 consensus_queue.cc:237] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } }
I20260709 13:16:23.902338  7679 raft_consensus.cc:2468] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 3.
I20260709 13:16:23.909971  7358 catalog_manager.cc:5697] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 2 to 3, leader changed from e733469bde7c479a916acbbe84b5f342 (127.31.17.132) to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 3 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:23.913488  8531 raft_consensus.cc:993] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342: : Instructing follower d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:23.914042  8503 raft_consensus.cc:1081] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Signalling peer d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:23.915578  8305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8219a2ee929d4169bde0d0eaf559f7d9"
dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:36694
I20260709 13:16:23.916102  8305 raft_consensus.cc:493] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:23.916452  8305 raft_consensus.cc:3060] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.923002  8305 raft_consensus.cc:515] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:23.924623  8305 leader_election.cc:290] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 election: Requested vote from peers e733469bde7c479a916acbbe84b5f342 (127.31.17.132:35931), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:23.925392  7679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8219a2ee929d4169bde0d0eaf559f7d9" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e733469bde7c479a916acbbe84b5f342"
I20260709 13:16:23.925529  7527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8219a2ee929d4169bde0d0eaf559f7d9" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:23.926138  7679 raft_consensus.cc:3055] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:23.926196  7527 raft_consensus.cc:3060] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.926491  7679 raft_consensus.cc:740] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e733469bde7c479a916acbbe84b5f342, State: Running, Role: LEADER
I20260709 13:16:23.927253  7679 consensus_queue.cc:260] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:23.928319  7679 raft_consensus.cc:3060] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.931097  7527 raft_consensus.cc:2468] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 2.
I20260709 13:16:23.932116  8256 leader_election.cc:304] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:23.932883  8506 raft_consensus.cc:2804] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:23.934163  8506 raft_consensus.cc:697] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:23.934614  7679 raft_consensus.cc:2468] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 2.
I20260709 13:16:23.935192  8506 consensus_queue.cc:237] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:23.948786  7358 catalog_manager.cc:5697] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 1 to 2, leader changed from e733469bde7c479a916acbbe84b5f342 (127.31.17.132) to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 2 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:24.249409  7684 raft_consensus.cc:1275] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Refusing update from remote peer 382e1f4385ac4066b7098e4fd1f5df06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:24.253549  8505 consensus_queue.cc:1048] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:24.278692  7680 raft_consensus.cc:1275] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:24.281028  8551 consensus_queue.cc:1048] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:24.294894  7609 raft_consensus.cc:1275] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 3 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:24.299815  8507 consensus_queue.cc:1048] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:24.343185  7527 raft_consensus.cc:1275] T 58b825b38d394fbfbdf8cb645514c782 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Refusing update from remote peer 382e1f4385ac4066b7098e4fd1f5df06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:24.345217  8505 consensus_queue.cc:1048] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:16:24.427946  7527 raft_consensus.cc:1275] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:24.462102 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:24.506932  7680 raft_consensus.cc:1275] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:24.501375  7684 raft_consensus.cc:1275] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:24.554962  8582 consensus_queue.cc:1048] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:16:24.581358  8579 consensus_queue.cc:1048] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:16:24.588840  8593 consensus_queue.cc:1048] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:16:24.639367  7609 raft_consensus.cc:1275] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [term 3 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:24.665277  8593 consensus_queue.cc:1048] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:24.768013 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:24.814391  7605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1560149675ca410fa6cbef0e9eb5bb22"
dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
mode: GRACEFUL
new_leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:53214
I20260709 13:16:24.815093  7605 raft_consensus.cc:606] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 LEADER]: Received request to transfer leadership to TS d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:24.816720 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:16:24.818236 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:24.939220  8402 raft_consensus.cc:993] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06: : Instructing follower d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:24.939791  8505 raft_consensus.cc:1081] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 LEADER]: Signalling peer d54f6e4b9e604cd78c48a1828cd3b23a to start an election
I20260709 13:16:24.941123  8305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1560149675ca410fa6cbef0e9eb5bb22"
dest_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a"
 from {username='slave'} at 127.0.0.1:36674
I20260709 13:16:24.941599  8305 raft_consensus.cc:493] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:24.941941  8305 raft_consensus.cc:3060] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.949361  8305 raft_consensus.cc:515] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:24.951298  8305 leader_election.cc:290] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 3 election: Requested vote from peers 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835), 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815)
I20260709 13:16:24.952267  7527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560149675ca410fa6cbef0e9eb5bb22" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a0eef4c5880424694542637530b55c0"
I20260709 13:16:24.952608  7605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560149675ca410fa6cbef0e9eb5bb22" candidate_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "382e1f4385ac4066b7098e4fd1f5df06"
I20260709 13:16:24.953032  7527 raft_consensus.cc:3060] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.953228  7605 raft_consensus.cc:3055] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:24.953593  7605 raft_consensus.cc:740] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 382e1f4385ac4066b7098e4fd1f5df06, State: Running, Role: LEADER
I20260709 13:16:24.954459  7605 consensus_queue.cc:260] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:24.955790  7605 raft_consensus.cc:3060] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.961120  7527 raft_consensus.cc:2468] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 3.
I20260709 13:16:24.962030  7605 raft_consensus.cc:2468] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f6e4b9e604cd78c48a1828cd3b23a in term 3.
I20260709 13:16:24.962572  8256 leader_election.cc:304] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a; no voters: 
I20260709 13:16:24.963380  8579 raft_consensus.cc:2804] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:24.963871  8579 raft_consensus.cc:697] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 LEADER]: Becoming Leader. State: Replica: d54f6e4b9e604cd78c48a1828cd3b23a, State: Running, Role: LEADER
I20260709 13:16:24.965057  8579 consensus_queue.cc:237] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } }
I20260709 13:16:24.976389  7355 catalog_manager.cc:5697] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a reported cstate change: term changed from 2 to 3, leader changed from 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131) to d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129). New cstate: current_term: 3 leader_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:25.473938  7527 raft_consensus.cc:1275] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 3 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:25.474907  7605 raft_consensus.cc:1275] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 3 FOLLOWER]: Refusing update from remote peer d54f6e4b9e604cd78c48a1828cd3b23a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:25.475181  8590 consensus_queue.cc:1048] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:25.476384  8593 consensus_queue.cc:1048] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:25.819100 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:25.855831 31814 tablet_server.cc:179] TabletServer@127.31.17.129:35515 shutting down...
W20260709 13:16:25.861925  7574 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 68 similar messages]
W20260709 13:16:25.865653  7574 consensus_peers.cc:597] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:25.875276  7500 consensus_peers.cc:597] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:25.891330  7500 consensus_peers.cc:597] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:25.892659 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:25.893630 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.894574 31814 raft_consensus.cc:2243] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:25.895614 31814 raft_consensus.cc:2272] T b2119d52e4a048ebb803fffdf77b85c2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.898948 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.899853 31814 raft_consensus.cc:2243] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:25.900415 31814 raft_consensus.cc:2272] T ce18aefbfb644eeab2cfc05f961b1771 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:25.900740  7648 consensus_peers.cc:597] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:25.901258  7500 consensus_peers.cc:597] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:25.903051  7648 consensus_peers.cc:597] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:25.903641 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.904343 31814 raft_consensus.cc:2243] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:25.904759 31814 raft_consensus.cc:2272] T 20ee12a0193649c295925bc14e57d382 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.907135 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.907881 31814 raft_consensus.cc:2243] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:25.908733 31814 raft_consensus.cc:2272] T 6d716d1bf1004e7ca0d255d7d9c50835 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.910961 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.911649 31814 raft_consensus.cc:2243] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:25.912063 31814 raft_consensus.cc:2272] T 2a6621f1923f4b5b9885003705a57309 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.914244 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.914923 31814 raft_consensus.cc:2243] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:25.915351 31814 raft_consensus.cc:2272] T 81671c7a827b47caac30f622c4407bf4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.917672 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.918286 31814 raft_consensus.cc:2243] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:25.918733 31814 raft_consensus.cc:2272] T 120b8b81bd894896b1bdf58d7b461d41 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.920881 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.921633 31814 raft_consensus.cc:2243] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:25.922083 31814 raft_consensus.cc:2272] T 7b4e6876d12b4cf6ad01688451c1b033 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.925061 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.925666 31814 raft_consensus.cc:2243] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:25.926091 31814 raft_consensus.cc:2272] T b50e7db706514f8bb0b8885fca0868d3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.928493 31814 tablet_replica.cc:333] stopping tablet replica
W20260709 13:16:25.928553  7574 consensus_peers.cc:597] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:25.929293 31814 raft_consensus.cc:2243] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:25.930897 31814 raft_consensus.cc:2272] T a87af8743bc441c28b895aa411d33f2a P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.933879 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.934430 31814 raft_consensus.cc:2243] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:25.934934 31814 raft_consensus.cc:2272] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.937738 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.938549 31814 raft_consensus.cc:2243] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:25.939476 31814 raft_consensus.cc:2272] T 8219a2ee929d4169bde0d0eaf559f7d9 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.943308 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.944061 31814 raft_consensus.cc:2243] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:25.944571 31814 raft_consensus.cc:2272] T b215f304c98341bebbc937add44da99d P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.947469 31814 tablet_replica.cc:333] stopping tablet replica
W20260709 13:16:25.947501  7574 consensus_peers.cc:597] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:25.948345 31814 raft_consensus.cc:2243] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:25.948969 31814 raft_consensus.cc:2272] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.952009 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.952791 31814 raft_consensus.cc:2243] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:25.953346 31814 raft_consensus.cc:2272] T 98892caf6b1549c8a1906b47c1298334 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.956084 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.956880 31814 raft_consensus.cc:2243] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:25.957894 31814 raft_consensus.cc:2272] T e7bab86470a74fdfb18b961658f9e371 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:25.961251  7648 consensus_peers.cc:597] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:25.966404 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.967393 31814 raft_consensus.cc:2243] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:25.967922 31814 raft_consensus.cc:2272] T 343cf82796c24137960d60c292b5dd42 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.970870 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.971697 31814 raft_consensus.cc:2243] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:25.972235 31814 raft_consensus.cc:2272] T 11909bda591f4d61a9817bd3575748b5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.975040 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.975800 31814 raft_consensus.cc:2243] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:25.976264 31814 raft_consensus.cc:2272] T e1b1bccbb9eb4fc7987174b429fce6d4 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.978716 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.979208 31814 raft_consensus.cc:2243] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:25.979657 31814 raft_consensus.cc:2272] T 81703e5e726a4905a8cff753fe076535 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.982332 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.983033 31814 raft_consensus.cc:2243] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:25.983610 31814 raft_consensus.cc:2272] T a87d88042080495293c0e772b280f3da P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:25.984216  7574 consensus_peers.cc:597] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:25.986096 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.986759 31814 raft_consensus.cc:2243] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:25.987569 31814 raft_consensus.cc:2272] T 0e442d8263394fa7bd9df6ee46bb246e P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.989662 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.990263 31814 raft_consensus.cc:2243] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:25.991086 31814 raft_consensus.cc:2272] T 6a5f0a58d050468dae029bfd50e74d02 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.994370 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.995290 31814 raft_consensus.cc:2243] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:25.995766 31814 raft_consensus.cc:2272] T 29addb5a68094e16887e2c843d5b1ef5 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:25.998224 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:25.998800 31814 raft_consensus.cc:2243] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:25.999328 31814 raft_consensus.cc:2272] T 54c4242890a943ec865bafae33141d3b P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.001425 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.001958 31814 raft_consensus.cc:2243] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.002372 31814 raft_consensus.cc:2272] T 5f4267f73a67486e8568dfa6c4a0bd7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.005160 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.005937 31814 raft_consensus.cc:2243] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.006453 31814 raft_consensus.cc:2272] T a899962d588849ccb4af0f8cb06c07d0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.009078 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.009661 31814 raft_consensus.cc:2243] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.010470 31814 raft_consensus.cc:2272] T 0ce2cd95149b4e5999f7b078e668f5b7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.013054 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.013793 31814 raft_consensus.cc:2243] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.014290 31814 raft_consensus.cc:2272] T c9b5ae77739f4adca66b64acf11c42ce P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.017153 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.017747 31814 raft_consensus.cc:2243] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.018164 31814 raft_consensus.cc:2272] T cfd5d05ff1384d2c9c133fdb0483f29a P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.020401 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.020985 31814 raft_consensus.cc:2243] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.021478 31814 raft_consensus.cc:2272] T c96e53ac6d4a4521824a0eef2bf0400b P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.023581 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.024139 31814 raft_consensus.cc:2243] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.024582 31814 raft_consensus.cc:2272] T ecfe0c23a9c54b2dbe03deca022a9123 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.027304 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.027842 31814 raft_consensus.cc:2243] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.028250 31814 raft_consensus.cc:2272] T 8e6382ace6264a0db74146326b719f7b P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.030838 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.031464 31814 raft_consensus.cc:2243] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.031934 31814 raft_consensus.cc:2272] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.034498 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.035060 31814 raft_consensus.cc:2243] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.036376 31814 raft_consensus.cc:2272] T d0a389b4005c4d6890f09b248b3e1ad8 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.038892 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.040650 31814 raft_consensus.cc:2243] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.041203 31814 raft_consensus.cc:2272] T 5266494b97e8402b9696d8771ca7e9f0 P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:26.042410  7648 consensus_peers.cc:597] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.044281 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.045246 31814 raft_consensus.cc:2243] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.046073 31814 raft_consensus.cc:2272] T 1560149675ca410fa6cbef0e9eb5bb22 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:26.047465  7500 consensus_peers.cc:597] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.048739 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.049494 31814 raft_consensus.cc:2243] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.049958 31814 raft_consensus.cc:2272] T aa473d10c0ad424f8268c67efcccccff P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.052343 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.052933 31814 raft_consensus.cc:2243] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.053911 31814 raft_consensus.cc:2272] T 868663ec219f46a5abe840f8d43158e7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.056169 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.056648 31814 raft_consensus.cc:2243] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.057371 31814 raft_consensus.cc:2272] T 2234d05a2ffa48c18ad9af837d067f5a P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.059428 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.059978 31814 raft_consensus.cc:2243] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.060331 31814 raft_consensus.cc:2272] T ee023e046cb943559b9daae3b76c4adf P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.062240 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.062698 31814 raft_consensus.cc:2243] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.063488 31814 raft_consensus.cc:2272] T 1e689baf00c741e2ae7e123bad19a9a7 P d54f6e4b9e604cd78c48a1828cd3b23a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.065995 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.066681 31814 raft_consensus.cc:2243] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.067148 31814 raft_consensus.cc:2272] T fb1b71c94d284d209da03c159c07316f P d54f6e4b9e604cd78c48a1828cd3b23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.069845 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.070501 31814 raft_consensus.cc:2243] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:16:26.070678  7500 consensus_peers.cc:597] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.071441 31814 raft_consensus.cc:2272] T 82d28d9895a5469db67cd40794083e95 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.073895 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:26.074513 31814 raft_consensus.cc:2243] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.075070 31814 raft_consensus.cc:2272] T de79ef75f6ba41b4a0e56ba851add378 P d54f6e4b9e604cd78c48a1828cd3b23a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:26.079597  7648 consensus_peers.cc:597] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.084683  7500 consensus_peers.cc:597] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.093660  7500 consensus_peers.cc:597] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.120775  7500 consensus_peers.cc:597] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.126590  7574 consensus_peers.cc:597] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.127676  7648 consensus_peers.cc:597] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.157544  7574 consensus_peers.cc:597] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.160246 31814 tablet_server.cc:196] TabletServer@127.31.17.129:35515 shutdown complete.
W20260709 13:16:26.164029  7500 consensus_peers.cc:597] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.172683  7574 consensus_peers.cc:597] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.222899  7500 consensus_peers.cc:597] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.232472  7500 consensus_peers.cc:597] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.250244 31814 tablet_server.cc:179] TabletServer@127.31.17.130:0 shutting down...
W20260709 13:16:26.258562  7576 consensus_peers.cc:597] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.269060  7650 consensus_peers.cc:597] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.282454  7574 consensus_peers.cc:597] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.292985  7648 consensus_peers.cc:597] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.293490  7648 consensus_peers.cc:597] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.307065 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:16:26.307296  7650 consensus_peers.cc:597] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.308274 31814 tablet_replica.cc:333] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.309348 31814 raft_consensus.cc:2243] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.309995 31814 raft_consensus.cc:2272] T 2234d05a2ffa48c18ad9af837d067f5a P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.312177 31814 tablet_replica.cc:333] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.312762 31814 raft_consensus.cc:2243] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.313266 31814 raft_consensus.cc:2272] T 2a6621f1923f4b5b9885003705a57309 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.316370 31814 tablet_replica.cc:333] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.317225 31814 raft_consensus.cc:2243] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.317778 31814 raft_consensus.cc:2272] T 1560149675ca410fa6cbef0e9eb5bb22 P 4a0eef4c5880424694542637530b55c0 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:26.319839  7576 consensus_peers.cc:597] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.320976 31814 tablet_replica.cc:333] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
W20260709 13:16:26.321310  7650 consensus_peers.cc:597] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.321942 31814 raft_consensus.cc:2243] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.322738 31814 raft_consensus.cc:2272] T b50e7db706514f8bb0b8885fca0868d3 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.325060 31814 tablet_replica.cc:333] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.325934 31814 raft_consensus.cc:2243] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.326771 31814 raft_consensus.cc:2272] T ce18aefbfb644eeab2cfc05f961b1771 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.328836 31814 tablet_replica.cc:333] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.329928 31814 raft_consensus.cc:2243] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.330801 31814 raft_consensus.cc:2272] T d351dea40bb24488b7159df0e49bb759 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.333079 31814 tablet_replica.cc:333] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.333653 31814 raft_consensus.cc:2243] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.334429 31814 raft_consensus.cc:2272] T 54c4242890a943ec865bafae33141d3b P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:26.336081  7576 consensus_peers.cc:597] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.336884 31814 tablet_replica.cc:333] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.337755 31814 raft_consensus.cc:2243] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.338308 31814 raft_consensus.cc:2272] T 58c780fdb61048ac8f4c44481a73f9ff P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:26.339886  7576 consensus_peers.cc:597] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.340474  7650 consensus_peers.cc:597] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.341179 31814 tablet_replica.cc:333] T b215f304c98341bebbc937add44da99d P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.341759 31814 raft_consensus.cc:2243] T b215f304c98341bebbc937add44da99d P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.342145 31814 raft_consensus.cc:2272] T b215f304c98341bebbc937add44da99d P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.344180 31814 tablet_replica.cc:333] T 29addb5a68094e16887e2c843d5b1ef5 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.344686 31814 raft_consensus.cc:2243] T 29addb5a68094e16887e2c843d5b1ef5 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.345027 31814 raft_consensus.cc:2272] T 29addb5a68094e16887e2c843d5b1ef5 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.347523 31814 tablet_replica.cc:333] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.348270 31814 raft_consensus.cc:2243] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.348824 31814 raft_consensus.cc:2272] T 1ce8654527b4453bab2b63775a4e2601 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:26.349139  7650 consensus_peers.cc:597] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.351024 31814 tablet_replica.cc:333] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.351781 31814 raft_consensus.cc:2243] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.352602 31814 raft_consensus.cc:2272] T 0433292c261b4a29b57235e8647c5db8 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.354398 31814 tablet_replica.cc:333] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.354915 31814 raft_consensus.cc:2243] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.355703 31814 raft_consensus.cc:2272] T 8e6382ace6264a0db74146326b719f7b P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.357772 31814 tablet_replica.cc:333] T 5266494b97e8402b9696d8771ca7e9f0 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.358366 31814 raft_consensus.cc:2243] T 5266494b97e8402b9696d8771ca7e9f0 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.358886 31814 raft_consensus.cc:2272] T 5266494b97e8402b9696d8771ca7e9f0 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.361059 31814 tablet_replica.cc:333] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.361737 31814 raft_consensus.cc:2243] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:26.362062  7574 consensus_peers.cc:597] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.362210 31814 raft_consensus.cc:2272] T 0e442d8263394fa7bd9df6ee46bb246e P 4a0eef4c5880424694542637530b55c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.364631 31814 tablet_replica.cc:333] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.365415 31814 raft_consensus.cc:2243] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.366173 31814 raft_consensus.cc:2272] T e1b1bccbb9eb4fc7987174b429fce6d4 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.368765 31814 tablet_replica.cc:333] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.369365 31814 raft_consensus.cc:2243] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:16:26.369688  7574 consensus_peers.cc:597] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.370410 31814 raft_consensus.cc:2272] T a87d88042080495293c0e772b280f3da P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.373013 31814 tablet_replica.cc:333] T 3e8887c1835b4d5b9697b6a44f0efd7e P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.373690 31814 raft_consensus.cc:2243] T 3e8887c1835b4d5b9697b6a44f0efd7e P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.374277 31814 raft_consensus.cc:2272] T 3e8887c1835b4d5b9697b6a44f0efd7e P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:26.376150  7500 consensus_peers.cc:597] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.376966 31814 tablet_replica.cc:333] T e8380470ec0d46c1914152ad9818bab7 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.377974 31814 raft_consensus.cc:2243] T e8380470ec0d46c1914152ad9818bab7 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.378535 31814 raft_consensus.cc:2272] T e8380470ec0d46c1914152ad9818bab7 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.381199 31814 tablet_replica.cc:333] T ee023e046cb943559b9daae3b76c4adf P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.381907 31814 raft_consensus.cc:2243] T ee023e046cb943559b9daae3b76c4adf P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.382339 31814 raft_consensus.cc:2272] T ee023e046cb943559b9daae3b76c4adf P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.384863 31814 tablet_replica.cc:333] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.385479 31814 raft_consensus.cc:2243] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.386483 31814 raft_consensus.cc:2272] T e0e1f08d649449a6a1a39b78f0b7adff P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.389014 31814 tablet_replica.cc:333] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.389801 31814 raft_consensus.cc:2243] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.390378 31814 raft_consensus.cc:2272] T 5e84fe9726f946d2b3552cd90cf46b98 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:26.390597  7574 consensus_peers.cc:597] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Couldn't send request to peer d54f6e4b9e604cd78c48a1828cd3b23a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.393154 31814 tablet_replica.cc:333] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.394091 31814 raft_consensus.cc:2243] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.394759 31814 raft_consensus.cc:2272] T 120b8b81bd894896b1bdf58d7b461d41 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:26.396142  7576 consensus_peers.cc:597] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.397778 31814 tablet_replica.cc:333] T 7b4e6876d12b4cf6ad01688451c1b033 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.398749 31814 raft_consensus.cc:2243] T 7b4e6876d12b4cf6ad01688451c1b033 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.399391 31814 raft_consensus.cc:2272] T 7b4e6876d12b4cf6ad01688451c1b033 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.403334 31814 tablet_replica.cc:333] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.404057 31814 raft_consensus.cc:2243] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.404678 31814 raft_consensus.cc:2272] T 82d28d9895a5469db67cd40794083e95 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.407500 31814 tablet_replica.cc:333] T bf1e31a4767d403688a20b985eb0ab79 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.408078 31814 raft_consensus.cc:2243] T bf1e31a4767d403688a20b985eb0ab79 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.408612 31814 raft_consensus.cc:2272] T bf1e31a4767d403688a20b985eb0ab79 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.410599 31814 tablet_replica.cc:333] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.411136 31814 raft_consensus.cc:2243] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.411672 31814 raft_consensus.cc:2272] T 6d716d1bf1004e7ca0d255d7d9c50835 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.413985 31814 tablet_replica.cc:333] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.414592 31814 raft_consensus.cc:2243] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.415704 31814 raft_consensus.cc:2272] T a899962d588849ccb4af0f8cb06c07d0 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.418496 31814 tablet_replica.cc:333] T 20ee12a0193649c295925bc14e57d382 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.419168 31814 raft_consensus.cc:2243] T 20ee12a0193649c295925bc14e57d382 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.419699 31814 raft_consensus.cc:2272] T 20ee12a0193649c295925bc14e57d382 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.422008 31814 tablet_replica.cc:333] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.422722 31814 raft_consensus.cc:2243] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.423812 31814 raft_consensus.cc:2272] T c9b5ae77739f4adca66b64acf11c42ce P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.426580 31814 tablet_replica.cc:333] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.427321 31814 raft_consensus.cc:2243] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.427847 31814 raft_consensus.cc:2272] T 0ce2cd95149b4e5999f7b078e668f5b7 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.430496 31814 tablet_replica.cc:333] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.431263 31814 raft_consensus.cc:2243] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.432353 31814 raft_consensus.cc:2272] T aa473d10c0ad424f8268c67efcccccff P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:26.432698  7650 consensus_peers.cc:597] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.435349 31814 tablet_replica.cc:333] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.436179 31814 raft_consensus.cc:2243] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.436733 31814 raft_consensus.cc:2272] T 33e9e771ee0f4cb6b649f9ebc0056443 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.439597 31814 tablet_replica.cc:333] T 4d154a19800f414dbaec32117c0ca6bd P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.440330 31814 raft_consensus.cc:2243] T 4d154a19800f414dbaec32117c0ca6bd P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.440871 31814 raft_consensus.cc:2272] T 4d154a19800f414dbaec32117c0ca6bd P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.443645 31814 tablet_replica.cc:333] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.444289 31814 raft_consensus.cc:2243] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.444846 31814 raft_consensus.cc:2272] T c96e53ac6d4a4521824a0eef2bf0400b P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.447513 31814 tablet_replica.cc:333] T e250baa9f7b44f2fb0002ff47f7c34db P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.448341 31814 raft_consensus.cc:2243] T e250baa9f7b44f2fb0002ff47f7c34db P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.448884 31814 raft_consensus.cc:2272] T e250baa9f7b44f2fb0002ff47f7c34db P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.451628 31814 tablet_replica.cc:333] T 58b825b38d394fbfbdf8cb645514c782 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.452355 31814 raft_consensus.cc:2243] T 58b825b38d394fbfbdf8cb645514c782 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.452844 31814 raft_consensus.cc:2272] T 58b825b38d394fbfbdf8cb645514c782 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:26.453915  7576 consensus_peers.cc:597] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.455641 31814 tablet_replica.cc:333] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.456494 31814 raft_consensus.cc:2243] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.457054 31814 raft_consensus.cc:2272] T 1e689baf00c741e2ae7e123bad19a9a7 P 4a0eef4c5880424694542637530b55c0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.459985 31814 tablet_replica.cc:333] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.460757 31814 raft_consensus.cc:2243] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.465878 31814 raft_consensus.cc:2272] T 98892caf6b1549c8a1906b47c1298334 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.469060 31814 tablet_replica.cc:333] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.469911 31814 raft_consensus.cc:2243] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.470566 31814 raft_consensus.cc:2272] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P 4a0eef4c5880424694542637530b55c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.473770 31814 tablet_replica.cc:333] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.474627 31814 raft_consensus.cc:2243] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.475769 31814 raft_consensus.cc:2272] T cfd5d05ff1384d2c9c133fdb0483f29a P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.478745 31814 tablet_replica.cc:333] T 1ea546eef5aa4273af08f1b3468c5369 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.479525 31814 raft_consensus.cc:2243] T 1ea546eef5aa4273af08f1b3468c5369 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.480026 31814 raft_consensus.cc:2272] T 1ea546eef5aa4273af08f1b3468c5369 P 4a0eef4c5880424694542637530b55c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.482601 31814 tablet_replica.cc:333] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.483086 31814 raft_consensus.cc:2243] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.483520 31814 raft_consensus.cc:2272] T 8219a2ee929d4169bde0d0eaf559f7d9 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.485409 31814 tablet_replica.cc:333] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0: stopping tablet replica
I20260709 13:16:26.485868 31814 raft_consensus.cc:2243] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.486804 31814 raft_consensus.cc:2272] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 4a0eef4c5880424694542637530b55c0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:26.527261  7650 consensus_peers.cc:597] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.535753  7650 consensus_peers.cc:597] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.574388  7650 consensus_peers.cc:597] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:45835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.602397 31814 tablet_server.cc:196] TabletServer@127.31.17.130:0 shutdown complete.
I20260709 13:16:26.684686 31814 tablet_server.cc:179] TabletServer@127.31.17.131:0 shutting down...
W20260709 13:16:26.693914  7647 consensus_peers.cc:597] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 -> Peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Couldn't send request to peer 382e1f4385ac4066b7098e4fd1f5df06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.713930  7576 consensus_peers.cc:597] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:45835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.718302  7650 consensus_peers.cc:597] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:45835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.719915  7576 consensus_peers.cc:597] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:45835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.723544  7650 consensus_peers.cc:597] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:45835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:26.738492  7647 consensus_peers.cc:597] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 -> Peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Couldn't send request to peer 382e1f4385ac4066b7098e4fd1f5df06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.740638 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:26.741542 31814 tablet_replica.cc:333] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.742251 31814 raft_consensus.cc:2243] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.743054 31814 raft_consensus.cc:2272] T 5f4267f73a67486e8568dfa6c4a0bd7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.745214 31814 tablet_replica.cc:333] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.745798 31814 raft_consensus.cc:2243] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.746539 31814 raft_consensus.cc:2272] T 2a6621f1923f4b5b9885003705a57309 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.748440 31814 tablet_replica.cc:333] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.748986 31814 raft_consensus.cc:2243] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.749719 31814 raft_consensus.cc:2272] T 81671c7a827b47caac30f622c4407bf4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.751650 31814 tablet_replica.cc:333] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.752218 31814 raft_consensus.cc:2243] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.752631 31814 raft_consensus.cc:2272] T 1560149675ca410fa6cbef0e9eb5bb22 P 382e1f4385ac4066b7098e4fd1f5df06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.754419 31814 tablet_replica.cc:333] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.754961 31814 raft_consensus.cc:2243] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.755561 31814 raft_consensus.cc:2272] T 6a5f0a58d050468dae029bfd50e74d02 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.758092 31814 tablet_replica.cc:333] T d351dea40bb24488b7159df0e49bb759 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.758857 31814 raft_consensus.cc:2243] T d351dea40bb24488b7159df0e49bb759 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.759333 31814 raft_consensus.cc:2272] T d351dea40bb24488b7159df0e49bb759 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.761273 31814 tablet_replica.cc:333] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.761829 31814 raft_consensus.cc:2243] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.762338 31814 raft_consensus.cc:2272] T a87af8743bc441c28b895aa411d33f2a P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.764386 31814 tablet_replica.cc:333] T 58c780fdb61048ac8f4c44481a73f9ff P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.764978 31814 raft_consensus.cc:2243] T 58c780fdb61048ac8f4c44481a73f9ff P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.765413 31814 raft_consensus.cc:2272] T 58c780fdb61048ac8f4c44481a73f9ff P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.767202 31814 tablet_replica.cc:333] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.767799 31814 raft_consensus.cc:2243] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.768513 31814 raft_consensus.cc:2272] T 29addb5a68094e16887e2c843d5b1ef5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.770372 31814 tablet_replica.cc:333] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.770936 31814 raft_consensus.cc:2243] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.771790 31814 raft_consensus.cc:2272] T 1ce8654527b4453bab2b63775a4e2601 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.774379 31814 tablet_replica.cc:333] T e8380470ec0d46c1914152ad9818bab7 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.775127 31814 raft_consensus.cc:2243] T e8380470ec0d46c1914152ad9818bab7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.775676 31814 raft_consensus.cc:2272] T e8380470ec0d46c1914152ad9818bab7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:26.776276  7647 consensus_peers.cc:597] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 -> Peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Couldn't send request to peer 382e1f4385ac4066b7098e4fd1f5df06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.777848 31814 tablet_replica.cc:333] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.778476 31814 raft_consensus.cc:2243] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.778932 31814 raft_consensus.cc:2272] T 54c4242890a943ec865bafae33141d3b P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.780845 31814 tablet_replica.cc:333] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.781405 31814 raft_consensus.cc:2243] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.782177 31814 raft_consensus.cc:2272] T aa473d10c0ad424f8268c67efcccccff P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.784888 31814 tablet_replica.cc:333] T 33e9e771ee0f4cb6b649f9ebc0056443 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.785547 31814 raft_consensus.cc:2243] T 33e9e771ee0f4cb6b649f9ebc0056443 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.786171 31814 raft_consensus.cc:2272] T 33e9e771ee0f4cb6b649f9ebc0056443 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.788691 31814 tablet_replica.cc:333] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.789494 31814 raft_consensus.cc:2243] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.790581 31814 raft_consensus.cc:2272] T bf1e31a4767d403688a20b985eb0ab79 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:26.792480  7647 consensus_peers.cc:597] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 -> Peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Couldn't send request to peer 382e1f4385ac4066b7098e4fd1f5df06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.793463 31814 tablet_replica.cc:333] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.794117 31814 raft_consensus.cc:2243] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.794612 31814 raft_consensus.cc:2272] T 6d716d1bf1004e7ca0d255d7d9c50835 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.796741 31814 tablet_replica.cc:333] T 5e84fe9726f946d2b3552cd90cf46b98 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.797394 31814 raft_consensus.cc:2243] T 5e84fe9726f946d2b3552cd90cf46b98 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.797943 31814 raft_consensus.cc:2272] T 5e84fe9726f946d2b3552cd90cf46b98 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.800333 31814 tablet_replica.cc:333] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.801127 31814 raft_consensus.cc:2243] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.802119 31814 raft_consensus.cc:2272] T 120b8b81bd894896b1bdf58d7b461d41 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.805027 31814 tablet_replica.cc:333] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.805837 31814 raft_consensus.cc:2243] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.806354 31814 raft_consensus.cc:2272] T a899962d588849ccb4af0f8cb06c07d0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:26.809846  7650 consensus_peers.cc:597] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:45835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.810303 31814 tablet_replica.cc:333] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.811146 31814 raft_consensus.cc:2243] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.812135 31814 raft_consensus.cc:2272] T 11909bda591f4d61a9817bd3575748b5 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:26.812913  7576 consensus_peers.cc:597] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 -> Peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Couldn't send request to peer 4a0eef4c5880424694542637530b55c0. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:45835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.814559 31814 tablet_replica.cc:333] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.815384 31814 raft_consensus.cc:2243] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.816321 31814 raft_consensus.cc:2272] T 81703e5e726a4905a8cff753fe076535 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:26.817639  7647 consensus_peers.cc:597] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 -> Peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Couldn't send request to peer 382e1f4385ac4066b7098e4fd1f5df06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:26.818701 31814 tablet_replica.cc:333] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.819370 31814 raft_consensus.cc:2243] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.819813 31814 raft_consensus.cc:2272] T e1b1bccbb9eb4fc7987174b429fce6d4 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.821700 31814 tablet_replica.cc:333] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.822218 31814 raft_consensus.cc:2243] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.822629 31814 raft_consensus.cc:2272] T 3e8887c1835b4d5b9697b6a44f0efd7e P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.824529 31814 tablet_replica.cc:333] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.825053 31814 raft_consensus.cc:2243] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.825433 31814 raft_consensus.cc:2272] T 868663ec219f46a5abe840f8d43158e7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.827310 31814 tablet_replica.cc:333] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.827919 31814 raft_consensus.cc:2243] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.828801 31814 raft_consensus.cc:2272] T ecfe0c23a9c54b2dbe03deca022a9123 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.830838 31814 tablet_replica.cc:333] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.831485 31814 raft_consensus.cc:2243] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.832324 31814 raft_consensus.cc:2272] T c96e53ac6d4a4521824a0eef2bf0400b P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.835011 31814 tablet_replica.cc:333] T 4d154a19800f414dbaec32117c0ca6bd P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.835742 31814 raft_consensus.cc:2243] T 4d154a19800f414dbaec32117c0ca6bd P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.836288 31814 raft_consensus.cc:2272] T 4d154a19800f414dbaec32117c0ca6bd P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.839087 31814 tablet_replica.cc:333] T e250baa9f7b44f2fb0002ff47f7c34db P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.839831 31814 raft_consensus.cc:2243] T e250baa9f7b44f2fb0002ff47f7c34db P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.840317 31814 raft_consensus.cc:2272] T e250baa9f7b44f2fb0002ff47f7c34db P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.842732 31814 tablet_replica.cc:333] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.843295 31814 raft_consensus.cc:2243] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.843709 31814 raft_consensus.cc:2272] T b2119d52e4a048ebb803fffdf77b85c2 P 382e1f4385ac4066b7098e4fd1f5df06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.845518 31814 tablet_replica.cc:333] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.846024 31814 raft_consensus.cc:2243] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.846374 31814 raft_consensus.cc:2272] T 361e20d70ddc4e43b3dcbe2e9ca30f50 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.848384 31814 tablet_replica.cc:333] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.848857 31814 raft_consensus.cc:2243] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.849208 31814 raft_consensus.cc:2272] T de79ef75f6ba41b4a0e56ba851add378 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.851153 31814 tablet_replica.cc:333] T 343cf82796c24137960d60c292b5dd42 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.851727 31814 raft_consensus.cc:2243] T 343cf82796c24137960d60c292b5dd42 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.852097 31814 raft_consensus.cc:2272] T 343cf82796c24137960d60c292b5dd42 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.853919 31814 tablet_replica.cc:333] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.854368 31814 raft_consensus.cc:2243] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.855082 31814 raft_consensus.cc:2272] T 1ea546eef5aa4273af08f1b3468c5369 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.857061 31814 tablet_replica.cc:333] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.857887 31814 raft_consensus.cc:2243] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.858387 31814 raft_consensus.cc:2272] T 0433292c261b4a29b57235e8647c5db8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.861064 31814 tablet_replica.cc:333] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.861764 31814 raft_consensus.cc:2243] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.862280 31814 raft_consensus.cc:2272] T 8e6382ace6264a0db74146326b719f7b P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.865042 31814 tablet_replica.cc:333] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.865728 31814 raft_consensus.cc:2243] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.866266 31814 raft_consensus.cc:2272] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.869096 31814 tablet_replica.cc:333] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.869676 31814 raft_consensus.cc:2243] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.870595 31814 raft_consensus.cc:2272] T 5266494b97e8402b9696d8771ca7e9f0 P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.872861 31814 tablet_replica.cc:333] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.873461 31814 raft_consensus.cc:2243] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.873893 31814 raft_consensus.cc:2272] T d0a389b4005c4d6890f09b248b3e1ad8 P 382e1f4385ac4066b7098e4fd1f5df06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.875757 31814 tablet_replica.cc:333] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.876259 31814 raft_consensus.cc:2243] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.876668 31814 raft_consensus.cc:2272] T e0e1f08d649449a6a1a39b78f0b7adff P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.878638 31814 tablet_replica.cc:333] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.879189 31814 raft_consensus.cc:2243] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.879626 31814 raft_consensus.cc:2272] T 1e689baf00c741e2ae7e123bad19a9a7 P 382e1f4385ac4066b7098e4fd1f5df06 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.881508 31814 tablet_replica.cc:333] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.881937 31814 raft_consensus.cc:2243] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.882642 31814 raft_consensus.cc:2272] T fb1b71c94d284d209da03c159c07316f P 382e1f4385ac4066b7098e4fd1f5df06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.884536 31814 tablet_replica.cc:333] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.885030 31814 raft_consensus.cc:2243] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.885407 31814 raft_consensus.cc:2272] T 98892caf6b1549c8a1906b47c1298334 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.887355 31814 tablet_replica.cc:333] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.887771 31814 raft_consensus.cc:2243] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:26.888120 31814 raft_consensus.cc:2272] T e7bab86470a74fdfb18b961658f9e371 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.889994 31814 tablet_replica.cc:333] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06: stopping tablet replica
I20260709 13:16:26.890383 31814 raft_consensus.cc:2243] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:26.891047 31814 raft_consensus.cc:2272] T 58b825b38d394fbfbdf8cb645514c782 P 382e1f4385ac4066b7098e4fd1f5df06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:26.978009 31814 tablet_server.cc:196] TabletServer@127.31.17.131:0 shutdown complete.
I20260709 13:16:27.010461  8620 raft_consensus.cc:493] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:27.011183  8620 raft_consensus.cc:515] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:27.011891  8600 raft_consensus.cc:493] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:27.012480  8600 raft_consensus.cc:515] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:27.016129  8620 leader_election.cc:290] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:27.015113  8600 leader_election.cc:290] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
W20260709 13:16:27.023191  7647 leader_election.cc:336] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Network error: Client connection negotiation failed: client connection to 127.31.17.131:46815: connect: Connection refused (error 111)
W20260709 13:16:27.023777  7648 leader_election.cc:336] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111)
I20260709 13:16:27.024235  7648 leader_election.cc:304] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
W20260709 13:16:27.025238  7648 leader_election.cc:336] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111)
I20260709 13:16:27.025977  8620 raft_consensus.cc:2749] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:27.028825  7650 leader_election.cc:336] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Network error: Client connection negotiation failed: client connection to 127.31.17.130:45835: connect: Connection refused (error 111)
I20260709 13:16:27.029386  7650 leader_election.cc:304] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:27.030172  8620 raft_consensus.cc:2749] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:27.045215  7647 consensus_peers.cc:597] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 -> Peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Couldn't send request to peer 382e1f4385ac4066b7098e4fd1f5df06. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.131:46815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:27.048014  7647 consensus_peers.cc:597] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 -> Peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Couldn't send request to peer 382e1f4385ac4066b7098e4fd1f5df06. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.131:46815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:27.063966  7647 consensus_peers.cc:597] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 -> Peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Couldn't send request to peer 382e1f4385ac4066b7098e4fd1f5df06. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.131:46815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:27.065102 31814 tablet_server.cc:179] TabletServer@127.31.17.132:0 shutting down...
I20260709 13:16:27.078545  8600 raft_consensus.cc:493] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:27.079290  8600 raft_consensus.cc:515] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:27.082358  8600 leader_election.cc:290] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:27.085775  8600 raft_consensus.cc:493] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
W20260709 13:16:27.089830  7648 leader_election.cc:336] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111)
I20260709 13:16:27.088673  8600 raft_consensus.cc:515] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
W20260709 13:16:27.090595  7647 leader_election.cc:336] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Network error: Client connection negotiation failed: client connection to 127.31.17.131:46815: connect: Connection refused (error 111)
I20260709 13:16:27.091089  7647 leader_election.cc:304] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:27.093704  8620 raft_consensus.cc:2749] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:27.094705  8600 leader_election.cc:290] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
W20260709 13:16:27.099287  7650 leader_election.cc:336] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Network error: Client connection negotiation failed: client connection to 127.31.17.130:45835: connect: Connection refused (error 111)
W20260709 13:16:27.099846  7648 leader_election.cc:336] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111)
I20260709 13:16:27.100248  7648 leader_election.cc:304] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:27.100853  8620 raft_consensus.cc:2749] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:27.114880 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:27.115885 31814 tablet_replica.cc:333] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.116555 31814 raft_consensus.cc:2243] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.117053 31814 raft_consensus.cc:2272] T 5f4267f73a67486e8568dfa6c4a0bd7b P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.119686 31814 tablet_replica.cc:333] T 6a5f0a58d050468dae029bfd50e74d02 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.120303 31814 raft_consensus.cc:2243] T 6a5f0a58d050468dae029bfd50e74d02 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.120779 31814 raft_consensus.cc:2272] T 6a5f0a58d050468dae029bfd50e74d02 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.123032 31814 tablet_replica.cc:333] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.123790 31814 raft_consensus.cc:2243] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.124321 31814 raft_consensus.cc:2272] T bf1e31a4767d403688a20b985eb0ab79 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.124377  8620 raft_consensus.cc:493] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:27.125052  8600 raft_consensus.cc:493] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:27.125001  8620 raft_consensus.cc:515] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:27.125609  8600 raft_consensus.cc:515] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } } peers { permanent_uuid: "4a0eef4c5880424694542637530b55c0" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45835 } }
I20260709 13:16:27.127449 31814 tablet_replica.cc:333] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.127780  8600 leader_election.cc:290] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
W20260709 13:16:27.127655  7647 consensus_peers.cc:597] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 -> Peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Couldn't send request to peer 382e1f4385ac4066b7098e4fd1f5df06. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.131:46815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:27.128360 31814 raft_consensus.cc:2243] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.128453  8620 leader_election.cc:290] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515), 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835)
I20260709 13:16:27.129865 31814 raft_consensus.cc:2272] T 81671c7a827b47caac30f622c4407bf4 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:27.131876  7650 leader_election.cc:336] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Network error: Client connection negotiation failed: client connection to 127.31.17.130:45835: connect: Connection refused (error 111)
W20260709 13:16:27.132431  7650 leader_election.cc:336] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4a0eef4c5880424694542637530b55c0 (127.31.17.130:45835): Network error: Client connection negotiation failed: client connection to 127.31.17.130:45835: connect: Connection refused (error 111)
I20260709 13:16:27.132691 31814 tablet_replica.cc:333] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.133708 31814 raft_consensus.cc:2243] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.134321 31814 raft_consensus.cc:2272] T 2234d05a2ffa48c18ad9af837d067f5a P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:27.135483  7648 leader_election.cc:336] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111)
I20260709 13:16:27.135947  7648 leader_election.cc:304] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:27.136622  8620 raft_consensus.cc:2749] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:27.137312 31814 tablet_replica.cc:333] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
W20260709 13:16:27.137538  7648 leader_election.cc:336] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111)
I20260709 13:16:27.138044  7648 leader_election.cc:304] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 4a0eef4c5880424694542637530b55c0, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:27.138434 31814 raft_consensus.cc:2243] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.138702  8620 raft_consensus.cc:2749] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:27.139098 31814 raft_consensus.cc:2272] T 8219a2ee929d4169bde0d0eaf559f7d9 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.141362 31814 tablet_replica.cc:333] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.142024 31814 raft_consensus.cc:2243] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.142495 31814 raft_consensus.cc:2272] T b50e7db706514f8bb0b8885fca0868d3 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.144655 31814 tablet_replica.cc:333] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.145262 31814 raft_consensus.cc:2243] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.145720 31814 raft_consensus.cc:2272] T ce18aefbfb644eeab2cfc05f961b1771 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.147859 31814 tablet_replica.cc:333] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.148249  8600 raft_consensus.cc:493] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d54f6e4b9e604cd78c48a1828cd3b23a)
I20260709 13:16:27.148754 31814 raft_consensus.cc:2243] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.148892  8600 raft_consensus.cc:515] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e1f4385ac4066b7098e4fd1f5df06" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 46815 } } peers { permanent_uuid: "e733469bde7c479a916acbbe84b5f342" member_type: VOTER last_known_addr { host: "127.31.17.132" port: 35931 } } peers { permanent_uuid: "d54f6e4b9e604cd78c48a1828cd3b23a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 35515 } }
I20260709 13:16:27.149437 31814 raft_consensus.cc:2272] T d351dea40bb24488b7159df0e49bb759 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.152616 31814 tablet_replica.cc:333] T 1ce8654527b4453bab2b63775a4e2601 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.152649  8600 leader_election.cc:290] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815), d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515)
I20260709 13:16:27.153609 31814 raft_consensus.cc:2243] T 1ce8654527b4453bab2b63775a4e2601 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.154142 31814 raft_consensus.cc:2272] T 1ce8654527b4453bab2b63775a4e2601 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:27.155773  7648 leader_election.cc:336] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d54f6e4b9e604cd78c48a1828cd3b23a (127.31.17.129:35515): Network error: Client connection negotiation failed: client connection to 127.31.17.129:35515: connect: Connection refused (error 111)
W20260709 13:16:27.156363  7647 leader_election.cc:336] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Network error: Client connection negotiation failed: client connection to 127.31.17.131:46815: connect: Connection refused (error 111)
I20260709 13:16:27.156692  7647 leader_election.cc:304] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e733469bde7c479a916acbbe84b5f342; no voters: 382e1f4385ac4066b7098e4fd1f5df06, d54f6e4b9e604cd78c48a1828cd3b23a
I20260709 13:16:27.157078 31814 tablet_replica.cc:333] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.157336  8600 raft_consensus.cc:2749] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:27.157874 31814 raft_consensus.cc:2243] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.158454 31814 raft_consensus.cc:2272] T a87af8743bc441c28b895aa411d33f2a P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.160486 31814 tablet_replica.cc:333] T e0e1f08d649449a6a1a39b78f0b7adff P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.161139 31814 raft_consensus.cc:2243] T e0e1f08d649449a6a1a39b78f0b7adff P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.161659 31814 raft_consensus.cc:2272] T e0e1f08d649449a6a1a39b78f0b7adff P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.163795 31814 tablet_replica.cc:333] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.164531 31814 raft_consensus.cc:2243] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.165617 31814 raft_consensus.cc:2272] T 58c780fdb61048ac8f4c44481a73f9ff P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.168300 31814 tablet_replica.cc:333] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.169086 31814 raft_consensus.cc:2243] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.169888 31814 raft_consensus.cc:2272] T b215f304c98341bebbc937add44da99d P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.171983 31814 tablet_replica.cc:333] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.172659 31814 raft_consensus.cc:2243] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.173115 31814 raft_consensus.cc:2272] T 0e442d8263394fa7bd9df6ee46bb246e P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.175128 31814 tablet_replica.cc:333] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.175786 31814 raft_consensus.cc:2243] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.176205 31814 raft_consensus.cc:2272] T 11909bda591f4d61a9817bd3575748b5 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.178162 31814 tablet_replica.cc:333] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.178785 31814 raft_consensus.cc:2243] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.179292 31814 raft_consensus.cc:2272] T 81703e5e726a4905a8cff753fe076535 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.181273 31814 tablet_replica.cc:333] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.181875 31814 raft_consensus.cc:2243] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.182478 31814 raft_consensus.cc:2272] T a87d88042080495293c0e772b280f3da P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.184499 31814 tablet_replica.cc:333] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.185055 31814 raft_consensus.cc:2243] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.185868 31814 raft_consensus.cc:2272] T 3e8887c1835b4d5b9697b6a44f0efd7e P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.187881 31814 tablet_replica.cc:333] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.188416 31814 raft_consensus.cc:2243] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.188835 31814 raft_consensus.cc:2272] T 868663ec219f46a5abe840f8d43158e7 P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.190816 31814 tablet_replica.cc:333] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.191439 31814 raft_consensus.cc:2243] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.191919 31814 raft_consensus.cc:2272] T b2119d52e4a048ebb803fffdf77b85c2 P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.193836 31814 tablet_replica.cc:333] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.194396 31814 raft_consensus.cc:2243] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.195178 31814 raft_consensus.cc:2272] T e250baa9f7b44f2fb0002ff47f7c34db P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.196997 31814 tablet_replica.cc:333] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.197536 31814 raft_consensus.cc:2243] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.197964 31814 raft_consensus.cc:2272] T 58b825b38d394fbfbdf8cb645514c782 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.200295 31814 tablet_replica.cc:333] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.201032 31814 raft_consensus.cc:2243] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.201926 31814 raft_consensus.cc:2272] T 33e9e771ee0f4cb6b649f9ebc0056443 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.204370 31814 tablet_replica.cc:333] T c9b5ae77739f4adca66b64acf11c42ce P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
W20260709 13:16:27.204254  7647 consensus_peers.cc:597] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 -> Peer 382e1f4385ac4066b7098e4fd1f5df06 (127.31.17.131:46815): Couldn't send request to peer 382e1f4385ac4066b7098e4fd1f5df06. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.131:46815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:27.205122 31814 raft_consensus.cc:2243] T c9b5ae77739f4adca66b64acf11c42ce P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.205508 31814 raft_consensus.cc:2272] T c9b5ae77739f4adca66b64acf11c42ce P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.207485 31814 tablet_replica.cc:333] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.208070 31814 raft_consensus.cc:2243] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.208478 31814 raft_consensus.cc:2272] T 0ce2cd95149b4e5999f7b078e668f5b7 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.210273 31814 tablet_replica.cc:333] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.210786 31814 raft_consensus.cc:2243] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.211615 31814 raft_consensus.cc:2272] T e8380470ec0d46c1914152ad9818bab7 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.213441 31814 tablet_replica.cc:333] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.213941 31814 raft_consensus.cc:2243] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.214600 31814 raft_consensus.cc:2272] T ee023e046cb943559b9daae3b76c4adf P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.216624 31814 tablet_replica.cc:333] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.217178 31814 raft_consensus.cc:2243] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.217689 31814 raft_consensus.cc:2272] T 0433292c261b4a29b57235e8647c5db8 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.220329 31814 tablet_replica.cc:333] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.221114 31814 raft_consensus.cc:2243] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.222084 31814 raft_consensus.cc:2272] T aa56ac7185b84a7ba5fdc8f39e5de8f3 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.224205 31814 tablet_replica.cc:333] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.224668 31814 raft_consensus.cc:2243] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.225013 31814 raft_consensus.cc:2272] T d0a389b4005c4d6890f09b248b3e1ad8 P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.226716 31814 tablet_replica.cc:333] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.227190 31814 raft_consensus.cc:2243] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.227629 31814 raft_consensus.cc:2272] T 82d28d9895a5469db67cd40794083e95 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.229350 31814 tablet_replica.cc:333] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.229812 31814 raft_consensus.cc:2243] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.230525 31814 raft_consensus.cc:2272] T 5e84fe9726f946d2b3552cd90cf46b98 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.232719 31814 tablet_replica.cc:333] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.233212 31814 raft_consensus.cc:2243] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.233896 31814 raft_consensus.cc:2272] T 7b4e6876d12b4cf6ad01688451c1b033 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.236322 31814 tablet_replica.cc:333] T fb1b71c94d284d209da03c159c07316f P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.236819 31814 raft_consensus.cc:2243] T fb1b71c94d284d209da03c159c07316f P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.237196 31814 raft_consensus.cc:2272] T fb1b71c94d284d209da03c159c07316f P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.239532 31814 tablet_replica.cc:333] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.240027 31814 raft_consensus.cc:2243] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.240746 31814 raft_consensus.cc:2272] T 51c6aa50aa7a4ad9bbcbb6342bb232f2 P e733469bde7c479a916acbbe84b5f342 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.242655 31814 tablet_replica.cc:333] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.243130 31814 raft_consensus.cc:2243] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.243571 31814 raft_consensus.cc:2272] T e7bab86470a74fdfb18b961658f9e371 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.245273 31814 tablet_replica.cc:333] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.245702 31814 raft_consensus.cc:2243] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.246376 31814 raft_consensus.cc:2272] T 20ee12a0193649c295925bc14e57d382 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.248266 31814 tablet_replica.cc:333] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.248693 31814 raft_consensus.cc:2243] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.249330 31814 raft_consensus.cc:2272] T de79ef75f6ba41b4a0e56ba851add378 P e733469bde7c479a916acbbe84b5f342 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.251084 31814 tablet_replica.cc:333] T 1ea546eef5aa4273af08f1b3468c5369 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.251577 31814 raft_consensus.cc:2243] T 1ea546eef5aa4273af08f1b3468c5369 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.251932 31814 raft_consensus.cc:2272] T 1ea546eef5aa4273af08f1b3468c5369 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.253729 31814 tablet_replica.cc:333] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.254236 31814 raft_consensus.cc:2243] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.255124 31814 raft_consensus.cc:2272] T 343cf82796c24137960d60c292b5dd42 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.257028 31814 tablet_replica.cc:333] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.257519 31814 raft_consensus.cc:2243] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.258240 31814 raft_consensus.cc:2272] T 4d154a19800f414dbaec32117c0ca6bd P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.260129 31814 tablet_replica.cc:333] T ecfe0c23a9c54b2dbe03deca022a9123 P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.260573 31814 raft_consensus.cc:2243] T ecfe0c23a9c54b2dbe03deca022a9123 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.260972 31814 raft_consensus.cc:2272] T ecfe0c23a9c54b2dbe03deca022a9123 P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.262715 31814 tablet_replica.cc:333] T cfd5d05ff1384d2c9c133fdb0483f29a P e733469bde7c479a916acbbe84b5f342: stopping tablet replica
I20260709 13:16:27.263176 31814 raft_consensus.cc:2243] T cfd5d05ff1384d2c9c133fdb0483f29a P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.263651 31814 raft_consensus.cc:2272] T cfd5d05ff1384d2c9c133fdb0483f29a P e733469bde7c479a916acbbe84b5f342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.328792 31814 tablet_server.cc:196] TabletServer@127.31.17.132:0 shutdown complete.
I20260709 13:16:27.392241 31814 master.cc:562] Master@127.31.17.190:35391 shutting down...
I20260709 13:16:27.420266 31814 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.420836 31814 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.421157 31814 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0c77d1c2656b40b1a3fa069f44bf9467: stopping tablet replica
I20260709 13:16:27.443110 31814 master.cc:584] Master@127.31.17.190:35391 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (30773 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:16:27.533857 31814 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.31.17.190:41919
I20260709 13:16:27.534991 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:27.542402  8626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:27.542485  8627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:27.542743  8629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:27.543155 31814 server_base.cc:1061] running on GCE node
I20260709 13:16:27.544328 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:27.544543 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:27.544721 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602987544704 us; error 0 us; skew 500 ppm
I20260709 13:16:27.545267 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:27.547847 31814 webserver.cc:533] Webserver started at http://127.31.17.190:36243/ using document root <none> and password file <none>
I20260709 13:16:27.548348 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:27.548554 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:27.548833 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:27.549974 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/master-0-root/instance:
uuid: "663cbb16e0e2433b8b61ccdb23bc1a84"
format_stamp: "Formatted at 2026-07-09 13:16:27 on dist-test-slave-zhw8"
I20260709 13:16:27.554890 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:16:27.558380  8634 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:27.559352 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:16:27.559592 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/master-0-root
uuid: "663cbb16e0e2433b8b61ccdb23bc1a84"
format_stamp: "Formatted at 2026-07-09 13:16:27 on dist-test-slave-zhw8"
I20260709 13:16:27.559887 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:27.588768 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:27.589939 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:27.628746 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.190:41919
I20260709 13:16:27.628861  8685 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.190:41919 every 8 connection(s)
I20260709 13:16:27.633097  8686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.643757  8686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84: Bootstrap starting.
I20260709 13:16:27.648463  8686 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:27.652909  8686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84: No bootstrap required, opened a new log
I20260709 13:16:27.655093  8686 raft_consensus.cc:359] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "663cbb16e0e2433b8b61ccdb23bc1a84" member_type: VOTER }
I20260709 13:16:27.655558  8686 raft_consensus.cc:385] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:27.655774  8686 raft_consensus.cc:740] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663cbb16e0e2433b8b61ccdb23bc1a84, State: Initialized, Role: FOLLOWER
I20260709 13:16:27.656378  8686 consensus_queue.cc:260] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "663cbb16e0e2433b8b61ccdb23bc1a84" member_type: VOTER }
I20260709 13:16:27.656836  8686 raft_consensus.cc:399] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:27.657030  8686 raft_consensus.cc:493] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:27.657336  8686 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:27.662164  8686 raft_consensus.cc:515] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "663cbb16e0e2433b8b61ccdb23bc1a84" member_type: VOTER }
I20260709 13:16:27.662699  8686 leader_election.cc:304] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 663cbb16e0e2433b8b61ccdb23bc1a84; no voters: 
I20260709 13:16:27.663848  8686 leader_election.cc:290] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:27.664196  8689 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:27.665591  8689 raft_consensus.cc:697] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [term 1 LEADER]: Becoming Leader. State: Replica: 663cbb16e0e2433b8b61ccdb23bc1a84, State: Running, Role: LEADER
I20260709 13:16:27.666270  8689 consensus_queue.cc:237] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "663cbb16e0e2433b8b61ccdb23bc1a84" member_type: VOTER }
I20260709 13:16:27.666834  8686 sys_catalog.cc:565] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:27.670694  8690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "663cbb16e0e2433b8b61ccdb23bc1a84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "663cbb16e0e2433b8b61ccdb23bc1a84" member_type: VOTER } }
I20260709 13:16:27.671494  8690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:27.671526  8691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 663cbb16e0e2433b8b61ccdb23bc1a84. Latest consensus state: current_term: 1 leader_uuid: "663cbb16e0e2433b8b61ccdb23bc1a84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "663cbb16e0e2433b8b61ccdb23bc1a84" member_type: VOTER } }
I20260709 13:16:27.672168  8691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:27.673775  8696 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:27.682121  8696 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:27.683946 31814 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:27.691432  8696 catalog_manager.cc:1383] Generated new cluster ID: 1f058038ec7e4f27b1a58507586a96a2
I20260709 13:16:27.691788  8696 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:27.738835  8696 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:27.740114  8696 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:27.759855  8696 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84: Generated new TSK 0
I20260709 13:16:27.760486  8696 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:27.815167 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:27.823453  8707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:27.824429  8708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:27.829278  8710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:27.829732 31814 server_base.cc:1061] running on GCE node
I20260709 13:16:27.831103 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:27.831633 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:27.831866 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602987831845 us; error 0 us; skew 500 ppm
I20260709 13:16:27.832958 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:27.835908 31814 webserver.cc:533] Webserver started at http://127.31.17.129:34007/ using document root <none> and password file <none>
I20260709 13:16:27.836484 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:27.836692 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:27.836997 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:27.838135 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/ts-0-root/instance:
uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
format_stamp: "Formatted at 2026-07-09 13:16:27 on dist-test-slave-zhw8"
I20260709 13:16:27.842770 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:16:27.846737  8715 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:27.847589 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:16:27.847857 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/ts-0-root
uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
format_stamp: "Formatted at 2026-07-09 13:16:27 on dist-test-slave-zhw8"
I20260709 13:16:27.848115 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:27.876902 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:27.878394 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:27.880120 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:27.882776 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:27.883030 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:27.883320 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:27.883514 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:27.925156 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.129:44209
I20260709 13:16:27.925272  8777 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.129:44209 every 8 connection(s)
I20260709 13:16:27.930218 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:27.937222  8782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:27.938831  8783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:27.943109  8786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:27.945436 31814 server_base.cc:1061] running on GCE node
I20260709 13:16:27.946399 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:27.946632 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:27.946811 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602987946793 us; error 0 us; skew 500 ppm
I20260709 13:16:27.947515 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:27.950420 31814 webserver.cc:533] Webserver started at http://127.31.17.130:45889/ using document root <none> and password file <none>
I20260709 13:16:27.950773  8778 heartbeater.cc:344] Connected to a master server at 127.31.17.190:41919
I20260709 13:16:27.951013 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:27.951258  8778 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:27.951318 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:27.951779 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:27.952293  8778 heartbeater.cc:507] Master 127.31.17.190:41919 requested a full tablet report, sending...
I20260709 13:16:27.953444 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/ts-1-root/instance:
uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
format_stamp: "Formatted at 2026-07-09 13:16:27 on dist-test-slave-zhw8"
I20260709 13:16:27.954509  8651 ts_manager.cc:194] Registered new tserver with Master: 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209)
I20260709 13:16:27.956346  8651 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43704
I20260709 13:16:27.958359 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:16:27.962060  8790 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:27.962809 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:16:27.963284 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/ts-1-root
uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
format_stamp: "Formatted at 2026-07-09 13:16:27 on dist-test-slave-zhw8"
I20260709 13:16:27.963754 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:27.974092 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:27.975344 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:27.976814 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:27.979027 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:27.979247 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:27.979523 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:27.979691 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:28.023028 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.130:41751
I20260709 13:16:28.023223  8852 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.130:41751 every 8 connection(s)
I20260709 13:16:28.028326 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:28.036281  8856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:28.037497  8857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:28.040962  8859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:28.041849 31814 server_base.cc:1061] running on GCE node
I20260709 13:16:28.042222  8853 heartbeater.cc:344] Connected to a master server at 127.31.17.190:41919
I20260709 13:16:28.042649  8853 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:28.042893 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:28.043159 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:28.043406 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602988043382 us; error 0 us; skew 500 ppm
I20260709 13:16:28.043593  8853 heartbeater.cc:507] Master 127.31.17.190:41919 requested a full tablet report, sending...
I20260709 13:16:28.044044 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:28.045939  8651 ts_manager.cc:194] Registered new tserver with Master: 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751)
I20260709 13:16:28.046824 31814 webserver.cc:533] Webserver started at http://127.31.17.131:39601/ using document root <none> and password file <none>
I20260709 13:16:28.047470 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:28.047683 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:28.047564  8651 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43718
I20260709 13:16:28.048101 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:28.049422 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/ts-2-root/instance:
uuid: "8d58272f60794aba93285416034cfb3b"
format_stamp: "Formatted at 2026-07-09 13:16:28 on dist-test-slave-zhw8"
I20260709 13:16:28.053889 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:16:28.057058  8864 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:28.057955 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:16:28.058266 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/ts-2-root
uuid: "8d58272f60794aba93285416034cfb3b"
format_stamp: "Formatted at 2026-07-09 13:16:28 on dist-test-slave-zhw8"
I20260709 13:16:28.058552 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:28.070363 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:28.071539 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:28.072935 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:28.075115 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:28.075423 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:28.075663 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:28.075834 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:28.117101 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.131:43121
I20260709 13:16:28.117244  8926 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.131:43121 every 8 connection(s)
I20260709 13:16:28.130654  8927 heartbeater.cc:344] Connected to a master server at 127.31.17.190:41919
I20260709 13:16:28.131115  8927 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:28.131942  8927 heartbeater.cc:507] Master 127.31.17.190:41919 requested a full tablet report, sending...
I20260709 13:16:28.133912  8651 ts_manager.cc:194] Registered new tserver with Master: 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:28.134130 31814 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01382949s
I20260709 13:16:28.135402  8651 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43720
I20260709 13:16:28.162884  8651 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43728:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:28.165937  8651 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:28.245568  8892 tablet_service.cc:1511] Processing CreateTablet for tablet 7085954ca82846de8e52835cae7146f9 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:28.246268  8888 tablet_service.cc:1511] Processing CreateTablet for tablet d5587ada44ae4085bfc0e6ddacd80ef3 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:28.247071  8892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7085954ca82846de8e52835cae7146f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.248584  8889 tablet_service.cc:1511] Processing CreateTablet for tablet 488298c497cb42ecb64885b19bcd1a10 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:28.250900  8891 tablet_service.cc:1511] Processing CreateTablet for tablet 35c9eedcc83d4cb3aaf703d0684cc1d9 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:28.253090  8890 tablet_service.cc:1511] Processing CreateTablet for tablet da899017c34d461b89751b5a3dbd705c (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:28.249027  8888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5587ada44ae4085bfc0e6ddacd80ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.256222  8889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488298c497cb42ecb64885b19bcd1a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.259660  8890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da899017c34d461b89751b5a3dbd705c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.261814  8891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35c9eedcc83d4cb3aaf703d0684cc1d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.264755  8814 tablet_service.cc:1511] Processing CreateTablet for tablet d5587ada44ae4085bfc0e6ddacd80ef3 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:28.265699  8817 tablet_service.cc:1511] Processing CreateTablet for tablet 35c9eedcc83d4cb3aaf703d0684cc1d9 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:28.266214  8814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5587ada44ae4085bfc0e6ddacd80ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.267094  8817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35c9eedcc83d4cb3aaf703d0684cc1d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.266211  8812 tablet_service.cc:1511] Processing CreateTablet for tablet cfed7271d68f4ef087e2881aedbbd8ba (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:28.267412  8813 tablet_service.cc:1511] Processing CreateTablet for tablet a94d0587141e42dcb88cf6eca845d596 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:28.268682  8812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfed7271d68f4ef087e2881aedbbd8ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.269244  8811 tablet_service.cc:1511] Processing CreateTablet for tablet 1316a4338cec4f6cbb6aaaf59053b189 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:28.269341  8815 tablet_service.cc:1511] Processing CreateTablet for tablet 488298c497cb42ecb64885b19bcd1a10 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:28.271040  8816 tablet_service.cc:1511] Processing CreateTablet for tablet da899017c34d461b89751b5a3dbd705c (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:28.272558  8810 tablet_service.cc:1511] Processing CreateTablet for tablet b84bf4c66a694d1cbc4e3f61afe49bd5 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:28.273109  8818 tablet_service.cc:1511] Processing CreateTablet for tablet 7085954ca82846de8e52835cae7146f9 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:28.273906  8811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1316a4338cec4f6cbb6aaaf59053b189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.278003  8818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7085954ca82846de8e52835cae7146f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.284111  8813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a94d0587141e42dcb88cf6eca845d596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.286432  8887 tablet_service.cc:1511] Processing CreateTablet for tablet a94d0587141e42dcb88cf6eca845d596 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:28.287868  8816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da899017c34d461b89751b5a3dbd705c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.290355  8886 tablet_service.cc:1511] Processing CreateTablet for tablet cfed7271d68f4ef087e2881aedbbd8ba (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:28.291263  8885 tablet_service.cc:1511] Processing CreateTablet for tablet 1316a4338cec4f6cbb6aaaf59053b189 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:28.291826  8815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488298c497cb42ecb64885b19bcd1a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.293474  8885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1316a4338cec4f6cbb6aaaf59053b189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.293686  8810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b84bf4c66a694d1cbc4e3f61afe49bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.294171  8886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfed7271d68f4ef087e2881aedbbd8ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.294958  8887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a94d0587141e42dcb88cf6eca845d596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.306993  8809 tablet_service.cc:1511] Processing CreateTablet for tablet c281645c031146b88e5884ce1c3d9997 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:28.308472  8809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c281645c031146b88e5884ce1c3d9997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.313357  8942 tablet_bootstrap.cc:492] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b: Bootstrap starting.
I20260709 13:16:28.316011  8892 tablet_service.cc:1511] Processing CreateTablet for tablet b84bf4c66a694d1cbc4e3f61afe49bd5 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:28.317346  8892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b84bf4c66a694d1cbc4e3f61afe49bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.330441  8884 tablet_service.cc:1511] Processing CreateTablet for tablet c281645c031146b88e5884ce1c3d9997 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:28.331967  8884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c281645c031146b88e5884ce1c3d9997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.344079  8743 tablet_service.cc:1511] Processing CreateTablet for tablet 7085954ca82846de8e52835cae7146f9 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:28.345556  8743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7085954ca82846de8e52835cae7146f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.347898  8735 tablet_service.cc:1511] Processing CreateTablet for tablet b84bf4c66a694d1cbc4e3f61afe49bd5 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:28.348608  8942 tablet_bootstrap.cc:654] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.349419  8735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b84bf4c66a694d1cbc4e3f61afe49bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.349896  8741 tablet_service.cc:1511] Processing CreateTablet for tablet da899017c34d461b89751b5a3dbd705c (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:28.352459  8740 tablet_service.cc:1511] Processing CreateTablet for tablet 488298c497cb42ecb64885b19bcd1a10 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:28.356330  8738 tablet_service.cc:1511] Processing CreateTablet for tablet a94d0587141e42dcb88cf6eca845d596 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:28.356870  8734 tablet_service.cc:1511] Processing CreateTablet for tablet c281645c031146b88e5884ce1c3d9997 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:28.358639  8737 tablet_service.cc:1511] Processing CreateTablet for tablet cfed7271d68f4ef087e2881aedbbd8ba (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:28.361017  8736 tablet_service.cc:1511] Processing CreateTablet for tablet 1316a4338cec4f6cbb6aaaf59053b189 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:28.354643  8739 tablet_service.cc:1511] Processing CreateTablet for tablet d5587ada44ae4085bfc0e6ddacd80ef3 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:28.364677  8741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da899017c34d461b89751b5a3dbd705c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.368827  8738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a94d0587141e42dcb88cf6eca845d596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.372646  8739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5587ada44ae4085bfc0e6ddacd80ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.375564  8736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1316a4338cec4f6cbb6aaaf59053b189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.375936  8943 tablet_bootstrap.cc:492] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b: Bootstrap starting.
I20260709 13:16:28.377733  8737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfed7271d68f4ef087e2881aedbbd8ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.378381  8942 tablet_bootstrap.cc:492] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b: No bootstrap required, opened a new log
I20260709 13:16:28.378899  8942 ts_tablet_manager.cc:1403] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.000s
I20260709 13:16:28.383646  8740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488298c497cb42ecb64885b19bcd1a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.383045  8942 raft_consensus.cc:359] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } }
I20260709 13:16:28.384093  8942 raft_consensus.cc:385] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.384406  8942 raft_consensus.cc:740] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.385557  8942 consensus_queue.cc:260] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } }
I20260709 13:16:28.348462  8742 tablet_service.cc:1511] Processing CreateTablet for tablet 35c9eedcc83d4cb3aaf703d0684cc1d9 (DEFAULT_TABLE table=test-workload [id=583c7cc59c854721a5593f6ac91e58e6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:28.387621  8734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c281645c031146b88e5884ce1c3d9997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.388610  8742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35c9eedcc83d4cb3aaf703d0684cc1d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.394897  8943 tablet_bootstrap.cc:654] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.427577  8943 tablet_bootstrap.cc:492] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b: No bootstrap required, opened a new log
I20260709 13:16:28.428207  8943 ts_tablet_manager.cc:1403] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.022s
I20260709 13:16:28.431398  8943 raft_consensus.cc:359] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } }
I20260709 13:16:28.432320  8943 raft_consensus.cc:385] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.432705  8943 raft_consensus.cc:740] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.433777  8943 consensus_queue.cc:260] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } }
I20260709 13:16:28.440532  8927 heartbeater.cc:499] Master 127.31.17.190:41919 was elected leader, sending a full tablet report...
I20260709 13:16:28.443533  8942 ts_tablet_manager.cc:1434] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.011s
I20260709 13:16:28.457293  8943 ts_tablet_manager.cc:1434] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.012s
I20260709 13:16:28.457284  8942 tablet_bootstrap.cc:492] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b: Bootstrap starting.
I20260709 13:16:28.458370  8853 heartbeater.cc:499] Master 127.31.17.190:41919 was elected leader, sending a full tablet report...
I20260709 13:16:28.461601  8943 tablet_bootstrap.cc:492] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b: Bootstrap starting.
I20260709 13:16:28.465332  8942 tablet_bootstrap.cc:654] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.468355  8943 tablet_bootstrap.cc:654] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.487962  8947 tablet_bootstrap.cc:492] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
I20260709 13:16:28.500684  8942 tablet_bootstrap.cc:492] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b: No bootstrap required, opened a new log
I20260709 13:16:28.508317  8947 tablet_bootstrap.cc:654] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.505542  8942 ts_tablet_manager.cc:1403] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b: Time spent bootstrapping tablet: real 0.052s	user 0.005s	sys 0.009s
I20260709 13:16:28.513890  8947 tablet_bootstrap.cc:492] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2: No bootstrap required, opened a new log
I20260709 13:16:28.514384  8947 ts_tablet_manager.cc:1403] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.000s
I20260709 13:16:28.517283  8947 raft_consensus.cc:359] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.517920  8947 raft_consensus.cc:385] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.518216  8947 raft_consensus.cc:740] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.518157  8942 raft_consensus.cc:359] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.519057  8942 raft_consensus.cc:385] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.519619  8943 tablet_bootstrap.cc:492] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b: No bootstrap required, opened a new log
I20260709 13:16:28.519404  8942 raft_consensus.cc:740] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.519321  8947 consensus_queue.cc:260] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.520175  8943 ts_tablet_manager.cc:1403] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent bootstrapping tablet: real 0.059s	user 0.025s	sys 0.028s
I20260709 13:16:28.520571  8942 consensus_queue.cc:260] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.522974  8942 ts_tablet_manager.cc:1434] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:16:28.523192  8943 raft_consensus.cc:359] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.523940  8943 raft_consensus.cc:385] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.524115  8942 tablet_bootstrap.cc:492] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b: Bootstrap starting.
I20260709 13:16:28.524248  8943 raft_consensus.cc:740] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.525197  8943 consensus_queue.cc:260] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.529223  8947 ts_tablet_manager.cc:1434] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.005s
I20260709 13:16:28.529945  8778 heartbeater.cc:499] Master 127.31.17.190:41919 was elected leader, sending a full tablet report...
I20260709 13:16:28.530131  8943 ts_tablet_manager.cc:1434] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:16:28.531175  8943 tablet_bootstrap.cc:492] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b: Bootstrap starting.
I20260709 13:16:28.531944  8947 tablet_bootstrap.cc:492] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
I20260709 13:16:28.539091  8947 tablet_bootstrap.cc:654] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.540470  8942 tablet_bootstrap.cc:654] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.544723  8943 tablet_bootstrap.cc:654] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.554904  8942 tablet_bootstrap.cc:492] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b: No bootstrap required, opened a new log
I20260709 13:16:28.555622  8942 ts_tablet_manager.cc:1403] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.005s
I20260709 13:16:28.560901  8942 raft_consensus.cc:359] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.561774  8942 raft_consensus.cc:385] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.562160  8942 raft_consensus.cc:740] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.562266  8943 tablet_bootstrap.cc:492] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b: No bootstrap required, opened a new log
I20260709 13:16:28.562846  8943 ts_tablet_manager.cc:1403] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.004s
I20260709 13:16:28.563097  8942 consensus_queue.cc:260] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.565409  8942 ts_tablet_manager.cc:1434] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:16:28.565796  8943 raft_consensus.cc:359] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.566404  8942 tablet_bootstrap.cc:492] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b: Bootstrap starting.
I20260709 13:16:28.567407  8947 tablet_bootstrap.cc:492] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2: No bootstrap required, opened a new log
I20260709 13:16:28.566624  8943 raft_consensus.cc:385] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.568015  8947 ts_tablet_manager.cc:1403] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.019s
I20260709 13:16:28.567991  8943 raft_consensus.cc:740] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.569253  8943 consensus_queue.cc:260] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.571321  8947 raft_consensus.cc:359] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.572093  8947 raft_consensus.cc:385] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.572381  8947 raft_consensus.cc:740] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.573351  8942 tablet_bootstrap.cc:654] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.573233  8947 consensus_queue.cc:260] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.575728  8947 ts_tablet_manager.cc:1434] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:28.576864  8947 tablet_bootstrap.cc:492] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
I20260709 13:16:28.579061  8943 ts_tablet_manager.cc:1434] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:16:28.583161  8947 tablet_bootstrap.cc:654] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.587535  8943 tablet_bootstrap.cc:492] T cfed7271d68f4ef087e2881aedbbd8ba P 4a3147b92c754c88a02b7ac3a105fd2b: Bootstrap starting.
I20260709 13:16:28.588099  8947 tablet_bootstrap.cc:492] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2: No bootstrap required, opened a new log
I20260709 13:16:28.588626  8947 ts_tablet_manager.cc:1403] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:16:28.588941  8942 tablet_bootstrap.cc:492] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b: No bootstrap required, opened a new log
I20260709 13:16:28.589514  8942 ts_tablet_manager.cc:1403] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.009s
I20260709 13:16:28.591459  8947 raft_consensus.cc:359] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.592252  8947 raft_consensus.cc:385] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.592563  8947 raft_consensus.cc:740] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.592492  8942 raft_consensus.cc:359] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.593468  8942 raft_consensus.cc:385] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.593788  8942 raft_consensus.cc:740] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.593654  8947 consensus_queue.cc:260] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.594446  8943 tablet_bootstrap.cc:654] T cfed7271d68f4ef087e2881aedbbd8ba P 4a3147b92c754c88a02b7ac3a105fd2b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.594602  8942 consensus_queue.cc:260] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.597570  8942 ts_tablet_manager.cc:1434] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:28.598549  8942 tablet_bootstrap.cc:492] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b: Bootstrap starting.
I20260709 13:16:28.598976  8947 ts_tablet_manager.cc:1434] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:16:28.600018  8947 tablet_bootstrap.cc:492] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
I20260709 13:16:28.604898  8942 tablet_bootstrap.cc:654] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.606256  8947 tablet_bootstrap.cc:654] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.615083  8952 raft_consensus.cc:493] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.615835  8952 raft_consensus.cc:515] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.619293  8947 tablet_bootstrap.cc:492] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2: No bootstrap required, opened a new log
I20260709 13:16:28.619861  8947 ts_tablet_manager.cc:1403] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.005s
I20260709 13:16:28.620592  8952 leader_election.cc:290] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
W20260709 13:16:28.623607  8928 tablet.cc:2406] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:16:28.627978  8942 tablet_bootstrap.cc:492] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b: No bootstrap required, opened a new log
I20260709 13:16:28.628645  8942 ts_tablet_manager.cc:1403] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.000s
I20260709 13:16:28.630846  8947 raft_consensus.cc:359] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.631815  8947 raft_consensus.cc:385] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.632030  8943 tablet_bootstrap.cc:492] T cfed7271d68f4ef087e2881aedbbd8ba P 4a3147b92c754c88a02b7ac3a105fd2b: No bootstrap required, opened a new log
I20260709 13:16:28.632119  8947 raft_consensus.cc:740] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.632716  8943 ts_tablet_manager.cc:1403] T cfed7271d68f4ef087e2881aedbbd8ba P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.029s
I20260709 13:16:28.633001  8947 consensus_queue.cc:260] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.633921  8942 raft_consensus.cc:359] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.634799  8942 raft_consensus.cc:385] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.635200  8947 ts_tablet_manager.cc:1434] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:16:28.635195  8942 raft_consensus.cc:740] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.642179  8942 consensus_queue.cc:260] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.644215  8947 tablet_bootstrap.cc:492] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
I20260709 13:16:28.644644  8942 ts_tablet_manager.cc:1434] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:16:28.645792  8942 tablet_bootstrap.cc:492] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b: Bootstrap starting.
I20260709 13:16:28.651419  8947 tablet_bootstrap.cc:654] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.651813  8942 tablet_bootstrap.cc:654] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.635713  8943 raft_consensus.cc:359] T cfed7271d68f4ef087e2881aedbbd8ba P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.654241  8943 raft_consensus.cc:385] T cfed7271d68f4ef087e2881aedbbd8ba P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.654690  8943 raft_consensus.cc:740] T cfed7271d68f4ef087e2881aedbbd8ba P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.655658  8943 consensus_queue.cc:260] T cfed7271d68f4ef087e2881aedbbd8ba P 4a3147b92c754c88a02b7ac3a105fd2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.658643  8943 ts_tablet_manager.cc:1434] T cfed7271d68f4ef087e2881aedbbd8ba P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:16:28.663437  8947 tablet_bootstrap.cc:492] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2: No bootstrap required, opened a new log
I20260709 13:16:28.664005  8947 ts_tablet_manager.cc:1403] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.012s
I20260709 13:16:28.664618  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5587ada44ae4085bfc0e6ddacd80ef3" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b" is_pre_election: true
I20260709 13:16:28.671386  8947 raft_consensus.cc:359] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.672174  8947 raft_consensus.cc:385] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.672499  8947 raft_consensus.cc:740] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
W20260709 13:16:28.672554  8718 leader_election.cc:343] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:28.664886  8943 tablet_bootstrap.cc:492] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b: Bootstrap starting.
I20260709 13:16:28.665462  8945 raft_consensus.cc:493] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.673316  8947 consensus_queue.cc:260] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.673659  8945 raft_consensus.cc:515] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.676445  8945 leader_election.cc:290] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751)
I20260709 13:16:28.677812  8947 ts_tablet_manager.cc:1434] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:16:28.678929  8947 tablet_bootstrap.cc:492] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
W20260709 13:16:28.679602  8699 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:28.679724  8943 tablet_bootstrap.cc:654] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.669345  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5587ada44ae4085bfc0e6ddacd80ef3" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" is_pre_election: true
I20260709 13:16:28.685642  8828 raft_consensus.cc:2468] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3891d8a821ec4b6ea07053cafbcc10f2 in term 0.
I20260709 13:16:28.686506  8943 tablet_bootstrap.cc:492] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b: No bootstrap required, opened a new log
I20260709 13:16:28.686728  8948 raft_consensus.cc:493] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.687104  8943 ts_tablet_manager.cc:1403] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.002s
I20260709 13:16:28.687279  8948 raft_consensus.cc:515] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.690281  8943 raft_consensus.cc:359] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.690999  8947 tablet_bootstrap.cc:654] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.691033  8943 raft_consensus.cc:385] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.691641  8943 raft_consensus.cc:740] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.692446  8717 leader_election.cc:304] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 4a3147b92c754c88a02b7ac3a105fd2b; no voters: 8d58272f60794aba93285416034cfb3b
I20260709 13:16:28.692379  8943 consensus_queue.cc:260] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.693368  8952 raft_consensus.cc:2804] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:28.693738  8952 raft_consensus.cc:493] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.694154  8952 raft_consensus.cc:3060] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.695570  8948 leader_election.cc:290] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:28.710314  8952 raft_consensus.cc:515] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.728027  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c281645c031146b88e5884ce1c3d9997" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" is_pre_election: true
I20260709 13:16:28.730916  8753 raft_consensus.cc:2468] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 0.
I20260709 13:16:28.730027  8972 raft_consensus.cc:493] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.733090  8867 leader_election.cc:304] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 8d58272f60794aba93285416034cfb3b; no voters: 
I20260709 13:16:28.734771  8942 tablet_bootstrap.cc:492] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b: No bootstrap required, opened a new log
I20260709 13:16:28.736052  8942 ts_tablet_manager.cc:1403] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b: Time spent bootstrapping tablet: real 0.090s	user 0.024s	sys 0.008s
I20260709 13:16:28.736949  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c281645c031146b88e5884ce1c3d9997" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" is_pre_election: true
I20260709 13:16:28.735255  8952 leader_election.cc:290] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 election: Requested vote from peers 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:28.734833  8945 raft_consensus.cc:2804] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:28.738771  8945 raft_consensus.cc:493] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.735868  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5587ada44ae4085bfc0e6ddacd80ef3" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b"
I20260709 13:16:28.739285  8945 raft_consensus.cc:3060] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:28.749904  8718 leader_election.cc:343] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:28.750356  8866 leader_election.cc:343] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:28.750818  8948 raft_consensus.cc:493] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.751503  8948 raft_consensus.cc:515] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.754084  8948 leader_election.cc:290] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:28.757310  8947 tablet_bootstrap.cc:492] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2: No bootstrap required, opened a new log
I20260709 13:16:28.757849  8947 ts_tablet_manager.cc:1403] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.000s
I20260709 13:16:28.758858  8945 raft_consensus.cc:515] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.742120  8972 raft_consensus.cc:515] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.761600  8947 raft_consensus.cc:359] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.762070  8972 leader_election.cc:290] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:28.764353  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1316a4338cec4f6cbb6aaaf59053b189" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b" is_pre_election: true
I20260709 13:16:28.764663  8943 ts_tablet_manager.cc:1434] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent starting tablet: real 0.077s	user 0.029s	sys 0.038s
I20260709 13:16:28.764292  8942 raft_consensus.cc:359] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.765121  8942 raft_consensus.cc:385] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.765441  8942 raft_consensus.cc:740] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.765393  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5587ada44ae4085bfc0e6ddacd80ef3" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
W20260709 13:16:28.766001  8718 leader_election.cc:343] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:28.766253  8828 raft_consensus.cc:3060] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.762473  8947 raft_consensus.cc:385] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.767038  8947 raft_consensus.cc:740] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.766642  8942 consensus_queue.cc:260] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.767936  8947 consensus_queue.cc:260] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.767758  8943 tablet_bootstrap.cc:492] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b: Bootstrap starting.
I20260709 13:16:28.770417  8947 ts_tablet_manager.cc:1434] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:16:28.771462  8947 tablet_bootstrap.cc:492] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
I20260709 13:16:28.777961  8947 tablet_bootstrap.cc:654] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.779639  8943 tablet_bootstrap.cc:654] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.785640  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1316a4338cec4f6cbb6aaaf59053b189" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" is_pre_election: true
I20260709 13:16:28.786700  8827 raft_consensus.cc:2468] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3891d8a821ec4b6ea07053cafbcc10f2 in term 0.
I20260709 13:16:28.790622  8828 raft_consensus.cc:2468] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3891d8a821ec4b6ea07053cafbcc10f2 in term 1.
I20260709 13:16:28.795734  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c281645c031146b88e5884ce1c3d9997" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
I20260709 13:16:28.796599  8753 raft_consensus.cc:3060] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.793056  8942 ts_tablet_manager.cc:1434] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b: Time spent starting tablet: real 0.056s	user 0.020s	sys 0.008s
I20260709 13:16:28.798802  8942 tablet_bootstrap.cc:492] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b: Bootstrap starting.
I20260709 13:16:28.801630  8943 tablet_bootstrap.cc:492] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b: No bootstrap required, opened a new log
I20260709 13:16:28.802284  8943 ts_tablet_manager.cc:1403] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.004s
I20260709 13:16:28.805354  8943 raft_consensus.cc:359] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.806092  8943 raft_consensus.cc:385] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.806393  8943 raft_consensus.cc:740] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.806715  8942 tablet_bootstrap.cc:654] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.807217  8943 consensus_queue.cc:260] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.809834  8943 ts_tablet_manager.cc:1434] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:28.814858  8943 tablet_bootstrap.cc:492] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b: Bootstrap starting.
I20260709 13:16:28.815608  8968 raft_consensus.cc:493] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.816169  8968 raft_consensus.cc:515] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } }
I20260709 13:16:28.818199  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c281645c031146b88e5884ce1c3d9997" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
I20260709 13:16:28.818578  8968 leader_election.cc:290] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121), 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209)
W20260709 13:16:28.819449  8866 leader_election.cc:343] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:28.822582  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5587ada44ae4085bfc0e6ddacd80ef3" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" is_pre_election: true
I20260709 13:16:28.823500  8752 raft_consensus.cc:2393] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a3147b92c754c88a02b7ac3a105fd2b in current term 1: Already voted for candidate 3891d8a821ec4b6ea07053cafbcc10f2 in this term.
I20260709 13:16:28.823819  8947 tablet_bootstrap.cc:492] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2: No bootstrap required, opened a new log
I20260709 13:16:28.824383  8947 ts_tablet_manager.cc:1403] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.053s	user 0.028s	sys 0.013s
I20260709 13:16:28.824787  8943 tablet_bootstrap.cc:654] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.824867  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c9eedcc83d4cb3aaf703d0684cc1d9" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" is_pre_election: true
I20260709 13:16:28.826642  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7085954ca82846de8e52835cae7146f9" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" is_pre_election: true
I20260709 13:16:28.827705  8717 leader_election.cc:304] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 4a3147b92c754c88a02b7ac3a105fd2b; no voters: 8d58272f60794aba93285416034cfb3b
I20260709 13:16:28.827615  8947 raft_consensus.cc:359] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } }
I20260709 13:16:28.828590  8972 raft_consensus.cc:2804] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:28.828492  8947 raft_consensus.cc:385] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.828961  8972 raft_consensus.cc:493] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.829260  8947 raft_consensus.cc:740] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.829388  8972 raft_consensus.cc:3060] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.828953  8968 raft_consensus.cc:493] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.830134  8968 raft_consensus.cc:515] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.832319  8968 leader_election.cc:290] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:28.833312  8717 leader_election.cc:304] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 4a3147b92c754c88a02b7ac3a105fd2b; no voters: 8d58272f60794aba93285416034cfb3b
I20260709 13:16:28.834120  8952 raft_consensus.cc:2804] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:28.835536  8952 raft_consensus.cc:697] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 LEADER]: Becoming Leader. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Running, Role: LEADER
I20260709 13:16:28.836405  8952 consensus_queue.cc:237] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.839260  8947 consensus_queue.cc:260] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } }
I20260709 13:16:28.840576  8943 tablet_bootstrap.cc:492] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b: No bootstrap required, opened a new log
I20260709 13:16:28.841280  8943 ts_tablet_manager.cc:1403] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.004s
I20260709 13:16:28.842113  8753 raft_consensus.cc:2468] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 1.
I20260709 13:16:28.842414  8947 ts_tablet_manager.cc:1434] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 13:16:28.838506  8972 raft_consensus.cc:515] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.843550  8947 tablet_bootstrap.cc:492] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
I20260709 13:16:28.843508  8867 leader_election.cc:304] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 8d58272f60794aba93285416034cfb3b; no voters: 4a3147b92c754c88a02b7ac3a105fd2b
I20260709 13:16:28.844859  8974 raft_consensus.cc:2804] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:28.845991  8943 raft_consensus.cc:359] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.847025  8943 raft_consensus.cc:385] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.847433  8943 raft_consensus.cc:740] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.848315  8979 raft_consensus.cc:493] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.848892  8979 raft_consensus.cc:515] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.850414  8972 leader_election.cc:290] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 election: Requested vote from peers 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:28.851655  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1316a4338cec4f6cbb6aaaf59053b189" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b"
I20260709 13:16:28.851500  8943 consensus_queue.cc:260] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
W20260709 13:16:28.853893  8718 leader_election.cc:343] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:28.855732  8968 raft_consensus.cc:493] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.856504  8945 leader_election.cc:290] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751)
I20260709 13:16:28.856389  8968 raft_consensus.cc:515] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.857641  8974 raft_consensus.cc:697] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 1 LEADER]: Becoming Leader. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Running, Role: LEADER
I20260709 13:16:28.858650  8974 consensus_queue.cc:237] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.860538  8968 leader_election.cc:290] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:28.855085  8943 ts_tablet_manager.cc:1434] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:16:28.862627  8943 tablet_bootstrap.cc:492] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b: Bootstrap starting.
I20260709 13:16:28.861373  8981 raft_consensus.cc:493] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.864636  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b84bf4c66a694d1cbc4e3f61afe49bd5" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b" is_pre_election: true
I20260709 13:16:28.865381  8902 raft_consensus.cc:2468] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3891d8a821ec4b6ea07053cafbcc10f2 in term 0.
I20260709 13:16:28.867529  8718 leader_election.cc:304] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 8d58272f60794aba93285416034cfb3b; no voters: 
I20260709 13:16:28.872383  8943 tablet_bootstrap.cc:654] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.875170  8952 raft_consensus.cc:2804] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:28.875808  8952 raft_consensus.cc:493] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.876219  8952 raft_consensus.cc:3060] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:28.876866  8717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.130:41751, user_credentials={real_user=slave}} blocked reactor thread for 43651.6us
I20260709 13:16:28.880570  8981 raft_consensus.cc:515] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } }
I20260709 13:16:28.893416  8945 raft_consensus.cc:493] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.959520  8945 raft_consensus.cc:515] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.891011  8952 raft_consensus.cc:515] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
W20260709 13:16:28.960361  8793 leader_election.cc:343] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:28.883347  8979 leader_election.cc:290] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:28.881860  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7085954ca82846de8e52835cae7146f9" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b" is_pre_election: true
W20260709 13:16:28.961618  8793 leader_election.cc:343] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:28.938879  8648 catalog_manager.cc:5697] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d58272f60794aba93285416034cfb3b (127.31.17.131). New cstate: current_term: 1 leader_uuid: "8d58272f60794aba93285416034cfb3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.962109  8900 raft_consensus.cc:2468] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 0.
I20260709 13:16:28.883734  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da899017c34d461b89751b5a3dbd705c" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b" is_pre_election: true
I20260709 13:16:28.963760  8898 raft_consensus.cc:2468] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 0.
I20260709 13:16:28.963457  8793 leader_election.cc:304] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a3147b92c754c88a02b7ac3a105fd2b, 8d58272f60794aba93285416034cfb3b; no voters: 3891d8a821ec4b6ea07053cafbcc10f2
I20260709 13:16:28.881016  8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c9eedcc83d4cb3aaf703d0684cc1d9" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b" is_pre_election: true
I20260709 13:16:28.887256  8902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5587ada44ae4085bfc0e6ddacd80ef3" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b" is_pre_election: true
I20260709 13:16:28.965109  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b84bf4c66a694d1cbc4e3f61afe49bd5" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b"
I20260709 13:16:28.893162  8947 tablet_bootstrap.cc:654] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.966159  8793 leader_election.cc:304] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a3147b92c754c88a02b7ac3a105fd2b, 8d58272f60794aba93285416034cfb3b; no voters: 
I20260709 13:16:28.967260  8948 raft_consensus.cc:2804] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:28.967293  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7085954ca82846de8e52835cae7146f9" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" is_pre_election: true
I20260709 13:16:28.967947  8948 raft_consensus.cc:493] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.861897  8651 catalog_manager.cc:5697] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:28.964787  8968 raft_consensus.cc:2804] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:28.882788  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94d0587141e42dcb88cf6eca845d596" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b" is_pre_election: true
I20260709 13:16:28.965939  8900 raft_consensus.cc:3060] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.972159  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1316a4338cec4f6cbb6aaaf59053b189" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
I20260709 13:16:28.981077  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b84bf4c66a694d1cbc4e3f61afe49bd5" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" is_pre_election: true
I20260709 13:16:28.963449  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c9eedcc83d4cb3aaf703d0684cc1d9" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" is_pre_election: true
I20260709 13:16:28.982867  8827 raft_consensus.cc:3060] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.977982  8979 raft_consensus.cc:493] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:28.983471  8867 leader_election.cc:343] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:28.983716  8979 raft_consensus.cc:515] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:28.980887  8948 raft_consensus.cc:3060] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:28.969241  8793 leader_election.cc:343] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:28.987433  8793 leader_election.cc:304] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a3147b92c754c88a02b7ac3a105fd2b; no voters: 3891d8a821ec4b6ea07053cafbcc10f2, 8d58272f60794aba93285416034cfb3b
I20260709 13:16:28.980541  8952 leader_election.cc:290] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 election: Requested vote from peers 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:28.989343  8752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94d0587141e42dcb88cf6eca845d596" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" is_pre_election: true
I20260709 13:16:28.990846  8981 leader_election.cc:290] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751), 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209)
I20260709 13:16:28.964986  8901 raft_consensus.cc:2468] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 0.
I20260709 13:16:28.991662  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da899017c34d461b89751b5a3dbd705c" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" is_pre_election: true
I20260709 13:16:28.992046  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b84bf4c66a694d1cbc4e3f61afe49bd5" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
I20260709 13:16:28.991027  8750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7085954ca82846de8e52835cae7146f9" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" is_pre_election: true
I20260709 13:16:28.992007  8968 raft_consensus.cc:493] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.993642  8750 raft_consensus.cc:2468] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 0.
I20260709 13:16:28.993875  8968 raft_consensus.cc:3060] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.994911  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488298c497cb42ecb64885b19bcd1a10" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" is_pre_election: true
I20260709 13:16:28.995476  8867 leader_election.cc:304] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 8d58272f60794aba93285416034cfb3b; no voters: 
W20260709 13:16:28.996440  8717 leader_election.cc:343] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:28.996985  8981 raft_consensus.cc:2804] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:28.996978  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488298c497cb42ecb64885b19bcd1a10" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b" is_pre_election: true
I20260709 13:16:28.997611  8981 raft_consensus.cc:493] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.998216  8981 raft_consensus.cc:3060] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:28.999010  8718 leader_election.cc:343] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:28.993844  8979 leader_election.cc:290] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:29.001659  8945 leader_election.cc:290] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751)
W20260709 13:16:28.997459  8717 leader_election.cc:343] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:29.002202  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c9eedcc83d4cb3aaf703d0684cc1d9" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" is_pre_election: true
W20260709 13:16:29.002879  8717 leader_election.cc:343] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:29.002899  8826 raft_consensus.cc:2468] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 0.
I20260709 13:16:29.003772  8717 leader_election.cc:304] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2; no voters: 4a3147b92c754c88a02b7ac3a105fd2b, 8d58272f60794aba93285416034cfb3b
I20260709 13:16:29.004655  8866 leader_election.cc:304] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a3147b92c754c88a02b7ac3a105fd2b, 8d58272f60794aba93285416034cfb3b; no voters: 3891d8a821ec4b6ea07053cafbcc10f2
I20260709 13:16:29.011148  8945 raft_consensus.cc:2804] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:29.011809  8945 raft_consensus.cc:493] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.012159  8945 raft_consensus.cc:3060] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.015411  8974 raft_consensus.cc:493] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.016024  8974 raft_consensus.cc:515] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.010610  8979 raft_consensus.cc:2749] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:29.019760  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfed7271d68f4ef087e2881aedbbd8ba" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" is_pre_election: true
I20260709 13:16:29.020874  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfed7271d68f4ef087e2881aedbbd8ba" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" is_pre_election: true
I20260709 13:16:29.021562  8826 raft_consensus.cc:2468] T cfed7271d68f4ef087e2881aedbbd8ba P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 0.
I20260709 13:16:29.022778  8753 raft_consensus.cc:2468] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 0.
I20260709 13:16:29.023108  8900 raft_consensus.cc:2468] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3891d8a821ec4b6ea07053cafbcc10f2 in term 1.
I20260709 13:16:29.022811  8866 leader_election.cc:304] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a3147b92c754c88a02b7ac3a105fd2b, 8d58272f60794aba93285416034cfb3b; no voters: 
I20260709 13:16:29.024888  8718 leader_election.cc:304] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 8d58272f60794aba93285416034cfb3b; no voters: 4a3147b92c754c88a02b7ac3a105fd2b
I20260709 13:16:29.023028  8974 leader_election.cc:290] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751)
I20260709 13:16:29.027827  8979 raft_consensus.cc:2804] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:29.028925  8974 raft_consensus.cc:2804] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:29.031584  8979 raft_consensus.cc:697] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 LEADER]: Becoming Leader. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Running, Role: LEADER
I20260709 13:16:29.031884  8974 raft_consensus.cc:493] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.032812  8974 raft_consensus.cc:3060] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.032536  8979 consensus_queue.cc:237] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
W20260709 13:16:29.030290  8793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.17.131:43121, user_credentials={real_user=slave}} blocked reactor thread for 61088.6us
I20260709 13:16:29.034286  8981 raft_consensus.cc:515] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } }
W20260709 13:16:29.035645  8793 leader_election.cc:343] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:29.034713  8948 raft_consensus.cc:515] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.036623  8981 leader_election.cc:290] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 election: Requested vote from peers 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751), 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209)
W20260709 13:16:29.038183  8793 leader_election.cc:343] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:29.041611  8986 raft_consensus.cc:2749] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:29.041515  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7085954ca82846de8e52835cae7146f9" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
I20260709 13:16:29.044728  8753 raft_consensus.cc:3060] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.046375  8827 raft_consensus.cc:2468] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3891d8a821ec4b6ea07053cafbcc10f2 in term 1.
I20260709 13:16:29.046872  8943 tablet_bootstrap.cc:492] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b: No bootstrap required, opened a new log
I20260709 13:16:29.047376  8943 ts_tablet_manager.cc:1403] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent bootstrapping tablet: real 0.185s	user 0.036s	sys 0.039s
I20260709 13:16:29.049453  8943 raft_consensus.cc:359] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.050100  8943 raft_consensus.cc:385] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.050315  8943 raft_consensus.cc:740] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.051292  8753 raft_consensus.cc:2468] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 1.
W20260709 13:16:29.042043  8793 leader_election.cc:343] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:29.052382  8793 leader_election.cc:304] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a3147b92c754c88a02b7ac3a105fd2b; no voters: 3891d8a821ec4b6ea07053cafbcc10f2, 8d58272f60794aba93285416034cfb3b
I20260709 13:16:29.041685  8948 leader_election.cc:290] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:29.052749  8867 leader_election.cc:304] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 8d58272f60794aba93285416034cfb3b; no voters: 
I20260709 13:16:29.042135  8968 raft_consensus.cc:515] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } }
I20260709 13:16:29.051465  8717 leader_election.cc:304] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 4a3147b92c754c88a02b7ac3a105fd2b; no voters: 8d58272f60794aba93285416034cfb3b
I20260709 13:16:29.054436  8828 raft_consensus.cc:2393] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d58272f60794aba93285416034cfb3b in current term 1: Already voted for candidate 4a3147b92c754c88a02b7ac3a105fd2b in this term.
I20260709 13:16:29.054478  8793 leader_election.cc:304] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a3147b92c754c88a02b7ac3a105fd2b, 8d58272f60794aba93285416034cfb3b; no voters: 3891d8a821ec4b6ea07053cafbcc10f2
I20260709 13:16:29.055392  8968 leader_election.cc:290] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 election: Requested vote from peers 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121), 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209)
I20260709 13:16:29.056166  8952 raft_consensus.cc:2804] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:29.056612  8968 raft_consensus.cc:2804] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:29.056690  8952 raft_consensus.cc:697] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 LEADER]: Becoming Leader. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Running, Role: LEADER
I20260709 13:16:29.057134  8968 raft_consensus.cc:493] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.057331  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da899017c34d461b89751b5a3dbd705c" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b"
I20260709 13:16:29.057538  8968 raft_consensus.cc:3060] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.057972  8900 raft_consensus.cc:3060] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.057711  8952 consensus_queue.cc:237] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.059422  8981 raft_consensus.cc:2804] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:29.060057  8981 raft_consensus.cc:697] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [term 1 LEADER]: Becoming Leader. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Running, Role: LEADER
I20260709 13:16:29.061659  8981 consensus_queue.cc:237] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } }
I20260709 13:16:29.065866  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7085954ca82846de8e52835cae7146f9" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
I20260709 13:16:29.066746  8828 raft_consensus.cc:2393] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d58272f60794aba93285416034cfb3b in current term 1: Already voted for candidate 4a3147b92c754c88a02b7ac3a105fd2b in this term.
I20260709 13:16:29.053469  8986 raft_consensus.cc:2749] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:29.044123  8942 tablet_bootstrap.cc:492] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b: No bootstrap required, opened a new log
I20260709 13:16:29.066576  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7085954ca82846de8e52835cae7146f9" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b"
I20260709 13:16:29.050940  8943 consensus_queue.cc:260] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.068711  8942 ts_tablet_manager.cc:1403] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b: Time spent bootstrapping tablet: real 0.270s	user 0.076s	sys 0.145s
I20260709 13:16:29.071002  8968 raft_consensus.cc:515] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.071894  8942 raft_consensus.cc:359] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.052953  8947 tablet_bootstrap.cc:492] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2: No bootstrap required, opened a new log
I20260709 13:16:29.072700  8942 raft_consensus.cc:385] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.073050  8942 raft_consensus.cc:740] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.073135  8968 leader_election.cc:290] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:29.073678  8947 ts_tablet_manager.cc:1403] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.230s	user 0.012s	sys 0.019s
I20260709 13:16:29.079169  8750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7085954ca82846de8e52835cae7146f9" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
I20260709 13:16:29.080005  8750 raft_consensus.cc:2393] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a3147b92c754c88a02b7ac3a105fd2b in current term 1: Already voted for candidate 8d58272f60794aba93285416034cfb3b in this term.
I20260709 13:16:29.080935  8751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c9eedcc83d4cb3aaf703d0684cc1d9" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
I20260709 13:16:29.082217  8793 leader_election.cc:304] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a3147b92c754c88a02b7ac3a105fd2b; no voters: 3891d8a821ec4b6ea07053cafbcc10f2, 8d58272f60794aba93285416034cfb3b
W20260709 13:16:29.084540  8793 leader_election.cc:343] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:29.074985  8945 raft_consensus.cc:515] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.075449  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c9eedcc83d4cb3aaf703d0684cc1d9" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b"
I20260709 13:16:29.076115  8942 consensus_queue.cc:260] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.084652  8986 raft_consensus.cc:2749] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:29.085831  8898 raft_consensus.cc:2393] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a3147b92c754c88a02b7ac3a105fd2b in current term 1: Already voted for candidate 8d58272f60794aba93285416034cfb3b in this term.
I20260709 13:16:29.076839  8943 ts_tablet_manager.cc:1434] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:16:29.077847  8900 raft_consensus.cc:2468] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 1.
I20260709 13:16:29.078154  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da899017c34d461b89751b5a3dbd705c" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
I20260709 13:16:29.087469  8947 raft_consensus.cc:359] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.088486  8947 raft_consensus.cc:385] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.088821  8947 raft_consensus.cc:740] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.088286  8942 ts_tablet_manager.cc:1434] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:16:29.091207  8793 leader_election.cc:304] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a3147b92c754c88a02b7ac3a105fd2b; no voters: 3891d8a821ec4b6ea07053cafbcc10f2, 8d58272f60794aba93285416034cfb3b
W20260709 13:16:29.092494  8793 leader_election.cc:343] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:29.092730  8974 raft_consensus.cc:515] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.093413  8793 leader_election.cc:304] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a3147b92c754c88a02b7ac3a105fd2b, 8d58272f60794aba93285416034cfb3b; no voters: 3891d8a821ec4b6ea07053cafbcc10f2
I20260709 13:16:29.094214  8968 raft_consensus.cc:2749] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:29.094563  8986 raft_consensus.cc:2804] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:29.095065  8986 raft_consensus.cc:697] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 LEADER]: Becoming Leader. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Running, Role: LEADER
I20260709 13:16:29.095448  8947 consensus_queue.cc:260] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.096007  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfed7271d68f4ef087e2881aedbbd8ba" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
I20260709 13:16:29.096874  8753 raft_consensus.cc:3060] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.095983  8986 consensus_queue.cc:237] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.097873  8947 ts_tablet_manager.cc:1434] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:16:29.098840  8947 tablet_bootstrap.cc:492] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
I20260709 13:16:29.099957  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfed7271d68f4ef087e2881aedbbd8ba" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
I20260709 13:16:29.100801  8828 raft_consensus.cc:3060] T cfed7271d68f4ef087e2881aedbbd8ba P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.104269  8947 tablet_bootstrap.cc:654] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:29.104728  8753 raft_consensus.cc:2468] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 1.
I20260709 13:16:29.106335  8867 leader_election.cc:304] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 8d58272f60794aba93285416034cfb3b; no voters: 
I20260709 13:16:29.106724  8974 leader_election.cc:290] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751)
I20260709 13:16:29.089221  8943 tablet_bootstrap.cc:492] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b: Bootstrap starting.
I20260709 13:16:29.112900  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c9eedcc83d4cb3aaf703d0684cc1d9" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
I20260709 13:16:29.113570  8753 raft_consensus.cc:3060] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.108734  8987 raft_consensus.cc:2804] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:29.117621  8987 raft_consensus.cc:697] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [term 1 LEADER]: Becoming Leader. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Running, Role: LEADER
I20260709 13:16:29.127091  8987 consensus_queue.cc:237] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.120565  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c9eedcc83d4cb3aaf703d0684cc1d9" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
I20260709 13:16:29.130378  8827 raft_consensus.cc:2393] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d58272f60794aba93285416034cfb3b in current term 1: Already voted for candidate 4a3147b92c754c88a02b7ac3a105fd2b in this term.
I20260709 13:16:29.125697  8828 raft_consensus.cc:2468] T cfed7271d68f4ef087e2881aedbbd8ba P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 1.
I20260709 13:16:29.119415  8945 leader_election.cc:290] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751)
I20260709 13:16:29.128517  8942 tablet_bootstrap.cc:492] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b: Bootstrap starting.
I20260709 13:16:29.130996  8649 catalog_manager.cc:5697] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d58272f60794aba93285416034cfb3b (127.31.17.131). New cstate: current_term: 1 leader_uuid: "8d58272f60794aba93285416034cfb3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.129251  8648 catalog_manager.cc:5697] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130). New cstate: current_term: 1 leader_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.139016  8942 tablet_bootstrap.cc:654] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:29.138440  8753 raft_consensus.cc:2468] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 1.
I20260709 13:16:29.144335  8867 leader_election.cc:304] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 8d58272f60794aba93285416034cfb3b; no voters: 4a3147b92c754c88a02b7ac3a105fd2b
I20260709 13:16:29.145828  8945 raft_consensus.cc:2804] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:29.146405  8945 raft_consensus.cc:697] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 1 LEADER]: Becoming Leader. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Running, Role: LEADER
I20260709 13:16:29.147413  8945 consensus_queue.cc:237] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.141500  8943 tablet_bootstrap.cc:654] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:29.151494  8947 tablet_bootstrap.cc:492] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2: No bootstrap required, opened a new log
I20260709 13:16:29.152195  8947 ts_tablet_manager.cc:1403] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.006s
I20260709 13:16:29.154633  8651 catalog_manager.cc:5697] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.155788  8942 tablet_bootstrap.cc:492] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b: No bootstrap required, opened a new log
I20260709 13:16:29.155633  8947 raft_consensus.cc:359] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.156386  8942 ts_tablet_manager.cc:1403] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.003s
I20260709 13:16:29.156749  8651 catalog_manager.cc:5697] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.159042  8942 raft_consensus.cc:359] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.159742  8942 raft_consensus.cc:385] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.160014  8942 raft_consensus.cc:740] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.160844  8942 consensus_queue.cc:260] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.162890  8942 ts_tablet_manager.cc:1434] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:29.156670  8947 raft_consensus.cc:385] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.163739  8942 tablet_bootstrap.cc:492] T 488298c497cb42ecb64885b19bcd1a10 P 8d58272f60794aba93285416034cfb3b: Bootstrap starting.
I20260709 13:16:29.163784  8947 raft_consensus.cc:740] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.164680  8947 consensus_queue.cc:260] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.169524  8947 ts_tablet_manager.cc:1434] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 13:16:29.169905  8942 tablet_bootstrap.cc:654] T 488298c497cb42ecb64885b19bcd1a10 P 8d58272f60794aba93285416034cfb3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:29.170889  8947 tablet_bootstrap.cc:492] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
I20260709 13:16:29.172850  8648 catalog_manager.cc:5697] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d58272f60794aba93285416034cfb3b (127.31.17.131). New cstate: current_term: 1 leader_uuid: "8d58272f60794aba93285416034cfb3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:29.180904  8942 tablet_bootstrap.cc:492] T 488298c497cb42ecb64885b19bcd1a10 P 8d58272f60794aba93285416034cfb3b: No bootstrap required, opened a new log
I20260709 13:16:29.181385  8947 tablet_bootstrap.cc:654] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:29.181425  8942 ts_tablet_manager.cc:1403] T 488298c497cb42ecb64885b19bcd1a10 P 8d58272f60794aba93285416034cfb3b: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 13:16:29.184578  8942 raft_consensus.cc:359] T 488298c497cb42ecb64885b19bcd1a10 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.185222  8942 raft_consensus.cc:385] T 488298c497cb42ecb64885b19bcd1a10 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.185482  8942 raft_consensus.cc:740] T 488298c497cb42ecb64885b19bcd1a10 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.189865  8942 consensus_queue.cc:260] T 488298c497cb42ecb64885b19bcd1a10 P 8d58272f60794aba93285416034cfb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.191956  8942 ts_tablet_manager.cc:1434] T 488298c497cb42ecb64885b19bcd1a10 P 8d58272f60794aba93285416034cfb3b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:16:29.192884  8942 tablet_bootstrap.cc:492] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b: Bootstrap starting.
I20260709 13:16:29.198504  8942 tablet_bootstrap.cc:654] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:29.197834  8648 catalog_manager.cc:5697] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d58272f60794aba93285416034cfb3b (127.31.17.131). New cstate: current_term: 1 leader_uuid: "8d58272f60794aba93285416034cfb3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:29.201362  8947 tablet_bootstrap.cc:492] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2: No bootstrap required, opened a new log
I20260709 13:16:29.201844  8947 ts_tablet_manager.cc:1403] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.007s
I20260709 13:16:29.204252  8947 raft_consensus.cc:359] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.204756  8947 raft_consensus.cc:385] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.205039  8947 raft_consensus.cc:740] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.205754  8947 consensus_queue.cc:260] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.207814  8947 ts_tablet_manager.cc:1434] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:16:29.208719  8942 tablet_bootstrap.cc:492] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b: No bootstrap required, opened a new log
I20260709 13:16:29.209246  8942 ts_tablet_manager.cc:1403] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.004s
I20260709 13:16:29.210629  8943 tablet_bootstrap.cc:492] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b: No bootstrap required, opened a new log
I20260709 13:16:29.211161  8943 ts_tablet_manager.cc:1403] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent bootstrapping tablet: real 0.122s	user 0.012s	sys 0.000s
I20260709 13:16:29.211946  8942 raft_consensus.cc:359] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.212718  8942 raft_consensus.cc:385] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.213012  8942 raft_consensus.cc:740] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.213723  8942 consensus_queue.cc:260] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.215643  8942 ts_tablet_manager.cc:1434] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:16:29.216307  8943 raft_consensus.cc:359] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.216976  8943 raft_consensus.cc:385] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.217288  8943 raft_consensus.cc:740] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.217933  8943 consensus_queue.cc:260] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.219873  8943 ts_tablet_manager.cc:1434] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:16:29.221603  8943 tablet_bootstrap.cc:492] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b: Bootstrap starting.
I20260709 13:16:29.226109  8943 tablet_bootstrap.cc:654] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:29.236792  8943 tablet_bootstrap.cc:492] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b: No bootstrap required, opened a new log
I20260709 13:16:29.237218  8943 ts_tablet_manager.cc:1403] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:16:29.239070  8943 raft_consensus.cc:359] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.239583  8943 raft_consensus.cc:385] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.239759  8943 raft_consensus.cc:740] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.240300  8943 consensus_queue.cc:260] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.241626  8943 ts_tablet_manager.cc:1434] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:16:29.244831  8952 raft_consensus.cc:493] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.245420  8952 raft_consensus.cc:515] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.247591  8952 leader_election.cc:290] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:29.248354  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94d0587141e42dcb88cf6eca845d596" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" is_pre_election: true
I20260709 13:16:29.248641  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94d0587141e42dcb88cf6eca845d596" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b" is_pre_election: true
I20260709 13:16:29.248986  8828 raft_consensus.cc:2468] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3891d8a821ec4b6ea07053cafbcc10f2 in term 0.
I20260709 13:16:29.249446  8900 raft_consensus.cc:2468] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3891d8a821ec4b6ea07053cafbcc10f2 in term 0.
I20260709 13:16:29.250049  8717 leader_election.cc:304] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 4a3147b92c754c88a02b7ac3a105fd2b; no voters: 
I20260709 13:16:29.250857  8952 raft_consensus.cc:2804] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:29.251272  8952 raft_consensus.cc:493] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.251653  8952 raft_consensus.cc:3060] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.254594  8945 raft_consensus.cc:493] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.255100  8945 raft_consensus.cc:515] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.257208  8945 leader_election.cc:290] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751)
I20260709 13:16:29.257998  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1316a4338cec4f6cbb6aaaf59053b189" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" is_pre_election: true
I20260709 13:16:29.258639  8952 raft_consensus.cc:515] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.258800  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1316a4338cec4f6cbb6aaaf59053b189" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" is_pre_election: true
I20260709 13:16:29.259793  8828 raft_consensus.cc:2393] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d58272f60794aba93285416034cfb3b in current term 1: Already voted for candidate 3891d8a821ec4b6ea07053cafbcc10f2 in this term.
I20260709 13:16:29.260445  8952 leader_election.cc:290] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 election: Requested vote from peers 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:29.261231  8866 leader_election.cc:304] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d58272f60794aba93285416034cfb3b; no voters: 3891d8a821ec4b6ea07053cafbcc10f2, 4a3147b92c754c88a02b7ac3a105fd2b
I20260709 13:16:29.261469  8828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94d0587141e42dcb88cf6eca845d596" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
I20260709 13:16:29.261706  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94d0587141e42dcb88cf6eca845d596" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b"
I20260709 13:16:29.262045  8828 raft_consensus.cc:3060] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.262315  8900 raft_consensus.cc:3060] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.262553  8945 raft_consensus.cc:3060] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.268638  8945 raft_consensus.cc:2749] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:29.269272  8828 raft_consensus.cc:2468] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3891d8a821ec4b6ea07053cafbcc10f2 in term 1.
I20260709 13:16:29.269289  8900 raft_consensus.cc:2468] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3891d8a821ec4b6ea07053cafbcc10f2 in term 1.
I20260709 13:16:29.270663  8718 leader_election.cc:304] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 8d58272f60794aba93285416034cfb3b; no voters: 
I20260709 13:16:29.271435  8952 raft_consensus.cc:2804] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:29.271884  8952 raft_consensus.cc:697] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 LEADER]: Becoming Leader. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Running, Role: LEADER
I20260709 13:16:29.272661  8952 consensus_queue.cc:237] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.279330  8648 catalog_manager.cc:5697] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.335963  8986 raft_consensus.cc:493] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.336560  8986 raft_consensus.cc:515] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.338155  8986 leader_election.cc:290] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:29.339228  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488298c497cb42ecb64885b19bcd1a10" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" is_pre_election: true
I20260709 13:16:29.339468  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488298c497cb42ecb64885b19bcd1a10" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b" is_pre_election: true
I20260709 13:16:29.340114  8900 raft_consensus.cc:2468] T 488298c497cb42ecb64885b19bcd1a10 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 0.
I20260709 13:16:29.340104  8753 raft_consensus.cc:2468] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 0.
I20260709 13:16:29.341383  8793 leader_election.cc:304] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 4a3147b92c754c88a02b7ac3a105fd2b; no voters: 
I20260709 13:16:29.342042  8986 raft_consensus.cc:2804] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:29.342370  8986 raft_consensus.cc:493] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.342639  8986 raft_consensus.cc:3060] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.347884  8986 raft_consensus.cc:515] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.349308  8986 leader_election.cc:290] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:29.350677  8753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488298c497cb42ecb64885b19bcd1a10" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
I20260709 13:16:29.350731  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488298c497cb42ecb64885b19bcd1a10" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b"
I20260709 13:16:29.351410  8753 raft_consensus.cc:3060] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.351441  8900 raft_consensus.cc:3060] T 488298c497cb42ecb64885b19bcd1a10 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.356470  8900 raft_consensus.cc:2468] T 488298c497cb42ecb64885b19bcd1a10 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 1.
I20260709 13:16:29.356750  8753 raft_consensus.cc:2468] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 1.
I20260709 13:16:29.357543  8793 leader_election.cc:304] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a3147b92c754c88a02b7ac3a105fd2b, 8d58272f60794aba93285416034cfb3b; no voters: 
I20260709 13:16:29.358249  8986 raft_consensus.cc:2804] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:29.358664  8986 raft_consensus.cc:697] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 LEADER]: Becoming Leader. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Running, Role: LEADER
I20260709 13:16:29.359357  8986 consensus_queue.cc:237] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.365064  8945 consensus_queue.cc:1048] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:29.369029  8648 catalog_manager.cc:5697] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130). New cstate: current_term: 1 leader_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.379309  8828 raft_consensus.cc:3060] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.382999  8952 consensus_queue.cc:1048] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:29.384327  8900 raft_consensus.cc:3060] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.387814  8945 consensus_queue.cc:1048] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:29.396142  8952 consensus_queue.cc:1048] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:29.453480  9012 consensus_queue.cc:1048] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:29.462364  8826 raft_consensus.cc:3060] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.471119  8952 consensus_queue.cc:1048] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:29.475976 31814 ts_manager.cc:295] Set tserver state for 3891d8a821ec4b6ea07053cafbcc10f2 to MAINTENANCE_MODE
I20260709 13:16:29.476926 31814 tablet_server.cc:179] TabletServer@127.31.17.129:0 shutting down...
I20260709 13:16:29.486925  8952 raft_consensus.cc:493] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.487994  8952 raft_consensus.cc:515] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:29.491115  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da899017c34d461b89751b5a3dbd705c" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" is_pre_election: true
I20260709 13:16:29.491510  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da899017c34d461b89751b5a3dbd705c" candidate_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b" is_pre_election: true
I20260709 13:16:29.492933  8900 raft_consensus.cc:2393] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3891d8a821ec4b6ea07053cafbcc10f2 in current term 1: Already voted for candidate 4a3147b92c754c88a02b7ac3a105fd2b in this term.
I20260709 13:16:29.494292  8718 leader_election.cc:304] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2; no voters: 4a3147b92c754c88a02b7ac3a105fd2b, 8d58272f60794aba93285416034cfb3b
I20260709 13:16:29.495260  8972 raft_consensus.cc:3060] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.499533  8952 leader_election.cc:290] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:29.504036  8972 raft_consensus.cc:2749] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:29.506999 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:29.507884 31814 tablet_replica.cc:333] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2: stopping tablet replica
I20260709 13:16:29.508576 31814 raft_consensus.cc:2243] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:29.508972 31814 raft_consensus.cc:2272] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:29.511204 31814 tablet_replica.cc:333] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2: stopping tablet replica
I20260709 13:16:29.511835 31814 raft_consensus.cc:2243] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:29.512169 31814 raft_consensus.cc:2272] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:29.513872 31814 tablet_replica.cc:333] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2: stopping tablet replica
I20260709 13:16:29.514385 31814 raft_consensus.cc:2243] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:29.514693 31814 raft_consensus.cc:2272] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:29.516853 31814 tablet_replica.cc:333] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2: stopping tablet replica
I20260709 13:16:29.517354 31814 raft_consensus.cc:2243] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:29.517670 31814 raft_consensus.cc:2272] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:29.519305 31814 tablet_replica.cc:333] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2: stopping tablet replica
I20260709 13:16:29.519774 31814 raft_consensus.cc:2243] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:29.520443 31814 raft_consensus.cc:2272] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:29.522508 31814 tablet_replica.cc:333] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2: stopping tablet replica
I20260709 13:16:29.523034 31814 raft_consensus.cc:2243] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:29.523926 31814 raft_consensus.cc:2272] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:29.526016 31814 tablet_replica.cc:333] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2: stopping tablet replica
I20260709 13:16:29.526492 31814 raft_consensus.cc:2243] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:29.526814 31814 raft_consensus.cc:2272] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:29.528411 31814 tablet_replica.cc:333] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2: stopping tablet replica
I20260709 13:16:29.528867 31814 raft_consensus.cc:2243] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:29.529443 31814 pending_rounds.cc:70] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2: Trying to abort 1 pending ops.
I20260709 13:16:29.529623 31814 pending_rounds.cc:77] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637843199758336 op_type: NO_OP noop_request { }
I20260709 13:16:29.529873 31814 raft_consensus.cc:2889] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:29.530112 31814 raft_consensus.cc:2272] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:29.532369 31814 tablet_replica.cc:333] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2: stopping tablet replica
I20260709 13:16:29.532991 31814 raft_consensus.cc:2243] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:29.533828 31814 pending_rounds.cc:70] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2: Trying to abort 1 pending ops.
I20260709 13:16:29.534005 31814 pending_rounds.cc:77] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637844067020800 op_type: NO_OP noop_request { }
I20260709 13:16:29.534335 31814 raft_consensus.cc:2889] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:29.534677 31814 raft_consensus.cc:2272] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:29.535706  8867 consensus_peers.cc:597] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:29.537329 31814 tablet_replica.cc:333] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2: stopping tablet replica
I20260709 13:16:29.537832 31814 raft_consensus.cc:2243] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:29.538300 31814 raft_consensus.cc:2272] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:29.552018  8945 consensus_queue.cc:1048] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:29.565145 31814 tablet_server.cc:196] TabletServer@127.31.17.129:0 shutdown complete.
W20260709 13:16:29.574846  8867 consensus_peers.cc:597] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:29.632992  8974 consensus_queue.cc:1048] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:29.646046  8867 consensus_peers.cc:597] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:29.663972  8981 consensus_queue.cc:1048] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:29.664611  8986 consensus_queue.cc:1048] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:29.680765  8699 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:16:29.687796  8793 consensus_peers.cc:597] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:29.746034  8793 consensus_peers.cc:597] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:29.783174  8867 consensus_peers.cc:597] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:29.843876  8968 consensus_queue.cc:1048] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:16:30.681901  8699 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:16:30.862778  8793 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111) [suppressed 130 similar messages]
I20260709 13:16:30.905609  8945 raft_consensus.cc:493] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.906229  8945 raft_consensus.cc:515] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:30.907917  8945 leader_election.cc:290] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751)
I20260709 13:16:30.908842  8945 raft_consensus.cc:493] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3891d8a821ec4b6ea07053cafbcc10f2)
I20260709 13:16:30.909251  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94d0587141e42dcb88cf6eca845d596" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" is_pre_election: true
I20260709 13:16:30.909487  8945 raft_consensus.cc:515] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:30.909989  8826 raft_consensus.cc:2468] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 1.
I20260709 13:16:30.911198  8866 leader_election.cc:304] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a3147b92c754c88a02b7ac3a105fd2b, 8d58272f60794aba93285416034cfb3b; no voters: 
I20260709 13:16:30.911630  8945 leader_election.cc:290] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751)
I20260709 13:16:30.912266  8945 raft_consensus.cc:2804] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:16:30.913404  8867 leader_election.cc:336] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111)
I20260709 13:16:30.912631  8945 raft_consensus.cc:493] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.914222  8945 raft_consensus.cc:3060] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.914060  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5587ada44ae4085bfc0e6ddacd80ef3" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" is_pre_election: true
I20260709 13:16:30.914810  8826 raft_consensus.cc:2468] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 1.
I20260709 13:16:30.915825  8866 leader_election.cc:304] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a3147b92c754c88a02b7ac3a105fd2b, 8d58272f60794aba93285416034cfb3b; no voters: 
W20260709 13:16:30.916317  8867 leader_election.cc:336] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111)
I20260709 13:16:30.916534  9026 raft_consensus.cc:2804] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:30.917004  9026 raft_consensus.cc:493] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3891d8a821ec4b6ea07053cafbcc10f2)
I20260709 13:16:30.917291  9026 raft_consensus.cc:3060] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.921564  8945 raft_consensus.cc:515] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:30.922465  9026 raft_consensus.cc:515] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:30.923425  8945 leader_election.cc:290] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 2 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751)
I20260709 13:16:30.924422  9026 leader_election.cc:290] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 2 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751)
I20260709 13:16:30.924499  8826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94d0587141e42dcb88cf6eca845d596" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
I20260709 13:16:30.925280  8826 raft_consensus.cc:3060] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.926034  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5587ada44ae4085bfc0e6ddacd80ef3" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
I20260709 13:16:30.926640  8827 raft_consensus.cc:3060] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:30.927205  8867 leader_election.cc:336] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111)
W20260709 13:16:30.927726  8867 leader_election.cc:336] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111)
I20260709 13:16:30.932528  8826 raft_consensus.cc:2468] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 2.
I20260709 13:16:30.933732  8866 leader_election.cc:304] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a3147b92c754c88a02b7ac3a105fd2b, 8d58272f60794aba93285416034cfb3b; no voters: 3891d8a821ec4b6ea07053cafbcc10f2
I20260709 13:16:30.933986  8827 raft_consensus.cc:2468] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 2.
I20260709 13:16:30.934490  9026 raft_consensus.cc:2804] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:30.935005  9026 raft_consensus.cc:697] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 2 LEADER]: Becoming Leader. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Running, Role: LEADER
I20260709 13:16:30.935078  8866 leader_election.cc:304] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a3147b92c754c88a02b7ac3a105fd2b, 8d58272f60794aba93285416034cfb3b; no voters: 3891d8a821ec4b6ea07053cafbcc10f2
I20260709 13:16:30.935986  8945 raft_consensus.cc:2804] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:30.935977  9026 consensus_queue.cc:237] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:30.937283  8945 raft_consensus.cc:697] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 2 LEADER]: Becoming Leader. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Running, Role: LEADER
I20260709 13:16:30.938055  8945 consensus_queue.cc:237] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:30.944799  8651 catalog_manager.cc:5697] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b reported cstate change: term changed from 1 to 2, leader changed from 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129) to 8d58272f60794aba93285416034cfb3b (127.31.17.131). New cstate: current_term: 2 leader_uuid: "8d58272f60794aba93285416034cfb3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:30.960433  8651 catalog_manager.cc:5697] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b reported cstate change: term changed from 1 to 2, leader changed from 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129) to 8d58272f60794aba93285416034cfb3b (127.31.17.131). New cstate: current_term: 2 leader_uuid: "8d58272f60794aba93285416034cfb3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:30.962924  8945 raft_consensus.cc:493] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3891d8a821ec4b6ea07053cafbcc10f2)
I20260709 13:16:30.963534  8945 raft_consensus.cc:515] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:30.965731  8945 leader_election.cc:290] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751)
I20260709 13:16:30.966876  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b84bf4c66a694d1cbc4e3f61afe49bd5" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" is_pre_election: true
W20260709 13:16:30.969756  8867 leader_election.cc:336] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111)
I20260709 13:16:30.970239  8867 leader_election.cc:304] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d58272f60794aba93285416034cfb3b; no voters: 3891d8a821ec4b6ea07053cafbcc10f2, 4a3147b92c754c88a02b7ac3a105fd2b
I20260709 13:16:30.970928  8945 raft_consensus.cc:2749] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:30.974550  9025 raft_consensus.cc:493] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3891d8a821ec4b6ea07053cafbcc10f2)
I20260709 13:16:30.975025  9025 raft_consensus.cc:515] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:30.976853  9025 leader_election.cc:290] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:30.978477  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b84bf4c66a694d1cbc4e3f61afe49bd5" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b" is_pre_election: true
I20260709 13:16:30.979163  8900 raft_consensus.cc:2468] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 1.
I20260709 13:16:30.980358  8793 leader_election.cc:304] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a3147b92c754c88a02b7ac3a105fd2b, 8d58272f60794aba93285416034cfb3b; no voters: 
W20260709 13:16:30.981000  8793 leader_election.cc:336] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111)
I20260709 13:16:30.981017  9025 raft_consensus.cc:2804] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:30.981534  9025 raft_consensus.cc:493] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3891d8a821ec4b6ea07053cafbcc10f2)
I20260709 13:16:30.981853  9025 raft_consensus.cc:3060] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.987655  9025 raft_consensus.cc:515] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:30.989387  9025 leader_election.cc:290] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 2 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:30.991113  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b84bf4c66a694d1cbc4e3f61afe49bd5" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b"
I20260709 13:16:30.991868  8900 raft_consensus.cc:3060] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:30.993240  8793 leader_election.cc:336] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111)
I20260709 13:16:30.997458  8900 raft_consensus.cc:2468] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 2.
I20260709 13:16:30.998510  8793 leader_election.cc:304] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a3147b92c754c88a02b7ac3a105fd2b, 8d58272f60794aba93285416034cfb3b; no voters: 3891d8a821ec4b6ea07053cafbcc10f2
I20260709 13:16:30.999182  9025 raft_consensus.cc:2804] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:31.000389  9025 raft_consensus.cc:697] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 LEADER]: Becoming Leader. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Running, Role: LEADER
I20260709 13:16:31.001062  9025 consensus_queue.cc:237] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:31.008121  8651 catalog_manager.cc:5697] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b reported cstate change: term changed from 1 to 2, leader changed from 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129) to 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130). New cstate: current_term: 2 leader_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:31.100306  9025 raft_consensus.cc:493] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.100926  9025 raft_consensus.cc:515] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:31.102854  9025 leader_election.cc:290] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:31.104516  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1316a4338cec4f6cbb6aaaf59053b189" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b" is_pre_election: true
I20260709 13:16:31.105211  8900 raft_consensus.cc:2468] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 1.
I20260709 13:16:31.106196  8793 leader_election.cc:304] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a3147b92c754c88a02b7ac3a105fd2b, 8d58272f60794aba93285416034cfb3b; no voters: 
I20260709 13:16:31.106837  9025 raft_consensus.cc:2804] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:16:31.106842  8793 leader_election.cc:336] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111)
I20260709 13:16:31.107224  9025 raft_consensus.cc:493] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.107625  9025 raft_consensus.cc:3060] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:31.112679  9025 raft_consensus.cc:515] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:31.114326  9025 leader_election.cc:290] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 2 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:31.116240  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1316a4338cec4f6cbb6aaaf59053b189" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d58272f60794aba93285416034cfb3b"
I20260709 13:16:31.117017  8900 raft_consensus.cc:3060] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:31.118772  8793 leader_election.cc:336] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111)
I20260709 13:16:31.124025  8900 raft_consensus.cc:2468] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 2.
I20260709 13:16:31.125180  8793 leader_election.cc:304] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a3147b92c754c88a02b7ac3a105fd2b, 8d58272f60794aba93285416034cfb3b; no voters: 3891d8a821ec4b6ea07053cafbcc10f2
I20260709 13:16:31.125977  9025 raft_consensus.cc:2804] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:31.126425  9025 raft_consensus.cc:697] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 LEADER]: Becoming Leader. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Running, Role: LEADER
I20260709 13:16:31.127135  9025 consensus_queue.cc:237] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:31.133874  8651 catalog_manager.cc:5697] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b reported cstate change: term changed from 1 to 2, leader changed from 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129) to 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130). New cstate: current_term: 2 leader_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:31.321924  8827 raft_consensus.cc:1275] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Refusing update from remote peer 8d58272f60794aba93285416034cfb3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:16:31.323200  8945 consensus_queue.cc:1048] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:31.336465  8867 consensus_peers.cc:597] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:31.379878  8867 consensus_peers.cc:597] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:31.404855  8793 consensus_peers.cc:597] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:31.458626  8900 raft_consensus.cc:1275] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Refusing update from remote peer 4a3147b92c754c88a02b7ac3a105fd2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:31.460124  9025 consensus_queue.cc:1048] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:31.500506  8827 raft_consensus.cc:1275] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Refusing update from remote peer 8d58272f60794aba93285416034cfb3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:31.502048  8945 consensus_queue.cc:1048] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:31.547200  8900 raft_consensus.cc:1275] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Refusing update from remote peer 4a3147b92c754c88a02b7ac3a105fd2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:16:31.548599  9041 consensus_queue.cc:1048] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:31.562690  8793 consensus_peers.cc:597] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:31.682991  8699 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:16:32.021165  8867 consensus_peers.cc:597] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:32.164397  8793 consensus_peers.cc:597] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:32.269136  8867 consensus_peers.cc:597] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:32.297734  8867 consensus_peers.cc:597] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:32.304389  8867 consensus_peers.cc:597] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:32.358377  8793 consensus_peers.cc:597] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:32.684125  8699 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:16:33.622400  8867 consensus_peers.cc:597] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:33.685164  8699 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:16:33.823616  8867 consensus_peers.cc:597] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:33.942919  8793 consensus_peers.cc:597] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:33.970386  8793 consensus_peers.cc:597] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:34.586522 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:34.597735  9050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:34.599079  9051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:34.601166  9053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:34.602094 31814 server_base.cc:1061] running on GCE node
I20260709 13:16:34.606873 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:34.607100 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:34.607393 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783602994607372 us; error 0 us; skew 500 ppm
I20260709 13:16:34.608029 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:34.621738 31814 webserver.cc:533] Webserver started at http://127.31.17.129:34007/ using document root <none> and password file <none>
I20260709 13:16:34.622756 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:34.623046 31814 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:16:34.630501 31814 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.005s	sys 0.000s
W20260709 13:16:34.639168  8793 consensus_peers.cc:597] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:34.639541  9058 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:34.640575 31814 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:16:34.641044 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/ts-0-root
uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
format_stamp: "Formatted at 2026-07-09 13:16:27 on dist-test-slave-zhw8"
I20260709 13:16:34.641702 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602713491408-31814-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:34.661772 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:34.663443 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:34.665007 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:34.668758  9066 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:16:34.676594  8867 consensus_peers.cc:597] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:34.686473  8699 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:34.731460 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:16:34.731981 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.064s	user 0.000s	sys 0.003s
I20260709 13:16:34.732251 31814 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:16:34.738248  9066 tablet_bootstrap.cc:492] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
I20260709 13:16:34.752537  9066 tablet_bootstrap.cc:492] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:16:34.753321  9066 tablet_bootstrap.cc:492] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap complete.
I20260709 13:16:34.753984  9066 ts_tablet_manager.cc:1403] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:16:34.757292  9066 raft_consensus.cc:359] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:34.758651  9066 raft_consensus.cc:740] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:34.759387  9066 consensus_queue.cc:260] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:34.762025  9066 ts_tablet_manager.cc:1434] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:34.762720  9066 tablet_bootstrap.cc:492] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
I20260709 13:16:34.774822  9066 tablet_bootstrap.cc:492] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:34.775640  9066 tablet_bootstrap.cc:492] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap complete.
I20260709 13:16:34.776196  9066 ts_tablet_manager.cc:1403] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:16:34.777988 31814 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:16:34.778363 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.046s	user 0.039s	sys 0.005s
I20260709 13:16:34.778400  9066 raft_consensus.cc:359] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:34.779078  9066 raft_consensus.cc:740] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:34.779906  9066 consensus_queue.cc:260] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:34.781508  9066 ts_tablet_manager.cc:1434] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:34.782194  9066 tablet_bootstrap.cc:492] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
I20260709 13:16:34.795898  9066 tablet_bootstrap.cc:492] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:34.796687  9066 tablet_bootstrap.cc:492] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap complete.
I20260709 13:16:34.797412  9066 ts_tablet_manager.cc:1403] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.001s
I20260709 13:16:34.800416  9066 raft_consensus.cc:359] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } }
I20260709 13:16:34.801268  9066 raft_consensus.cc:740] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:34.802950  9066 consensus_queue.cc:260] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } }
I20260709 13:16:34.804991  9066 ts_tablet_manager.cc:1434] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:34.805733  9066 tablet_bootstrap.cc:492] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
W20260709 13:16:34.820079  8867 consensus_peers.cc:597] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:34.821132  9066 tablet_bootstrap.cc:492] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:34.822000  9066 tablet_bootstrap.cc:492] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap complete.
I20260709 13:16:34.822558  9066 ts_tablet_manager.cc:1403] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:16:34.824682  9066 raft_consensus.cc:359] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:34.825219  9066 raft_consensus.cc:740] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:34.826031  9066 consensus_queue.cc:260] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:34.827705  9066 ts_tablet_manager.cc:1434] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:16:34.828359  9066 tablet_bootstrap.cc:492] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
W20260709 13:16:34.840966  8793 consensus_peers.cc:597] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:34.845453  9066 tablet_bootstrap.cc:492] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:16:34.846433  9066 tablet_bootstrap.cc:492] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap complete.
I20260709 13:16:34.846973  9066 ts_tablet_manager.cc:1403] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.004s
I20260709 13:16:34.848563 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.129:44209
I20260709 13:16:34.848685  9128 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.129:44209 every 8 connection(s)
I20260709 13:16:34.849162  9066 raft_consensus.cc:359] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:34.849857  9066 raft_consensus.cc:740] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:34.850593  9066 consensus_queue.cc:260] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:34.852182  9066 ts_tablet_manager.cc:1434] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:16:34.852927  9066 tablet_bootstrap.cc:492] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
I20260709 13:16:34.854128 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:34.886025  9129 heartbeater.cc:344] Connected to a master server at 127.31.17.190:41919
I20260709 13:16:34.886518  9129 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:34.887595  9129 heartbeater.cc:507] Master 127.31.17.190:41919 requested a full tablet report, sending...
I20260709 13:16:34.888100  9066 tablet_bootstrap.cc:492] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:34.889247  9066 tablet_bootstrap.cc:492] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap complete.
I20260709 13:16:34.890074  9066 ts_tablet_manager.cc:1403] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.011s
I20260709 13:16:34.894048  9066 raft_consensus.cc:359] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:34.894853  9066 raft_consensus.cc:740] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:34.895795  9066 consensus_queue.cc:260] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:34.898062  9066 ts_tablet_manager.cc:1434] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 13:16:34.898955  9066 tablet_bootstrap.cc:492] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
I20260709 13:16:34.899395  8649 ts_manager.cc:194] Re-registered known tserver with Master: 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209)
I20260709 13:16:34.915573  8649 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49086
W20260709 13:16:34.917479  8867 consensus_peers.cc:597] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:34.918571  8867 consensus_peers.cc:597] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:34.920487  9129 heartbeater.cc:499] Master 127.31.17.190:41919 was elected leader, sending a full tablet report...
I20260709 13:16:34.921187  8898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35c9eedcc83d4cb3aaf703d0684cc1d9"
dest_uuid: "8d58272f60794aba93285416034cfb3b"
mode: GRACEFUL
new_leader_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
 from {username='slave'} at 127.0.0.1:48648
I20260709 13:16:34.921980  8898 raft_consensus.cc:606] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 1 LEADER]: Received request to transfer leadership to TS 4a3147b92c754c88a02b7ac3a105fd2b
I20260709 13:16:34.922685  9066 tablet_bootstrap.cc:492] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:34.923624  9066 tablet_bootstrap.cc:492] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap complete.
I20260709 13:16:34.924185  9066 ts_tablet_manager.cc:1403] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.011s
I20260709 13:16:34.925205  8898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a94d0587141e42dcb88cf6eca845d596"
dest_uuid: "8d58272f60794aba93285416034cfb3b"
mode: GRACEFUL
new_leader_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
 from {username='slave'} at 127.0.0.1:48648
I20260709 13:16:34.925848  8898 raft_consensus.cc:606] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 2 LEADER]: Received request to transfer leadership to TS 4a3147b92c754c88a02b7ac3a105fd2b
I20260709 13:16:34.926721  9066 raft_consensus.cc:359] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:34.927141 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:34.927489  9066 raft_consensus.cc:740] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:34.927867 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:34.928216  9066 consensus_queue.cc:260] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:34.928766 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:34.929841  9066 ts_tablet_manager.cc:1434] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:34.930481  9066 tablet_bootstrap.cc:492] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
I20260709 13:16:34.940909  9066 tablet_bootstrap.cc:492] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:34.941668  9066 tablet_bootstrap.cc:492] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap complete.
I20260709 13:16:34.942214  9066 ts_tablet_manager.cc:1403] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:16:34.944312  9066 raft_consensus.cc:359] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:34.944916  9066 raft_consensus.cc:740] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:34.945501  9066 consensus_queue.cc:260] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:34.946995  9066 ts_tablet_manager.cc:1434] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:34.947803  9066 tablet_bootstrap.cc:492] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
I20260709 13:16:34.959619  9066 tablet_bootstrap.cc:492] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:34.960397  9066 tablet_bootstrap.cc:492] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap complete.
I20260709 13:16:34.960983  9066 ts_tablet_manager.cc:1403] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:16:34.963230  9066 raft_consensus.cc:359] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:34.963867  9066 raft_consensus.cc:740] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:34.964313  9102 raft_consensus.cc:3060] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.964545  9066 consensus_queue.cc:260] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:34.966722  9066 ts_tablet_manager.cc:1434] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:16:34.967532  9066 tablet_bootstrap.cc:492] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap starting.
I20260709 13:16:34.976861  9102 pending_rounds.cc:85] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2: Aborting all ops after (but not including) 0
I20260709 13:16:34.977300  9102 pending_rounds.cc:107] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:16:34.977697  9102 raft_consensus.cc:2889] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:34.985443  9066 tablet_bootstrap.cc:492] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:34.986418  9066 tablet_bootstrap.cc:492] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2: Bootstrap complete.
I20260709 13:16:34.986976  9066 ts_tablet_manager.cc:1403] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 13:16:34.988560  9102 raft_consensus.cc:3060] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.993607  9103 raft_consensus.cc:3060] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.995483  9066 raft_consensus.cc:359] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:34.996284  9066 raft_consensus.cc:740] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3891d8a821ec4b6ea07053cafbcc10f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:34.997287  9066 consensus_queue.cc:260] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:34.999564  9066 ts_tablet_manager.cc:1434] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:16:35.004136  9103 pending_rounds.cc:85] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2: Aborting all ops after (but not including) 0
I20260709 13:16:35.004526  9103 pending_rounds.cc:107] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:16:35.004786  9103 raft_consensus.cc:2889] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:35.177378  9144 raft_consensus.cc:993] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b: : Instructing follower 4a3147b92c754c88a02b7ac3a105fd2b to start an election
I20260709 13:16:35.177987  9048 raft_consensus.cc:1081] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 2 LEADER]: Signalling peer 4a3147b92c754c88a02b7ac3a105fd2b to start an election
I20260709 13:16:35.179623  8827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a94d0587141e42dcb88cf6eca845d596"
dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
 from {username='slave'} at 127.0.0.1:38060
I20260709 13:16:35.180124  8827 raft_consensus.cc:493] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:35.180450  8827 raft_consensus.cc:3060] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:35.186578  8827 raft_consensus.cc:515] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:35.188277  8827 leader_election.cc:290] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 3 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:35.189221  9103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94d0587141e42dcb88cf6eca845d596" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
I20260709 13:16:35.189632  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94d0587141e42dcb88cf6eca845d596" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "8d58272f60794aba93285416034cfb3b"
I20260709 13:16:35.189867  9103 raft_consensus.cc:3060] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:35.190369  8898 raft_consensus.cc:3055] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:35.190698  8898 raft_consensus.cc:740] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Running, Role: LEADER
I20260709 13:16:35.191794  8898 consensus_queue.cc:260] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:35.193033  8898 raft_consensus.cc:3060] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:35.196017  9103 raft_consensus.cc:2468] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 3.
I20260709 13:16:35.197155  8793 leader_election.cc:304] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 4a3147b92c754c88a02b7ac3a105fd2b; no voters: 
I20260709 13:16:35.198052  9063 raft_consensus.cc:2804] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:35.199075  9063 raft_consensus.cc:697] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 LEADER]: Becoming Leader. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Running, Role: LEADER
I20260709 13:16:35.199975  8898 raft_consensus.cc:2468] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 3.
I20260709 13:16:35.200160  9063 consensus_queue.cc:237] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:35.209510  8649 catalog_manager.cc:5697] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b reported cstate change: term changed from 2 to 3, leader changed from 8d58272f60794aba93285416034cfb3b (127.31.17.131) to 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130). New cstate: current_term: 3 leader_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:35.248879  9103 raft_consensus.cc:3060] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.396878  9144 raft_consensus.cc:993] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b: : Instructing follower 4a3147b92c754c88a02b7ac3a105fd2b to start an election
I20260709 13:16:35.397468  9048 raft_consensus.cc:1081] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 1 LEADER]: Signalling peer 4a3147b92c754c88a02b7ac3a105fd2b to start an election
I20260709 13:16:35.398886  8827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35c9eedcc83d4cb3aaf703d0684cc1d9"
dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
 from {username='slave'} at 127.0.0.1:38060
I20260709 13:16:35.399501  8827 raft_consensus.cc:493] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:35.399791  8827 raft_consensus.cc:3060] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.406498  8827 raft_consensus.cc:515] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:35.408708  8827 leader_election.cc:290] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 2 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:35.409330  9103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c9eedcc83d4cb3aaf703d0684cc1d9" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
I20260709 13:16:35.410043  9103 raft_consensus.cc:3060] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.410092  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c9eedcc83d4cb3aaf703d0684cc1d9" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d58272f60794aba93285416034cfb3b"
I20260709 13:16:35.410739  8898 raft_consensus.cc:3055] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:35.411105  8898 raft_consensus.cc:740] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Running, Role: LEADER
I20260709 13:16:35.412309  8898 consensus_queue.cc:260] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:35.413885  8898 raft_consensus.cc:3060] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.418797  9103 raft_consensus.cc:2468] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 2.
I20260709 13:16:35.420142  8793 leader_election.cc:304] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 4a3147b92c754c88a02b7ac3a105fd2b; no voters: 
I20260709 13:16:35.421106  9148 raft_consensus.cc:2804] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:35.421662  9148 raft_consensus.cc:697] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 LEADER]: Becoming Leader. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Running, Role: LEADER
I20260709 13:16:35.421773  8898 raft_consensus.cc:2468] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 2.
I20260709 13:16:35.422732  9148 consensus_queue.cc:237] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:35.432348  8651 catalog_manager.cc:5697] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b reported cstate change: term changed from 1 to 2, leader changed from 8d58272f60794aba93285416034cfb3b (127.31.17.131) to 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130). New cstate: current_term: 2 leader_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:35.591212  8898 raft_consensus.cc:1275] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Refusing update from remote peer 4a3147b92c754c88a02b7ac3a105fd2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:35.592434  9160 consensus_queue.cc:1048] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:35.603168  9103 raft_consensus.cc:1275] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Refusing update from remote peer 4a3147b92c754c88a02b7ac3a105fd2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:35.605062  9160 consensus_queue.cc:1048] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:35.687630  8699 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:35.874993  9103 raft_consensus.cc:1275] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 2 FOLLOWER]: Refusing update from remote peer 4a3147b92c754c88a02b7ac3a105fd2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:35.876523  9160 consensus_queue.cc:1048] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:35.886780  8898 raft_consensus.cc:1275] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Refusing update from remote peer 4a3147b92c754c88a02b7ac3a105fd2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:35.888374  9148 consensus_queue.cc:1048] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:35.939069 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:35.956223  8827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1316a4338cec4f6cbb6aaaf59053b189"
dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
mode: GRACEFUL
new_leader_uuid: "8d58272f60794aba93285416034cfb3b"
 from {username='slave'} at 127.0.0.1:38072
I20260709 13:16:35.956804  8827 raft_consensus.cc:606] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 LEADER]: Received request to transfer leadership to TS 8d58272f60794aba93285416034cfb3b
I20260709 13:16:35.959448  8827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b84bf4c66a694d1cbc4e3f61afe49bd5"
dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
mode: GRACEFUL
new_leader_uuid: "8d58272f60794aba93285416034cfb3b"
 from {username='slave'} at 127.0.0.1:38072
I20260709 13:16:35.960011  8827 raft_consensus.cc:606] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 LEADER]: Received request to transfer leadership to TS 8d58272f60794aba93285416034cfb3b
I20260709 13:16:35.961119 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:35.961704 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:35.962283 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:36.173223  9063 raft_consensus.cc:993] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b: : Instructing follower 8d58272f60794aba93285416034cfb3b to start an election
I20260709 13:16:36.173712  9148 raft_consensus.cc:1081] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 LEADER]: Signalling peer 8d58272f60794aba93285416034cfb3b to start an election
I20260709 13:16:36.175349  8898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b84bf4c66a694d1cbc4e3f61afe49bd5"
dest_uuid: "8d58272f60794aba93285416034cfb3b"
 from {username='slave'} at 127.0.0.1:48642
I20260709 13:16:36.175840  8898 raft_consensus.cc:493] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:36.176118  8898 raft_consensus.cc:3060] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.182116  8898 raft_consensus.cc:515] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:36.183878  8898 leader_election.cc:290] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 3 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751)
I20260709 13:16:36.184798  9103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b84bf4c66a694d1cbc4e3f61afe49bd5" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
I20260709 13:16:36.185026  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b84bf4c66a694d1cbc4e3f61afe49bd5" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
I20260709 13:16:36.185472  9103 raft_consensus.cc:3060] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.185709  8827 raft_consensus.cc:3055] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:36.186101  8827 raft_consensus.cc:740] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Running, Role: LEADER
I20260709 13:16:36.186878  8827 consensus_queue.cc:260] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:36.188019  8827 raft_consensus.cc:3060] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.190898  9103 raft_consensus.cc:2468] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 3.
I20260709 13:16:36.191977  8867 leader_election.cc:304] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 8d58272f60794aba93285416034cfb3b; no voters: 
I20260709 13:16:36.192713  9144 raft_consensus.cc:2804] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:36.193226  9144 raft_consensus.cc:697] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 3 LEADER]: Becoming Leader. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Running, Role: LEADER
I20260709 13:16:36.194594  8827 raft_consensus.cc:2468] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 3.
I20260709 13:16:36.194289  9144 consensus_queue.cc:237] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:36.202970  8649 catalog_manager.cc:5697] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b reported cstate change: term changed from 2 to 3, leader changed from 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130) to 8d58272f60794aba93285416034cfb3b (127.31.17.131). New cstate: current_term: 3 leader_uuid: "8d58272f60794aba93285416034cfb3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:36.321105  9148 raft_consensus.cc:993] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b: : Instructing follower 8d58272f60794aba93285416034cfb3b to start an election
I20260709 13:16:36.321655  9063 raft_consensus.cc:1081] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 LEADER]: Signalling peer 8d58272f60794aba93285416034cfb3b to start an election
I20260709 13:16:36.323060  8898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1316a4338cec4f6cbb6aaaf59053b189"
dest_uuid: "8d58272f60794aba93285416034cfb3b"
 from {username='slave'} at 127.0.0.1:48642
I20260709 13:16:36.323575  8898 raft_consensus.cc:493] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:36.323879  8898 raft_consensus.cc:3060] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.329022  8898 raft_consensus.cc:515] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:36.330823  8898 leader_election.cc:290] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 3 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751)
I20260709 13:16:36.331712  9103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1316a4338cec4f6cbb6aaaf59053b189" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
I20260709 13:16:36.331966  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1316a4338cec4f6cbb6aaaf59053b189" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
I20260709 13:16:36.332309  9103 raft_consensus.cc:3060] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.332549  8827 raft_consensus.cc:3055] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:36.332899  8827 raft_consensus.cc:740] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Running, Role: LEADER
I20260709 13:16:36.333635  8827 consensus_queue.cc:260] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:36.334589  8827 raft_consensus.cc:3060] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.337540  9103 raft_consensus.cc:2468] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 3.
I20260709 13:16:36.338680  8867 leader_election.cc:304] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 8d58272f60794aba93285416034cfb3b; no voters: 
I20260709 13:16:36.339433  9144 raft_consensus.cc:2804] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:36.339908  9144 raft_consensus.cc:697] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [term 3 LEADER]: Becoming Leader. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Running, Role: LEADER
I20260709 13:16:36.340191  8827 raft_consensus.cc:2468] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 3.
I20260709 13:16:36.340950  9144 consensus_queue.cc:237] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:36.348138  8649 catalog_manager.cc:5697] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b reported cstate change: term changed from 2 to 3, leader changed from 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130) to 8d58272f60794aba93285416034cfb3b (127.31.17.131). New cstate: current_term: 3 leader_uuid: "8d58272f60794aba93285416034cfb3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:36.606619  8827 raft_consensus.cc:1275] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Refusing update from remote peer 8d58272f60794aba93285416034cfb3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:36.608058  9144 consensus_queue.cc:1048] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:36.617551  9103 raft_consensus.cc:1275] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Refusing update from remote peer 8d58272f60794aba93285416034cfb3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:36.619325  9144 consensus_queue.cc:1048] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:16:36.688531  8699 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:36.726495  9103 raft_consensus.cc:1275] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Refusing update from remote peer 8d58272f60794aba93285416034cfb3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:36.728050  9144 consensus_queue.cc:1048] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:36.737627  8827 raft_consensus.cc:1275] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Refusing update from remote peer 8d58272f60794aba93285416034cfb3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:36.740228  9144 consensus_queue.cc:1048] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:36.968633 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:36.975900  8898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c281645c031146b88e5884ce1c3d9997"
dest_uuid: "8d58272f60794aba93285416034cfb3b"
mode: GRACEFUL
new_leader_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
 from {username='slave'} at 127.0.0.1:48648
I20260709 13:16:36.976512  8898 raft_consensus.cc:606] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 1 LEADER]: Received request to transfer leadership to TS 4a3147b92c754c88a02b7ac3a105fd2b
I20260709 13:16:36.979223  8898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5587ada44ae4085bfc0e6ddacd80ef3"
dest_uuid: "8d58272f60794aba93285416034cfb3b"
mode: GRACEFUL
new_leader_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
 from {username='slave'} at 127.0.0.1:48648
I20260709 13:16:36.979803  8898 raft_consensus.cc:606] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 2 LEADER]: Received request to transfer leadership to TS 4a3147b92c754c88a02b7ac3a105fd2b
I20260709 13:16:36.980888 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:36.981390 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:36.981956 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:37.018769  9144 raft_consensus.cc:993] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b: : Instructing follower 4a3147b92c754c88a02b7ac3a105fd2b to start an election
I20260709 13:16:37.019328  9158 raft_consensus.cc:1081] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 1 LEADER]: Signalling peer 4a3147b92c754c88a02b7ac3a105fd2b to start an election
I20260709 13:16:37.020723  8827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c281645c031146b88e5884ce1c3d9997"
dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
 from {username='slave'} at 127.0.0.1:38060
I20260709 13:16:37.021123  8827 raft_consensus.cc:493] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.021358  8827 raft_consensus.cc:3060] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.026160  8827 raft_consensus.cc:515] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:37.027536  8827 leader_election.cc:290] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 2 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:37.028472  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c281645c031146b88e5884ce1c3d9997" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
I20260709 13:16:37.028628  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c281645c031146b88e5884ce1c3d9997" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d58272f60794aba93285416034cfb3b"
I20260709 13:16:37.029099  9102 raft_consensus.cc:3060] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.029203  8898 raft_consensus.cc:3055] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:37.029587  8898 raft_consensus.cc:740] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Running, Role: LEADER
I20260709 13:16:37.030242  8898 consensus_queue.cc:260] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:37.031292  8898 raft_consensus.cc:3060] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.034658  9102 raft_consensus.cc:2468] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 2.
I20260709 13:16:37.035831  8793 leader_election.cc:304] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 4a3147b92c754c88a02b7ac3a105fd2b; no voters: 
I20260709 13:16:37.036398  8898 raft_consensus.cc:2468] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 2.
I20260709 13:16:37.036514  9148 raft_consensus.cc:2804] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:37.037117  9148 raft_consensus.cc:697] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 LEADER]: Becoming Leader. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Running, Role: LEADER
I20260709 13:16:37.038090  9148 consensus_queue.cc:237] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:37.044850  8649 catalog_manager.cc:5697] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b reported cstate change: term changed from 1 to 2, leader changed from 8d58272f60794aba93285416034cfb3b (127.31.17.131) to 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130). New cstate: current_term: 2 leader_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.175405  9144 raft_consensus.cc:993] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b: : Instructing follower 4a3147b92c754c88a02b7ac3a105fd2b to start an election
I20260709 13:16:37.175918  9144 raft_consensus.cc:1081] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 2 LEADER]: Signalling peer 4a3147b92c754c88a02b7ac3a105fd2b to start an election
I20260709 13:16:37.177775  8827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5587ada44ae4085bfc0e6ddacd80ef3"
dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
 from {username='slave'} at 127.0.0.1:38060
I20260709 13:16:37.178261  8827 raft_consensus.cc:493] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.178640  8827 raft_consensus.cc:3060] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.183167  8827 raft_consensus.cc:515] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:37.184669  8827 leader_election.cc:290] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 3 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:37.185446  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5587ada44ae4085bfc0e6ddacd80ef3" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
I20260709 13:16:37.185724  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5587ada44ae4085bfc0e6ddacd80ef3" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8d58272f60794aba93285416034cfb3b"
I20260709 13:16:37.186035  9102 raft_consensus.cc:3060] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.186314  8898 raft_consensus.cc:3055] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:37.186643  8898 raft_consensus.cc:740] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Running, Role: LEADER
I20260709 13:16:37.187469  8898 consensus_queue.cc:260] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:37.188462  8898 raft_consensus.cc:3060] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.191332  9102 raft_consensus.cc:2468] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 3.
I20260709 13:16:37.192457  8793 leader_election.cc:304] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 4a3147b92c754c88a02b7ac3a105fd2b; no voters: 
I20260709 13:16:37.193221  9148 raft_consensus.cc:2804] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:37.193651  9148 raft_consensus.cc:697] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 LEADER]: Becoming Leader. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Running, Role: LEADER
I20260709 13:16:37.194105  8898 raft_consensus.cc:2468] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 3.
I20260709 13:16:37.194614  9148 consensus_queue.cc:237] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:37.201968  8649 catalog_manager.cc:5697] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b reported cstate change: term changed from 2 to 3, leader changed from 8d58272f60794aba93285416034cfb3b (127.31.17.131) to 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130). New cstate: current_term: 3 leader_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.538972  8898 raft_consensus.cc:1275] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Refusing update from remote peer 4a3147b92c754c88a02b7ac3a105fd2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:37.540462  9148 consensus_queue.cc:1048] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:37.552618  9102 raft_consensus.cc:1275] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 2 FOLLOWER]: Refusing update from remote peer 4a3147b92c754c88a02b7ac3a105fd2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:37.553946  9148 consensus_queue.cc:1048] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:37.689486  8699 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:37.726718  8898 raft_consensus.cc:1275] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Refusing update from remote peer 4a3147b92c754c88a02b7ac3a105fd2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:37.728034  9148 consensus_queue.cc:1048] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:37.741312  9102 raft_consensus.cc:1275] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Refusing update from remote peer 4a3147b92c754c88a02b7ac3a105fd2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:37.742625  9195 consensus_queue.cc:1048] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:37.988415 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:37.997061  8827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c281645c031146b88e5884ce1c3d9997"
dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
mode: GRACEFUL
new_leader_uuid: "8d58272f60794aba93285416034cfb3b"
 from {username='slave'} at 127.0.0.1:38072
I20260709 13:16:37.997614  8827 raft_consensus.cc:606] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 LEADER]: Received request to transfer leadership to TS 8d58272f60794aba93285416034cfb3b
I20260709 13:16:38.000248  8827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da899017c34d461b89751b5a3dbd705c"
dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
mode: GRACEFUL
new_leader_uuid: "8d58272f60794aba93285416034cfb3b"
 from {username='slave'} at 127.0.0.1:38072
I20260709 13:16:38.000830  8827 raft_consensus.cc:606] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 LEADER]: Received request to transfer leadership to TS 8d58272f60794aba93285416034cfb3b
I20260709 13:16:38.001983 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:38.002588 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:38.003356 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:38.070999  9148 raft_consensus.cc:993] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b: : Instructing follower 8d58272f60794aba93285416034cfb3b to start an election
I20260709 13:16:38.071563  9195 raft_consensus.cc:1081] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 LEADER]: Signalling peer 8d58272f60794aba93285416034cfb3b to start an election
I20260709 13:16:38.072852  8898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c281645c031146b88e5884ce1c3d9997"
dest_uuid: "8d58272f60794aba93285416034cfb3b"
 from {username='slave'} at 127.0.0.1:48642
I20260709 13:16:38.073292  8898 raft_consensus.cc:493] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:38.073556  8898 raft_consensus.cc:3060] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.078994  8898 raft_consensus.cc:515] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:38.080689  8898 leader_election.cc:290] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 3 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751)
I20260709 13:16:38.081696  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c281645c031146b88e5884ce1c3d9997" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
I20260709 13:16:38.082252  8827 raft_consensus.cc:3055] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:38.082159  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c281645c031146b88e5884ce1c3d9997" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
I20260709 13:16:38.082621  8827 raft_consensus.cc:740] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Running, Role: LEADER
I20260709 13:16:38.082835  9102 raft_consensus.cc:3060] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.083531  8827 consensus_queue.cc:260] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:38.084731  8827 raft_consensus.cc:3060] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.090145  9102 raft_consensus.cc:2468] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 3.
I20260709 13:16:38.091204  8827 raft_consensus.cc:2468] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 3.
I20260709 13:16:38.091439  8867 leader_election.cc:304] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 8d58272f60794aba93285416034cfb3b; no voters: 
I20260709 13:16:38.092245  9144 raft_consensus.cc:2804] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:38.093039  9144 raft_consensus.cc:697] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 3 LEADER]: Becoming Leader. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Running, Role: LEADER
I20260709 13:16:38.093695  9144 consensus_queue.cc:237] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:38.099890  8649 catalog_manager.cc:5697] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b reported cstate change: term changed from 2 to 3, leader changed from 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130) to 8d58272f60794aba93285416034cfb3b (127.31.17.131). New cstate: current_term: 3 leader_uuid: "8d58272f60794aba93285416034cfb3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:38.344822  9148 raft_consensus.cc:993] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b: : Instructing follower 8d58272f60794aba93285416034cfb3b to start an election
I20260709 13:16:38.345345  9195 raft_consensus.cc:1081] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 LEADER]: Signalling peer 8d58272f60794aba93285416034cfb3b to start an election
I20260709 13:16:38.346829  8898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da899017c34d461b89751b5a3dbd705c"
dest_uuid: "8d58272f60794aba93285416034cfb3b"
 from {username='slave'} at 127.0.0.1:48642
I20260709 13:16:38.347385  8898 raft_consensus.cc:493] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:38.347723  8898 raft_consensus.cc:3060] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:38.352802  8898 raft_consensus.cc:515] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:38.354558  8898 leader_election.cc:290] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 2 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751)
I20260709 13:16:38.355370  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da899017c34d461b89751b5a3dbd705c" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
I20260709 13:16:38.355611  8827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da899017c34d461b89751b5a3dbd705c" candidate_uuid: "8d58272f60794aba93285416034cfb3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
I20260709 13:16:38.356076  9102 raft_consensus.cc:3060] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:38.356174  8827 raft_consensus.cc:3055] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:38.356590  8827 raft_consensus.cc:740] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Running, Role: LEADER
I20260709 13:16:38.357178  8827 consensus_queue.cc:260] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:38.358070  8827 raft_consensus.cc:3060] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:38.362331  9102 raft_consensus.cc:2468] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 2.
I20260709 13:16:38.362762  8827 raft_consensus.cc:2468] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d58272f60794aba93285416034cfb3b in term 2.
I20260709 13:16:38.364007  8867 leader_election.cc:304] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 8d58272f60794aba93285416034cfb3b; no voters: 
I20260709 13:16:38.364951  9144 raft_consensus.cc:2804] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:38.365478  9144 raft_consensus.cc:697] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 2 LEADER]: Becoming Leader. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Running, Role: LEADER
I20260709 13:16:38.366291  9144 consensus_queue.cc:237] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:38.372536  8649 catalog_manager.cc:5697] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b reported cstate change: term changed from 1 to 2, leader changed from 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130) to 8d58272f60794aba93285416034cfb3b (127.31.17.131). New cstate: current_term: 2 leader_uuid: "8d58272f60794aba93285416034cfb3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:38.506021  8827 raft_consensus.cc:1275] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Refusing update from remote peer 8d58272f60794aba93285416034cfb3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:38.507169  9144 consensus_queue.cc:1048] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:38.515515  9102 raft_consensus.cc:1275] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Refusing update from remote peer 8d58272f60794aba93285416034cfb3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:38.517319  9144 consensus_queue.cc:1048] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:16:38.690357  8699 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:38.768579  8827 raft_consensus.cc:1275] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Refusing update from remote peer 8d58272f60794aba93285416034cfb3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:38.769927  9144 consensus_queue.cc:1048] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:38.778959  9102 raft_consensus.cc:1275] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [term 2 FOLLOWER]: Refusing update from remote peer 8d58272f60794aba93285416034cfb3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:38.780537  9144 consensus_queue.cc:1048] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:39.009684 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:39.017357  8898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b84bf4c66a694d1cbc4e3f61afe49bd5"
dest_uuid: "8d58272f60794aba93285416034cfb3b"
mode: GRACEFUL
new_leader_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
 from {username='slave'} at 127.0.0.1:48648
I20260709 13:16:39.017920  8898 raft_consensus.cc:606] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 3 LEADER]: Received request to transfer leadership to TS 4a3147b92c754c88a02b7ac3a105fd2b
I20260709 13:16:39.020628  8898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da899017c34d461b89751b5a3dbd705c"
dest_uuid: "8d58272f60794aba93285416034cfb3b"
mode: GRACEFUL
new_leader_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
 from {username='slave'} at 127.0.0.1:48648
I20260709 13:16:39.021092  8898 raft_consensus.cc:606] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 2 LEADER]: Received request to transfer leadership to TS 4a3147b92c754c88a02b7ac3a105fd2b
I20260709 13:16:39.022367 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:39.022975 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:39.023638 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:39.334873  9197 raft_consensus.cc:993] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b: : Instructing follower 4a3147b92c754c88a02b7ac3a105fd2b to start an election
I20260709 13:16:39.335358  9144 raft_consensus.cc:1081] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 2 LEADER]: Signalling peer 4a3147b92c754c88a02b7ac3a105fd2b to start an election
I20260709 13:16:39.336635  8827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da899017c34d461b89751b5a3dbd705c"
dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
 from {username='slave'} at 127.0.0.1:38060
I20260709 13:16:39.337069  8827 raft_consensus.cc:493] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:39.337339  8827 raft_consensus.cc:3060] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:39.341630  8827 raft_consensus.cc:515] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:39.343096  8827 leader_election.cc:290] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 3 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:39.343858  9103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da899017c34d461b89751b5a3dbd705c" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
I20260709 13:16:39.344180  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da899017c34d461b89751b5a3dbd705c" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8d58272f60794aba93285416034cfb3b"
I20260709 13:16:39.344537  9103 raft_consensus.cc:3060] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:39.344787  8900 raft_consensus.cc:3055] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:39.345171  8900 raft_consensus.cc:740] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Running, Role: LEADER
I20260709 13:16:39.345889  8900 consensus_queue.cc:260] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:39.346838  8900 raft_consensus.cc:3060] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:39.349690  9103 raft_consensus.cc:2468] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 3.
I20260709 13:16:39.350785  8793 leader_election.cc:304] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 4a3147b92c754c88a02b7ac3a105fd2b; no voters: 
I20260709 13:16:39.351415  9209 raft_consensus.cc:2804] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:39.351841  9209 raft_consensus.cc:697] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 LEADER]: Becoming Leader. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Running, Role: LEADER
I20260709 13:16:39.352545  9209 consensus_queue.cc:237] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:39.352701  8900 raft_consensus.cc:2468] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 3.
I20260709 13:16:39.358860  8651 catalog_manager.cc:5697] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b reported cstate change: term changed from 2 to 3, leader changed from 8d58272f60794aba93285416034cfb3b (127.31.17.131) to 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130). New cstate: current_term: 3 leader_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.372262  9197 raft_consensus.cc:993] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b: : Instructing follower 4a3147b92c754c88a02b7ac3a105fd2b to start an election
I20260709 13:16:39.372721  9144 raft_consensus.cc:1081] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 3 LEADER]: Signalling peer 4a3147b92c754c88a02b7ac3a105fd2b to start an election
I20260709 13:16:39.374066  8827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b84bf4c66a694d1cbc4e3f61afe49bd5"
dest_uuid: "4a3147b92c754c88a02b7ac3a105fd2b"
 from {username='slave'} at 127.0.0.1:38060
I20260709 13:16:39.374504  8827 raft_consensus.cc:493] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:39.374774  8827 raft_consensus.cc:3060] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:39.379088  8827 raft_consensus.cc:515] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:39.380596  8827 leader_election.cc:290] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 4 election: Requested vote from peers 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209), 8d58272f60794aba93285416034cfb3b (127.31.17.131:43121)
I20260709 13:16:39.381253  9103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b84bf4c66a694d1cbc4e3f61afe49bd5" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3891d8a821ec4b6ea07053cafbcc10f2"
I20260709 13:16:39.381587  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b84bf4c66a694d1cbc4e3f61afe49bd5" candidate_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8d58272f60794aba93285416034cfb3b"
I20260709 13:16:39.381888  9103 raft_consensus.cc:3060] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:39.382171  8900 raft_consensus.cc:3055] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:39.382510  8900 raft_consensus.cc:740] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8d58272f60794aba93285416034cfb3b, State: Running, Role: LEADER
I20260709 13:16:39.383319  8900 consensus_queue.cc:260] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:39.384552  8900 raft_consensus.cc:3060] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:39.388963  9103 raft_consensus.cc:2468] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 4.
I20260709 13:16:39.390308  8793 leader_election.cc:304] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3891d8a821ec4b6ea07053cafbcc10f2, 4a3147b92c754c88a02b7ac3a105fd2b; no voters: 
I20260709 13:16:39.390940  9209 raft_consensus.cc:2804] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:39.391425  9209 raft_consensus.cc:697] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 4 LEADER]: Becoming Leader. State: Replica: 4a3147b92c754c88a02b7ac3a105fd2b, State: Running, Role: LEADER
I20260709 13:16:39.391875  8900 raft_consensus.cc:2468] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a3147b92c754c88a02b7ac3a105fd2b in term 4.
I20260709 13:16:39.392380  9209 consensus_queue.cc:237] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } }
I20260709 13:16:39.398975  8651 catalog_manager.cc:5697] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b reported cstate change: term changed from 3 to 4, leader changed from 8d58272f60794aba93285416034cfb3b (127.31.17.131) to 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130). New cstate: current_term: 4 leader_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a3147b92c754c88a02b7ac3a105fd2b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:39.691372  8699 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:39.912343  9103 raft_consensus.cc:1275] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 4 FOLLOWER]: Refusing update from remote peer 4a3147b92c754c88a02b7ac3a105fd2b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:39.913731  9209 consensus_queue.cc:1048] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:39.916512  8900 raft_consensus.cc:1275] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Refusing update from remote peer 4a3147b92c754c88a02b7ac3a105fd2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:39.917855  9214 consensus_queue.cc:1048] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:39.929497  8898 raft_consensus.cc:1275] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 4 FOLLOWER]: Refusing update from remote peer 4a3147b92c754c88a02b7ac3a105fd2b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:39.931844  9214 consensus_queue.cc:1048] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d58272f60794aba93285416034cfb3b" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 43121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:39.947383  9103 raft_consensus.cc:1275] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Refusing update from remote peer 4a3147b92c754c88a02b7ac3a105fd2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:39.949069  9209 consensus_queue.cc:1048] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3891d8a821ec4b6ea07053cafbcc10f2" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:40.030277 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:40.055061 31814 tablet_server.cc:179] TabletServer@127.31.17.129:44209 shutting down...
I20260709 13:16:40.074316 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:40.075096 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:40.075721 31814 raft_consensus.cc:2243] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.076206 31814 raft_consensus.cc:2272] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.078537 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:40.079084 31814 raft_consensus.cc:2243] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.079566 31814 raft_consensus.cc:2272] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.081282 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:40.081836 31814 raft_consensus.cc:2243] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.082270 31814 raft_consensus.cc:2272] T d5587ada44ae4085bfc0e6ddacd80ef3 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.084137 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:40.084796 31814 raft_consensus.cc:2243] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.085258 31814 raft_consensus.cc:2272] T c281645c031146b88e5884ce1c3d9997 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.087141 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:40.087920 31814 raft_consensus.cc:2243] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.088364 31814 raft_consensus.cc:2272] T a94d0587141e42dcb88cf6eca845d596 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.090049 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:40.090554 31814 raft_consensus.cc:2243] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.090947 31814 raft_consensus.cc:2272] T cfed7271d68f4ef087e2881aedbbd8ba P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.092691 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:40.093210 31814 raft_consensus.cc:2243] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.093609 31814 raft_consensus.cc:2272] T da899017c34d461b89751b5a3dbd705c P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.095844 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:40.096390 31814 raft_consensus.cc:2243] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.096796 31814 raft_consensus.cc:2272] T 7085954ca82846de8e52835cae7146f9 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.098449 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:40.098922 31814 raft_consensus.cc:2243] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.099375 31814 raft_consensus.cc:2272] T 488298c497cb42ecb64885b19bcd1a10 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.101048 31814 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:40.101500 31814 raft_consensus.cc:2243] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.101897 31814 raft_consensus.cc:2272] T 1316a4338cec4f6cbb6aaaf59053b189 P 3891d8a821ec4b6ea07053cafbcc10f2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.130525 31814 tablet_server.cc:196] TabletServer@127.31.17.129:44209 shutdown complete.
W20260709 13:16:40.134991  8793 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111) [suppressed 84 similar messages]
W20260709 13:16:40.138612  8793 consensus_peers.cc:597] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b -> Peer 3891d8a821ec4b6ea07053cafbcc10f2 (127.31.17.129:44209): Couldn't send request to peer 3891d8a821ec4b6ea07053cafbcc10f2. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:44209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:40.150170 31814 tablet_server.cc:179] TabletServer@127.31.17.130:0 shutting down...
I20260709 13:16:40.180596 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:40.181381 31814 tablet_replica.cc:333] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b: stopping tablet replica
I20260709 13:16:40.182456 31814 raft_consensus.cc:2243] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:40.183743 31814 raft_consensus.cc:2272] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 4a3147b92c754c88a02b7ac3a105fd2b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.187597 31814 tablet_replica.cc:333] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b: stopping tablet replica
I20260709 13:16:40.188151 31814 raft_consensus.cc:2243] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.188563 31814 raft_consensus.cc:2272] T c281645c031146b88e5884ce1c3d9997 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.190796 31814 tablet_replica.cc:333] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b: stopping tablet replica
I20260709 13:16:40.191396 31814 raft_consensus.cc:2243] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:40.192169 31814 raft_consensus.cc:2272] T a94d0587141e42dcb88cf6eca845d596 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.194298 31814 tablet_replica.cc:333] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b: stopping tablet replica
I20260709 13:16:40.194869 31814 raft_consensus.cc:2243] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:40.195701 31814 raft_consensus.cc:2272] T da899017c34d461b89751b5a3dbd705c P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.198271 31814 tablet_replica.cc:333] T cfed7271d68f4ef087e2881aedbbd8ba P 4a3147b92c754c88a02b7ac3a105fd2b: stopping tablet replica
I20260709 13:16:40.198812 31814 raft_consensus.cc:2243] T cfed7271d68f4ef087e2881aedbbd8ba P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.199297 31814 raft_consensus.cc:2272] T cfed7271d68f4ef087e2881aedbbd8ba P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.201406 31814 tablet_replica.cc:333] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b: stopping tablet replica
I20260709 13:16:40.201946 31814 raft_consensus.cc:2243] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:40.202713 31814 raft_consensus.cc:2272] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.205168 31814 tablet_replica.cc:333] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b: stopping tablet replica
I20260709 13:16:40.205750 31814 raft_consensus.cc:2243] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:40.206619 31814 raft_consensus.cc:2272] T 488298c497cb42ecb64885b19bcd1a10 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.208822 31814 tablet_replica.cc:333] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b: stopping tablet replica
I20260709 13:16:40.209311 31814 raft_consensus.cc:2243] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.209707 31814 raft_consensus.cc:2272] T 1316a4338cec4f6cbb6aaaf59053b189 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.212085 31814 tablet_replica.cc:333] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b: stopping tablet replica
I20260709 13:16:40.212577 31814 raft_consensus.cc:2243] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:40.213311 31814 raft_consensus.cc:2272] T d5587ada44ae4085bfc0e6ddacd80ef3 P 4a3147b92c754c88a02b7ac3a105fd2b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.215656 31814 tablet_replica.cc:333] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b: stopping tablet replica
I20260709 13:16:40.216109 31814 raft_consensus.cc:2243] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.216545 31814 raft_consensus.cc:2272] T 7085954ca82846de8e52835cae7146f9 P 4a3147b92c754c88a02b7ac3a105fd2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.249951 31814 tablet_server.cc:196] TabletServer@127.31.17.130:0 shutdown complete.
W20260709 13:16:40.269011  8866 consensus_peers.cc:597] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b -> Peer 4a3147b92c754c88a02b7ac3a105fd2b (127.31.17.130:41751): Couldn't send request to peer 4a3147b92c754c88a02b7ac3a105fd2b. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:41751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:40.277539 31814 tablet_server.cc:179] TabletServer@127.31.17.131:0 shutting down...
I20260709 13:16:40.309651 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:40.310405 31814 tablet_replica.cc:333] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b: stopping tablet replica
I20260709 13:16:40.311164 31814 raft_consensus.cc:2243] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.311688 31814 raft_consensus.cc:2272] T d5587ada44ae4085bfc0e6ddacd80ef3 P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.313910 31814 tablet_replica.cc:333] T 488298c497cb42ecb64885b19bcd1a10 P 8d58272f60794aba93285416034cfb3b: stopping tablet replica
I20260709 13:16:40.314496 31814 raft_consensus.cc:2243] T 488298c497cb42ecb64885b19bcd1a10 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.314946 31814 raft_consensus.cc:2272] T 488298c497cb42ecb64885b19bcd1a10 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.316890 31814 tablet_replica.cc:333] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b: stopping tablet replica
I20260709 13:16:40.317409 31814 raft_consensus.cc:2243] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:40.318149 31814 raft_consensus.cc:2272] T 1316a4338cec4f6cbb6aaaf59053b189 P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.320201 31814 tablet_replica.cc:333] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b: stopping tablet replica
I20260709 13:16:40.320816 31814 raft_consensus.cc:2243] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.321235 31814 raft_consensus.cc:2272] T b84bf4c66a694d1cbc4e3f61afe49bd5 P 8d58272f60794aba93285416034cfb3b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.323760 31814 tablet_replica.cc:333] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b: stopping tablet replica
I20260709 13:16:40.324288 31814 raft_consensus.cc:2243] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.324720 31814 raft_consensus.cc:2272] T a94d0587141e42dcb88cf6eca845d596 P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.326615 31814 tablet_replica.cc:333] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b: stopping tablet replica
I20260709 13:16:40.327103 31814 raft_consensus.cc:2243] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:40.327906 31814 raft_consensus.cc:2272] T c281645c031146b88e5884ce1c3d9997 P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.329944 31814 tablet_replica.cc:333] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b: stopping tablet replica
I20260709 13:16:40.330494 31814 raft_consensus.cc:2243] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.330910 31814 raft_consensus.cc:2272] T 35c9eedcc83d4cb3aaf703d0684cc1d9 P 8d58272f60794aba93285416034cfb3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.333014 31814 tablet_replica.cc:333] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b: stopping tablet replica
I20260709 13:16:40.333563 31814 raft_consensus.cc:2243] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:40.334336 31814 raft_consensus.cc:2272] T cfed7271d68f4ef087e2881aedbbd8ba P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.336369 31814 tablet_replica.cc:333] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b: stopping tablet replica
I20260709 13:16:40.336872 31814 raft_consensus.cc:2243] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.337272 31814 raft_consensus.cc:2272] T da899017c34d461b89751b5a3dbd705c P 8d58272f60794aba93285416034cfb3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.339712 31814 tablet_replica.cc:333] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b: stopping tablet replica
I20260709 13:16:40.340170 31814 raft_consensus.cc:2243] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:40.340883 31814 raft_consensus.cc:2272] T 7085954ca82846de8e52835cae7146f9 P 8d58272f60794aba93285416034cfb3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.371673 31814 tablet_server.cc:196] TabletServer@127.31.17.131:0 shutdown complete.
I20260709 13:16:40.396868 31814 master.cc:562] Master@127.31.17.190:41919 shutting down...
I20260709 13:16:40.424099 31814 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:40.424651 31814 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.424989 31814 tablet_replica.cc:333] T 00000000000000000000000000000000 P 663cbb16e0e2433b8b61ccdb23bc1a84: stopping tablet replica
I20260709 13:16:40.445142 31814 master.cc:584] Master@127.31.17.190:41919 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12956 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:16:40.490605 31814 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.31.17.190:44879
I20260709 13:16:40.492131 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:40.498067  9232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:40.498100  9231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:40.499313  9234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:40.500566 31814 server_base.cc:1061] running on GCE node
I20260709 13:16:40.501574 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:40.501781 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:40.501978 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783603000501959 us; error 0 us; skew 500 ppm
I20260709 13:16:40.502555 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:40.505283 31814 webserver.cc:533] Webserver started at http://127.31.17.190:34071/ using document root <none> and password file <none>
I20260709 13:16:40.505846 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:40.506080 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:40.506415 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:40.507649 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/master-0-root/instance:
uuid: "ffba9d71439e411ab2028c177704dc6e"
format_stamp: "Formatted at 2026-07-09 13:16:40 on dist-test-slave-zhw8"
I20260709 13:16:40.512071 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:16:40.515486  9239 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:40.516330 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:16:40.516649 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/master-0-root
uuid: "ffba9d71439e411ab2028c177704dc6e"
format_stamp: "Formatted at 2026-07-09 13:16:40 on dist-test-slave-zhw8"
I20260709 13:16:40.516925 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:40.528962 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:40.530133 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:40.568796 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.190:44879
I20260709 13:16:40.568924  9290 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.190:44879 every 8 connection(s)
I20260709 13:16:40.572690  9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:40.583626  9291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e: Bootstrap starting.
I20260709 13:16:40.588276  9291 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:40.592389  9291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e: No bootstrap required, opened a new log
I20260709 13:16:40.594472  9291 raft_consensus.cc:359] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffba9d71439e411ab2028c177704dc6e" member_type: VOTER }
I20260709 13:16:40.594833  9291 raft_consensus.cc:385] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:40.595016  9291 raft_consensus.cc:740] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffba9d71439e411ab2028c177704dc6e, State: Initialized, Role: FOLLOWER
I20260709 13:16:40.595520  9291 consensus_queue.cc:260] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffba9d71439e411ab2028c177704dc6e" member_type: VOTER }
I20260709 13:16:40.595927  9291 raft_consensus.cc:399] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:40.596118  9291 raft_consensus.cc:493] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:40.596319  9291 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:40.600852  9291 raft_consensus.cc:515] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffba9d71439e411ab2028c177704dc6e" member_type: VOTER }
I20260709 13:16:40.601328  9291 leader_election.cc:304] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ffba9d71439e411ab2028c177704dc6e; no voters: 
I20260709 13:16:40.602522  9291 leader_election.cc:290] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:40.602869  9294 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:40.604341  9294 raft_consensus.cc:697] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [term 1 LEADER]: Becoming Leader. State: Replica: ffba9d71439e411ab2028c177704dc6e, State: Running, Role: LEADER
I20260709 13:16:40.604987  9294 consensus_queue.cc:237] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffba9d71439e411ab2028c177704dc6e" member_type: VOTER }
I20260709 13:16:40.605481  9291 sys_catalog.cc:565] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:40.610281  9296 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader ffba9d71439e411ab2028c177704dc6e. Latest consensus state: current_term: 1 leader_uuid: "ffba9d71439e411ab2028c177704dc6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffba9d71439e411ab2028c177704dc6e" member_type: VOTER } }
I20260709 13:16:40.611104  9296 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:40.611013  9295 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ffba9d71439e411ab2028c177704dc6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffba9d71439e411ab2028c177704dc6e" member_type: VOTER } }
I20260709 13:16:40.611770  9295 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:40.613214  9302 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:40.618327  9302 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:40.621023 31814 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:40.626829  9302 catalog_manager.cc:1383] Generated new cluster ID: 07e2a503fe1b4349b1ee69030f1be979
I20260709 13:16:40.627107  9302 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:40.654798  9302 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:40.656136  9302 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:40.673873  9302 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e: Generated new TSK 0
I20260709 13:16:40.674572  9302 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:40.688112 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:40.694402  9312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:40.695093  9313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:40.697360  9315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:40.698026 31814 server_base.cc:1061] running on GCE node
I20260709 13:16:40.698945 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:40.699122 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:40.699298 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783603000699280 us; error 0 us; skew 500 ppm
I20260709 13:16:40.699863 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:40.702139 31814 webserver.cc:533] Webserver started at http://127.31.17.129:46333/ using document root <none> and password file <none>
I20260709 13:16:40.702612 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:40.702769 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:40.702973 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:40.704151 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/ts-0-root/instance:
uuid: "af3c90b923d94c9cbf4bf5387960c098"
format_stamp: "Formatted at 2026-07-09 13:16:40 on dist-test-slave-zhw8"
I20260709 13:16:40.708807 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:16:40.712227  9320 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:40.713057 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:16:40.713397 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/ts-0-root
uuid: "af3c90b923d94c9cbf4bf5387960c098"
format_stamp: "Formatted at 2026-07-09 13:16:40 on dist-test-slave-zhw8"
I20260709 13:16:40.713688 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:40.727784 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:40.728979 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:40.730460 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:40.732800 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:40.733022 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:40.733325 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:40.733498 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:40.775574 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.129:44825
I20260709 13:16:40.775662  9382 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.129:44825 every 8 connection(s)
I20260709 13:16:40.780870 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:40.789721  9387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:40.790787  9388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:40.793170  9390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:40.794312 31814 server_base.cc:1061] running on GCE node
I20260709 13:16:40.795519  9383 heartbeater.cc:344] Connected to a master server at 127.31.17.190:44879
I20260709 13:16:40.795553 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:40.796022 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:40.796106  9383 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:40.796247 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783603000796226 us; error 0 us; skew 500 ppm
I20260709 13:16:40.797073  9383 heartbeater.cc:507] Master 127.31.17.190:44879 requested a full tablet report, sending...
I20260709 13:16:40.797119 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:40.799655  9256 ts_manager.cc:194] Registered new tserver with Master: af3c90b923d94c9cbf4bf5387960c098 (127.31.17.129:44825)
I20260709 13:16:40.800195 31814 webserver.cc:533] Webserver started at http://127.31.17.130:33775/ using document root <none> and password file <none>
I20260709 13:16:40.800740 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:40.800931 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:40.801214 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:40.801877  9256 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57022
I20260709 13:16:40.802361 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/ts-1-root/instance:
uuid: "d85f3157220f47a4ae41f7fefd518204"
format_stamp: "Formatted at 2026-07-09 13:16:40 on dist-test-slave-zhw8"
I20260709 13:16:40.807824 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:16:40.811458  9395 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:40.812230 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:16:40.812530 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/ts-1-root
uuid: "d85f3157220f47a4ae41f7fefd518204"
format_stamp: "Formatted at 2026-07-09 13:16:40 on dist-test-slave-zhw8"
I20260709 13:16:40.812829 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:40.831600 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:40.832790 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:40.834237 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:40.836773 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:40.836951 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:40.837227 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:40.837390 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:40.877902 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.130:40311
I20260709 13:16:40.878021  9457 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.130:40311 every 8 connection(s)
I20260709 13:16:40.882802 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:40.889891  9461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:40.891606  9462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:40.894704  9464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:40.895344 31814 server_base.cc:1061] running on GCE node
I20260709 13:16:40.895800  9458 heartbeater.cc:344] Connected to a master server at 127.31.17.190:44879
I20260709 13:16:40.896260  9458 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:40.896360 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:40.896675 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:40.896880 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783603000896862 us; error 0 us; skew 500 ppm
I20260709 13:16:40.897181  9458 heartbeater.cc:507] Master 127.31.17.190:44879 requested a full tablet report, sending...
I20260709 13:16:40.897527 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:40.899742  9256 ts_manager.cc:194] Registered new tserver with Master: d85f3157220f47a4ae41f7fefd518204 (127.31.17.130:40311)
I20260709 13:16:40.900522 31814 webserver.cc:533] Webserver started at http://127.31.17.131:33031/ using document root <none> and password file <none>
I20260709 13:16:40.901201 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:40.901435 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:40.901633  9256 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57036
I20260709 13:16:40.901742 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:40.903384 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/ts-2-root/instance:
uuid: "9432bc2bc50f4f6191d04d53a81ef5cb"
format_stamp: "Formatted at 2026-07-09 13:16:40 on dist-test-slave-zhw8"
I20260709 13:16:40.907866 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:16:40.911334  9469 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:40.912072 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:16:40.912362 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/ts-2-root
uuid: "9432bc2bc50f4f6191d04d53a81ef5cb"
format_stamp: "Formatted at 2026-07-09 13:16:40 on dist-test-slave-zhw8"
I20260709 13:16:40.912643 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602713491408-31814-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:40.935097 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:40.936331 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:40.937824 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:40.939985 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:40.940203 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:40.940441 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:40.940609 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:40.983620 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.131:33545
I20260709 13:16:40.983713  9531 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.131:33545 every 8 connection(s)
I20260709 13:16:40.998418  9532 heartbeater.cc:344] Connected to a master server at 127.31.17.190:44879
I20260709 13:16:40.998906  9532 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:40.999683  9532 heartbeater.cc:507] Master 127.31.17.190:44879 requested a full tablet report, sending...
I20260709 13:16:41.001863  9256 ts_manager.cc:194] Registered new tserver with Master: 9432bc2bc50f4f6191d04d53a81ef5cb (127.31.17.131:33545)
I20260709 13:16:41.002996 31814 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016106835s
I20260709 13:16:41.003557  9256 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57040
I20260709 13:16:41.032502  9256 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57054:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:41.034894  9256 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:41.098673  9348 tablet_service.cc:1511] Processing CreateTablet for tablet bc8d90f48eba4d77b22ddfe1f3717962 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=cdf46a0b4546429a9d7aae68213c2828]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:16:41.098959  9422 tablet_service.cc:1511] Processing CreateTablet for tablet f70c216af52b439e93919930d5664ea7 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=cdf46a0b4546429a9d7aae68213c2828]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:16:41.100005  9496 tablet_service.cc:1511] Processing CreateTablet for tablet f70c216af52b439e93919930d5664ea7 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=cdf46a0b4546429a9d7aae68213c2828]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:16:41.100356  9348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc8d90f48eba4d77b22ddfe1f3717962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.100281  9347 tablet_service.cc:1511] Processing CreateTablet for tablet f70c216af52b439e93919930d5664ea7 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=cdf46a0b4546429a9d7aae68213c2828]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:16:41.098959  9423 tablet_service.cc:1511] Processing CreateTablet for tablet bc8d90f48eba4d77b22ddfe1f3717962 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=cdf46a0b4546429a9d7aae68213c2828]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:16:41.100554  9422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f70c216af52b439e93919930d5664ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.101895  9347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f70c216af52b439e93919930d5664ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.102038  9497 tablet_service.cc:1511] Processing CreateTablet for tablet bc8d90f48eba4d77b22ddfe1f3717962 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=cdf46a0b4546429a9d7aae68213c2828]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:16:41.103618  9497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc8d90f48eba4d77b22ddfe1f3717962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.106657  9496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f70c216af52b439e93919930d5664ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.111626  9423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc8d90f48eba4d77b22ddfe1f3717962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.137315  9547 tablet_bootstrap.cc:492] T f70c216af52b439e93919930d5664ea7 P d85f3157220f47a4ae41f7fefd518204: Bootstrap starting.
I20260709 13:16:41.142518  9548 tablet_bootstrap.cc:492] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098: Bootstrap starting.
I20260709 13:16:41.147814  9547 tablet_bootstrap.cc:654] T f70c216af52b439e93919930d5664ea7 P d85f3157220f47a4ae41f7fefd518204: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.148612  9549 tablet_bootstrap.cc:492] T bc8d90f48eba4d77b22ddfe1f3717962 P 9432bc2bc50f4f6191d04d53a81ef5cb: Bootstrap starting.
I20260709 13:16:41.150741  9548 tablet_bootstrap.cc:654] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.154294  9547 tablet_bootstrap.cc:492] T f70c216af52b439e93919930d5664ea7 P d85f3157220f47a4ae41f7fefd518204: No bootstrap required, opened a new log
I20260709 13:16:41.154414  9549 tablet_bootstrap.cc:654] T bc8d90f48eba4d77b22ddfe1f3717962 P 9432bc2bc50f4f6191d04d53a81ef5cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.154769  9547 ts_tablet_manager.cc:1403] T f70c216af52b439e93919930d5664ea7 P d85f3157220f47a4ae41f7fefd518204: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.004s
I20260709 13:16:41.156955  9548 tablet_bootstrap.cc:492] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098: No bootstrap required, opened a new log
I20260709 13:16:41.157464  9548 ts_tablet_manager.cc:1403] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:16:41.157809  9547 raft_consensus.cc:359] T f70c216af52b439e93919930d5664ea7 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.158623  9547 raft_consensus.cc:385] T f70c216af52b439e93919930d5664ea7 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.158921  9547 raft_consensus.cc:740] T f70c216af52b439e93919930d5664ea7 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d85f3157220f47a4ae41f7fefd518204, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.159718  9547 consensus_queue.cc:260] T f70c216af52b439e93919930d5664ea7 P d85f3157220f47a4ae41f7fefd518204 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.160379  9548 raft_consensus.cc:359] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.161201  9549 tablet_bootstrap.cc:492] T bc8d90f48eba4d77b22ddfe1f3717962 P 9432bc2bc50f4f6191d04d53a81ef5cb: No bootstrap required, opened a new log
I20260709 13:16:41.161233  9548 raft_consensus.cc:385] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.161789  9549 ts_tablet_manager.cc:1403] T bc8d90f48eba4d77b22ddfe1f3717962 P 9432bc2bc50f4f6191d04d53a81ef5cb: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.006s
I20260709 13:16:41.161818  9548 raft_consensus.cc:740] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3c90b923d94c9cbf4bf5387960c098, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.162539  9458 heartbeater.cc:499] Master 127.31.17.190:44879 was elected leader, sending a full tablet report...
I20260709 13:16:41.162953  9548 consensus_queue.cc:260] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.163784  9547 ts_tablet_manager.cc:1434] T f70c216af52b439e93919930d5664ea7 P d85f3157220f47a4ae41f7fefd518204: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.002s
I20260709 13:16:41.164925  9547 tablet_bootstrap.cc:492] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204: Bootstrap starting.
I20260709 13:16:41.165156  9549 raft_consensus.cc:359] T bc8d90f48eba4d77b22ddfe1f3717962 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.165903  9549 raft_consensus.cc:385] T bc8d90f48eba4d77b22ddfe1f3717962 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.166208  9549 raft_consensus.cc:740] T bc8d90f48eba4d77b22ddfe1f3717962 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9432bc2bc50f4f6191d04d53a81ef5cb, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.167106  9549 consensus_queue.cc:260] T bc8d90f48eba4d77b22ddfe1f3717962 P 9432bc2bc50f4f6191d04d53a81ef5cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.175856  9547 tablet_bootstrap.cc:654] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.182665  9383 heartbeater.cc:499] Master 127.31.17.190:44879 was elected leader, sending a full tablet report...
I20260709 13:16:41.183034  9548 ts_tablet_manager.cc:1434] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098: Time spent starting tablet: real 0.025s	user 0.017s	sys 0.009s
I20260709 13:16:41.184151  9548 tablet_bootstrap.cc:492] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098: Bootstrap starting.
I20260709 13:16:41.187557  9549 ts_tablet_manager.cc:1434] T bc8d90f48eba4d77b22ddfe1f3717962 P 9432bc2bc50f4f6191d04d53a81ef5cb: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.018s
I20260709 13:16:41.188706  9549 tablet_bootstrap.cc:492] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb: Bootstrap starting.
I20260709 13:16:41.189801  9532 heartbeater.cc:499] Master 127.31.17.190:44879 was elected leader, sending a full tablet report...
I20260709 13:16:41.190824  9548 tablet_bootstrap.cc:654] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.195689  9549 tablet_bootstrap.cc:654] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.197732  9547 tablet_bootstrap.cc:492] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204: No bootstrap required, opened a new log
I20260709 13:16:41.198695  9547 ts_tablet_manager.cc:1403] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.005s
I20260709 13:16:41.201939  9547 raft_consensus.cc:359] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.202445  9548 tablet_bootstrap.cc:492] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098: No bootstrap required, opened a new log
I20260709 13:16:41.202713  9547 raft_consensus.cc:385] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.203092  9547 raft_consensus.cc:740] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d85f3157220f47a4ae41f7fefd518204, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.203164  9548 ts_tablet_manager.cc:1403] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 13:16:41.204841  9547 consensus_queue.cc:260] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.206182  9549 tablet_bootstrap.cc:492] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb: No bootstrap required, opened a new log
I20260709 13:16:41.206771  9549 ts_tablet_manager.cc:1403] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.003s
I20260709 13:16:41.206187  9548 raft_consensus.cc:359] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.207120  9547 ts_tablet_manager.cc:1434] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:41.207267  9548 raft_consensus.cc:385] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.207726  9548 raft_consensus.cc:740] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3c90b923d94c9cbf4bf5387960c098, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.208515  9548 consensus_queue.cc:260] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.210134  9549 raft_consensus.cc:359] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.210604  9548 ts_tablet_manager.cc:1434] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:16:41.210948  9549 raft_consensus.cc:385] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.211323  9549 raft_consensus.cc:740] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9432bc2bc50f4f6191d04d53a81ef5cb, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.212193  9549 consensus_queue.cc:260] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.214603  9549 ts_tablet_manager.cc:1434] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 13:16:41.267320  9553 raft_consensus.cc:493] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.267906  9553 raft_consensus.cc:515] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.270150  9553 leader_election.cc:290] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3c90b923d94c9cbf4bf5387960c098 (127.31.17.129:44825), 9432bc2bc50f4f6191d04d53a81ef5cb (127.31.17.131:33545)
I20260709 13:16:41.280407  9358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8d90f48eba4d77b22ddfe1f3717962" candidate_uuid: "d85f3157220f47a4ae41f7fefd518204" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3c90b923d94c9cbf4bf5387960c098" is_pre_election: true
I20260709 13:16:41.281168  9358 raft_consensus.cc:2468] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d85f3157220f47a4ae41f7fefd518204 in term 0.
I20260709 13:16:41.282017  9507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8d90f48eba4d77b22ddfe1f3717962" candidate_uuid: "d85f3157220f47a4ae41f7fefd518204" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" is_pre_election: true
I20260709 13:16:41.282481  9399 leader_election.cc:304] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3c90b923d94c9cbf4bf5387960c098, d85f3157220f47a4ae41f7fefd518204; no voters: 
I20260709 13:16:41.282703  9507 raft_consensus.cc:2468] T bc8d90f48eba4d77b22ddfe1f3717962 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d85f3157220f47a4ae41f7fefd518204 in term 0.
I20260709 13:16:41.283324  9553 raft_consensus.cc:2804] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:41.283684  9553 raft_consensus.cc:493] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.284042  9553 raft_consensus.cc:3060] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.289273  9553 raft_consensus.cc:515] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.291023  9553 leader_election.cc:290] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [CANDIDATE]: Term 1 election: Requested vote from peers af3c90b923d94c9cbf4bf5387960c098 (127.31.17.129:44825), 9432bc2bc50f4f6191d04d53a81ef5cb (127.31.17.131:33545)
I20260709 13:16:41.291910  9358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8d90f48eba4d77b22ddfe1f3717962" candidate_uuid: "d85f3157220f47a4ae41f7fefd518204" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3c90b923d94c9cbf4bf5387960c098"
I20260709 13:16:41.292078  9507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8d90f48eba4d77b22ddfe1f3717962" candidate_uuid: "d85f3157220f47a4ae41f7fefd518204" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb"
I20260709 13:16:41.292448  9358 raft_consensus.cc:3060] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.292654  9507 raft_consensus.cc:3060] T bc8d90f48eba4d77b22ddfe1f3717962 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.298261  9358 raft_consensus.cc:2468] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d85f3157220f47a4ae41f7fefd518204 in term 1.
I20260709 13:16:41.298441  9507 raft_consensus.cc:2468] T bc8d90f48eba4d77b22ddfe1f3717962 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d85f3157220f47a4ae41f7fefd518204 in term 1.
I20260709 13:16:41.299515  9399 leader_election.cc:304] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3c90b923d94c9cbf4bf5387960c098, d85f3157220f47a4ae41f7fefd518204; no voters: 
I20260709 13:16:41.300243  9553 raft_consensus.cc:2804] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:41.301137  9553 raft_consensus.cc:697] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 1 LEADER]: Becoming Leader. State: Replica: d85f3157220f47a4ae41f7fefd518204, State: Running, Role: LEADER
I20260709 13:16:41.301800  9553 consensus_queue.cc:237] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.308328  9255 catalog_manager.cc:5697] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 reported cstate change: term changed from 0 to 1, leader changed from <none> to d85f3157220f47a4ae41f7fefd518204 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "d85f3157220f47a4ae41f7fefd518204" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.514091  9554 raft_consensus.cc:493] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.514932  9554 raft_consensus.cc:515] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.517117  9554 leader_election.cc:290] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d85f3157220f47a4ae41f7fefd518204 (127.31.17.130:40311), 9432bc2bc50f4f6191d04d53a81ef5cb (127.31.17.131:33545)
I20260709 13:16:41.527815  9507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70c216af52b439e93919930d5664ea7" candidate_uuid: "af3c90b923d94c9cbf4bf5387960c098" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" is_pre_election: true
I20260709 13:16:41.528136  9433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70c216af52b439e93919930d5664ea7" candidate_uuid: "af3c90b923d94c9cbf4bf5387960c098" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d85f3157220f47a4ae41f7fefd518204" is_pre_election: true
I20260709 13:16:41.528502  9507 raft_consensus.cc:2468] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3c90b923d94c9cbf4bf5387960c098 in term 0.
I20260709 13:16:41.528837  9433 raft_consensus.cc:2468] T f70c216af52b439e93919930d5664ea7 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3c90b923d94c9cbf4bf5387960c098 in term 0.
I20260709 13:16:41.529590  9321 leader_election.cc:304] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9432bc2bc50f4f6191d04d53a81ef5cb, af3c90b923d94c9cbf4bf5387960c098; no voters: 
I20260709 13:16:41.530405  9554 raft_consensus.cc:2804] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:41.530781  9554 raft_consensus.cc:493] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.531065  9554 raft_consensus.cc:3060] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.536620  9554 raft_consensus.cc:515] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.538175  9554 leader_election.cc:290] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [CANDIDATE]: Term 1 election: Requested vote from peers d85f3157220f47a4ae41f7fefd518204 (127.31.17.130:40311), 9432bc2bc50f4f6191d04d53a81ef5cb (127.31.17.131:33545)
I20260709 13:16:41.539184  9507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70c216af52b439e93919930d5664ea7" candidate_uuid: "af3c90b923d94c9cbf4bf5387960c098" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb"
I20260709 13:16:41.539184  9433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70c216af52b439e93919930d5664ea7" candidate_uuid: "af3c90b923d94c9cbf4bf5387960c098" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d85f3157220f47a4ae41f7fefd518204"
I20260709 13:16:41.540092  9507 raft_consensus.cc:3060] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.540110  9433 raft_consensus.cc:3060] T f70c216af52b439e93919930d5664ea7 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.547621  9507 raft_consensus.cc:2468] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3c90b923d94c9cbf4bf5387960c098 in term 1.
I20260709 13:16:41.547621  9433 raft_consensus.cc:2468] T f70c216af52b439e93919930d5664ea7 P d85f3157220f47a4ae41f7fefd518204 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3c90b923d94c9cbf4bf5387960c098 in term 1.
I20260709 13:16:41.549005  9321 leader_election.cc:304] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9432bc2bc50f4f6191d04d53a81ef5cb, af3c90b923d94c9cbf4bf5387960c098; no voters: 
I20260709 13:16:41.549787  9554 raft_consensus.cc:2804] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:41.550716  9554 raft_consensus.cc:697] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 1 LEADER]: Becoming Leader. State: Replica: af3c90b923d94c9cbf4bf5387960c098, State: Running, Role: LEADER
I20260709 13:16:41.551460  9554 consensus_queue.cc:237] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.558266  9255 catalog_manager.cc:5697] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3c90b923d94c9cbf4bf5387960c098 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "af3c90b923d94c9cbf4bf5387960c098" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.591809  9255 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57056:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:41.593909  9255 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260709 13:16:41.615887  9304 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:41.619243  9347 tablet_service.cc:1511] Processing CreateTablet for tablet e63322b9b6564a55ac208394981daec8 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=47e91867e84e455aa83022aa6a2efd03]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:16:41.620659  9347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63322b9b6564a55ac208394981daec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.620755  9423 tablet_service.cc:1511] Processing CreateTablet for tablet e63322b9b6564a55ac208394981daec8 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=47e91867e84e455aa83022aa6a2efd03]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:16:41.622078  9423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63322b9b6564a55ac208394981daec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.626528  9348 tablet_service.cc:1511] Processing CreateTablet for tablet 0713a59b6acd41fb8bd0fe967d25c799 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=47e91867e84e455aa83022aa6a2efd03]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:16:41.626674  9422 tablet_service.cc:1511] Processing CreateTablet for tablet 0713a59b6acd41fb8bd0fe967d25c799 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=47e91867e84e455aa83022aa6a2efd03]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:16:41.627063  9496 tablet_service.cc:1511] Processing CreateTablet for tablet 0713a59b6acd41fb8bd0fe967d25c799 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=47e91867e84e455aa83022aa6a2efd03]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:16:41.627944  9348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0713a59b6acd41fb8bd0fe967d25c799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.628007  9422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0713a59b6acd41fb8bd0fe967d25c799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.628346  9496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0713a59b6acd41fb8bd0fe967d25c799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.624235  9497 tablet_service.cc:1511] Processing CreateTablet for tablet e63322b9b6564a55ac208394981daec8 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=47e91867e84e455aa83022aa6a2efd03]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:16:41.631353  9497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63322b9b6564a55ac208394981daec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.641768  9547 tablet_bootstrap.cc:492] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204: Bootstrap starting.
I20260709 13:16:41.644805  9548 tablet_bootstrap.cc:492] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098: Bootstrap starting.
I20260709 13:16:41.666855  9547 tablet_bootstrap.cc:654] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.672453  9548 tablet_bootstrap.cc:654] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.683065  9548 tablet_bootstrap.cc:492] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098: No bootstrap required, opened a new log
I20260709 13:16:41.683656  9548 ts_tablet_manager.cc:1403] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098: Time spent bootstrapping tablet: real 0.039s	user 0.025s	sys 0.001s
I20260709 13:16:41.684981  9549 tablet_bootstrap.cc:492] T 0713a59b6acd41fb8bd0fe967d25c799 P 9432bc2bc50f4f6191d04d53a81ef5cb: Bootstrap starting.
I20260709 13:16:41.686718  9548 raft_consensus.cc:359] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.687541  9548 raft_consensus.cc:385] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.687832  9548 raft_consensus.cc:740] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3c90b923d94c9cbf4bf5387960c098, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.688753  9548 consensus_queue.cc:260] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.690925  9548 ts_tablet_manager.cc:1434] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:41.692170  9548 tablet_bootstrap.cc:492] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098: Bootstrap starting.
I20260709 13:16:41.696405  9549 tablet_bootstrap.cc:654] T 0713a59b6acd41fb8bd0fe967d25c799 P 9432bc2bc50f4f6191d04d53a81ef5cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.698971  9548 tablet_bootstrap.cc:654] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.702528  9547 tablet_bootstrap.cc:492] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204: No bootstrap required, opened a new log
I20260709 13:16:41.703437  9547 ts_tablet_manager.cc:1403] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204: Time spent bootstrapping tablet: real 0.062s	user 0.030s	sys 0.017s
I20260709 13:16:41.706909  9547 raft_consensus.cc:359] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.707731  9547 raft_consensus.cc:385] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.708046  9547 raft_consensus.cc:740] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d85f3157220f47a4ae41f7fefd518204, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.708865  9547 consensus_queue.cc:260] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.712829  9547 ts_tablet_manager.cc:1434] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:16:41.714119  9549 tablet_bootstrap.cc:492] T 0713a59b6acd41fb8bd0fe967d25c799 P 9432bc2bc50f4f6191d04d53a81ef5cb: No bootstrap required, opened a new log
I20260709 13:16:41.714553  9547 tablet_bootstrap.cc:492] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204: Bootstrap starting.
I20260709 13:16:41.714775  9549 ts_tablet_manager.cc:1403] T 0713a59b6acd41fb8bd0fe967d25c799 P 9432bc2bc50f4f6191d04d53a81ef5cb: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.009s
I20260709 13:16:41.715622  9548 tablet_bootstrap.cc:492] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098: No bootstrap required, opened a new log
I20260709 13:16:41.716184  9548 ts_tablet_manager.cc:1403] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 13:16:41.718227  9549 raft_consensus.cc:359] T 0713a59b6acd41fb8bd0fe967d25c799 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.719103  9549 raft_consensus.cc:385] T 0713a59b6acd41fb8bd0fe967d25c799 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.719502  9549 raft_consensus.cc:740] T 0713a59b6acd41fb8bd0fe967d25c799 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9432bc2bc50f4f6191d04d53a81ef5cb, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.719213  9548 raft_consensus.cc:359] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.720095  9548 raft_consensus.cc:385] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.720427  9548 raft_consensus.cc:740] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3c90b923d94c9cbf4bf5387960c098, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.720535  9549 consensus_queue.cc:260] T 0713a59b6acd41fb8bd0fe967d25c799 P 9432bc2bc50f4f6191d04d53a81ef5cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.721339  9548 consensus_queue.cc:260] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.723357  9547 tablet_bootstrap.cc:654] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.725745  9549 ts_tablet_manager.cc:1434] T 0713a59b6acd41fb8bd0fe967d25c799 P 9432bc2bc50f4f6191d04d53a81ef5cb: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.007s
I20260709 13:16:41.726435  9548 ts_tablet_manager.cc:1434] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:16:41.729089  9549 tablet_bootstrap.cc:492] T e63322b9b6564a55ac208394981daec8 P 9432bc2bc50f4f6191d04d53a81ef5cb: Bootstrap starting.
I20260709 13:16:41.737011  9547 tablet_bootstrap.cc:492] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204: No bootstrap required, opened a new log
I20260709 13:16:41.737567  9547 ts_tablet_manager.cc:1403] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 13:16:41.737987  9549 tablet_bootstrap.cc:654] T e63322b9b6564a55ac208394981daec8 P 9432bc2bc50f4f6191d04d53a81ef5cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.740363  9547 raft_consensus.cc:359] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.741199  9547 raft_consensus.cc:385] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.741511  9547 raft_consensus.cc:740] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d85f3157220f47a4ae41f7fefd518204, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.742291  9547 consensus_queue.cc:260] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.744010  9549 tablet_bootstrap.cc:492] T e63322b9b6564a55ac208394981daec8 P 9432bc2bc50f4f6191d04d53a81ef5cb: No bootstrap required, opened a new log
I20260709 13:16:41.744652  9549 ts_tablet_manager.cc:1403] T e63322b9b6564a55ac208394981daec8 P 9432bc2bc50f4f6191d04d53a81ef5cb: Time spent bootstrapping tablet: real 0.016s	user 0.004s	sys 0.010s
I20260709 13:16:41.744518  9547 ts_tablet_manager.cc:1434] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:16:41.747861  9549 raft_consensus.cc:359] T e63322b9b6564a55ac208394981daec8 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.748438  9549 raft_consensus.cc:385] T e63322b9b6564a55ac208394981daec8 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.748720  9549 raft_consensus.cc:740] T e63322b9b6564a55ac208394981daec8 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9432bc2bc50f4f6191d04d53a81ef5cb, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.749532  9549 consensus_queue.cc:260] T e63322b9b6564a55ac208394981daec8 P 9432bc2bc50f4f6191d04d53a81ef5cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.751647  9549 ts_tablet_manager.cc:1434] T e63322b9b6564a55ac208394981daec8 P 9432bc2bc50f4f6191d04d53a81ef5cb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:41.756706  9553 raft_consensus.cc:493] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.757280  9553 raft_consensus.cc:515] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.759295  9553 leader_election.cc:290] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3c90b923d94c9cbf4bf5387960c098 (127.31.17.129:44825), 9432bc2bc50f4f6191d04d53a81ef5cb (127.31.17.131:33545)
I20260709 13:16:41.759958  9358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63322b9b6564a55ac208394981daec8" candidate_uuid: "d85f3157220f47a4ae41f7fefd518204" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3c90b923d94c9cbf4bf5387960c098" is_pre_election: true
I20260709 13:16:41.760634  9358 raft_consensus.cc:2468] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d85f3157220f47a4ae41f7fefd518204 in term 0.
I20260709 13:16:41.760978  9553 consensus_queue.cc:1048] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:41.761354  9507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63322b9b6564a55ac208394981daec8" candidate_uuid: "d85f3157220f47a4ae41f7fefd518204" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" is_pre_election: true
I20260709 13:16:41.761853  9399 leader_election.cc:304] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3c90b923d94c9cbf4bf5387960c098, d85f3157220f47a4ae41f7fefd518204; no voters: 
I20260709 13:16:41.762151  9507 raft_consensus.cc:2468] T e63322b9b6564a55ac208394981daec8 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d85f3157220f47a4ae41f7fefd518204 in term 0.
I20260709 13:16:41.762887  9553 raft_consensus.cc:2804] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:41.763280  9553 raft_consensus.cc:493] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.763682  9553 raft_consensus.cc:3060] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.770807  9553 raft_consensus.cc:515] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.773753  9358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63322b9b6564a55ac208394981daec8" candidate_uuid: "d85f3157220f47a4ae41f7fefd518204" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3c90b923d94c9cbf4bf5387960c098"
I20260709 13:16:41.773903  9553 leader_election.cc:290] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [CANDIDATE]: Term 1 election: Requested vote from peers af3c90b923d94c9cbf4bf5387960c098 (127.31.17.129:44825), 9432bc2bc50f4f6191d04d53a81ef5cb (127.31.17.131:33545)
I20260709 13:16:41.774345  9358 raft_consensus.cc:3060] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.777307  9506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63322b9b6564a55ac208394981daec8" candidate_uuid: "d85f3157220f47a4ae41f7fefd518204" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb"
I20260709 13:16:41.777997  9506 raft_consensus.cc:3060] T e63322b9b6564a55ac208394981daec8 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.782835  9358 raft_consensus.cc:2468] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d85f3157220f47a4ae41f7fefd518204 in term 1.
I20260709 13:16:41.784396  9560 consensus_queue.cc:1048] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:41.784566  9399 leader_election.cc:304] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3c90b923d94c9cbf4bf5387960c098, d85f3157220f47a4ae41f7fefd518204; no voters: 
I20260709 13:16:41.785805  9560 raft_consensus.cc:2804] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:41.786276  9560 raft_consensus.cc:697] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 1 LEADER]: Becoming Leader. State: Replica: d85f3157220f47a4ae41f7fefd518204, State: Running, Role: LEADER
I20260709 13:16:41.787083  9560 consensus_queue.cc:237] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.790836  9506 raft_consensus.cc:2468] T e63322b9b6564a55ac208394981daec8 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d85f3157220f47a4ae41f7fefd518204 in term 1.
I20260709 13:16:41.796692  9255 catalog_manager.cc:5697] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 reported cstate change: term changed from 0 to 1, leader changed from <none> to d85f3157220f47a4ae41f7fefd518204 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "d85f3157220f47a4ae41f7fefd518204" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.925549  9554 raft_consensus.cc:493] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.926154  9554 raft_consensus.cc:515] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.928017  9554 leader_election.cc:290] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d85f3157220f47a4ae41f7fefd518204 (127.31.17.130:40311), 9432bc2bc50f4f6191d04d53a81ef5cb (127.31.17.131:33545)
I20260709 13:16:41.928787  9433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0713a59b6acd41fb8bd0fe967d25c799" candidate_uuid: "af3c90b923d94c9cbf4bf5387960c098" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d85f3157220f47a4ae41f7fefd518204" is_pre_election: true
I20260709 13:16:41.929044  9506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0713a59b6acd41fb8bd0fe967d25c799" candidate_uuid: "af3c90b923d94c9cbf4bf5387960c098" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" is_pre_election: true
I20260709 13:16:41.929591  9433 raft_consensus.cc:2468] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3c90b923d94c9cbf4bf5387960c098 in term 0.
I20260709 13:16:41.929730  9506 raft_consensus.cc:2468] T 0713a59b6acd41fb8bd0fe967d25c799 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3c90b923d94c9cbf4bf5387960c098 in term 0.
I20260709 13:16:41.930673  9322 leader_election.cc:304] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3c90b923d94c9cbf4bf5387960c098, d85f3157220f47a4ae41f7fefd518204; no voters: 
I20260709 13:16:41.931422  9554 raft_consensus.cc:2804] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:41.931792  9554 raft_consensus.cc:493] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.932090  9554 raft_consensus.cc:3060] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.937193  9554 raft_consensus.cc:515] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.938755  9554 leader_election.cc:290] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [CANDIDATE]: Term 1 election: Requested vote from peers d85f3157220f47a4ae41f7fefd518204 (127.31.17.130:40311), 9432bc2bc50f4f6191d04d53a81ef5cb (127.31.17.131:33545)
I20260709 13:16:41.939811  9433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0713a59b6acd41fb8bd0fe967d25c799" candidate_uuid: "af3c90b923d94c9cbf4bf5387960c098" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d85f3157220f47a4ae41f7fefd518204"
I20260709 13:16:41.939811  9506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0713a59b6acd41fb8bd0fe967d25c799" candidate_uuid: "af3c90b923d94c9cbf4bf5387960c098" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb"
I20260709 13:16:41.940725  9433 raft_consensus.cc:3060] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.940775  9506 raft_consensus.cc:3060] T 0713a59b6acd41fb8bd0fe967d25c799 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.947907  9433 raft_consensus.cc:2468] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3c90b923d94c9cbf4bf5387960c098 in term 1.
I20260709 13:16:41.947907  9506 raft_consensus.cc:2468] T 0713a59b6acd41fb8bd0fe967d25c799 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3c90b923d94c9cbf4bf5387960c098 in term 1.
I20260709 13:16:41.949347  9322 leader_election.cc:304] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af3c90b923d94c9cbf4bf5387960c098, d85f3157220f47a4ae41f7fefd518204; no voters: 
I20260709 13:16:41.950063  9554 raft_consensus.cc:2804] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:41.950515  9554 raft_consensus.cc:697] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [term 1 LEADER]: Becoming Leader. State: Replica: af3c90b923d94c9cbf4bf5387960c098, State: Running, Role: LEADER
I20260709 13:16:41.951355  9554 consensus_queue.cc:237] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:41.957808  9254 catalog_manager.cc:5697] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 reported cstate change: term changed from 0 to 1, leader changed from <none> to af3c90b923d94c9cbf4bf5387960c098 (127.31.17.129). New cstate: current_term: 1 leader_uuid: "af3c90b923d94c9cbf4bf5387960c098" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.962006  9554 consensus_queue.cc:1048] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:41.974040  9554 consensus_queue.cc:1048] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:42.001431  9433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc8d90f48eba4d77b22ddfe1f3717962"
dest_uuid: "d85f3157220f47a4ae41f7fefd518204"
mode: GRACEFUL
new_leader_uuid: "af3c90b923d94c9cbf4bf5387960c098"
 from {username='slave'} at 127.0.0.1:59602
I20260709 13:16:42.001950  9433 raft_consensus.cc:606] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 1 LEADER]: Received request to transfer leadership to TS af3c90b923d94c9cbf4bf5387960c098
I20260709 13:16:42.017760  9358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f70c216af52b439e93919930d5664ea7"
dest_uuid: "af3c90b923d94c9cbf4bf5387960c098"
mode: GRACEFUL
new_leader_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb"
 from {username='slave'} at 127.0.0.1:34084
I20260709 13:16:42.018636  9358 raft_consensus.cc:606] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 1 LEADER]: Received request to transfer leadership to TS 9432bc2bc50f4f6191d04d53a81ef5cb
I20260709 13:16:42.024781  9433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e63322b9b6564a55ac208394981daec8"
dest_uuid: "d85f3157220f47a4ae41f7fefd518204"
mode: GRACEFUL
new_leader_uuid: "af3c90b923d94c9cbf4bf5387960c098"
 from {username='slave'} at 127.0.0.1:59602
I20260709 13:16:42.025269  9433 raft_consensus.cc:606] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 1 LEADER]: Received request to transfer leadership to TS af3c90b923d94c9cbf4bf5387960c098
I20260709 13:16:42.252562  9553 raft_consensus.cc:993] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204: : Instructing follower af3c90b923d94c9cbf4bf5387960c098 to start an election
I20260709 13:16:42.252676  9580 consensus_queue.cc:1048] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:42.253157  9553 raft_consensus.cc:1081] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 1 LEADER]: Signalling peer af3c90b923d94c9cbf4bf5387960c098 to start an election
I20260709 13:16:42.254892  9358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc8d90f48eba4d77b22ddfe1f3717962"
dest_uuid: "af3c90b923d94c9cbf4bf5387960c098"
 from {username='slave'} at 127.0.0.1:34074
I20260709 13:16:42.255481  9358 raft_consensus.cc:493] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:42.255832  9358 raft_consensus.cc:3060] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:42.262902  9358 raft_consensus.cc:515] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:42.265332  9553 consensus_queue.cc:1048] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:42.265692  9433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8d90f48eba4d77b22ddfe1f3717962" candidate_uuid: "af3c90b923d94c9cbf4bf5387960c098" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d85f3157220f47a4ae41f7fefd518204"
I20260709 13:16:42.265980  9358 leader_election.cc:290] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 [CANDIDATE]: Term 2 election: Requested vote from peers d85f3157220f47a4ae41f7fefd518204 (127.31.17.130:40311), 9432bc2bc50f4f6191d04d53a81ef5cb (127.31.17.131:33545)
I20260709 13:16:42.266295  9433 raft_consensus.cc:3055] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:42.266199  9507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8d90f48eba4d77b22ddfe1f3717962" candidate_uuid: "af3c90b923d94c9cbf4bf5387960c098" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb"
I20260709 13:16:42.266794  9433 raft_consensus.cc:740] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d85f3157220f47a4ae41f7fefd518204, State: Running, Role: LEADER
I20260709 13:16:42.267017  9507 raft_consensus.cc:3060] T bc8d90f48eba4d77b22ddfe1f3717962 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:42.267663  9433 consensus_queue.cc:260] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:42.269277  9433 raft_consensus.cc:3060] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:42.274495  9507 raft_consensus.cc:2468] T bc8d90f48eba4d77b22ddfe1f3717962 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3c90b923d94c9cbf4bf5387960c098 in term 2.
I20260709 13:16:42.276381  9321 leader_election.cc:304] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9432bc2bc50f4f6191d04d53a81ef5cb, af3c90b923d94c9cbf4bf5387960c098; no voters: 
I20260709 13:16:42.277490  9588 raft_consensus.cc:2804] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:42.278148  9588 raft_consensus.cc:697] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 [term 2 LEADER]: Becoming Leader. State: Replica: af3c90b923d94c9cbf4bf5387960c098, State: Running, Role: LEADER
I20260709 13:16:42.279289  9588 consensus_queue.cc:237] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:42.281014  9433 raft_consensus.cc:2468] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3c90b923d94c9cbf4bf5387960c098 in term 2.
I20260709 13:16:42.285432  9560 raft_consensus.cc:993] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204: : Instructing follower af3c90b923d94c9cbf4bf5387960c098 to start an election
I20260709 13:16:42.285892  9560 raft_consensus.cc:1081] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 1 LEADER]: Signalling peer af3c90b923d94c9cbf4bf5387960c098 to start an election
I20260709 13:16:42.287693  9357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e63322b9b6564a55ac208394981daec8"
dest_uuid: "af3c90b923d94c9cbf4bf5387960c098"
 from {username='slave'} at 127.0.0.1:34074
I20260709 13:16:42.288215  9357 raft_consensus.cc:493] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:42.288661  9357 raft_consensus.cc:3060] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:42.294330  9357 raft_consensus.cc:515] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:42.296202  9357 leader_election.cc:290] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 [CANDIDATE]: Term 2 election: Requested vote from peers d85f3157220f47a4ae41f7fefd518204 (127.31.17.130:40311), 9432bc2bc50f4f6191d04d53a81ef5cb (127.31.17.131:33545)
I20260709 13:16:42.297235  9433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63322b9b6564a55ac208394981daec8" candidate_uuid: "af3c90b923d94c9cbf4bf5387960c098" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d85f3157220f47a4ae41f7fefd518204"
I20260709 13:16:42.297331  9507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63322b9b6564a55ac208394981daec8" candidate_uuid: "af3c90b923d94c9cbf4bf5387960c098" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb"
I20260709 13:16:42.298005  9433 raft_consensus.cc:3055] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:42.298127  9507 raft_consensus.cc:3060] T e63322b9b6564a55ac208394981daec8 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:42.298398  9433 raft_consensus.cc:740] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d85f3157220f47a4ae41f7fefd518204, State: Running, Role: LEADER
I20260709 13:16:42.299466  9433 consensus_queue.cc:260] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:42.300823  9433 raft_consensus.cc:3060] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:42.300652  9255 catalog_manager.cc:5697] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 reported cstate change: term changed from 1 to 2, leader changed from d85f3157220f47a4ae41f7fefd518204 (127.31.17.130) to af3c90b923d94c9cbf4bf5387960c098 (127.31.17.129). New cstate: current_term: 2 leader_uuid: "af3c90b923d94c9cbf4bf5387960c098" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:42.306041  9507 raft_consensus.cc:2468] T e63322b9b6564a55ac208394981daec8 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3c90b923d94c9cbf4bf5387960c098 in term 2.
I20260709 13:16:42.307668  9321 leader_election.cc:304] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9432bc2bc50f4f6191d04d53a81ef5cb, af3c90b923d94c9cbf4bf5387960c098; no voters: 
I20260709 13:16:42.308539  9588 raft_consensus.cc:2804] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:42.309044  9588 raft_consensus.cc:697] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 [term 2 LEADER]: Becoming Leader. State: Replica: af3c90b923d94c9cbf4bf5387960c098, State: Running, Role: LEADER
I20260709 13:16:42.309933  9588 consensus_queue.cc:237] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:42.311954  9433 raft_consensus.cc:2468] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3c90b923d94c9cbf4bf5387960c098 in term 2.
I20260709 13:16:42.318118  9254 catalog_manager.cc:5697] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 reported cstate change: term changed from 1 to 2, leader changed from d85f3157220f47a4ae41f7fefd518204 (127.31.17.130) to af3c90b923d94c9cbf4bf5387960c098 (127.31.17.129). New cstate: current_term: 2 leader_uuid: "af3c90b923d94c9cbf4bf5387960c098" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:42.335268  9588 consensus_queue.cc:1048] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:42.347262  9564 consensus_queue.cc:1048] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:42.403782  9588 raft_consensus.cc:993] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098: : Instructing follower 9432bc2bc50f4f6191d04d53a81ef5cb to start an election
I20260709 13:16:42.404456  9564 raft_consensus.cc:1081] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 1 LEADER]: Signalling peer 9432bc2bc50f4f6191d04d53a81ef5cb to start an election
I20260709 13:16:42.406354  9507 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f70c216af52b439e93919930d5664ea7"
dest_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb"
 from {username='slave'} at 127.0.0.1:36432
I20260709 13:16:42.406948  9507 raft_consensus.cc:493] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:42.407366  9507 raft_consensus.cc:3060] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:42.412148  9507 raft_consensus.cc:515] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:42.414168  9507 leader_election.cc:290] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb [CANDIDATE]: Term 2 election: Requested vote from peers af3c90b923d94c9cbf4bf5387960c098 (127.31.17.129:44825), d85f3157220f47a4ae41f7fefd518204 (127.31.17.130:40311)
I20260709 13:16:42.424897  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70c216af52b439e93919930d5664ea7" candidate_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3c90b923d94c9cbf4bf5387960c098"
I20260709 13:16:42.424892  9433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f70c216af52b439e93919930d5664ea7" candidate_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d85f3157220f47a4ae41f7fefd518204"
I20260709 13:16:42.425557  9357 raft_consensus.cc:3055] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:42.425634  9433 raft_consensus.cc:3060] T f70c216af52b439e93919930d5664ea7 P d85f3157220f47a4ae41f7fefd518204 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:42.425889  9357 raft_consensus.cc:740] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3c90b923d94c9cbf4bf5387960c098, State: Running, Role: LEADER
I20260709 13:16:42.426630  9357 consensus_queue.cc:260] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:42.427641  9357 raft_consensus.cc:3060] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:42.431175  9433 raft_consensus.cc:2468] T f70c216af52b439e93919930d5664ea7 P d85f3157220f47a4ae41f7fefd518204 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9432bc2bc50f4f6191d04d53a81ef5cb in term 2.
I20260709 13:16:42.432312  9471 leader_election.cc:304] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9432bc2bc50f4f6191d04d53a81ef5cb, d85f3157220f47a4ae41f7fefd518204; no voters: 
I20260709 13:16:42.432582  9357 raft_consensus.cc:2468] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9432bc2bc50f4f6191d04d53a81ef5cb in term 2.
I20260709 13:16:42.433174  9576 raft_consensus.cc:2804] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:42.434372  9576 raft_consensus.cc:697] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 2 LEADER]: Becoming Leader. State: Replica: 9432bc2bc50f4f6191d04d53a81ef5cb, State: Running, Role: LEADER
I20260709 13:16:42.435176  9576 consensus_queue.cc:237] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:42.441023  9255 catalog_manager.cc:5697] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb reported cstate change: term changed from 1 to 2, leader changed from af3c90b923d94c9cbf4bf5387960c098 (127.31.17.129) to 9432bc2bc50f4f6191d04d53a81ef5cb (127.31.17.131). New cstate: current_term: 2 leader_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:42.474237 31814 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:16:42.475930 31814 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:16:42.476351 31814 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:16:42.488585  9357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0713a59b6acd41fb8bd0fe967d25c799"
dest_uuid: "af3c90b923d94c9cbf4bf5387960c098"
mode: GRACEFUL
new_leader_uuid: "d85f3157220f47a4ae41f7fefd518204"
 from {username='slave'} at 127.0.0.1:34096
I20260709 13:16:42.489181  9357 raft_consensus.cc:606] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [term 1 LEADER]: Received request to transfer leadership to TS d85f3157220f47a4ae41f7fefd518204
I20260709 13:16:42.490397 31814 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:16:42.695065  9507 raft_consensus.cc:1275] T e63322b9b6564a55ac208394981daec8 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 2 FOLLOWER]: Refusing update from remote peer af3c90b923d94c9cbf4bf5387960c098: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:42.695124  9433 raft_consensus.cc:1275] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 2 FOLLOWER]: Refusing update from remote peer af3c90b923d94c9cbf4bf5387960c098: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:42.696748  9588 consensus_queue.cc:1048] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:42.696879  9564 consensus_queue.cc:1048] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:42.708441  9507 raft_consensus.cc:1275] T bc8d90f48eba4d77b22ddfe1f3717962 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 2 FOLLOWER]: Refusing update from remote peer af3c90b923d94c9cbf4bf5387960c098: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:42.710521  9554 consensus_queue.cc:1048] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:42.712123  9433 raft_consensus.cc:1275] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 2 FOLLOWER]: Refusing update from remote peer af3c90b923d94c9cbf4bf5387960c098: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:42.713672  9554 consensus_queue.cc:1048] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:42.841188  9357 raft_consensus.cc:1275] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 2 FOLLOWER]: Refusing update from remote peer 9432bc2bc50f4f6191d04d53a81ef5cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:42.842813  9598 consensus_queue.cc:1048] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:42.851454  9432 raft_consensus.cc:1275] T f70c216af52b439e93919930d5664ea7 P d85f3157220f47a4ae41f7fefd518204 [term 2 FOLLOWER]: Refusing update from remote peer 9432bc2bc50f4f6191d04d53a81ef5cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:42.854508  9600 consensus_queue.cc:1048] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:42.966600  9564 raft_consensus.cc:993] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098: : Instructing follower d85f3157220f47a4ae41f7fefd518204 to start an election
I20260709 13:16:42.967142  9554 raft_consensus.cc:1081] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [term 1 LEADER]: Signalling peer d85f3157220f47a4ae41f7fefd518204 to start an election
I20260709 13:16:42.968739  9432 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0713a59b6acd41fb8bd0fe967d25c799"
dest_uuid: "d85f3157220f47a4ae41f7fefd518204"
 from {username='slave'} at 127.0.0.1:59590
I20260709 13:16:42.969285  9432 raft_consensus.cc:493] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:42.969559  9432 raft_consensus.cc:3060] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:42.975082  9432 raft_consensus.cc:515] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:42.976987  9432 leader_election.cc:290] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204 [CANDIDATE]: Term 2 election: Requested vote from peers af3c90b923d94c9cbf4bf5387960c098 (127.31.17.129:44825), 9432bc2bc50f4f6191d04d53a81ef5cb (127.31.17.131:33545)
I20260709 13:16:42.978055  9506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0713a59b6acd41fb8bd0fe967d25c799" candidate_uuid: "d85f3157220f47a4ae41f7fefd518204" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb"
I20260709 13:16:42.978050  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0713a59b6acd41fb8bd0fe967d25c799" candidate_uuid: "d85f3157220f47a4ae41f7fefd518204" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af3c90b923d94c9cbf4bf5387960c098"
I20260709 13:16:42.978708  9506 raft_consensus.cc:3060] T 0713a59b6acd41fb8bd0fe967d25c799 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:42.978863  9357 raft_consensus.cc:3055] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:42.979319  9357 raft_consensus.cc:740] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af3c90b923d94c9cbf4bf5387960c098, State: Running, Role: LEADER
I20260709 13:16:42.980031  9357 consensus_queue.cc:260] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:42.980973  9357 raft_consensus.cc:3060] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:42.984068  9506 raft_consensus.cc:2468] T 0713a59b6acd41fb8bd0fe967d25c799 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d85f3157220f47a4ae41f7fefd518204 in term 2.
I20260709 13:16:42.985292  9396 leader_election.cc:304] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9432bc2bc50f4f6191d04d53a81ef5cb, d85f3157220f47a4ae41f7fefd518204; no voters: 
I20260709 13:16:42.986078  9553 raft_consensus.cc:2804] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:42.986609  9553 raft_consensus.cc:697] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204 [term 2 LEADER]: Becoming Leader. State: Replica: d85f3157220f47a4ae41f7fefd518204, State: Running, Role: LEADER
I20260709 13:16:42.987421  9553 consensus_queue.cc:237] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } }
I20260709 13:16:42.988517  9357 raft_consensus.cc:2468] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d85f3157220f47a4ae41f7fefd518204 in term 2.
I20260709 13:16:42.993877  9255 catalog_manager.cc:5697] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204 reported cstate change: term changed from 1 to 2, leader changed from af3c90b923d94c9cbf4bf5387960c098 (127.31.17.129) to d85f3157220f47a4ae41f7fefd518204 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "d85f3157220f47a4ae41f7fefd518204" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3c90b923d94c9cbf4bf5387960c098" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 44825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d85f3157220f47a4ae41f7fefd518204" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 40311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9432bc2bc50f4f6191d04d53a81ef5cb" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 33545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:43.113232 31814 tablet_server.cc:179] TabletServer@127.31.17.129:0 shutting down...
I20260709 13:16:43.137270 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:43.137917 31814 tablet_replica.cc:333] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098: stopping tablet replica
I20260709 13:16:43.138475 31814 raft_consensus.cc:2243] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:43.139370 31814 raft_consensus.cc:2272] T e63322b9b6564a55ac208394981daec8 P af3c90b923d94c9cbf4bf5387960c098 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:43.141528 31814 tablet_replica.cc:333] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098: stopping tablet replica
I20260709 13:16:43.142084 31814 raft_consensus.cc:2243] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:43.142887 31814 raft_consensus.cc:2272] T bc8d90f48eba4d77b22ddfe1f3717962 P af3c90b923d94c9cbf4bf5387960c098 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:43.145539 31814 tablet_replica.cc:333] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098: stopping tablet replica
I20260709 13:16:43.146060 31814 raft_consensus.cc:2243] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:43.146443 31814 raft_consensus.cc:2272] T 0713a59b6acd41fb8bd0fe967d25c799 P af3c90b923d94c9cbf4bf5387960c098 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:43.148463 31814 tablet_replica.cc:333] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098: stopping tablet replica
I20260709 13:16:43.148941 31814 raft_consensus.cc:2243] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:43.149351 31814 raft_consensus.cc:2272] T f70c216af52b439e93919930d5664ea7 P af3c90b923d94c9cbf4bf5387960c098 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:43.162205 31814 tablet_server.cc:196] TabletServer@127.31.17.129:0 shutdown complete.
I20260709 13:16:43.173894 31814 tablet_server.cc:179] TabletServer@127.31.17.130:0 shutting down...
I20260709 13:16:43.192224 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:43.192883 31814 tablet_replica.cc:333] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204: stopping tablet replica
I20260709 13:16:43.193609 31814 raft_consensus.cc:2243] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:43.194125 31814 raft_consensus.cc:2272] T e63322b9b6564a55ac208394981daec8 P d85f3157220f47a4ae41f7fefd518204 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:43.196890 31814 tablet_replica.cc:333] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204: stopping tablet replica
I20260709 13:16:43.197408 31814 raft_consensus.cc:2243] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:43.197932 31814 raft_consensus.cc:2272] T bc8d90f48eba4d77b22ddfe1f3717962 P d85f3157220f47a4ae41f7fefd518204 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:43.200548 31814 tablet_replica.cc:333] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204: stopping tablet replica
I20260709 13:16:43.201169 31814 raft_consensus.cc:2243] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:43.201763 31814 pending_rounds.cc:70] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204: Trying to abort 1 pending ops.
I20260709 13:16:43.201920 31814 pending_rounds.cc:77] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305637900245807104 op_type: NO_OP noop_request { }
I20260709 13:16:43.202232 31814 raft_consensus.cc:2889] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:43.202553 31814 raft_consensus.cc:2272] T 0713a59b6acd41fb8bd0fe967d25c799 P d85f3157220f47a4ae41f7fefd518204 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:43.204933 31814 tablet_replica.cc:333] T f70c216af52b439e93919930d5664ea7 P d85f3157220f47a4ae41f7fefd518204: stopping tablet replica
I20260709 13:16:43.205430 31814 raft_consensus.cc:2243] T f70c216af52b439e93919930d5664ea7 P d85f3157220f47a4ae41f7fefd518204 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:43.205852 31814 raft_consensus.cc:2272] T f70c216af52b439e93919930d5664ea7 P d85f3157220f47a4ae41f7fefd518204 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:43.229027 31814 tablet_server.cc:196] TabletServer@127.31.17.130:0 shutdown complete.
I20260709 13:16:43.240754 31814 tablet_server.cc:179] TabletServer@127.31.17.131:0 shutting down...
I20260709 13:16:43.258464 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:43.259105 31814 tablet_replica.cc:333] T e63322b9b6564a55ac208394981daec8 P 9432bc2bc50f4f6191d04d53a81ef5cb: stopping tablet replica
I20260709 13:16:43.259660 31814 raft_consensus.cc:2243] T e63322b9b6564a55ac208394981daec8 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:43.260069 31814 raft_consensus.cc:2272] T e63322b9b6564a55ac208394981daec8 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:43.262130 31814 tablet_replica.cc:333] T 0713a59b6acd41fb8bd0fe967d25c799 P 9432bc2bc50f4f6191d04d53a81ef5cb: stopping tablet replica
I20260709 13:16:43.262583 31814 raft_consensus.cc:2243] T 0713a59b6acd41fb8bd0fe967d25c799 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:43.262925 31814 raft_consensus.cc:2272] T 0713a59b6acd41fb8bd0fe967d25c799 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:43.265422 31814 tablet_replica.cc:333] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb: stopping tablet replica
I20260709 13:16:43.265865 31814 raft_consensus.cc:2243] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:43.266580 31814 raft_consensus.cc:2272] T f70c216af52b439e93919930d5664ea7 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:43.268916 31814 tablet_replica.cc:333] T bc8d90f48eba4d77b22ddfe1f3717962 P 9432bc2bc50f4f6191d04d53a81ef5cb: stopping tablet replica
I20260709 13:16:43.269402 31814 raft_consensus.cc:2243] T bc8d90f48eba4d77b22ddfe1f3717962 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:43.269831 31814 raft_consensus.cc:2272] T bc8d90f48eba4d77b22ddfe1f3717962 P 9432bc2bc50f4f6191d04d53a81ef5cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:43.281898 31814 tablet_server.cc:196] TabletServer@127.31.17.131:0 shutdown complete.
I20260709 13:16:43.293104 31814 master.cc:562] Master@127.31.17.190:44879 shutting down...
I20260709 13:16:43.308060 31814 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:43.308621 31814 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:43.308952 31814 tablet_replica.cc:333] T 00000000000000000000000000000000 P ffba9d71439e411ab2028c177704dc6e: stopping tablet replica
I20260709 13:16:43.319994 31814 master.cc:584] Master@127.31.17.190:44879 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2857 ms)
[----------] 6 tests from LeaderRebalancerTest (289691 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:16:43.348526 31814 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.31.17.190:44309
I20260709 13:16:43.349606 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:43.354532  9604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:43.354815  9605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:43.355697  9607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:43.357020 31814 server_base.cc:1061] running on GCE node
I20260709 13:16:43.357790 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:43.357954 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:43.358070 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783603003358059 us; error 0 us; skew 500 ppm
I20260709 13:16:43.358587 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:43.361146 31814 webserver.cc:533] Webserver started at http://127.31.17.190:43595/ using document root <none> and password file <none>
I20260709 13:16:43.361634 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:43.361825 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:43.362110 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:43.363160 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/master-0-root/instance:
uuid: "79aa53e96e60468d87d11cafa7229bbf"
format_stamp: "Formatted at 2026-07-09 13:16:43 on dist-test-slave-zhw8"
I20260709 13:16:43.367914 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:16:43.371628  9612 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:43.372417 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 13:16:43.372725 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/master-0-root
uuid: "79aa53e96e60468d87d11cafa7229bbf"
format_stamp: "Formatted at 2026-07-09 13:16:43 on dist-test-slave-zhw8"
I20260709 13:16:43.373037 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:43.388557 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:43.389581 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:43.425418 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.190:44309
I20260709 13:16:43.425547  9663 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.190:44309 every 8 connection(s)
I20260709 13:16:43.429356  9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.440148  9664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf: Bootstrap starting.
I20260709 13:16:43.444597  9664 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.448557  9664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf: No bootstrap required, opened a new log
I20260709 13:16:43.450577  9664 raft_consensus.cc:359] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79aa53e96e60468d87d11cafa7229bbf" member_type: VOTER }
I20260709 13:16:43.450937  9664 raft_consensus.cc:385] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.451120  9664 raft_consensus.cc:740] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79aa53e96e60468d87d11cafa7229bbf, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.451697  9664 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79aa53e96e60468d87d11cafa7229bbf" member_type: VOTER }
I20260709 13:16:43.452162  9664 raft_consensus.cc:399] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:43.452359  9664 raft_consensus.cc:493] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:43.452575  9664 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.457175  9664 raft_consensus.cc:515] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79aa53e96e60468d87d11cafa7229bbf" member_type: VOTER }
I20260709 13:16:43.457614  9664 leader_election.cc:304] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79aa53e96e60468d87d11cafa7229bbf; no voters: 
I20260709 13:16:43.458652  9664 leader_election.cc:290] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:43.459082  9667 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:43.460559  9667 raft_consensus.cc:697] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [term 1 LEADER]: Becoming Leader. State: Replica: 79aa53e96e60468d87d11cafa7229bbf, State: Running, Role: LEADER
I20260709 13:16:43.461252  9667 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79aa53e96e60468d87d11cafa7229bbf" member_type: VOTER }
I20260709 13:16:43.461664  9664 sys_catalog.cc:565] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:43.463966  9668 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79aa53e96e60468d87d11cafa7229bbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79aa53e96e60468d87d11cafa7229bbf" member_type: VOTER } }
I20260709 13:16:43.463948  9669 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79aa53e96e60468d87d11cafa7229bbf. Latest consensus state: current_term: 1 leader_uuid: "79aa53e96e60468d87d11cafa7229bbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79aa53e96e60468d87d11cafa7229bbf" member_type: VOTER } }
I20260709 13:16:43.464744  9668 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:43.464818  9669 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:43.468544  9672 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:43.473120  9672 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:43.478247 31814 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:43.482013  9672 catalog_manager.cc:1383] Generated new cluster ID: 7e322f70d9814d718758b8d80a299334
I20260709 13:16:43.482312  9672 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:43.516324  9672 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:43.517760  9672 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:43.534874  9672 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf: Generated new TSK 0
I20260709 13:16:43.535547  9672 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:43.545607 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:43.551839  9685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:43.553236  9686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:43.554543  9688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:43.556495 31814 server_base.cc:1061] running on GCE node
I20260709 13:16:43.557359 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:43.557565 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:43.557747 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783603003557733 us; error 0 us; skew 500 ppm
I20260709 13:16:43.558331 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:43.560783 31814 webserver.cc:533] Webserver started at http://127.31.17.129:41485/ using document root <none> and password file <none>
I20260709 13:16:43.561285 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:43.561480 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:43.561756 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:43.562896 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/ts-0-root/instance:
uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
format_stamp: "Formatted at 2026-07-09 13:16:43 on dist-test-slave-zhw8"
I20260709 13:16:43.567327 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:16:43.570606  9693 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:43.571439 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:16:43.571785 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/ts-0-root
uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
format_stamp: "Formatted at 2026-07-09 13:16:43 on dist-test-slave-zhw8"
I20260709 13:16:43.572094 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:43.596062 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:43.597214 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:43.598628 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:43.600857 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:43.601091 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:43.601333 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:43.601509 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:43.641384 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.129:33057
I20260709 13:16:43.641510  9755 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.129:33057 every 8 connection(s)
I20260709 13:16:43.646092 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:43.654031  9760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:43.655228  9761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:43.657019  9763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:43.657855 31814 server_base.cc:1061] running on GCE node
I20260709 13:16:43.659809 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:16:43.659869  9756 heartbeater.cc:344] Connected to a master server at 127.31.17.190:44309
W20260709 13:16:43.660121 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:43.660348  9756 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:43.660352 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783603003660330 us; error 0 us; skew 500 ppm
I20260709 13:16:43.661326 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:43.661442  9756 heartbeater.cc:507] Master 127.31.17.190:44309 requested a full tablet report, sending...
I20260709 13:16:43.664146  9629 ts_manager.cc:194] Registered new tserver with Master: 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057)
I20260709 13:16:43.664325 31814 webserver.cc:533] Webserver started at http://127.31.17.130:37967/ using document root <none> and password file <none>
I20260709 13:16:43.664939 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:43.665132 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:43.665405 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:43.666317  9629 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58438
I20260709 13:16:43.666456 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/ts-1-root/instance:
uuid: "782dc79175bb4562959a3d56d258e31b"
format_stamp: "Formatted at 2026-07-09 13:16:43 on dist-test-slave-zhw8"
I20260709 13:16:43.671191 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:16:43.674751  9768 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:43.675541 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:16:43.675844 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/ts-1-root
uuid: "782dc79175bb4562959a3d56d258e31b"
format_stamp: "Formatted at 2026-07-09 13:16:43 on dist-test-slave-zhw8"
I20260709 13:16:43.676168 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:43.699414 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:43.700519 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:43.701951 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:43.704260 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:43.704540 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:43.704922 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:43.705171 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:43.745282 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.130:45193
I20260709 13:16:43.745381  9830 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.130:45193 every 8 connection(s)
I20260709 13:16:43.750080 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:43.756516  9834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:43.759377  9835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:43.760958 31814 server_base.cc:1061] running on GCE node
W20260709 13:16:43.761740  9838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:43.762472  9831 heartbeater.cc:344] Connected to a master server at 127.31.17.190:44309
I20260709 13:16:43.762746 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:16:43.762856  9831 heartbeater.cc:461] Registering TS with master...
W20260709 13:16:43.763207 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:43.763453 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783603003763440 us; error 0 us; skew 500 ppm
I20260709 13:16:43.763829  9831 heartbeater.cc:507] Master 127.31.17.190:44309 requested a full tablet report, sending...
I20260709 13:16:43.763974 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:43.766095  9629 ts_manager.cc:194] Registered new tserver with Master: 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:43.766678 31814 webserver.cc:533] Webserver started at http://127.31.17.131:40151/ using document root <none> and password file <none>
I20260709 13:16:43.767280 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:43.767481 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:43.767549  9629 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58454
I20260709 13:16:43.767694 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:43.769158 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/ts-2-root/instance:
uuid: "7a3efe533142484099843a45430e835e"
format_stamp: "Formatted at 2026-07-09 13:16:43 on dist-test-slave-zhw8"
I20260709 13:16:43.774081 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:16:43.778178  9842 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:43.779088 31814 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:16:43.779458 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/ts-2-root
uuid: "7a3efe533142484099843a45430e835e"
format_stamp: "Formatted at 2026-07-09 13:16:43 on dist-test-slave-zhw8"
I20260709 13:16:43.779707 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602713491408-31814-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:43.791060 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:43.792133 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:43.793483 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:43.795796 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:43.795984 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:43.796276 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:43.796433 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:43.836401 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.131:35267
I20260709 13:16:43.836515  9904 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.131:35267 every 8 connection(s)
I20260709 13:16:43.850169  9905 heartbeater.cc:344] Connected to a master server at 127.31.17.190:44309
I20260709 13:16:43.850620  9905 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:43.851423  9905 heartbeater.cc:507] Master 127.31.17.190:44309 requested a full tablet report, sending...
I20260709 13:16:43.853312  9629 ts_manager.cc:194] Registered new tserver with Master: 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:43.853531 31814 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01402611s
I20260709 13:16:43.854717  9629 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58468
I20260709 13:16:43.880653  9629 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58476:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:43.883370  9629 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:43.950634  9721 tablet_service.cc:1511] Processing CreateTablet for tablet 04ad5f6dd66f44c3a0f495033d4b5784 (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:43.952392  9721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04ad5f6dd66f44c3a0f495033d4b5784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.956067  9720 tablet_service.cc:1511] Processing CreateTablet for tablet 1e7160b2d69c4a57b46af60fc5ceea5a (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:43.957489  9720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e7160b2d69c4a57b46af60fc5ceea5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.960325  9719 tablet_service.cc:1511] Processing CreateTablet for tablet 8d64d963832242a686386ac5d061005c (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:43.961740  9719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d64d963832242a686386ac5d061005c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.962141  9870 tablet_service.cc:1511] Processing CreateTablet for tablet 04ad5f6dd66f44c3a0f495033d4b5784 (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:43.963471  9870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04ad5f6dd66f44c3a0f495033d4b5784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.966759  9869 tablet_service.cc:1511] Processing CreateTablet for tablet 1e7160b2d69c4a57b46af60fc5ceea5a (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:43.969465  9868 tablet_service.cc:1511] Processing CreateTablet for tablet 8d64d963832242a686386ac5d061005c (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:43.968128  9869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e7160b2d69c4a57b46af60fc5ceea5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.972853  9868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d64d963832242a686386ac5d061005c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.983853  9796 tablet_service.cc:1511] Processing CreateTablet for tablet 04ad5f6dd66f44c3a0f495033d4b5784 (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:43.985288  9796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04ad5f6dd66f44c3a0f495033d4b5784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.988106  9920 tablet_bootstrap.cc:492] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc: Bootstrap starting.
I20260709 13:16:43.988344  9795 tablet_service.cc:1511] Processing CreateTablet for tablet 1e7160b2d69c4a57b46af60fc5ceea5a (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:43.989739  9795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e7160b2d69c4a57b46af60fc5ceea5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.992383  9794 tablet_service.cc:1511] Processing CreateTablet for tablet 8d64d963832242a686386ac5d061005c (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:43.993844  9794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d64d963832242a686386ac5d061005c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.994434  9920 tablet_bootstrap.cc:654] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.998067  9721 tablet_service.cc:1511] Processing CreateTablet for tablet c397e1036163454a8d0adf7fa989ebd7 (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:43.999454  9721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c397e1036163454a8d0adf7fa989ebd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.999934  9793 tablet_service.cc:1511] Processing CreateTablet for tablet c397e1036163454a8d0adf7fa989ebd7 (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:44.001243  9793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c397e1036163454a8d0adf7fa989ebd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.002066  9867 tablet_service.cc:1511] Processing CreateTablet for tablet c397e1036163454a8d0adf7fa989ebd7 (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:44.004733  9867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c397e1036163454a8d0adf7fa989ebd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.005306  9792 tablet_service.cc:1511] Processing CreateTablet for tablet 386daa82c32e4e47a1651d86e52acbf6 (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:44.006784  9792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 386daa82c32e4e47a1651d86e52acbf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.009900  9866 tablet_service.cc:1511] Processing CreateTablet for tablet 386daa82c32e4e47a1651d86e52acbf6 (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:44.011885  9866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 386daa82c32e4e47a1651d86e52acbf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.012881  9718 tablet_service.cc:1511] Processing CreateTablet for tablet 7f0058e1974a4f0db28945445d791d06 (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:44.014266  9718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f0058e1974a4f0db28945445d791d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.020814  9720 tablet_service.cc:1511] Processing CreateTablet for tablet 386daa82c32e4e47a1651d86e52acbf6 (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:44.038142  9720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 386daa82c32e4e47a1651d86e52acbf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.038283  9717 tablet_service.cc:1511] Processing CreateTablet for tablet cf8def47942243549659fe26a543f6ab (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:44.040099  9717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf8def47942243549659fe26a543f6ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.022595  9791 tablet_service.cc:1511] Processing CreateTablet for tablet 7f0058e1974a4f0db28945445d791d06 (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:44.044752  9791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f0058e1974a4f0db28945445d791d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.024894  9868 tablet_service.cc:1511] Processing CreateTablet for tablet 7f0058e1974a4f0db28945445d791d06 (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:44.048134  9868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f0058e1974a4f0db28945445d791d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.051571  9716 tablet_service.cc:1511] Processing CreateTablet for tablet 9f8f95e2da4249f48fd41d41810ce4de (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:44.052911  9716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8f95e2da4249f48fd41d41810ce4de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.056293  9789 tablet_service.cc:1511] Processing CreateTablet for tablet cf8def47942243549659fe26a543f6ab (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:44.057641  9789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf8def47942243549659fe26a543f6ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.064823  9788 tablet_service.cc:1511] Processing CreateTablet for tablet 9f8f95e2da4249f48fd41d41810ce4de (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:44.066231  9788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8f95e2da4249f48fd41d41810ce4de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.032838  9920 tablet_bootstrap.cc:492] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc: No bootstrap required, opened a new log
I20260709 13:16:44.035424  9790 tablet_service.cc:1511] Processing CreateTablet for tablet e0b87e57485846eb82bd1400340857d1 (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:44.067098  9867 tablet_service.cc:1511] Processing CreateTablet for tablet 9f8f95e2da4249f48fd41d41810ce4de (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:44.068140  9790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b87e57485846eb82bd1400340857d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.036749  9870 tablet_service.cc:1511] Processing CreateTablet for tablet e0b87e57485846eb82bd1400340857d1 (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:44.068449  9867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8f95e2da4249f48fd41d41810ce4de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.063123  9866 tablet_service.cc:1511] Processing CreateTablet for tablet cf8def47942243549659fe26a543f6ab (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:44.073320  9870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b87e57485846eb82bd1400340857d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.074316  9866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf8def47942243549659fe26a543f6ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.083446  9920 ts_tablet_manager.cc:1403] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent bootstrapping tablet: real 0.096s	user 0.017s	sys 0.000s
I20260709 13:16:44.086557  9920 raft_consensus.cc:359] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } }
I20260709 13:16:44.111414  9920 raft_consensus.cc:385] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.111786  9920 raft_consensus.cc:740] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.112696  9920 consensus_queue.cc:260] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } }
I20260709 13:16:44.038334  9721 tablet_service.cc:1511] Processing CreateTablet for tablet e0b87e57485846eb82bd1400340857d1 (DEFAULT_TABLE table=test-workload [id=8fcba380bc344083b8378a404231f878]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:44.114594  9721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b87e57485846eb82bd1400340857d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.115537  9921 tablet_bootstrap.cc:492] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e: Bootstrap starting.
I20260709 13:16:44.126361  9923 tablet_bootstrap.cc:492] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b: Bootstrap starting.
I20260709 13:16:44.133131  9923 tablet_bootstrap.cc:654] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.133824  9921 tablet_bootstrap.cc:654] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.138427  9756 heartbeater.cc:499] Master 127.31.17.190:44309 was elected leader, sending a full tablet report...
I20260709 13:16:44.141849  9920 ts_tablet_manager.cc:1434] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent starting tablet: real 0.058s	user 0.002s	sys 0.007s
I20260709 13:16:44.143126  9920 tablet_bootstrap.cc:492] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc: Bootstrap starting.
I20260709 13:16:44.160619  9921 tablet_bootstrap.cc:492] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e: No bootstrap required, opened a new log
I20260709 13:16:44.161293  9921 ts_tablet_manager.cc:1403] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.004s
I20260709 13:16:44.165695  9923 tablet_bootstrap.cc:492] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b: No bootstrap required, opened a new log
I20260709 13:16:44.166353  9923 ts_tablet_manager.cc:1403] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.015s
I20260709 13:16:44.166961  9920 tablet_bootstrap.cc:654] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.168848  9921 raft_consensus.cc:359] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.169514  9921 raft_consensus.cc:385] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.169212  9923 raft_consensus.cc:359] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.169862  9921 raft_consensus.cc:740] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.170204  9923 raft_consensus.cc:385] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.170694  9923 raft_consensus.cc:740] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.170734  9921 consensus_queue.cc:260] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.171664  9923 consensus_queue.cc:260] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.172230  9920 tablet_bootstrap.cc:492] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc: No bootstrap required, opened a new log
I20260709 13:16:44.172861  9920 ts_tablet_manager.cc:1403] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.000s
I20260709 13:16:44.176322  9920 raft_consensus.cc:359] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.177205  9920 raft_consensus.cc:385] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.177536  9920 raft_consensus.cc:740] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.179189  9920 consensus_queue.cc:260] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.180289  9905 heartbeater.cc:499] Master 127.31.17.190:44309 was elected leader, sending a full tablet report...
I20260709 13:16:44.180857  9921 ts_tablet_manager.cc:1434] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.003s
I20260709 13:16:44.181675  9920 ts_tablet_manager.cc:1434] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:44.181953  9921 tablet_bootstrap.cc:492] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e: Bootstrap starting.
I20260709 13:16:44.182782  9920 tablet_bootstrap.cc:492] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc: Bootstrap starting.
I20260709 13:16:44.189237  9920 tablet_bootstrap.cc:654] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.189427  9921 tablet_bootstrap.cc:654] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.192212  9831 heartbeater.cc:499] Master 127.31.17.190:44309 was elected leader, sending a full tablet report...
I20260709 13:16:44.192772  9923 ts_tablet_manager.cc:1434] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.010s
I20260709 13:16:44.194262  9923 tablet_bootstrap.cc:492] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b: Bootstrap starting.
I20260709 13:16:44.203078  9923 tablet_bootstrap.cc:654] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.206081  9920 tablet_bootstrap.cc:492] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc: No bootstrap required, opened a new log
I20260709 13:16:44.207123  9920 ts_tablet_manager.cc:1403] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.007s
I20260709 13:16:44.211153  9920 raft_consensus.cc:359] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.212412  9920 raft_consensus.cc:385] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.212945  9920 raft_consensus.cc:740] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.214318  9920 consensus_queue.cc:260] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.217093  9920 ts_tablet_manager.cc:1434] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:16:44.222429  9929 raft_consensus.cc:493] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.223274  9929 raft_consensus.cc:515] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.229571  9920 tablet_bootstrap.cc:492] T 386daa82c32e4e47a1651d86e52acbf6 P 4f0d10ddf86a4ab496486edd77d06dbc: Bootstrap starting.
I20260709 13:16:44.243219  9929 leader_election.cc:290] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:44.261858  9921 tablet_bootstrap.cc:492] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e: No bootstrap required, opened a new log
I20260709 13:16:44.262480  9921 ts_tablet_manager.cc:1403] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e: Time spent bootstrapping tablet: real 0.081s	user 0.031s	sys 0.039s
I20260709 13:16:44.265300  9921 raft_consensus.cc:359] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } }
I20260709 13:16:44.265852  9920 tablet_bootstrap.cc:654] T 386daa82c32e4e47a1651d86e52acbf6 P 4f0d10ddf86a4ab496486edd77d06dbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.266083  9921 raft_consensus.cc:385] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.268256  9921 raft_consensus.cc:740] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.269071  9921 consensus_queue.cc:260] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } }
I20260709 13:16:44.271256  9921 ts_tablet_manager.cc:1434] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:16:44.272367  9921 tablet_bootstrap.cc:492] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e: Bootstrap starting.
I20260709 13:16:44.276154  9923 tablet_bootstrap.cc:492] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b: No bootstrap required, opened a new log
I20260709 13:16:44.276939  9923 ts_tablet_manager.cc:1403] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b: Time spent bootstrapping tablet: real 0.083s	user 0.019s	sys 0.002s
I20260709 13:16:44.278843  9921 tablet_bootstrap.cc:654] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.279497  9920 tablet_bootstrap.cc:492] T 386daa82c32e4e47a1651d86e52acbf6 P 4f0d10ddf86a4ab496486edd77d06dbc: No bootstrap required, opened a new log
I20260709 13:16:44.280189  9920 ts_tablet_manager.cc:1403] T 386daa82c32e4e47a1651d86e52acbf6 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.012s
I20260709 13:16:44.278069  9928 raft_consensus.cc:493] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.281116  9928 raft_consensus.cc:515] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.283423  9920 raft_consensus.cc:359] T 386daa82c32e4e47a1651d86e52acbf6 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.284510  9920 raft_consensus.cc:385] T 386daa82c32e4e47a1651d86e52acbf6 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.284955  9920 raft_consensus.cc:740] T 386daa82c32e4e47a1651d86e52acbf6 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.288558  9928 leader_election.cc:290] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:44.293576  9921 tablet_bootstrap.cc:492] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e: No bootstrap required, opened a new log
I20260709 13:16:44.294149  9921 ts_tablet_manager.cc:1403] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 13:16:44.295675  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8f95e2da4249f48fd41d41810ce4de" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:44.297041  9730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7160b2d69c4a57b46af60fc5ceea5a" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:44.297140  9921 raft_consensus.cc:359] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.297953  9921 raft_consensus.cc:385] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.297899  9730 raft_consensus.cc:2468] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 0.
I20260709 13:16:44.298761  9921 raft_consensus.cc:740] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.299479  9846 leader_election.cc:304] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 
W20260709 13:16:44.298755  9772 leader_election.cc:343] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.299547  9920 consensus_queue.cc:260] T 386daa82c32e4e47a1651d86e52acbf6 P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.299978  9921 consensus_queue.cc:260] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.300660  9928 raft_consensus.cc:2804] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:44.301251  9928 raft_consensus.cc:493] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.301623  9928 raft_consensus.cc:3060] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.303604  9880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8f95e2da4249f48fd41d41810ce4de" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e" is_pre_election: true
W20260709 13:16:44.305341  9772 leader_election.cc:343] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a3efe533142484099843a45430e835e (127.31.17.131:35267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.305845  9772 leader_election.cc:304] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 782dc79175bb4562959a3d56d258e31b; no voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e
I20260709 13:16:44.307432  9929 raft_consensus.cc:2749] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.281072  9923 raft_consensus.cc:359] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.308844  9923 raft_consensus.cc:385] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.309073  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7160b2d69c4a57b46af60fc5ceea5a" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b" is_pre_election: true
I20260709 13:16:44.309267  9923 raft_consensus.cc:740] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.309378  9928 raft_consensus.cc:515] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.310447  9920 ts_tablet_manager.cc:1434] T 386daa82c32e4e47a1651d86e52acbf6 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.004s
I20260709 13:16:44.310340  9923 consensus_queue.cc:260] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
W20260709 13:16:44.310942  9843 leader_election.cc:343] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.312588  9730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7160b2d69c4a57b46af60fc5ceea5a" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:44.313369  9730 raft_consensus.cc:3060] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.313544  9923 ts_tablet_manager.cc:1434] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.003s
I20260709 13:16:44.314695  9923 tablet_bootstrap.cc:492] T c397e1036163454a8d0adf7fa989ebd7 P 782dc79175bb4562959a3d56d258e31b: Bootstrap starting.
I20260709 13:16:44.315708  9928 leader_election.cc:290] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:44.320714  9923 tablet_bootstrap.cc:654] T c397e1036163454a8d0adf7fa989ebd7 P 782dc79175bb4562959a3d56d258e31b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.328689  9923 tablet_bootstrap.cc:492] T c397e1036163454a8d0adf7fa989ebd7 P 782dc79175bb4562959a3d56d258e31b: No bootstrap required, opened a new log
I20260709 13:16:44.328961  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7160b2d69c4a57b46af60fc5ceea5a" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:44.329310  9923 ts_tablet_manager.cc:1403] T c397e1036163454a8d0adf7fa989ebd7 P 782dc79175bb4562959a3d56d258e31b: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.007s
W20260709 13:16:44.331601  9843 leader_election.cc:343] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.332584  9923 raft_consensus.cc:359] T c397e1036163454a8d0adf7fa989ebd7 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.333101  9730 raft_consensus.cc:2468] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 1.
I20260709 13:16:44.333539  9923 raft_consensus.cc:385] T c397e1036163454a8d0adf7fa989ebd7 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.333997  9923 raft_consensus.cc:740] T c397e1036163454a8d0adf7fa989ebd7 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.334846  9923 consensus_queue.cc:260] T c397e1036163454a8d0adf7fa989ebd7 P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.335417  9920 tablet_bootstrap.cc:492] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc: Bootstrap starting.
I20260709 13:16:44.335006  9846 leader_election.cc:304] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 782dc79175bb4562959a3d56d258e31b
I20260709 13:16:44.336269  9928 raft_consensus.cc:2804] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:44.336902  9928 raft_consensus.cc:697] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Becoming Leader. State: Replica: 7a3efe533142484099843a45430e835e, State: Running, Role: LEADER
I20260709 13:16:44.337481  9923 ts_tablet_manager.cc:1434] T c397e1036163454a8d0adf7fa989ebd7 P 782dc79175bb4562959a3d56d258e31b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:44.338553  9923 tablet_bootstrap.cc:492] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b: Bootstrap starting.
I20260709 13:16:44.338004  9928 consensus_queue.cc:237] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.343719  9920 tablet_bootstrap.cc:654] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.345577  9921 ts_tablet_manager.cc:1434] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.023s
I20260709 13:16:44.346894  9921 tablet_bootstrap.cc:492] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e: Bootstrap starting.
I20260709 13:16:44.349535  9923 tablet_bootstrap.cc:654] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.388216  9921 tablet_bootstrap.cc:654] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.392078  9928 raft_consensus.cc:493] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.394064  9924 raft_consensus.cc:493] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.393392  9928 raft_consensus.cc:515] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } }
I20260709 13:16:44.395107  9924 raft_consensus.cc:515] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } }
I20260709 13:16:44.400909  9730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ad5f6dd66f44c3a0f495033d4b5784" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:44.401887  9730 raft_consensus.cc:2468] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 0.
I20260709 13:16:44.422128  9920 tablet_bootstrap.cc:492] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc: No bootstrap required, opened a new log
I20260709 13:16:44.422163  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ad5f6dd66f44c3a0f495033d4b5784" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b" is_pre_election: true
I20260709 13:16:44.423655  9920 ts_tablet_manager.cc:1403] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent bootstrapping tablet: real 0.088s	user 0.016s	sys 0.008s
W20260709 13:16:44.424912  9843 leader_election.cc:343] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.425730  9843 leader_election.cc:304] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 782dc79175bb4562959a3d56d258e31b
I20260709 13:16:44.424912  9924 leader_election.cc:290] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a3efe533142484099843a45430e835e (127.31.17.131:35267), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:44.424680  9928 leader_election.cc:290] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:44.433708  9937 raft_consensus.cc:2804] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:44.434275  9937 raft_consensus.cc:493] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.434690  9937 raft_consensus.cc:3060] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.437263  9923 tablet_bootstrap.cc:492] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b: No bootstrap required, opened a new log
I20260709 13:16:44.438741  9923 ts_tablet_manager.cc:1403] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.011s
I20260709 13:16:44.448025  9629 catalog_manager.cc:5697] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a3efe533142484099843a45430e835e (127.31.17.131). New cstate: current_term: 1 leader_uuid: "7a3efe533142484099843a45430e835e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.448997  9923 raft_consensus.cc:359] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.450058  9923 raft_consensus.cc:385] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.450471  9923 raft_consensus.cc:740] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.439673  9920 raft_consensus.cc:359] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.452659  9920 raft_consensus.cc:385] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.453065  9920 raft_consensus.cc:740] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.456423  9920 consensus_queue.cc:260] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.458657  9923 consensus_queue.cc:260] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.461210  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ad5f6dd66f44c3a0f495033d4b5784" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b" is_pre_election: true
I20260709 13:16:44.462422  9923 ts_tablet_manager.cc:1434] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.003s
I20260709 13:16:44.464303  9923 tablet_bootstrap.cc:492] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b: Bootstrap starting.
W20260709 13:16:44.463114  9694 leader_election.cc:343] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.465758  9921 tablet_bootstrap.cc:492] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e: No bootstrap required, opened a new log
I20260709 13:16:44.466785  9921 ts_tablet_manager.cc:1403] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e: Time spent bootstrapping tablet: real 0.120s	user 0.014s	sys 0.018s
I20260709 13:16:44.472029  9920 ts_tablet_manager.cc:1434] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent starting tablet: real 0.038s	user 0.012s	sys 0.000s
I20260709 13:16:44.472136  9880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ad5f6dd66f44c3a0f495033d4b5784" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e" is_pre_election: true
W20260709 13:16:44.473966  9677 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:44.474328  9920 tablet_bootstrap.cc:492] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc: Bootstrap starting.
I20260709 13:16:44.463791  9937 raft_consensus.cc:515] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } }
I20260709 13:16:44.475422  9880 raft_consensus.cc:2393] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f0d10ddf86a4ab496486edd77d06dbc in current term 1: Already voted for candidate 7a3efe533142484099843a45430e835e in this term.
I20260709 13:16:44.478010  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ad5f6dd66f44c3a0f495033d4b5784" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b"
W20260709 13:16:44.480048  9843 leader_election.cc:343] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.479745  9921 raft_consensus.cc:359] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.480926  9921 raft_consensus.cc:385] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.481297  9921 raft_consensus.cc:740] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.481884  9697 leader_election.cc:304] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc; no voters: 782dc79175bb4562959a3d56d258e31b, 7a3efe533142484099843a45430e835e
I20260709 13:16:44.482204  9921 consensus_queue.cc:260] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.483028  9730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ad5f6dd66f44c3a0f495033d4b5784" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:44.483464  9937 leader_election.cc:290] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:44.483541  9924 raft_consensus.cc:3060] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.487819  9921 ts_tablet_manager.cc:1434] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.008s
I20260709 13:16:44.489212  9923 tablet_bootstrap.cc:654] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.489640  9921 tablet_bootstrap.cc:492] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e: Bootstrap starting.
I20260709 13:16:44.493758  9920 tablet_bootstrap.cc:654] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.497740  9921 tablet_bootstrap.cc:654] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.501271  9924 raft_consensus.cc:2749] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.509938  9923 tablet_bootstrap.cc:492] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b: No bootstrap required, opened a new log
I20260709 13:16:44.510730  9923 ts_tablet_manager.cc:1403] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.009s
I20260709 13:16:44.516832  9921 tablet_bootstrap.cc:492] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e: No bootstrap required, opened a new log
I20260709 13:16:44.517477  9921 ts_tablet_manager.cc:1403] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.011s
I20260709 13:16:44.518465  9923 raft_consensus.cc:359] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } }
I20260709 13:16:44.519321  9923 raft_consensus.cc:385] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.519634  9923 raft_consensus.cc:740] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.516832  9920 tablet_bootstrap.cc:492] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc: No bootstrap required, opened a new log
I20260709 13:16:44.520905  9920 ts_tablet_manager.cc:1403] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.001s
I20260709 13:16:44.520646  9921 raft_consensus.cc:359] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.521456  9921 raft_consensus.cc:385] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.521800  9921 raft_consensus.cc:740] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.522615  9921 consensus_queue.cc:260] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.523572  9923 consensus_queue.cc:260] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } }
I20260709 13:16:44.525400  9921 ts_tablet_manager.cc:1434] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 13:16:44.525755  9920 raft_consensus.cc:359] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.526574  9920 raft_consensus.cc:385] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.526750  9921 tablet_bootstrap.cc:492] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e: Bootstrap starting.
I20260709 13:16:44.527698  9730 raft_consensus.cc:2468] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 1.
I20260709 13:16:44.529117  9923 ts_tablet_manager.cc:1434] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.007s
I20260709 13:16:44.529603  9846 leader_election.cc:304] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 782dc79175bb4562959a3d56d258e31b
I20260709 13:16:44.529878  9937 raft_consensus.cc:493] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.530592  9923 tablet_bootstrap.cc:492] T 8d64d963832242a686386ac5d061005c P 782dc79175bb4562959a3d56d258e31b: Bootstrap starting.
I20260709 13:16:44.530475  9937 raft_consensus.cc:515] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.530921  9928 raft_consensus.cc:2804] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:44.532757  9937 leader_election.cc:290] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:44.526895  9920 raft_consensus.cc:740] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.533944  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c397e1036163454a8d0adf7fa989ebd7" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b" is_pre_election: true
I20260709 13:16:44.534660  9806 raft_consensus.cc:2468] T c397e1036163454a8d0adf7fa989ebd7 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 0.
I20260709 13:16:44.534415  9920 consensus_queue.cc:260] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.536432  9843 leader_election.cc:304] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 782dc79175bb4562959a3d56d258e31b, 7a3efe533142484099843a45430e835e; no voters: 
I20260709 13:16:44.537647  9921 tablet_bootstrap.cc:654] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.537954  9937 raft_consensus.cc:2804] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:44.538515  9937 raft_consensus.cc:493] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.538920  9937 raft_consensus.cc:3060] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.539526  9730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c397e1036163454a8d0adf7fa989ebd7" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:44.540984  9730 raft_consensus.cc:2468] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 0.
I20260709 13:16:44.545495  9920 ts_tablet_manager.cc:1434] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.003s
I20260709 13:16:44.549686  9921 tablet_bootstrap.cc:492] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e: No bootstrap required, opened a new log
I20260709 13:16:44.550263  9921 ts_tablet_manager.cc:1403] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.012s
I20260709 13:16:44.553534  9921 raft_consensus.cc:359] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.553946  9928 raft_consensus.cc:697] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Becoming Leader. State: Replica: 7a3efe533142484099843a45430e835e, State: Running, Role: LEADER
I20260709 13:16:44.555763  9923 tablet_bootstrap.cc:654] T 8d64d963832242a686386ac5d061005c P 782dc79175bb4562959a3d56d258e31b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.556216  9928 consensus_queue.cc:237] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } }
I20260709 13:16:44.558158  9937 raft_consensus.cc:515] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.554304  9921 raft_consensus.cc:385] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.554999  9920 tablet_bootstrap.cc:492] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc: Bootstrap starting.
I20260709 13:16:44.559253  9921 raft_consensus.cc:740] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.560220  9921 consensus_queue.cc:260] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.561313  9730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c397e1036163454a8d0adf7fa989ebd7" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:44.561939  9730 raft_consensus.cc:3060] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.563359  9921 ts_tablet_manager.cc:1434] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:16:44.565235  9921 tablet_bootstrap.cc:492] T 7f0058e1974a4f0db28945445d791d06 P 7a3efe533142484099843a45430e835e: Bootstrap starting.
I20260709 13:16:44.568364  9920 tablet_bootstrap.cc:654] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.571331  9730 raft_consensus.cc:2468] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 1.
I20260709 13:16:44.572836  9921 tablet_bootstrap.cc:654] T 7f0058e1974a4f0db28945445d791d06 P 7a3efe533142484099843a45430e835e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.572659  9846 leader_election.cc:304] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 
I20260709 13:16:44.573897  9952 raft_consensus.cc:2804] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:44.574028  9629 catalog_manager.cc:5697] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a3efe533142484099843a45430e835e (127.31.17.131). New cstate: current_term: 1 leader_uuid: "7a3efe533142484099843a45430e835e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:44.576598  9952 raft_consensus.cc:697] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Becoming Leader. State: Replica: 7a3efe533142484099843a45430e835e, State: Running, Role: LEADER
I20260709 13:16:44.578078  9952 consensus_queue.cc:237] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.580142  9920 tablet_bootstrap.cc:492] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc: No bootstrap required, opened a new log
I20260709 13:16:44.580689  9920 ts_tablet_manager.cc:1403] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.003s
I20260709 13:16:44.584594  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c397e1036163454a8d0adf7fa989ebd7" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:44.585008  9923 tablet_bootstrap.cc:492] T 8d64d963832242a686386ac5d061005c P 782dc79175bb4562959a3d56d258e31b: No bootstrap required, opened a new log
I20260709 13:16:44.585306  9806 raft_consensus.cc:3060] T c397e1036163454a8d0adf7fa989ebd7 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.585605  9923 ts_tablet_manager.cc:1403] T 8d64d963832242a686386ac5d061005c P 782dc79175bb4562959a3d56d258e31b: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.005s
I20260709 13:16:44.588624  9923 raft_consensus.cc:359] T 8d64d963832242a686386ac5d061005c P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.589231  9923 raft_consensus.cc:385] T 8d64d963832242a686386ac5d061005c P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.589498  9923 raft_consensus.cc:740] T 8d64d963832242a686386ac5d061005c P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.590210  9923 consensus_queue.cc:260] T 8d64d963832242a686386ac5d061005c P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.592425  9923 ts_tablet_manager.cc:1434] T 8d64d963832242a686386ac5d061005c P 782dc79175bb4562959a3d56d258e31b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:16:44.593899  9923 tablet_bootstrap.cc:492] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b: Bootstrap starting.
I20260709 13:16:44.597621  9920 raft_consensus.cc:359] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.598331  9920 raft_consensus.cc:385] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.598642  9920 raft_consensus.cc:740] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.599370  9937 leader_election.cc:290] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:44.600106  9920 consensus_queue.cc:260] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.605525  9920 ts_tablet_manager.cc:1434] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:16:44.606921  9920 tablet_bootstrap.cc:492] T cf8def47942243549659fe26a543f6ab P 4f0d10ddf86a4ab496486edd77d06dbc: Bootstrap starting.
I20260709 13:16:44.607996  9626 catalog_manager.cc:5697] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a3efe533142484099843a45430e835e (127.31.17.131). New cstate: current_term: 1 leader_uuid: "7a3efe533142484099843a45430e835e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.610368  9806 raft_consensus.cc:2468] T c397e1036163454a8d0adf7fa989ebd7 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 1.
I20260709 13:16:44.613018  9923 tablet_bootstrap.cc:654] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.613885  9921 tablet_bootstrap.cc:492] T 7f0058e1974a4f0db28945445d791d06 P 7a3efe533142484099843a45430e835e: No bootstrap required, opened a new log
I20260709 13:16:44.613893  9920 tablet_bootstrap.cc:654] T cf8def47942243549659fe26a543f6ab P 4f0d10ddf86a4ab496486edd77d06dbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.614590  9921 ts_tablet_manager.cc:1403] T 7f0058e1974a4f0db28945445d791d06 P 7a3efe533142484099843a45430e835e: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.017s
I20260709 13:16:44.618432  9921 raft_consensus.cc:359] T 7f0058e1974a4f0db28945445d791d06 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.619565  9921 raft_consensus.cc:385] T 7f0058e1974a4f0db28945445d791d06 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.619957  9921 raft_consensus.cc:740] T 7f0058e1974a4f0db28945445d791d06 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.620908  9952 raft_consensus.cc:493] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.620980  9921 consensus_queue.cc:260] T 7f0058e1974a4f0db28945445d791d06 P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.621533  9952 raft_consensus.cc:515] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.623827  9921 ts_tablet_manager.cc:1434] T 7f0058e1974a4f0db28945445d791d06 P 7a3efe533142484099843a45430e835e: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:16:44.623906  9952 leader_election.cc:290] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:44.624847  9730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d64d963832242a686386ac5d061005c" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:44.625216  9921 tablet_bootstrap.cc:492] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e: Bootstrap starting.
I20260709 13:16:44.625640  9730 raft_consensus.cc:2468] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 0.
I20260709 13:16:44.626915  9846 leader_election.cc:304] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 
I20260709 13:16:44.627787  9937 raft_consensus.cc:2804] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:44.628153  9937 raft_consensus.cc:493] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.628485  9937 raft_consensus.cc:3060] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.632647  9805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d64d963832242a686386ac5d061005c" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b" is_pre_election: true
I20260709 13:16:44.633040  9921 tablet_bootstrap.cc:654] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.633447  9805 raft_consensus.cc:2468] T 8d64d963832242a686386ac5d061005c P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 0.
I20260709 13:16:44.637311  9920 tablet_bootstrap.cc:492] T cf8def47942243549659fe26a543f6ab P 4f0d10ddf86a4ab496486edd77d06dbc: No bootstrap required, opened a new log
I20260709 13:16:44.637792  9920 ts_tablet_manager.cc:1403] T cf8def47942243549659fe26a543f6ab P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.000s
I20260709 13:16:44.640188  9920 raft_consensus.cc:359] T cf8def47942243549659fe26a543f6ab P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.640918  9920 raft_consensus.cc:385] T cf8def47942243549659fe26a543f6ab P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.640342  9937 raft_consensus.cc:515] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.641250  9920 raft_consensus.cc:740] T cf8def47942243549659fe26a543f6ab P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.641685  9923 tablet_bootstrap.cc:492] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b: No bootstrap required, opened a new log
I20260709 13:16:44.642253  9923 ts_tablet_manager.cc:1403] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.004s
I20260709 13:16:44.642174  9920 consensus_queue.cc:260] T cf8def47942243549659fe26a543f6ab P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.643999  9730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d64d963832242a686386ac5d061005c" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:44.644788  9730 raft_consensus.cc:3060] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.645087  9921 tablet_bootstrap.cc:492] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e: No bootstrap required, opened a new log
I20260709 13:16:44.645428  9920 ts_tablet_manager.cc:1434] T cf8def47942243549659fe26a543f6ab P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:44.645748  9921 ts_tablet_manager.cc:1403] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.001s
I20260709 13:16:44.646152  9923 raft_consensus.cc:359] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.646764  9923 raft_consensus.cc:385] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.647013  9923 raft_consensus.cc:740] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.647555  9924 raft_consensus.cc:493] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.647815  9923 consensus_queue.cc:260] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.648099  9924 raft_consensus.cc:515] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.649326  9921 raft_consensus.cc:359] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.650031  9921 raft_consensus.cc:385] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.650321  9924 leader_election.cc:290] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:44.650624  9923 ts_tablet_manager.cc:1434] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:16:44.652002  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0058e1974a4f0db28945445d791d06" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b" is_pre_election: true
I20260709 13:16:44.650300  9921 raft_consensus.cc:740] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.653311  9880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0058e1974a4f0db28945445d791d06" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e" is_pre_election: true
I20260709 13:16:44.654048  9880 raft_consensus.cc:2468] T 7f0058e1974a4f0db28945445d791d06 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 0.
I20260709 13:16:44.653656  9920 tablet_bootstrap.cc:492] T e0b87e57485846eb82bd1400340857d1 P 4f0d10ddf86a4ab496486edd77d06dbc: Bootstrap starting.
I20260709 13:16:44.655546  9697 leader_election.cc:304] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 
I20260709 13:16:44.656522  9924 raft_consensus.cc:2804] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:44.656895  9924 raft_consensus.cc:493] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:44.657085  9694 leader_election.cc:343] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.657214  9924 raft_consensus.cc:3060] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.655596  9923 tablet_bootstrap.cc:492] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b: Bootstrap starting.
I20260709 13:16:44.661286  9929 raft_consensus.cc:493] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.661864  9929 raft_consensus.cc:515] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.666079  9929 leader_election.cc:290] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:44.666394  9923 tablet_bootstrap.cc:654] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.667479  9924 raft_consensus.cc:515] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.667816  9880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8def47942243549659fe26a543f6ab" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e" is_pre_election: true
I20260709 13:16:44.668746  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8def47942243549659fe26a543f6ab" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:44.669449  9731 raft_consensus.cc:2468] T cf8def47942243549659fe26a543f6ab P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 0.
W20260709 13:16:44.669679  9772 leader_election.cc:343] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a3efe533142484099843a45430e835e (127.31.17.131:35267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.671022  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0058e1974a4f0db28945445d791d06" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:44.672257  9880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0058e1974a4f0db28945445d791d06" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e"
W20260709 13:16:44.673676  9694 leader_election.cc:343] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.673189  9880 raft_consensus.cc:3060] T 7f0058e1974a4f0db28945445d791d06 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.676913  9730 raft_consensus.cc:2468] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 1.
I20260709 13:16:44.654127  9921 consensus_queue.cc:260] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.678117  9846 leader_election.cc:304] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 
I20260709 13:16:44.678694  9772 leader_election.cc:304] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 7a3efe533142484099843a45430e835e
I20260709 13:16:44.679427  9921 ts_tablet_manager.cc:1434] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.006s
I20260709 13:16:44.679555  9952 raft_consensus.cc:2804] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:44.679904  9929 raft_consensus.cc:2804] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:44.680346  9952 raft_consensus.cc:697] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Becoming Leader. State: Replica: 7a3efe533142484099843a45430e835e, State: Running, Role: LEADER
I20260709 13:16:44.681850  9952 consensus_queue.cc:237] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.685750  9920 tablet_bootstrap.cc:654] T e0b87e57485846eb82bd1400340857d1 P 4f0d10ddf86a4ab496486edd77d06dbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.680388  9929 raft_consensus.cc:493] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.692679  9929 raft_consensus.cc:3060] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.695960  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d64d963832242a686386ac5d061005c" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:44.696919  9806 raft_consensus.cc:3060] T 8d64d963832242a686386ac5d061005c P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.680605  9921 tablet_bootstrap.cc:492] T cf8def47942243549659fe26a543f6ab P 7a3efe533142484099843a45430e835e: Bootstrap starting.
I20260709 13:16:44.706621  9929 raft_consensus.cc:515] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.711180  9964 raft_consensus.cc:493] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.712030  9964 raft_consensus.cc:515] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.715083  9806 raft_consensus.cc:2468] T 8d64d963832242a686386ac5d061005c P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 1.
I20260709 13:16:44.707340  9924 leader_election.cc:290] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 election: Requested vote from peers 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:44.716830  9929 leader_election.cc:290] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:44.717471  9929 raft_consensus.cc:493] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.717634  9880 raft_consensus.cc:2468] T 7f0058e1974a4f0db28945445d791d06 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 1.
I20260709 13:16:44.708098  9937 leader_election.cc:290] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:44.718868  9730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8def47942243549659fe26a543f6ab" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:44.719545  9730 raft_consensus.cc:3060] T cf8def47942243549659fe26a543f6ab P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.717972  9929 raft_consensus.cc:515] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } }
I20260709 13:16:44.719698  9697 leader_election.cc:304] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 782dc79175bb4562959a3d56d258e31b
I20260709 13:16:44.720592  9924 raft_consensus.cc:2804] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:44.723433  9967 raft_consensus.cc:493] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.723058  9880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8def47942243549659fe26a543f6ab" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:44.724068  9967 raft_consensus.cc:515] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.725103  9921 tablet_bootstrap.cc:654] T cf8def47942243549659fe26a543f6ab P 7a3efe533142484099843a45430e835e: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:44.725349  9772 leader_election.cc:343] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a3efe533142484099843a45430e835e (127.31.17.131:35267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.726286  9929 leader_election.cc:290] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:44.726341  9967 leader_election.cc:290] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:44.735205  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ad5f6dd66f44c3a0f495033d4b5784" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:44.736155  9731 raft_consensus.cc:2393] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 782dc79175bb4562959a3d56d258e31b in current term 1: Already voted for candidate 7a3efe533142484099843a45430e835e in this term.
I20260709 13:16:44.737397  9729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386daa82c32e4e47a1651d86e52acbf6" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:44.738178  9730 raft_consensus.cc:2468] T cf8def47942243549659fe26a543f6ab P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 1.
I20260709 13:16:44.734861  9879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ad5f6dd66f44c3a0f495033d4b5784" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e" is_pre_election: true
I20260709 13:16:44.739538  9772 leader_election.cc:304] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 7a3efe533142484099843a45430e835e
I20260709 13:16:44.735913  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386daa82c32e4e47a1651d86e52acbf6" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e" is_pre_election: true
I20260709 13:16:44.740500  9878 raft_consensus.cc:2468] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 0.
I20260709 13:16:44.738200  9729 raft_consensus.cc:2468] T 386daa82c32e4e47a1651d86e52acbf6 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 0.
I20260709 13:16:44.742740  9772 leader_election.cc:304] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 782dc79175bb4562959a3d56d258e31b; no voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e
I20260709 13:16:44.742219  9629 catalog_manager.cc:5697] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a3efe533142484099843a45430e835e (127.31.17.131). New cstate: current_term: 1 leader_uuid: "7a3efe533142484099843a45430e835e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.744215  9772 leader_election.cc:304] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 782dc79175bb4562959a3d56d258e31b, 7a3efe533142484099843a45430e835e; no voters: 
I20260709 13:16:44.745836  9929 raft_consensus.cc:2804] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:44.745855  9967 raft_consensus.cc:3060] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.757683  9964 leader_election.cc:290] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:44.762060  9806 raft_consensus.cc:3060] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.777771  9920 tablet_bootstrap.cc:492] T e0b87e57485846eb82bd1400340857d1 P 4f0d10ddf86a4ab496486edd77d06dbc: No bootstrap required, opened a new log
I20260709 13:16:44.774004  9952 raft_consensus.cc:493] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.766330  9964 raft_consensus.cc:2804] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:44.778991  9920 ts_tablet_manager.cc:1403] T e0b87e57485846eb82bd1400340857d1 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent bootstrapping tablet: real 0.126s	user 0.025s	sys 0.023s
I20260709 13:16:44.777661  9924 raft_consensus.cc:697] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 LEADER]: Becoming Leader. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Running, Role: LEADER
I20260709 13:16:44.779423  9929 raft_consensus.cc:697] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Becoming Leader. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Running, Role: LEADER
I20260709 13:16:44.780752  9964 raft_consensus.cc:493] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.785290  9964 raft_consensus.cc:3060] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.781796  9952 raft_consensus.cc:515] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.788115  9729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7160b2d69c4a57b46af60fc5ceea5a" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:44.789083  9729 raft_consensus.cc:2393] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 782dc79175bb4562959a3d56d258e31b in current term 1: Already voted for candidate 7a3efe533142484099843a45430e835e in this term.
I20260709 13:16:44.790262  9967 raft_consensus.cc:2749] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.790380  9923 tablet_bootstrap.cc:492] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b: No bootstrap required, opened a new log
I20260709 13:16:44.791213  9952 leader_election.cc:290] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:44.792855  9923 ts_tablet_manager.cc:1403] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b: Time spent bootstrapping tablet: real 0.141s	user 0.018s	sys 0.036s
I20260709 13:16:44.793428  9805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b87e57485846eb82bd1400340857d1" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b" is_pre_election: true
I20260709 13:16:44.795058  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7160b2d69c4a57b46af60fc5ceea5a" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e" is_pre_election: true
I20260709 13:16:44.786224  9929 consensus_queue.cc:237] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.795410  9924 consensus_queue.cc:237] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.797681  9923 raft_consensus.cc:359] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.798478  9923 raft_consensus.cc:385] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.800153  9923 raft_consensus.cc:740] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Initialized, Role: FOLLOWER
W20260709 13:16:44.801188  9843 leader_election.cc:343] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.801818  9921 tablet_bootstrap.cc:492] T cf8def47942243549659fe26a543f6ab P 7a3efe533142484099843a45430e835e: No bootstrap required, opened a new log
I20260709 13:16:44.802420  9921 ts_tablet_manager.cc:1403] T cf8def47942243549659fe26a543f6ab P 7a3efe533142484099843a45430e835e: Time spent bootstrapping tablet: real 0.122s	user 0.030s	sys 0.016s
I20260709 13:16:44.802383  9729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b87e57485846eb82bd1400340857d1" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:44.803594  9772 leader_election.cc:304] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 782dc79175bb4562959a3d56d258e31b; no voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e
I20260709 13:16:44.803745  9923 consensus_queue.cc:260] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.806595  9921 raft_consensus.cc:359] T cf8def47942243549659fe26a543f6ab P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.807541  9921 raft_consensus.cc:385] T cf8def47942243549659fe26a543f6ab P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.795439  9920 raft_consensus.cc:359] T e0b87e57485846eb82bd1400340857d1 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.808220  9923 ts_tablet_manager.cc:1434] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
I20260709 13:16:44.808549  9920 raft_consensus.cc:385] T e0b87e57485846eb82bd1400340857d1 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.808974  9920 raft_consensus.cc:740] T e0b87e57485846eb82bd1400340857d1 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.807946  9921 raft_consensus.cc:740] T cf8def47942243549659fe26a543f6ab P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.807219  9952 consensus_queue.cc:1048] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:16:44.811054  9921 consensus_queue.cc:260] T cf8def47942243549659fe26a543f6ab P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.818370  9967 raft_consensus.cc:2749] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.818730  9964 raft_consensus.cc:515] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.819552  9952 consensus_queue.cc:1048] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:44.822193  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386daa82c32e4e47a1651d86e52acbf6" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:44.822906  9731 raft_consensus.cc:3060] T 386daa82c32e4e47a1651d86e52acbf6 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.812826  9920 consensus_queue.cc:260] T e0b87e57485846eb82bd1400340857d1 P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.825192  9729 raft_consensus.cc:2468] T e0b87e57485846eb82bd1400340857d1 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 0.
I20260709 13:16:44.826673  9920 ts_tablet_manager.cc:1434] T e0b87e57485846eb82bd1400340857d1 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:16:44.827330  9846 leader_election.cc:304] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 782dc79175bb4562959a3d56d258e31b
I20260709 13:16:44.828748  9952 raft_consensus.cc:2804] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:44.829208  9952 raft_consensus.cc:493] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.829607  9952 raft_consensus.cc:3060] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.836021  9964 leader_election.cc:290] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:44.836683  9968 raft_consensus.cc:493] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.839705  9968 raft_consensus.cc:515] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.841475  9731 raft_consensus.cc:2468] T 386daa82c32e4e47a1651d86e52acbf6 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 1.
I20260709 13:16:44.841661  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386daa82c32e4e47a1651d86e52acbf6" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:44.843250  9878 raft_consensus.cc:3060] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.844805  9923 tablet_bootstrap.cc:492] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b: Bootstrap starting.
I20260709 13:16:44.846592  9805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8f95e2da4249f48fd41d41810ce4de" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b" is_pre_election: true
I20260709 13:16:44.851464  9805 raft_consensus.cc:2468] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 0.
I20260709 13:16:44.852854  9772 leader_election.cc:304] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 
I20260709 13:16:44.844601  9879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8f95e2da4249f48fd41d41810ce4de" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e" is_pre_election: true
I20260709 13:16:44.854123  9879 raft_consensus.cc:2468] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 0.
I20260709 13:16:44.856153  9697 leader_election.cc:304] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 
I20260709 13:16:44.855386  9968 leader_election.cc:290] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:44.858062  9968 raft_consensus.cc:2804] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:44.858259  9923 tablet_bootstrap.cc:654] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.859647  9964 raft_consensus.cc:2804] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:44.860381  9964 raft_consensus.cc:697] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Becoming Leader. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Running, Role: LEADER
I20260709 13:16:44.861720  9964 consensus_queue.cc:237] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.854846  9629 catalog_manager.cc:5697] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129). New cstate: current_term: 1 leader_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:44.858379  9921 ts_tablet_manager.cc:1434] T cf8def47942243549659fe26a543f6ab P 7a3efe533142484099843a45430e835e: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 13:16:44.872254  9878 raft_consensus.cc:2468] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 1.
I20260709 13:16:44.877938  9952 raft_consensus.cc:515] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.882321  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b87e57485846eb82bd1400340857d1" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:44.882993  9731 raft_consensus.cc:3060] T e0b87e57485846eb82bd1400340857d1 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.883961  9805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b87e57485846eb82bd1400340857d1" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b"
W20260709 13:16:44.885610  9843 leader_election.cc:343] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.886255  9952 leader_election.cc:290] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:44.864961  9968 raft_consensus.cc:493] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.887420  9968 raft_consensus.cc:3060] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.891069  9731 raft_consensus.cc:2468] T e0b87e57485846eb82bd1400340857d1 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 1.
I20260709 13:16:44.892390  9846 leader_election.cc:304] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 782dc79175bb4562959a3d56d258e31b
I20260709 13:16:44.893605  9952 raft_consensus.cc:2804] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:44.895864  9928 raft_consensus.cc:493] T cf8def47942243549659fe26a543f6ab P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.899786  9923 tablet_bootstrap.cc:492] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b: No bootstrap required, opened a new log
I20260709 13:16:44.896400  9928 raft_consensus.cc:515] T cf8def47942243549659fe26a543f6ab P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.900462  9923 ts_tablet_manager.cc:1403] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b: Time spent bootstrapping tablet: real 0.056s	user 0.022s	sys 0.013s
I20260709 13:16:44.902015  9627 catalog_manager.cc:5697] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b reported cstate change: term changed from 0 to 1, leader changed from <none> to 782dc79175bb4562959a3d56d258e31b (127.31.17.130). New cstate: current_term: 1 leader_uuid: "782dc79175bb4562959a3d56d258e31b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:44.903126  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8def47942243549659fe26a543f6ab" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:44.904227  9731 raft_consensus.cc:2393] T cf8def47942243549659fe26a543f6ab P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a3efe533142484099843a45430e835e in current term 1: Already voted for candidate 782dc79175bb4562959a3d56d258e31b in this term.
I20260709 13:16:44.909313  9928 leader_election.cc:290] T cf8def47942243549659fe26a543f6ab P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:44.909578  9923 raft_consensus.cc:359] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.910463  9805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8def47942243549659fe26a543f6ab" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b" is_pre_election: true
I20260709 13:16:44.910601  9923 raft_consensus.cc:385] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.911091  9923 raft_consensus.cc:740] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.912277  9923 consensus_queue.cc:260] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.912919  9843 leader_election.cc:304] T cf8def47942243549659fe26a543f6ab P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a3efe533142484099843a45430e835e; no voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b
I20260709 13:16:44.914151  9928 raft_consensus.cc:3060] T cf8def47942243549659fe26a543f6ab P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.914947  9923 ts_tablet_manager.cc:1434] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:16:44.915066  9967 raft_consensus.cc:493] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.915585  9967 raft_consensus.cc:515] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.917476  9967 leader_election.cc:290] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:44.918321  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0058e1974a4f0db28945445d791d06" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:44.894151  9952 raft_consensus.cc:697] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Becoming Leader. State: Replica: 7a3efe533142484099843a45430e835e, State: Running, Role: LEADER
I20260709 13:16:44.922848  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0058e1974a4f0db28945445d791d06" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e" is_pre_election: true
I20260709 13:16:44.925685  9878 raft_consensus.cc:2393] T 7f0058e1974a4f0db28945445d791d06 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 782dc79175bb4562959a3d56d258e31b in current term 1: Already voted for candidate 4f0d10ddf86a4ab496486edd77d06dbc in this term.
I20260709 13:16:44.926882  9772 leader_election.cc:304] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 782dc79175bb4562959a3d56d258e31b; no voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e
I20260709 13:16:44.928928  9929 raft_consensus.cc:3060] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.929409  9968 raft_consensus.cc:515] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.931689  9968 leader_election.cc:290] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 election: Requested vote from peers 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:44.932406  9805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8f95e2da4249f48fd41d41810ce4de" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:44.933060  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8f95e2da4249f48fd41d41810ce4de" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:44.933090  9805 raft_consensus.cc:3060] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.936620  9878 raft_consensus.cc:3060] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.950786  9805 raft_consensus.cc:2468] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 1.
I20260709 13:16:44.954807  9694 leader_election.cc:304] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 
I20260709 13:16:44.956053  9968 raft_consensus.cc:2804] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:44.956647  9968 raft_consensus.cc:697] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 LEADER]: Becoming Leader. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Running, Role: LEADER
I20260709 13:16:44.957651  9968 consensus_queue.cc:237] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.934509  9952 consensus_queue.cc:237] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:44.966038  9928 raft_consensus.cc:2749] T cf8def47942243549659fe26a543f6ab P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.970927  9878 raft_consensus.cc:2468] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 1.
I20260709 13:16:44.977105  9957 consensus_queue.cc:1048] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:44.978494  9627 catalog_manager.cc:5697] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129). New cstate: current_term: 1 leader_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:44.981700  9957 consensus_queue.cc:1048] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:44.987205  9929 raft_consensus.cc:2749] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.999223  9629 catalog_manager.cc:5697] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b reported cstate change: term changed from 0 to 1, leader changed from <none> to 782dc79175bb4562959a3d56d258e31b (127.31.17.130). New cstate: current_term: 1 leader_uuid: "782dc79175bb4562959a3d56d258e31b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.013345  9952 consensus_queue.cc:1048] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:45.017234  9627 catalog_manager.cc:5697] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a3efe533142484099843a45430e835e (127.31.17.131). New cstate: current_term: 1 leader_uuid: "7a3efe533142484099843a45430e835e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:45.020998  9952 consensus_queue.cc:1048] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:45.073539  9929 raft_consensus.cc:493] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.074028  9929 raft_consensus.cc:515] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:45.076018  9929 leader_election.cc:290] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:45.076669  9730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b87e57485846eb82bd1400340857d1" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:45.077060  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b87e57485846eb82bd1400340857d1" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e" is_pre_election: true
I20260709 13:16:45.077420  9730 raft_consensus.cc:2393] T e0b87e57485846eb82bd1400340857d1 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 782dc79175bb4562959a3d56d258e31b in current term 1: Already voted for candidate 7a3efe533142484099843a45430e835e in this term.
I20260709 13:16:45.078630  9772 leader_election.cc:304] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 782dc79175bb4562959a3d56d258e31b; no voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e
I20260709 13:16:45.079348  9929 raft_consensus.cc:3060] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.085232  9929 raft_consensus.cc:2749] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:45.131299  9952 consensus_queue.cc:1048] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:45.142489  9979 consensus_queue.cc:1048] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:45.197954  9929 consensus_queue.cc:1048] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:45.210098  9971 consensus_queue.cc:1048] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:45.219376  9878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04ad5f6dd66f44c3a0f495033d4b5784"
dest_uuid: "7a3efe533142484099843a45430e835e"
mode: GRACEFUL
new_leader_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
 from {username='slave'} at 127.0.0.1:59190
I20260709 13:16:45.220005  9878 raft_consensus.cc:606] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Received request to transfer leadership to TS 4f0d10ddf86a4ab496486edd77d06dbc
I20260709 13:16:45.225286  9878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e7160b2d69c4a57b46af60fc5ceea5a"
dest_uuid: "7a3efe533142484099843a45430e835e"
mode: GRACEFUL
new_leader_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
 from {username='slave'} at 127.0.0.1:59190
I20260709 13:16:45.225796  9878 raft_consensus.cc:606] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Received request to transfer leadership to TS 4f0d10ddf86a4ab496486edd77d06dbc
I20260709 13:16:45.230952  9878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d64d963832242a686386ac5d061005c"
dest_uuid: "7a3efe533142484099843a45430e835e"
mode: GRACEFUL
new_leader_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
 from {username='slave'} at 127.0.0.1:59190
I20260709 13:16:45.231576  9878 raft_consensus.cc:606] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Received request to transfer leadership to TS 4f0d10ddf86a4ab496486edd77d06dbc
I20260709 13:16:45.236516  9878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c397e1036163454a8d0adf7fa989ebd7"
dest_uuid: "7a3efe533142484099843a45430e835e"
mode: GRACEFUL
new_leader_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
 from {username='slave'} at 127.0.0.1:59190
I20260709 13:16:45.237057  9878 raft_consensus.cc:606] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Received request to transfer leadership to TS 4f0d10ddf86a4ab496486edd77d06dbc
I20260709 13:16:45.249938  9968 consensus_queue.cc:1048] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:45.253666  9730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f0058e1974a4f0db28945445d791d06"
dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
mode: GRACEFUL
new_leader_uuid: "782dc79175bb4562959a3d56d258e31b"
 from {username='slave'} at 127.0.0.1:60796
I20260709 13:16:45.254218  9730 raft_consensus.cc:606] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 LEADER]: Received request to transfer leadership to TS 782dc79175bb4562959a3d56d258e31b
I20260709 13:16:45.260141  9878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0b87e57485846eb82bd1400340857d1"
dest_uuid: "7a3efe533142484099843a45430e835e"
mode: GRACEFUL
new_leader_uuid: "782dc79175bb4562959a3d56d258e31b"
 from {username='slave'} at 127.0.0.1:59190
I20260709 13:16:45.260783  9878 raft_consensus.cc:606] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Received request to transfer leadership to TS 782dc79175bb4562959a3d56d258e31b
I20260709 13:16:45.266546  9924 consensus_queue.cc:1048] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:45.274907  9968 raft_consensus.cc:993] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc: : Instructing follower 782dc79175bb4562959a3d56d258e31b to start an election
I20260709 13:16:45.275408  9924 raft_consensus.cc:1081] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 LEADER]: Signalling peer 782dc79175bb4562959a3d56d258e31b to start an election
I20260709 13:16:45.277252  9806 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f0058e1974a4f0db28945445d791d06"
dest_uuid: "782dc79175bb4562959a3d56d258e31b"
 from {username='slave'} at 127.0.0.1:41052
I20260709 13:16:45.277835  9806 raft_consensus.cc:493] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:45.278345  9806 raft_consensus.cc:3060] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.282616  9730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f8f95e2da4249f48fd41d41810ce4de"
dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
mode: GRACEFUL
new_leader_uuid: "7a3efe533142484099843a45430e835e"
 from {username='slave'} at 127.0.0.1:60796
I20260709 13:16:45.283336  9730 raft_consensus.cc:606] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 LEADER]: Received request to transfer leadership to TS 7a3efe533142484099843a45430e835e
I20260709 13:16:45.285832  9806 raft_consensus.cc:515] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:45.288419  9806 leader_election.cc:290] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 2 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:45.289217  9730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0058e1974a4f0db28945445d791d06" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:45.289592  9879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0058e1974a4f0db28945445d791d06" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:45.290002  9730 raft_consensus.cc:3055] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:45.290182  9879 raft_consensus.cc:3060] T 7f0058e1974a4f0db28945445d791d06 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.290369  9730 raft_consensus.cc:740] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Running, Role: LEADER
I20260709 13:16:45.291366  9730 consensus_queue.cc:260] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:45.292765  9730 raft_consensus.cc:3060] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.298549  9879 raft_consensus.cc:2468] T 7f0058e1974a4f0db28945445d791d06 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 2.
I20260709 13:16:45.299836  9772 leader_election.cc:304] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 782dc79175bb4562959a3d56d258e31b, 7a3efe533142484099843a45430e835e; no voters: 
I20260709 13:16:45.299996  9730 raft_consensus.cc:2468] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 2.
I20260709 13:16:45.300597  9971 raft_consensus.cc:2804] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:45.301134  9971 raft_consensus.cc:697] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [term 2 LEADER]: Becoming Leader. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Running, Role: LEADER
I20260709 13:16:45.301868  9971 consensus_queue.cc:237] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:45.308238  9626 catalog_manager.cc:5697] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b reported cstate change: term changed from 1 to 2, leader changed from 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129) to 782dc79175bb4562959a3d56d258e31b (127.31.17.130). New cstate: current_term: 2 leader_uuid: "782dc79175bb4562959a3d56d258e31b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.435714  9924 consensus_queue.cc:1048] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:45.436209  9971 consensus_queue.cc:1048] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:45.437242  9937 raft_consensus.cc:993] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e: : Instructing follower 4f0d10ddf86a4ab496486edd77d06dbc to start an election
I20260709 13:16:45.437816  9979 raft_consensus.cc:1081] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Signalling peer 4f0d10ddf86a4ab496486edd77d06dbc to start an election
I20260709 13:16:45.440404  9730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e7160b2d69c4a57b46af60fc5ceea5a"
dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
 from {username='slave'} at 127.0.0.1:60786
I20260709 13:16:45.441238  9730 raft_consensus.cc:493] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:45.441797  9730 raft_consensus.cc:3060] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.455114  9929 consensus_queue.cc:1048] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:45.456035  9730 raft_consensus.cc:515] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:45.459332  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7160b2d69c4a57b46af60fc5ceea5a" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:45.459918  9878 raft_consensus.cc:3055] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:45.460224  9878 raft_consensus.cc:740] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Running, Role: LEADER
I20260709 13:16:45.460640  9979 raft_consensus.cc:993] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e: : Instructing follower 4f0d10ddf86a4ab496486edd77d06dbc to start an election
I20260709 13:16:45.461229  9952 raft_consensus.cc:1081] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Signalling peer 4f0d10ddf86a4ab496486edd77d06dbc to start an election
I20260709 13:16:45.461032  9878 consensus_queue.cc:260] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:45.462229  9878 raft_consensus.cc:3060] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.462083  9937 consensus_queue.cc:1048] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:45.465158  9805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7160b2d69c4a57b46af60fc5ceea5a" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:45.465730  9805 raft_consensus.cc:3060] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.465875  9731 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c397e1036163454a8d0adf7fa989ebd7"
dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
 from {username='slave'} at 127.0.0.1:60786
I20260709 13:16:45.466630  9731 raft_consensus.cc:493] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:45.467020  9730 leader_election.cc:290] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 2 election: Requested vote from peers 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:45.467021  9731 raft_consensus.cc:3060] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.478071  9805 raft_consensus.cc:2468] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 2.
I20260709 13:16:45.480381  9731 raft_consensus.cc:515] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:45.482745  9731 leader_election.cc:290] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 2 election: Requested vote from peers 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:45.470974  9878 raft_consensus.cc:2468] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 2.
I20260709 13:16:45.484548  9697 leader_election.cc:304] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 
I20260709 13:16:45.485455  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c397e1036163454a8d0adf7fa989ebd7" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:45.486109  9878 raft_consensus.cc:3055] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:45.486430  9878 raft_consensus.cc:740] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Running, Role: LEADER
I20260709 13:16:45.487344 10001 raft_consensus.cc:2804] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:45.490712  9968 consensus_queue.cc:1048] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:45.489362  9937 consensus_queue.cc:1048] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:16:45.494323  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c397e1036163454a8d0adf7fa989ebd7" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:45.495149  9806 raft_consensus.cc:3060] T c397e1036163454a8d0adf7fa989ebd7 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.488881  9878 consensus_queue.cc:260] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:45.497939  9878 raft_consensus.cc:3060] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.507402  9806 raft_consensus.cc:2468] T c397e1036163454a8d0adf7fa989ebd7 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 2.
I20260709 13:16:45.508616  9694 leader_election.cc:304] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 
I20260709 13:16:45.513808 10006 raft_consensus.cc:2804] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:45.514319 10006 raft_consensus.cc:697] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 LEADER]: Becoming Leader. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Running, Role: LEADER
I20260709 13:16:45.515471 10006 consensus_queue.cc:237] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:45.533892 10001 raft_consensus.cc:697] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 LEADER]: Becoming Leader. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Running, Role: LEADER
I20260709 13:16:45.535109 10001 consensus_queue.cc:237] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:45.536690  9878 raft_consensus.cc:2468] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 2.
W20260709 13:16:45.536890  9697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:35267, user_credentials={real_user=slave}} blocked reactor thread for 48428.3us
I20260709 13:16:45.545528  9937 raft_consensus.cc:993] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e: : Instructing follower 782dc79175bb4562959a3d56d258e31b to start an election
I20260709 13:16:45.546065  9937 raft_consensus.cc:1081] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Signalling peer 782dc79175bb4562959a3d56d258e31b to start an election
I20260709 13:16:45.548137  9806 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0b87e57485846eb82bd1400340857d1"
dest_uuid: "782dc79175bb4562959a3d56d258e31b"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:16:45.548699  9806 raft_consensus.cc:493] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:45.549093  9806 raft_consensus.cc:3060] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.554557  9924 raft_consensus.cc:993] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc: : Instructing follower 7a3efe533142484099843a45430e835e to start an election
I20260709 13:16:45.555126 10002 raft_consensus.cc:1081] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 LEADER]: Signalling peer 7a3efe533142484099843a45430e835e to start an election
I20260709 13:16:45.551466  9626 catalog_manager.cc:5697] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc reported cstate change: term changed from 1 to 2, leader changed from 7a3efe533142484099843a45430e835e (127.31.17.131) to 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129). New cstate: current_term: 2 leader_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.556655  9806 raft_consensus.cc:515] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:45.557052  9878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f8f95e2da4249f48fd41d41810ce4de"
dest_uuid: "7a3efe533142484099843a45430e835e"
 from {username='slave'} at 127.0.0.1:59174
I20260709 13:16:45.557719  9878 raft_consensus.cc:493] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:45.557777  9805 raft_consensus.cc:1240] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Rejecting Update request from peer 7a3efe533142484099843a45430e835e for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:45.558163  9878 raft_consensus.cc:3060] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.559650  9728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b87e57485846eb82bd1400340857d1" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:45.560297  9728 raft_consensus.cc:3060] T e0b87e57485846eb82bd1400340857d1 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.560346  9806 leader_election.cc:290] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 2 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:45.562176  9937 consensus_queue.cc:1059] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:45.562971  9979 raft_consensus.cc:3055] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:45.563338  9979 raft_consensus.cc:740] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Running, Role: LEADER
I20260709 13:16:45.564172  9979 consensus_queue.cc:260] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:45.564944  9879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b87e57485846eb82bd1400340857d1" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:45.565352  9979 raft_consensus.cc:3060] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.570598  9878 raft_consensus.cc:515] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:45.572297  9952 raft_consensus.cc:993] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e: : Instructing follower 4f0d10ddf86a4ab496486edd77d06dbc to start an election
I20260709 13:16:45.572854  9952 raft_consensus.cc:1081] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Signalling peer 4f0d10ddf86a4ab496486edd77d06dbc to start an election
I20260709 13:16:45.574752  9729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d64d963832242a686386ac5d061005c"
dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
 from {username='slave'} at 127.0.0.1:60786
I20260709 13:16:45.575405  9729 raft_consensus.cc:493] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:45.575810  9729 raft_consensus.cc:3060] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.575860  9878 leader_election.cc:290] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 2 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:45.576959  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8f95e2da4249f48fd41d41810ce4de" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:45.577611  9806 raft_consensus.cc:3060] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.578212  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8f95e2da4249f48fd41d41810ce4de" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:45.578833  9731 raft_consensus.cc:3055] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:45.579152  9731 raft_consensus.cc:740] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Running, Role: LEADER
I20260709 13:16:45.580034  9728 raft_consensus.cc:2468] T e0b87e57485846eb82bd1400340857d1 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 2.
I20260709 13:16:45.579970  9731 consensus_queue.cc:260] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:45.581342  9731 raft_consensus.cc:3060] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.581588  9772 leader_election.cc:304] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 
I20260709 13:16:45.582505  9929 raft_consensus.cc:2804] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:45.582975  9929 raft_consensus.cc:697] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [term 2 LEADER]: Becoming Leader. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Running, Role: LEADER
I20260709 13:16:45.584751  9929 consensus_queue.cc:237] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:45.585045  9806 raft_consensus.cc:2468] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 2.
I20260709 13:16:45.586364  9843 leader_election.cc:304] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 782dc79175bb4562959a3d56d258e31b, 7a3efe533142484099843a45430e835e; no voters: 
I20260709 13:16:45.587172  9937 raft_consensus.cc:2804] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:45.587894  9937 raft_consensus.cc:697] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e [term 2 LEADER]: Becoming Leader. State: Replica: 7a3efe533142484099843a45430e835e, State: Running, Role: LEADER
I20260709 13:16:45.588846  9731 raft_consensus.cc:2468] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 2.
I20260709 13:16:45.588721  9937 consensus_queue.cc:237] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:45.592267  9729 raft_consensus.cc:515] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:45.594185  9879 raft_consensus.cc:2468] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 2.
I20260709 13:16:45.594205  9729 leader_election.cc:290] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 2 election: Requested vote from peers 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:45.595072  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d64d963832242a686386ac5d061005c" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:45.595381  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d64d963832242a686386ac5d061005c" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:45.595728  9806 raft_consensus.cc:3060] T 8d64d963832242a686386ac5d061005c P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.596145  9878 raft_consensus.cc:3055] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:45.596444  9878 raft_consensus.cc:740] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Running, Role: LEADER
I20260709 13:16:45.597297  9878 consensus_queue.cc:260] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:45.598450  9878 raft_consensus.cc:3060] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.597573  9627 catalog_manager.cc:5697] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b reported cstate change: term changed from 1 to 2, leader changed from 7a3efe533142484099843a45430e835e (127.31.17.131) to 782dc79175bb4562959a3d56d258e31b (127.31.17.130). New cstate: current_term: 2 leader_uuid: "782dc79175bb4562959a3d56d258e31b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.604373  9806 raft_consensus.cc:2468] T 8d64d963832242a686386ac5d061005c P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 2.
I20260709 13:16:45.605683  9694 leader_election.cc:304] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 
I20260709 13:16:45.605778  9878 raft_consensus.cc:2468] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 2.
I20260709 13:16:45.606531 10002 raft_consensus.cc:2804] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:45.607007 10002 raft_consensus.cc:697] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 LEADER]: Becoming Leader. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Running, Role: LEADER
I20260709 13:16:45.607833 10002 consensus_queue.cc:237] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:45.613240  9626 catalog_manager.cc:5697] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc reported cstate change: term changed from 1 to 2, leader changed from 7a3efe533142484099843a45430e835e (127.31.17.131) to 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129). New cstate: current_term: 2 leader_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.623579  9937 raft_consensus.cc:993] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e: : Instructing follower 4f0d10ddf86a4ab496486edd77d06dbc to start an election
I20260709 13:16:45.624114  9957 raft_consensus.cc:1081] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Signalling peer 4f0d10ddf86a4ab496486edd77d06dbc to start an election
I20260709 13:16:45.624764  9629 catalog_manager.cc:5697] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e reported cstate change: term changed from 1 to 2, leader changed from 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129) to 7a3efe533142484099843a45430e835e (127.31.17.131). New cstate: current_term: 2 leader_uuid: "7a3efe533142484099843a45430e835e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:45.625823  9731 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04ad5f6dd66f44c3a0f495033d4b5784"
dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
 from {username='slave'} at 127.0.0.1:60786
I20260709 13:16:45.626466  9731 raft_consensus.cc:493] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:45.626861  9731 raft_consensus.cc:3060] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.633390  9731 raft_consensus.cc:515] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } }
I20260709 13:16:45.635005  9731 leader_election.cc:290] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 2 election: Requested vote from peers 7a3efe533142484099843a45430e835e (127.31.17.131:35267), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:45.635964  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ad5f6dd66f44c3a0f495033d4b5784" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:45.636179  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ad5f6dd66f44c3a0f495033d4b5784" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:45.636727  9878 raft_consensus.cc:3055] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:45.636844  9806 raft_consensus.cc:3060] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.637120  9878 raft_consensus.cc:740] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Running, Role: LEADER
I20260709 13:16:45.636376  9627 catalog_manager.cc:5697] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc reported cstate change: term changed from 1 to 2, leader changed from 7a3efe533142484099843a45430e835e (127.31.17.131) to 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129). New cstate: current_term: 2 leader_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.637873  9878 consensus_queue.cc:260] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } }
I20260709 13:16:45.638792  9878 raft_consensus.cc:3060] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.642948  9806 raft_consensus.cc:2468] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 2.
I20260709 13:16:45.644213  9694 leader_election.cc:304] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 
I20260709 13:16:45.645074 10002 raft_consensus.cc:2804] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:45.645537 10002 raft_consensus.cc:697] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 LEADER]: Becoming Leader. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Running, Role: LEADER
I20260709 13:16:45.646564 10002 consensus_queue.cc:237] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } }
I20260709 13:16:45.647576  9878 raft_consensus.cc:2468] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 2.
I20260709 13:16:45.652923  9627 catalog_manager.cc:5697] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc reported cstate change: term changed from 1 to 2, leader changed from 7a3efe533142484099843a45430e835e (127.31.17.131) to 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129). New cstate: current_term: 2 leader_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.723381  9878 raft_consensus.cc:1275] T 7f0058e1974a4f0db28945445d791d06 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Refusing update from remote peer 782dc79175bb4562959a3d56d258e31b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:45.724681  9967 consensus_queue.cc:1048] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:45.732685  9731 raft_consensus.cc:1275] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Refusing update from remote peer 782dc79175bb4562959a3d56d258e31b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:45.734660  9964 consensus_queue.cc:1048] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:45.946882  9878 raft_consensus.cc:1275] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Refusing update from remote peer 4f0d10ddf86a4ab496486edd77d06dbc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:45.948287 10002 consensus_queue.cc:1048] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:45.955688  9806 raft_consensus.cc:1275] T c397e1036163454a8d0adf7fa989ebd7 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Refusing update from remote peer 4f0d10ddf86a4ab496486edd77d06dbc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:45.957685  9924 consensus_queue.cc:1048] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:46.002758  9731 raft_consensus.cc:1275] T e0b87e57485846eb82bd1400340857d1 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Refusing update from remote peer 782dc79175bb4562959a3d56d258e31b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:46.004091  9964 consensus_queue.cc:1048] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:46.012566  9878 raft_consensus.cc:1275] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Refusing update from remote peer 782dc79175bb4562959a3d56d258e31b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:46.014304  9967 consensus_queue.cc:1048] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:46.072290  9878 raft_consensus.cc:1275] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Refusing update from remote peer 4f0d10ddf86a4ab496486edd77d06dbc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:46.073776  9924 consensus_queue.cc:1048] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:46.083010  9806 raft_consensus.cc:1275] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Refusing update from remote peer 4f0d10ddf86a4ab496486edd77d06dbc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:46.084718 10002 consensus_queue.cc:1048] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:46.136379  9878 raft_consensus.cc:1275] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Refusing update from remote peer 4f0d10ddf86a4ab496486edd77d06dbc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:46.138140 10001 consensus_queue.cc:1048] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:46.138568  9878 raft_consensus.cc:1275] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Refusing update from remote peer 4f0d10ddf86a4ab496486edd77d06dbc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:46.140057 10001 consensus_queue.cc:1048] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:46.152067  9806 raft_consensus.cc:1275] T 8d64d963832242a686386ac5d061005c P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Refusing update from remote peer 4f0d10ddf86a4ab496486edd77d06dbc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:46.157373 10002 consensus_queue.cc:1048] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:46.159477  9806 raft_consensus.cc:1275] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Refusing update from remote peer 4f0d10ddf86a4ab496486edd77d06dbc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:46.165966 10002 consensus_queue.cc:1048] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:46.174283  9806 raft_consensus.cc:1275] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Refusing update from remote peer 7a3efe533142484099843a45430e835e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:46.175858  9957 consensus_queue.cc:1048] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:46.185384  9731 raft_consensus.cc:1275] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Refusing update from remote peer 7a3efe533142484099843a45430e835e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:46.187848 10016 consensus_queue.cc:1048] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:48.312719  9627 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58484:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:48.315063  9627 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:48.364655  9721 tablet_service.cc:1511] Processing CreateTablet for tablet ae9c742a7c314b48bc814d7d040ae2cb (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:48.366246  9721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae9c742a7c314b48bc814d7d040ae2cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.366134  9790 tablet_service.cc:1511] Processing CreateTablet for tablet ae9c742a7c314b48bc814d7d040ae2cb (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:48.367718  9790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae9c742a7c314b48bc814d7d040ae2cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.368103  9866 tablet_service.cc:1511] Processing CreateTablet for tablet ae9c742a7c314b48bc814d7d040ae2cb (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:48.369496  9866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae9c742a7c314b48bc814d7d040ae2cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.373066  9870 tablet_service.cc:1511] Processing CreateTablet for tablet 73af79b3c859459d9440158f097c5467 (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:48.373658  9717 tablet_service.cc:1511] Processing CreateTablet for tablet 73af79b3c859459d9440158f097c5467 (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:48.374540  9870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73af79b3c859459d9440158f097c5467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.375082  9717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73af79b3c859459d9440158f097c5467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.375509  9716 tablet_service.cc:1511] Processing CreateTablet for tablet 66ac3544fa5b45fcb02476c11f0e68e7 (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:48.376818  9716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ac3544fa5b45fcb02476c11f0e68e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.378942  9789 tablet_service.cc:1511] Processing CreateTablet for tablet 66ac3544fa5b45fcb02476c11f0e68e7 (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:48.380528  9789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ac3544fa5b45fcb02476c11f0e68e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.380371  9868 tablet_service.cc:1511] Processing CreateTablet for tablet 66ac3544fa5b45fcb02476c11f0e68e7 (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:48.381811  9868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ac3544fa5b45fcb02476c11f0e68e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.379107  9791 tablet_service.cc:1511] Processing CreateTablet for tablet 73af79b3c859459d9440158f097c5467 (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:48.384049  9791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73af79b3c859459d9440158f097c5467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.396883  9718 tablet_service.cc:1511] Processing CreateTablet for tablet 42e2c921eeea47d6a2b901b36488834d (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:48.399458  9794 tablet_service.cc:1511] Processing CreateTablet for tablet 42e2c921eeea47d6a2b901b36488834d (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:48.400799  9794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42e2c921eeea47d6a2b901b36488834d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.401814  9867 tablet_service.cc:1511] Processing CreateTablet for tablet 42e2c921eeea47d6a2b901b36488834d (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:48.403146  9867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42e2c921eeea47d6a2b901b36488834d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.399533  9718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42e2c921eeea47d6a2b901b36488834d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.418854  9719 tablet_service.cc:1511] Processing CreateTablet for tablet ce6d8a95437b47a985c300f06d17f93d (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:48.422840  9719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce6d8a95437b47a985c300f06d17f93d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.425117 10029 tablet_bootstrap.cc:492] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc: Bootstrap starting.
I20260709 13:16:48.436825 10029 tablet_bootstrap.cc:654] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.437806  9788 tablet_service.cc:1511] Processing CreateTablet for tablet ce6d8a95437b47a985c300f06d17f93d (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:48.439195  9788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce6d8a95437b47a985c300f06d17f93d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.440845  9869 tablet_service.cc:1511] Processing CreateTablet for tablet ce6d8a95437b47a985c300f06d17f93d (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:48.442251  9869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce6d8a95437b47a985c300f06d17f93d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.447984  9721 tablet_service.cc:1511] Processing CreateTablet for tablet 0f31902f9d694417aa5061c6a3510974 (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:48.449396  9721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f31902f9d694417aa5061c6a3510974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.450958  9796 tablet_service.cc:1511] Processing CreateTablet for tablet 0f31902f9d694417aa5061c6a3510974 (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:48.454133  9867 tablet_service.cc:1511] Processing CreateTablet for tablet 0f31902f9d694417aa5061c6a3510974 (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:48.454304  9720 tablet_service.cc:1511] Processing CreateTablet for tablet 72363ee58e5a45ee90362406408513fe (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:48.455473  9867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f31902f9d694417aa5061c6a3510974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.455680  9720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72363ee58e5a45ee90362406408513fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.459808  9796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f31902f9d694417aa5061c6a3510974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.464107  9792 tablet_service.cc:1511] Processing CreateTablet for tablet 72363ee58e5a45ee90362406408513fe (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:48.465498  9792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72363ee58e5a45ee90362406408513fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.473505 10030 tablet_bootstrap.cc:492] T 73af79b3c859459d9440158f097c5467 P 7a3efe533142484099843a45430e835e: Bootstrap starting.
I20260709 13:16:48.475606  9870 tablet_service.cc:1511] Processing CreateTablet for tablet 72363ee58e5a45ee90362406408513fe (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:48.483865  9795 tablet_service.cc:1511] Processing CreateTablet for tablet fa927fad65bb4a70bedffcdc70d420a7 (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:48.485764  9795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa927fad65bb4a70bedffcdc70d420a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.506618  9717 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc591bd988f41949a454c3b671558d9 (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:48.507983  9717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc591bd988f41949a454c3b671558d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.508486  9719 tablet_service.cc:1511] Processing CreateTablet for tablet fa927fad65bb4a70bedffcdc70d420a7 (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:48.509989  9719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa927fad65bb4a70bedffcdc70d420a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.504289  9866 tablet_service.cc:1511] Processing CreateTablet for tablet fa927fad65bb4a70bedffcdc70d420a7 (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:48.512115  9793 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc591bd988f41949a454c3b671558d9 (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:48.513393  9793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc591bd988f41949a454c3b671558d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.521456  9870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72363ee58e5a45ee90362406408513fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.522264  9866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa927fad65bb4a70bedffcdc70d420a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.522049  9868 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc591bd988f41949a454c3b671558d9 (DEFAULT_TABLE table=soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:48.523483  9868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc591bd988f41949a454c3b671558d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.534497 10029 tablet_bootstrap.cc:492] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc: No bootstrap required, opened a new log
I20260709 13:16:48.535257 10029 ts_tablet_manager.cc:1403] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.009s
W20260709 13:16:48.546164  9677 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:48.554301 10029 raft_consensus.cc:359] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.555145 10029 raft_consensus.cc:385] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.555473 10029 raft_consensus.cc:740] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.556216 10029 consensus_queue.cc:260] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.565092 10029 ts_tablet_manager.cc:1434] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:16:48.580204 10030 tablet_bootstrap.cc:654] T 73af79b3c859459d9440158f097c5467 P 7a3efe533142484099843a45430e835e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.617340 10032 tablet_bootstrap.cc:492] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b: Bootstrap starting.
I20260709 13:16:48.616211 10029 tablet_bootstrap.cc:492] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc: Bootstrap starting.
I20260709 13:16:48.639796 10032 tablet_bootstrap.cc:654] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.642412 10029 tablet_bootstrap.cc:654] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.656276 10030 tablet_bootstrap.cc:492] T 73af79b3c859459d9440158f097c5467 P 7a3efe533142484099843a45430e835e: No bootstrap required, opened a new log
I20260709 13:16:48.656853 10030 ts_tablet_manager.cc:1403] T 73af79b3c859459d9440158f097c5467 P 7a3efe533142484099843a45430e835e: Time spent bootstrapping tablet: real 0.184s	user 0.018s	sys 0.005s
I20260709 13:16:48.659420 10030 raft_consensus.cc:359] T 73af79b3c859459d9440158f097c5467 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.660211 10030 raft_consensus.cc:385] T 73af79b3c859459d9440158f097c5467 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.660514 10030 raft_consensus.cc:740] T 73af79b3c859459d9440158f097c5467 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.661389 10030 consensus_queue.cc:260] T 73af79b3c859459d9440158f097c5467 P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.662952 10032 tablet_bootstrap.cc:492] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b: No bootstrap required, opened a new log
I20260709 13:16:48.663735 10032 ts_tablet_manager.cc:1403] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.011s
I20260709 13:16:48.665053 10029 tablet_bootstrap.cc:492] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc: No bootstrap required, opened a new log
I20260709 13:16:48.665578 10029 ts_tablet_manager.cc:1403] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent bootstrapping tablet: real 0.100s	user 0.013s	sys 0.009s
I20260709 13:16:48.666900 10030 ts_tablet_manager.cc:1434] T 73af79b3c859459d9440158f097c5467 P 7a3efe533142484099843a45430e835e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:16:48.666851 10032 raft_consensus.cc:359] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.668093 10030 tablet_bootstrap.cc:492] T ae9c742a7c314b48bc814d7d040ae2cb P 7a3efe533142484099843a45430e835e: Bootstrap starting.
I20260709 13:16:48.668170 10032 raft_consensus.cc:385] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.668780 10032 raft_consensus.cc:740] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.669668 10032 consensus_queue.cc:260] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.669697 10029 raft_consensus.cc:359] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.672544 10029 raft_consensus.cc:385] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.672909 10029 raft_consensus.cc:740] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.673882 10029 consensus_queue.cc:260] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.672120 10032 ts_tablet_manager.cc:1434] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:48.676008 10032 tablet_bootstrap.cc:492] T ae9c742a7c314b48bc814d7d040ae2cb P 782dc79175bb4562959a3d56d258e31b: Bootstrap starting.
I20260709 13:16:48.676831 10030 tablet_bootstrap.cc:654] T ae9c742a7c314b48bc814d7d040ae2cb P 7a3efe533142484099843a45430e835e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.677647 10029 ts_tablet_manager.cc:1434] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:16:48.685855 10032 tablet_bootstrap.cc:654] T ae9c742a7c314b48bc814d7d040ae2cb P 782dc79175bb4562959a3d56d258e31b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.685978 10029 tablet_bootstrap.cc:492] T ce6d8a95437b47a985c300f06d17f93d P 4f0d10ddf86a4ab496486edd77d06dbc: Bootstrap starting.
I20260709 13:16:48.690732 10030 tablet_bootstrap.cc:492] T ae9c742a7c314b48bc814d7d040ae2cb P 7a3efe533142484099843a45430e835e: No bootstrap required, opened a new log
I20260709 13:16:48.691408 10030 ts_tablet_manager.cc:1403] T ae9c742a7c314b48bc814d7d040ae2cb P 7a3efe533142484099843a45430e835e: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.006s
I20260709 13:16:48.693565 10029 tablet_bootstrap.cc:654] T ce6d8a95437b47a985c300f06d17f93d P 4f0d10ddf86a4ab496486edd77d06dbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.695641 10030 raft_consensus.cc:359] T ae9c742a7c314b48bc814d7d040ae2cb P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.696674 10030 raft_consensus.cc:385] T ae9c742a7c314b48bc814d7d040ae2cb P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.697067 10030 raft_consensus.cc:740] T ae9c742a7c314b48bc814d7d040ae2cb P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.698243 10030 consensus_queue.cc:260] T ae9c742a7c314b48bc814d7d040ae2cb P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.702008 10032 tablet_bootstrap.cc:492] T ae9c742a7c314b48bc814d7d040ae2cb P 782dc79175bb4562959a3d56d258e31b: No bootstrap required, opened a new log
I20260709 13:16:48.702625 10032 ts_tablet_manager.cc:1403] T ae9c742a7c314b48bc814d7d040ae2cb P 782dc79175bb4562959a3d56d258e31b: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.010s
I20260709 13:16:48.705646 10032 raft_consensus.cc:359] T ae9c742a7c314b48bc814d7d040ae2cb P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.706403 10032 raft_consensus.cc:385] T ae9c742a7c314b48bc814d7d040ae2cb P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.706740 10032 raft_consensus.cc:740] T ae9c742a7c314b48bc814d7d040ae2cb P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.707533 10032 consensus_queue.cc:260] T ae9c742a7c314b48bc814d7d040ae2cb P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.709964 10032 ts_tablet_manager.cc:1434] T ae9c742a7c314b48bc814d7d040ae2cb P 782dc79175bb4562959a3d56d258e31b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:16:48.710970 10032 tablet_bootstrap.cc:492] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b: Bootstrap starting.
I20260709 13:16:48.711069 10030 ts_tablet_manager.cc:1434] T ae9c742a7c314b48bc814d7d040ae2cb P 7a3efe533142484099843a45430e835e: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:16:48.712157 10030 tablet_bootstrap.cc:492] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e: Bootstrap starting.
I20260709 13:16:48.718564 10032 tablet_bootstrap.cc:654] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.718566 10030 tablet_bootstrap.cc:654] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.730244 10032 tablet_bootstrap.cc:492] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b: No bootstrap required, opened a new log
I20260709 13:16:48.730293 10030 tablet_bootstrap.cc:492] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e: No bootstrap required, opened a new log
I20260709 13:16:48.730757 10032 ts_tablet_manager.cc:1403] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.004s
I20260709 13:16:48.730883 10030 ts_tablet_manager.cc:1403] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e: Time spent bootstrapping tablet: real 0.019s	user 0.002s	sys 0.010s
I20260709 13:16:48.731108 10029 tablet_bootstrap.cc:492] T ce6d8a95437b47a985c300f06d17f93d P 4f0d10ddf86a4ab496486edd77d06dbc: No bootstrap required, opened a new log
I20260709 13:16:48.731670 10029 ts_tablet_manager.cc:1403] T ce6d8a95437b47a985c300f06d17f93d P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.029s
I20260709 13:16:48.733332 10032 raft_consensus.cc:359] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.733920 10032 raft_consensus.cc:385] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.734169 10032 raft_consensus.cc:740] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.734146 10030 raft_consensus.cc:359] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.734607 10029 raft_consensus.cc:359] T ce6d8a95437b47a985c300f06d17f93d P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.735057 10030 raft_consensus.cc:385] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.735368 10029 raft_consensus.cc:385] T ce6d8a95437b47a985c300f06d17f93d P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.735433 10030 raft_consensus.cc:740] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.735126 10032 consensus_queue.cc:260] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.735872 10029 raft_consensus.cc:740] T ce6d8a95437b47a985c300f06d17f93d P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.736660 10030 consensus_queue.cc:260] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.736748 10029 consensus_queue.cc:260] T ce6d8a95437b47a985c300f06d17f93d P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.737598 10032 ts_tablet_manager.cc:1434] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:48.739082 10029 ts_tablet_manager.cc:1434] T ce6d8a95437b47a985c300f06d17f93d P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:48.740272 10032 tablet_bootstrap.cc:492] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b: Bootstrap starting.
I20260709 13:16:48.740340 10029 tablet_bootstrap.cc:492] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc: Bootstrap starting.
I20260709 13:16:48.739039 10030 ts_tablet_manager.cc:1434] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:16:48.746920  9967 raft_consensus.cc:493] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.747694 10032 tablet_bootstrap.cc:654] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.747529  9967 raft_consensus.cc:515] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.747898 10030 tablet_bootstrap.cc:492] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e: Bootstrap starting.
I20260709 13:16:48.749868  9967 leader_election.cc:290] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:48.752036  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6d8a95437b47a985c300f06d17f93d" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:48.752820  9731 raft_consensus.cc:2468] T ce6d8a95437b47a985c300f06d17f93d P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 0.
I20260709 13:16:48.754338  9772 leader_election.cc:304] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 
I20260709 13:16:48.755362  9967 raft_consensus.cc:2804] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.755805  9967 raft_consensus.cc:493] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.756106  9879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6d8a95437b47a985c300f06d17f93d" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e" is_pre_election: true
I20260709 13:16:48.756795 10030 tablet_bootstrap.cc:654] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:48.758698  9772 leader_election.cc:343] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a3efe533142484099843a45430e835e (127.31.17.131:35267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.756244  9967 raft_consensus.cc:3060] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.759984 10029 tablet_bootstrap.cc:654] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.767818  9967 raft_consensus.cc:515] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.778393  9967 leader_election.cc:290] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:48.782799  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6d8a95437b47a985c300f06d17f93d" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:48.783545 10030 tablet_bootstrap.cc:492] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e: No bootstrap required, opened a new log
I20260709 13:16:48.783581  9731 raft_consensus.cc:3060] T ce6d8a95437b47a985c300f06d17f93d P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.784459 10030 ts_tablet_manager.cc:1403] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.016s
I20260709 13:16:48.785498  9967 raft_consensus.cc:493] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.786203  9967 raft_consensus.cc:515] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.788592  9967 leader_election.cc:290] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:48.784657  9879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6d8a95437b47a985c300f06d17f93d" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:48.789533 10029 tablet_bootstrap.cc:492] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc: No bootstrap required, opened a new log
I20260709 13:16:48.790248 10029 ts_tablet_manager.cc:1403] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.001s
I20260709 13:16:48.790284 10033 raft_consensus.cc:493] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.791051 10033 raft_consensus.cc:515] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.794757  9729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e2c921eeea47d6a2b901b36488834d" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:48.794704 10029 raft_consensus.cc:359] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.796300  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e2c921eeea47d6a2b901b36488834d" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e" is_pre_election: true
I20260709 13:16:48.796847  9879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9c742a7c314b48bc814d7d040ae2cb" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e" is_pre_election: true
I20260709 13:16:48.797487 10033 leader_election.cc:290] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:48.797341 10030 raft_consensus.cc:359] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.798197 10030 raft_consensus.cc:385] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:16:48.798358  9772 leader_election.cc:343] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a3efe533142484099843a45430e835e (127.31.17.131:35267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.798986 10030 raft_consensus.cc:740] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.796877 10029 raft_consensus.cc:385] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.799391 10032 tablet_bootstrap.cc:492] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b: No bootstrap required, opened a new log
I20260709 13:16:48.799610 10029 raft_consensus.cc:740] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.799975 10032 ts_tablet_manager.cc:1403] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b: Time spent bootstrapping tablet: real 0.060s	user 0.030s	sys 0.027s
I20260709 13:16:48.799770 10030 consensus_queue.cc:260] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.800478  9879 raft_consensus.cc:2468] T ae9c742a7c314b48bc814d7d040ae2cb P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 0.
I20260709 13:16:48.800980 10029 consensus_queue.cc:260] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.803154  9729 raft_consensus.cc:2468] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 0.
I20260709 13:16:48.803117 10032 raft_consensus.cc:359] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.802098  9697 leader_election.cc:304] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 
I20260709 13:16:48.804565 10032 raft_consensus.cc:385] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.804802  9731 raft_consensus.cc:2468] T ce6d8a95437b47a985c300f06d17f93d P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 1.
I20260709 13:16:48.805276 10006 raft_consensus.cc:2804] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.802232 10030 ts_tablet_manager.cc:1434] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:16:48.804917 10032 raft_consensus.cc:740] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.805717 10006 raft_consensus.cc:493] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.806200 10006 raft_consensus.cc:3060] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.805735 10029 ts_tablet_manager.cc:1434] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:16:48.807363 10029 tablet_bootstrap.cc:492] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc: Bootstrap starting.
I20260709 13:16:48.807591 10032 consensus_queue.cc:260] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
W20260709 13:16:48.799427  9772 leader_election.cc:343] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a3efe533142484099843a45430e835e (127.31.17.131:35267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.810732 10032 ts_tablet_manager.cc:1434] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:16:48.811117 10030 tablet_bootstrap.cc:492] T ce6d8a95437b47a985c300f06d17f93d P 7a3efe533142484099843a45430e835e: Bootstrap starting.
I20260709 13:16:48.811861 10032 tablet_bootstrap.cc:492] T 73af79b3c859459d9440158f097c5467 P 782dc79175bb4562959a3d56d258e31b: Bootstrap starting.
I20260709 13:16:48.810642  9772 leader_election.cc:304] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 7a3efe533142484099843a45430e835e
I20260709 13:16:48.814677  9967 raft_consensus.cc:2804] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.815052  9967 raft_consensus.cc:493] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.815398  9967 raft_consensus.cc:3060] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.817696 10030 tablet_bootstrap.cc:654] T ce6d8a95437b47a985c300f06d17f93d P 7a3efe533142484099843a45430e835e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.819082 10032 tablet_bootstrap.cc:654] T 73af79b3c859459d9440158f097c5467 P 782dc79175bb4562959a3d56d258e31b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.820014  9772 leader_election.cc:304] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 7a3efe533142484099843a45430e835e
I20260709 13:16:48.825162 10016 raft_consensus.cc:493] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.825502 10029 tablet_bootstrap.cc:654] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.825652 10016 raft_consensus.cc:515] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.826092 10037 raft_consensus.cc:2804] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.829254  9804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9c742a7c314b48bc814d7d040ae2cb" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b" is_pre_election: true
I20260709 13:16:48.830005  9804 raft_consensus.cc:2468] T ae9c742a7c314b48bc814d7d040ae2cb P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 0.
I20260709 13:16:48.833432 10016 leader_election.cc:290] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:48.838111  9804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e2c921eeea47d6a2b901b36488834d" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b" is_pre_election: true
I20260709 13:16:48.845551  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e2c921eeea47d6a2b901b36488834d" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:48.846378  9731 raft_consensus.cc:2468] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 0.
I20260709 13:16:48.847642  9846 leader_election.cc:304] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 
I20260709 13:16:48.848680 10016 raft_consensus.cc:2804] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.849085 10016 raft_consensus.cc:493] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.849462 10016 raft_consensus.cc:3060] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.852824 10006 raft_consensus.cc:515] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.824298  9967 raft_consensus.cc:515] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.854638  9804 raft_consensus.cc:2393] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a3efe533142484099843a45430e835e in current term 1: Already voted for candidate 782dc79175bb4562959a3d56d258e31b in this term.
I20260709 13:16:48.856043  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9c742a7c314b48bc814d7d040ae2cb" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:48.856688  9806 raft_consensus.cc:3060] T ae9c742a7c314b48bc814d7d040ae2cb P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.859707  9967 leader_election.cc:290] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:48.864441  9806 raft_consensus.cc:2468] T ae9c742a7c314b48bc814d7d040ae2cb P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 1.
I20260709 13:16:48.865192 10016 raft_consensus.cc:515] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.867400  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e2c921eeea47d6a2b901b36488834d" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:48.868036  9731 raft_consensus.cc:3060] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.868126  9729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e2c921eeea47d6a2b901b36488834d" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:48.871429  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e2c921eeea47d6a2b901b36488834d" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:48.872421  9694 leader_election.cc:304] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 
I20260709 13:16:48.871973 10016 leader_election.cc:290] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:48.872699  9806 raft_consensus.cc:2393] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a3efe533142484099843a45430e835e in current term 1: Already voted for candidate 782dc79175bb4562959a3d56d258e31b in this term.
I20260709 13:16:48.873968  9843 leader_election.cc:304] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a3efe533142484099843a45430e835e; no voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b
I20260709 13:16:48.875706  9879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e2c921eeea47d6a2b901b36488834d" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:48.876581  9879 raft_consensus.cc:2393] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 782dc79175bb4562959a3d56d258e31b in current term 1: Already voted for candidate 7a3efe533142484099843a45430e835e in this term.
I20260709 13:16:48.877429 10033 raft_consensus.cc:2804] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.878808 10033 raft_consensus.cc:697] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 LEADER]: Becoming Leader. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Running, Role: LEADER
I20260709 13:16:48.879444 10016 raft_consensus.cc:2749] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.880455  9731 raft_consensus.cc:2468] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 1.
I20260709 13:16:48.879863 10033 consensus_queue.cc:237] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.882010  9772 leader_election.cc:304] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 7a3efe533142484099843a45430e835e
I20260709 13:16:48.883186  9967 raft_consensus.cc:2804] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.883671  9967 raft_consensus.cc:697] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Becoming Leader. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Running, Role: LEADER
I20260709 13:16:48.884596 10006 leader_election.cc:290] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 election: Requested vote from peers 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:48.884528  9967 consensus_queue.cc:237] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.886267 10030 tablet_bootstrap.cc:492] T ce6d8a95437b47a985c300f06d17f93d P 7a3efe533142484099843a45430e835e: No bootstrap required, opened a new log
I20260709 13:16:48.886782 10030 ts_tablet_manager.cc:1403] T ce6d8a95437b47a985c300f06d17f93d P 7a3efe533142484099843a45430e835e: Time spent bootstrapping tablet: real 0.076s	user 0.018s	sys 0.018s
I20260709 13:16:48.887984 10037 raft_consensus.cc:697] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Becoming Leader. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Running, Role: LEADER
I20260709 13:16:48.889617 10006 raft_consensus.cc:493] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.889997 10030 raft_consensus.cc:359] T ce6d8a95437b47a985c300f06d17f93d P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.890798 10030 raft_consensus.cc:385] T ce6d8a95437b47a985c300f06d17f93d P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.889153 10037 consensus_queue.cc:237] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.891162 10030 raft_consensus.cc:740] T ce6d8a95437b47a985c300f06d17f93d P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.892299 10030 consensus_queue.cc:260] T ce6d8a95437b47a985c300f06d17f93d P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.894744 10032 tablet_bootstrap.cc:492] T 73af79b3c859459d9440158f097c5467 P 782dc79175bb4562959a3d56d258e31b: No bootstrap required, opened a new log
I20260709 13:16:48.895299 10032 ts_tablet_manager.cc:1403] T 73af79b3c859459d9440158f097c5467 P 782dc79175bb4562959a3d56d258e31b: Time spent bootstrapping tablet: real 0.084s	user 0.031s	sys 0.038s
I20260709 13:16:48.895388 10030 ts_tablet_manager.cc:1434] T ce6d8a95437b47a985c300f06d17f93d P 7a3efe533142484099843a45430e835e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.003s
I20260709 13:16:48.896689 10030 tablet_bootstrap.cc:492] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e: Bootstrap starting.
I20260709 13:16:48.890525  9879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9c742a7c314b48bc814d7d040ae2cb" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:48.889829 10029 tablet_bootstrap.cc:492] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc: No bootstrap required, opened a new log
I20260709 13:16:48.899451 10029 ts_tablet_manager.cc:1403] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.026s
I20260709 13:16:48.903028  9879 raft_consensus.cc:3060] T ae9c742a7c314b48bc814d7d040ae2cb P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.902724 10029 raft_consensus.cc:359] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.903489 10029 raft_consensus.cc:385] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.903803 10029 raft_consensus.cc:740] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.904552 10029 consensus_queue.cc:260] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.898957 10032 raft_consensus.cc:359] T 73af79b3c859459d9440158f097c5467 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.906133 10032 raft_consensus.cc:385] T 73af79b3c859459d9440158f097c5467 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.906490 10032 raft_consensus.cc:740] T 73af79b3c859459d9440158f097c5467 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.906834 10029 ts_tablet_manager.cc:1434] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:16:48.907380 10032 consensus_queue.cc:260] T 73af79b3c859459d9440158f097c5467 P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.909559 10032 ts_tablet_manager.cc:1434] T 73af79b3c859459d9440158f097c5467 P 782dc79175bb4562959a3d56d258e31b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:16:48.910372 10032 tablet_bootstrap.cc:492] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b: Bootstrap starting.
I20260709 13:16:48.911288  9879 raft_consensus.cc:2468] T ae9c742a7c314b48bc814d7d040ae2cb P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 1.
I20260709 13:16:48.890419 10006 raft_consensus.cc:515] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.907949 10029 tablet_bootstrap.cc:492] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc: Bootstrap starting.
I20260709 13:16:48.913774 10030 tablet_bootstrap.cc:654] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.915835  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73af79b3c859459d9440158f097c5467" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b" is_pre_election: true
I20260709 13:16:48.916923  9806 raft_consensus.cc:2468] T 73af79b3c859459d9440158f097c5467 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 0.
I20260709 13:16:48.917630  9879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73af79b3c859459d9440158f097c5467" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e" is_pre_election: true
I20260709 13:16:48.918081  9694 leader_election.cc:304] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 
I20260709 13:16:48.918279  9879 raft_consensus.cc:2468] T 73af79b3c859459d9440158f097c5467 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 0.
I20260709 13:16:48.917066 10032 tablet_bootstrap.cc:654] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.918954 10050 raft_consensus.cc:2804] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.916361 10006 leader_election.cc:290] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:48.919517 10050 raft_consensus.cc:493] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.920017 10050 raft_consensus.cc:3060] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.928073 10030 tablet_bootstrap.cc:492] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e: No bootstrap required, opened a new log
I20260709 13:16:48.928704 10032 tablet_bootstrap.cc:492] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b: No bootstrap required, opened a new log
I20260709 13:16:48.929379 10032 ts_tablet_manager.cc:1403] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.001s
I20260709 13:16:48.930989 10030 ts_tablet_manager.cc:1403] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.013s
I20260709 13:16:48.925652 10029 tablet_bootstrap.cc:654] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.931816 10050 raft_consensus.cc:515] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.934700 10032 raft_consensus.cc:359] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.935472 10016 raft_consensus.cc:493] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.935696 10032 raft_consensus.cc:385] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.936041 10016 raft_consensus.cc:515] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.936272 10032 raft_consensus.cc:740] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.937047 10030 raft_consensus.cc:359] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.937470 10032 consensus_queue.cc:260] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.941535 10016 leader_election.cc:290] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:48.940023 10030 raft_consensus.cc:385] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.942468 10030 raft_consensus.cc:740] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.942821 10032 ts_tablet_manager.cc:1434] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
I20260709 13:16:48.944324  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ac3544fa5b45fcb02476c11f0e68e7" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:48.943766 10030 consensus_queue.cc:260] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
W20260709 13:16:48.945794  9846 leader_election.cc:343] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.946506 10032 tablet_bootstrap.cc:492] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b: Bootstrap starting.
I20260709 13:16:48.945794  9628 catalog_manager.cc:5697] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129). New cstate: current_term: 1 leader_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.949819 10030 ts_tablet_manager.cc:1434] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:16:48.951598  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ac3544fa5b45fcb02476c11f0e68e7" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b" is_pre_election: true
I20260709 13:16:48.955138 10032 tablet_bootstrap.cc:654] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.962172  9627 catalog_manager.cc:5697] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b reported cstate change: term changed from 0 to 1, leader changed from <none> to 782dc79175bb4562959a3d56d258e31b (127.31.17.130). New cstate: current_term: 1 leader_uuid: "782dc79175bb4562959a3d56d258e31b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.964040  9804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73af79b3c859459d9440158f097c5467" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:48.964956  9804 raft_consensus.cc:3060] T 73af79b3c859459d9440158f097c5467 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.957019  9806 raft_consensus.cc:2468] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 0.
I20260709 13:16:48.966816  9843 leader_election.cc:304] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 782dc79175bb4562959a3d56d258e31b, 7a3efe533142484099843a45430e835e; no voters: 4f0d10ddf86a4ab496486edd77d06dbc
I20260709 13:16:48.967900 10016 raft_consensus.cc:2804] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.968258 10016 raft_consensus.cc:493] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.968592 10016 raft_consensus.cc:3060] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.970152 10030 tablet_bootstrap.cc:492] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e: Bootstrap starting.
I20260709 13:16:48.979889 10050 leader_election.cc:290] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 election: Requested vote from peers 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:48.980665 10033 raft_consensus.cc:493] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.981169 10016 raft_consensus.cc:515] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.982800  9879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73af79b3c859459d9440158f097c5467" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:48.983505  9879 raft_consensus.cc:3060] T 73af79b3c859459d9440158f097c5467 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.985220  9804 raft_consensus.cc:2468] T 73af79b3c859459d9440158f097c5467 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 1.
I20260709 13:16:48.981290 10033 raft_consensus.cc:515] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.987483  9694 leader_election.cc:304] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 
I20260709 13:16:48.989768 10033 leader_election.cc:290] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:48.990417 10033 raft_consensus.cc:2804] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.990999  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31902f9d694417aa5061c6a3510974" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e" is_pre_election: true
W20260709 13:16:48.992798  9697 leader_election.cc:343] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a3efe533142484099843a45430e835e (127.31.17.131:35267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.993465 10030 tablet_bootstrap.cc:654] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.990927 10033 raft_consensus.cc:697] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 LEADER]: Becoming Leader. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Running, Role: LEADER
I20260709 13:16:48.994748 10033 consensus_queue.cc:237] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:48.997699  9804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31902f9d694417aa5061c6a3510974" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b" is_pre_election: true
I20260709 13:16:48.998379 10029 tablet_bootstrap.cc:492] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc: No bootstrap required, opened a new log
I20260709 13:16:48.998467  9804 raft_consensus.cc:2468] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 0.
I20260709 13:16:49.002014  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ac3544fa5b45fcb02476c11f0e68e7" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:49.001629 10029 ts_tablet_manager.cc:1403] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent bootstrapping tablet: real 0.094s	user 0.027s	sys 0.012s
W20260709 13:16:49.003798  9846 leader_election.cc:343] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.005257  9694 leader_election.cc:304] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 7a3efe533142484099843a45430e835e
I20260709 13:16:49.005884 10016 leader_election.cc:290] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:49.010355  9879 raft_consensus.cc:2468] T 73af79b3c859459d9440158f097c5467 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 1.
I20260709 13:16:49.007589 10050 raft_consensus.cc:2804] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.012506 10029 raft_consensus.cc:359] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.013450 10050 raft_consensus.cc:493] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.013607 10029 raft_consensus.cc:385] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.014173 10050 raft_consensus.cc:3060] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.014199 10029 raft_consensus.cc:740] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.015618 10029 consensus_queue.cc:260] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.007302  9804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ac3544fa5b45fcb02476c11f0e68e7" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:49.019210  9804 raft_consensus.cc:3060] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.019362 10029 ts_tablet_manager.cc:1434] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:16:49.020892 10029 tablet_bootstrap.cc:492] T 8bc591bd988f41949a454c3b671558d9 P 4f0d10ddf86a4ab496486edd77d06dbc: Bootstrap starting.
I20260709 13:16:49.030406 10029 tablet_bootstrap.cc:654] T 8bc591bd988f41949a454c3b671558d9 P 4f0d10ddf86a4ab496486edd77d06dbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.035315 10032 tablet_bootstrap.cc:492] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b: No bootstrap required, opened a new log
I20260709 13:16:49.035902 10032 ts_tablet_manager.cc:1403] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b: Time spent bootstrapping tablet: real 0.090s	user 0.038s	sys 0.034s
I20260709 13:16:49.039433 10032 raft_consensus.cc:359] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.040411 10032 raft_consensus.cc:385] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.040796 10032 raft_consensus.cc:740] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.041776 10032 consensus_queue.cc:260] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.044337 10032 ts_tablet_manager.cc:1434] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:16:49.045745 10032 tablet_bootstrap.cc:492] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b: Bootstrap starting.
I20260709 13:16:49.045713 10050 raft_consensus.cc:515] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.047092 10030 tablet_bootstrap.cc:492] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e: No bootstrap required, opened a new log
I20260709 13:16:49.048669  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31902f9d694417aa5061c6a3510974" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:49.048993  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31902f9d694417aa5061c6a3510974" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:49.049289  9806 raft_consensus.cc:3060] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:49.050364  9697 leader_election.cc:343] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a3efe533142484099843a45430e835e (127.31.17.131:35267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.052843  9804 raft_consensus.cc:2468] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 1.
I20260709 13:16:49.054948 10032 tablet_bootstrap.cc:654] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.054533  9843 leader_election.cc:304] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 782dc79175bb4562959a3d56d258e31b, 7a3efe533142484099843a45430e835e; no voters: 4f0d10ddf86a4ab496486edd77d06dbc
I20260709 13:16:49.056489  9806 raft_consensus.cc:2468] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 1.
I20260709 13:16:49.056651 10016 raft_consensus.cc:2804] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:49.058475 10030 ts_tablet_manager.cc:1403] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e: Time spent bootstrapping tablet: real 0.089s	user 0.029s	sys 0.016s
I20260709 13:16:49.058660  9694 leader_election.cc:304] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 7a3efe533142484099843a45430e835e
I20260709 13:16:49.059893 10033 raft_consensus.cc:2804] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:49.060376 10033 raft_consensus.cc:697] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 LEADER]: Becoming Leader. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Running, Role: LEADER
I20260709 13:16:49.054816 10050 leader_election.cc:290] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 election: Requested vote from peers 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:49.061307 10033 consensus_queue.cc:237] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.062253 10030 raft_consensus.cc:359] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.063337 10030 raft_consensus.cc:385] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.063716 10030 raft_consensus.cc:740] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.065878 10030 consensus_queue.cc:260] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.066660 10016 raft_consensus.cc:697] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Becoming Leader. State: Replica: 7a3efe533142484099843a45430e835e, State: Running, Role: LEADER
I20260709 13:16:49.070218 10016 consensus_queue.cc:237] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.073886 10029 tablet_bootstrap.cc:492] T 8bc591bd988f41949a454c3b671558d9 P 4f0d10ddf86a4ab496486edd77d06dbc: No bootstrap required, opened a new log
I20260709 13:16:49.075439 10029 ts_tablet_manager.cc:1403] T 8bc591bd988f41949a454c3b671558d9 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.003s
I20260709 13:16:49.080955 10032 tablet_bootstrap.cc:492] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b: No bootstrap required, opened a new log
I20260709 13:16:49.081800 10032 ts_tablet_manager.cc:1403] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.004s
I20260709 13:16:49.082543 10029 raft_consensus.cc:359] T 8bc591bd988f41949a454c3b671558d9 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.084939 10032 raft_consensus.cc:359] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.086156 10032 raft_consensus.cc:385] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.086593 10032 raft_consensus.cc:740] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.087576 10030 ts_tablet_manager.cc:1434] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.013s
I20260709 13:16:49.087626 10032 consensus_queue.cc:260] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.088908 10030 tablet_bootstrap.cc:492] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e: Bootstrap starting.
I20260709 13:16:49.090277 10032 ts_tablet_manager.cc:1434] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:49.091603 10032 tablet_bootstrap.cc:492] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b: Bootstrap starting.
I20260709 13:16:49.085760 10029 raft_consensus.cc:385] T 8bc591bd988f41949a454c3b671558d9 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.095978 10029 raft_consensus.cc:740] T 8bc591bd988f41949a454c3b671558d9 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.097832 10029 consensus_queue.cc:260] T 8bc591bd988f41949a454c3b671558d9 P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.099812 10032 tablet_bootstrap.cc:654] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.101641 10030 tablet_bootstrap.cc:654] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.114331 10029 ts_tablet_manager.cc:1434] T 8bc591bd988f41949a454c3b671558d9 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.004s
I20260709 13:16:49.115567 10029 tablet_bootstrap.cc:492] T fa927fad65bb4a70bedffcdc70d420a7 P 4f0d10ddf86a4ab496486edd77d06dbc: Bootstrap starting.
I20260709 13:16:49.116492 10032 tablet_bootstrap.cc:492] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b: No bootstrap required, opened a new log
I20260709 13:16:49.117163 10032 ts_tablet_manager.cc:1403] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.002s
I20260709 13:16:49.117451  9626 catalog_manager.cc:5697] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a3efe533142484099843a45430e835e (127.31.17.131). New cstate: current_term: 1 leader_uuid: "7a3efe533142484099843a45430e835e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:49.119603 10016 raft_consensus.cc:493] T ce6d8a95437b47a985c300f06d17f93d P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.120126 10016 raft_consensus.cc:515] T ce6d8a95437b47a985c300f06d17f93d P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.120512 10032 raft_consensus.cc:359] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.122124 10032 raft_consensus.cc:385] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.122504 10032 raft_consensus.cc:740] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.124363 10016 leader_election.cc:290] T ce6d8a95437b47a985c300f06d17f93d P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:49.125770  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6d8a95437b47a985c300f06d17f93d" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:49.126598  9731 raft_consensus.cc:2393] T ce6d8a95437b47a985c300f06d17f93d P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a3efe533142484099843a45430e835e in current term 1: Already voted for candidate 782dc79175bb4562959a3d56d258e31b in this term.
I20260709 13:16:49.127552 10030 tablet_bootstrap.cc:492] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e: No bootstrap required, opened a new log
I20260709 13:16:49.127526  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6d8a95437b47a985c300f06d17f93d" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b" is_pre_election: true
I20260709 13:16:49.128315 10030 ts_tablet_manager.cc:1403] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.000s
I20260709 13:16:49.129127  9843 leader_election.cc:304] T ce6d8a95437b47a985c300f06d17f93d P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a3efe533142484099843a45430e835e; no voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b
I20260709 13:16:49.130369 10016 raft_consensus.cc:3060] T ce6d8a95437b47a985c300f06d17f93d P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.131021 10030 raft_consensus.cc:359] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.131793 10030 raft_consensus.cc:385] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.132085 10030 raft_consensus.cc:740] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.132823 10030 consensus_queue.cc:260] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.133514 10029 tablet_bootstrap.cc:654] T fa927fad65bb4a70bedffcdc70d420a7 P 4f0d10ddf86a4ab496486edd77d06dbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.135172 10030 ts_tablet_manager.cc:1434] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:49.136137 10030 tablet_bootstrap.cc:492] T 72363ee58e5a45ee90362406408513fe P 7a3efe533142484099843a45430e835e: Bootstrap starting.
I20260709 13:16:49.138098 10016 raft_consensus.cc:2749] T ce6d8a95437b47a985c300f06d17f93d P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:49.123490 10032 consensus_queue.cc:260] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.140753 10032 ts_tablet_manager.cc:1434] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 13:16:49.142748 10030 tablet_bootstrap.cc:654] T 72363ee58e5a45ee90362406408513fe P 7a3efe533142484099843a45430e835e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.141475 10029 tablet_bootstrap.cc:492] T fa927fad65bb4a70bedffcdc70d420a7 P 4f0d10ddf86a4ab496486edd77d06dbc: No bootstrap required, opened a new log
I20260709 13:16:49.147533 10029 ts_tablet_manager.cc:1403] T fa927fad65bb4a70bedffcdc70d420a7 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent bootstrapping tablet: real 0.032s	user 0.003s	sys 0.009s
I20260709 13:16:49.148118 10048 raft_consensus.cc:493] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.148620 10048 raft_consensus.cc:515] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.148679  9628 catalog_manager.cc:5697] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129). New cstate: current_term: 1 leader_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.150322 10029 raft_consensus.cc:359] T fa927fad65bb4a70bedffcdc70d420a7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.150825 10048 leader_election.cc:290] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:49.151093 10029 raft_consensus.cc:385] T fa927fad65bb4a70bedffcdc70d420a7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.150522  9628 catalog_manager.cc:5697] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129). New cstate: current_term: 1 leader_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.151412 10029 raft_consensus.cc:740] T fa927fad65bb4a70bedffcdc70d420a7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.152158 10029 consensus_queue.cc:260] T fa927fad65bb4a70bedffcdc70d420a7 P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.153224  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc591bd988f41949a454c3b671558d9" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:49.153867  9731 raft_consensus.cc:2468] T 8bc591bd988f41949a454c3b671558d9 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 0.
I20260709 13:16:49.154868  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc591bd988f41949a454c3b671558d9" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e" is_pre_election: true
I20260709 13:16:49.155107  9772 leader_election.cc:304] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 
I20260709 13:16:49.155556  9878 raft_consensus.cc:2468] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 0.
I20260709 13:16:49.156739 10048 raft_consensus.cc:2804] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.157099 10048 raft_consensus.cc:493] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.157193 10029 ts_tablet_manager.cc:1434] T fa927fad65bb4a70bedffcdc70d420a7 P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:16:49.157452 10048 raft_consensus.cc:3060] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.158150 10029 tablet_bootstrap.cc:492] T 72363ee58e5a45ee90362406408513fe P 4f0d10ddf86a4ab496486edd77d06dbc: Bootstrap starting.
I20260709 13:16:49.161650 10037 raft_consensus.cc:493] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.162151 10037 raft_consensus.cc:515] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.164467 10037 leader_election.cc:290] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:49.165058 10029 tablet_bootstrap.cc:654] T 72363ee58e5a45ee90362406408513fe P 4f0d10ddf86a4ab496486edd77d06dbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.165197 10048 raft_consensus.cc:515] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.166301  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa927fad65bb4a70bedffcdc70d420a7" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e" is_pre_election: true
I20260709 13:16:49.166970  9878 raft_consensus.cc:2468] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 0.
I20260709 13:16:49.166857  9627 catalog_manager.cc:5697] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b reported cstate change: term changed from 0 to 1, leader changed from <none> to 782dc79175bb4562959a3d56d258e31b (127.31.17.130). New cstate: current_term: 1 leader_uuid: "782dc79175bb4562959a3d56d258e31b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.168673  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa927fad65bb4a70bedffcdc70d420a7" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:49.169620  9731 raft_consensus.cc:2468] T fa927fad65bb4a70bedffcdc70d420a7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 0.
I20260709 13:16:49.171715  9772 leader_election.cc:304] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 
I20260709 13:16:49.175424 10037 raft_consensus.cc:2804] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.176653 10037 raft_consensus.cc:493] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.177134 10037 raft_consensus.cc:3060] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.185998 10037 raft_consensus.cc:515] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.191553  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc591bd988f41949a454c3b671558d9" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:49.192474  9731 raft_consensus.cc:3060] T 8bc591bd988f41949a454c3b671558d9 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.195698  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc591bd988f41949a454c3b671558d9" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:49.190946 10048 leader_election.cc:290] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:49.196599  9878 raft_consensus.cc:3060] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.198868 10037 leader_election.cc:290] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:49.199710  9729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa927fad65bb4a70bedffcdc70d420a7" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:49.200459  9879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa927fad65bb4a70bedffcdc70d420a7" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:49.200613  9729 raft_consensus.cc:3060] T fa927fad65bb4a70bedffcdc70d420a7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.201085  9879 raft_consensus.cc:3060] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.202143 10030 tablet_bootstrap.cc:492] T 72363ee58e5a45ee90362406408513fe P 7a3efe533142484099843a45430e835e: No bootstrap required, opened a new log
I20260709 13:16:49.202646 10030 ts_tablet_manager.cc:1403] T 72363ee58e5a45ee90362406408513fe P 7a3efe533142484099843a45430e835e: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.007s
I20260709 13:16:49.205535 10030 raft_consensus.cc:359] T 72363ee58e5a45ee90362406408513fe P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.206207 10030 raft_consensus.cc:385] T 72363ee58e5a45ee90362406408513fe P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.206480 10030 raft_consensus.cc:740] T 72363ee58e5a45ee90362406408513fe P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.207187 10030 consensus_queue.cc:260] T 72363ee58e5a45ee90362406408513fe P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.209831 10029 tablet_bootstrap.cc:492] T 72363ee58e5a45ee90362406408513fe P 4f0d10ddf86a4ab496486edd77d06dbc: No bootstrap required, opened a new log
I20260709 13:16:49.210407 10029 ts_tablet_manager.cc:1403] T 72363ee58e5a45ee90362406408513fe P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.027s
I20260709 13:16:49.210464 10030 ts_tablet_manager.cc:1434] T 72363ee58e5a45ee90362406408513fe P 7a3efe533142484099843a45430e835e: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:16:49.210975  9879 raft_consensus.cc:2468] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 1.
I20260709 13:16:49.212826  9772 leader_election.cc:304] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 782dc79175bb4562959a3d56d258e31b, 7a3efe533142484099843a45430e835e; no voters: 
I20260709 13:16:49.213145  9729 raft_consensus.cc:2468] T fa927fad65bb4a70bedffcdc70d420a7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 1.
I20260709 13:16:49.213716 10037 raft_consensus.cc:2804] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:49.214241 10037 raft_consensus.cc:697] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Becoming Leader. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Running, Role: LEADER
I20260709 13:16:49.219153  9731 raft_consensus.cc:2468] T 8bc591bd988f41949a454c3b671558d9 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 1.
I20260709 13:16:49.219684 10037 consensus_queue.cc:237] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.213192 10029 raft_consensus.cc:359] T 72363ee58e5a45ee90362406408513fe P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.222132  9772 leader_election.cc:304] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 
I20260709 13:16:49.223845 10029 raft_consensus.cc:385] T 72363ee58e5a45ee90362406408513fe P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.224186 10029 raft_consensus.cc:740] T 72363ee58e5a45ee90362406408513fe P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.224852 10029 consensus_queue.cc:260] T 72363ee58e5a45ee90362406408513fe P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.226760  9967 raft_consensus.cc:2804] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:49.230959 10029 ts_tablet_manager.cc:1434] T 72363ee58e5a45ee90362406408513fe P 4f0d10ddf86a4ab496486edd77d06dbc: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:16:49.230216  9626 catalog_manager.cc:5697] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b reported cstate change: term changed from 0 to 1, leader changed from <none> to 782dc79175bb4562959a3d56d258e31b (127.31.17.130). New cstate: current_term: 1 leader_uuid: "782dc79175bb4562959a3d56d258e31b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.231935  9878 raft_consensus.cc:2468] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 1.
I20260709 13:16:49.235387  9967 raft_consensus.cc:697] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Becoming Leader. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Running, Role: LEADER
I20260709 13:16:49.236341  9967 consensus_queue.cc:237] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.246217  9626 catalog_manager.cc:5697] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b reported cstate change: term changed from 0 to 1, leader changed from <none> to 782dc79175bb4562959a3d56d258e31b (127.31.17.130). New cstate: current_term: 1 leader_uuid: "782dc79175bb4562959a3d56d258e31b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.270325  9967 raft_consensus.cc:493] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.270906  9967 raft_consensus.cc:515] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.272742  9967 leader_election.cc:290] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:49.273674  9729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72363ee58e5a45ee90362406408513fe" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:49.273998  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72363ee58e5a45ee90362406408513fe" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e" is_pre_election: true
I20260709 13:16:49.274362  9729 raft_consensus.cc:2468] T 72363ee58e5a45ee90362406408513fe P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 0.
I20260709 13:16:49.274665  9878 raft_consensus.cc:2468] T 72363ee58e5a45ee90362406408513fe P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 0.
I20260709 13:16:49.275630  9772 leader_election.cc:304] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 
I20260709 13:16:49.276305  9967 raft_consensus.cc:2804] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.276683  9967 raft_consensus.cc:493] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.276979  9967 raft_consensus.cc:3060] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.282342  9967 raft_consensus.cc:515] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.283990  9967 leader_election.cc:290] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:49.284732  9729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72363ee58e5a45ee90362406408513fe" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:49.285039  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72363ee58e5a45ee90362406408513fe" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:49.285310  9729 raft_consensus.cc:3060] T 72363ee58e5a45ee90362406408513fe P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.285701  9878 raft_consensus.cc:3060] T 72363ee58e5a45ee90362406408513fe P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.291059  9729 raft_consensus.cc:2468] T 72363ee58e5a45ee90362406408513fe P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 1.
I20260709 13:16:49.291388  9878 raft_consensus.cc:2468] T 72363ee58e5a45ee90362406408513fe P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 1.
I20260709 13:16:49.292208  9772 leader_election.cc:304] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 
I20260709 13:16:49.292836  9967 raft_consensus.cc:2804] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:49.293339  9967 raft_consensus.cc:697] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Becoming Leader. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Running, Role: LEADER
I20260709 13:16:49.294050  9967 consensus_queue.cc:237] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.299682 10033 raft_consensus.cc:493] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.300217 10033 raft_consensus.cc:515] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.302327 10033 leader_election.cc:290] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:49.301924  9626 catalog_manager.cc:5697] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b reported cstate change: term changed from 0 to 1, leader changed from <none> to 782dc79175bb4562959a3d56d258e31b (127.31.17.130). New cstate: current_term: 1 leader_uuid: "782dc79175bb4562959a3d56d258e31b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.302857  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ac3544fa5b45fcb02476c11f0e68e7" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b" is_pre_election: true
I20260709 13:16:49.303578  9806 raft_consensus.cc:2393] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f0d10ddf86a4ab496486edd77d06dbc in current term 1: Already voted for candidate 7a3efe533142484099843a45430e835e in this term.
I20260709 13:16:49.303368  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ac3544fa5b45fcb02476c11f0e68e7" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3efe533142484099843a45430e835e" is_pre_election: true
I20260709 13:16:49.304981  9697 leader_election.cc:304] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc; no voters: 782dc79175bb4562959a3d56d258e31b, 7a3efe533142484099843a45430e835e
I20260709 13:16:49.305778 10033 raft_consensus.cc:3060] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.312052 10033 raft_consensus.cc:2749] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:49.326921 10033 consensus_queue.cc:1048] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.337641 10033 consensus_queue.cc:1048] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.343787 10076 consensus_queue.cc:1048] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.348821  9967 consensus_queue.cc:1048] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.368093  9967 consensus_queue.cc:1048] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.370076  9878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66ac3544fa5b45fcb02476c11f0e68e7"
dest_uuid: "7a3efe533142484099843a45430e835e"
mode: GRACEFUL
new_leader_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
 from {username='slave'} at 127.0.0.1:59190
I20260709 13:16:49.370607  9878 raft_consensus.cc:606] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Received request to transfer leadership to TS 4f0d10ddf86a4ab496486edd77d06dbc
I20260709 13:16:49.389325 10037 consensus_queue.cc:1048] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:16:49.404533 10016 raft_consensus.cc:493] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.405035 10016 raft_consensus.cc:515] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.408390  9729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31902f9d694417aa5061c6a3510974" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" is_pre_election: true
I20260709 13:16:49.411778  9806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42e2c921eeea47d6a2b901b36488834d"
dest_uuid: "782dc79175bb4562959a3d56d258e31b"
mode: GRACEFUL
new_leader_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
 from {username='slave'} at 127.0.0.1:47026
I20260709 13:16:49.412344  9806 raft_consensus.cc:606] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Received request to transfer leadership to TS 4f0d10ddf86a4ab496486edd77d06dbc
I20260709 13:16:49.407099 10016 leader_election.cc:290] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:49.413054  9804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31902f9d694417aa5061c6a3510974" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782dc79175bb4562959a3d56d258e31b" is_pre_election: true
I20260709 13:16:49.413914  9804 raft_consensus.cc:2393] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a3efe533142484099843a45430e835e in current term 1: Already voted for candidate 4f0d10ddf86a4ab496486edd77d06dbc in this term.
I20260709 13:16:49.415060  9843 leader_election.cc:304] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a3efe533142484099843a45430e835e; no voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b
I20260709 13:16:49.415939 10050 consensus_queue.cc:1048] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.417712 10016 raft_consensus.cc:3060] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.425758 10016 raft_consensus.cc:2749] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:49.429332  9731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f31902f9d694417aa5061c6a3510974"
dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
mode: GRACEFUL
new_leader_uuid: "782dc79175bb4562959a3d56d258e31b"
 from {username='slave'} at 127.0.0.1:60796
I20260709 13:16:49.430087  9731 raft_consensus.cc:606] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 LEADER]: Received request to transfer leadership to TS 782dc79175bb4562959a3d56d258e31b
I20260709 13:16:49.436143 10050 consensus_queue.cc:1048] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.443104  9804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bc591bd988f41949a454c3b671558d9"
dest_uuid: "782dc79175bb4562959a3d56d258e31b"
mode: GRACEFUL
new_leader_uuid: "7a3efe533142484099843a45430e835e"
 from {username='slave'} at 127.0.0.1:47026
I20260709 13:16:49.443750  9804 raft_consensus.cc:606] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Received request to transfer leadership to TS 7a3efe533142484099843a45430e835e
I20260709 13:16:49.456386 10016 consensus_queue.cc:1048] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.463070 10067 raft_consensus.cc:993] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e: : Instructing follower 4f0d10ddf86a4ab496486edd77d06dbc to start an election
I20260709 13:16:49.463614 10067 raft_consensus.cc:1081] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Signalling peer 4f0d10ddf86a4ab496486edd77d06dbc to start an election
I20260709 13:16:49.465274  9729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66ac3544fa5b45fcb02476c11f0e68e7"
dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
 from {username='slave'} at 127.0.0.1:60786
I20260709 13:16:49.467005  9729 raft_consensus.cc:493] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:49.467406  9729 raft_consensus.cc:3060] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.468130 10067 consensus_queue.cc:1048] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.474668  9729 raft_consensus.cc:515] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.481412  9729 leader_election.cc:290] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 2 election: Requested vote from peers 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:49.482481  9879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ac3544fa5b45fcb02476c11f0e68e7" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:49.483145  9879 raft_consensus.cc:3055] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:49.483342  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ac3544fa5b45fcb02476c11f0e68e7" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:49.483530  9879 raft_consensus.cc:740] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a3efe533142484099843a45430e835e, State: Running, Role: LEADER
I20260709 13:16:49.483985  9806 raft_consensus.cc:3060] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.484457  9879 consensus_queue.cc:260] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.485599  9879 raft_consensus.cc:3060] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.490244  9806 raft_consensus.cc:2468] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 2.
I20260709 13:16:49.491412  9694 leader_election.cc:304] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 
I20260709 13:16:49.492314 10050 raft_consensus.cc:2804] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:49.492769 10050 raft_consensus.cc:697] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 LEADER]: Becoming Leader. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Running, Role: LEADER
I20260709 13:16:49.493130  9879 raft_consensus.cc:2468] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 2.
I20260709 13:16:49.493577 10050 consensus_queue.cc:237] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.500761  9628 catalog_manager.cc:5697] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc reported cstate change: term changed from 1 to 2, leader changed from 7a3efe533142484099843a45430e835e (127.31.17.131) to 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129). New cstate: current_term: 2 leader_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.589356 10050 consensus_queue.cc:1048] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.597209 10006 raft_consensus.cc:993] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc: : Instructing follower 782dc79175bb4562959a3d56d258e31b to start an election
I20260709 13:16:49.597677 10006 raft_consensus.cc:1081] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 LEADER]: Signalling peer 782dc79175bb4562959a3d56d258e31b to start an election
I20260709 13:16:49.599622  9804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f31902f9d694417aa5061c6a3510974"
dest_uuid: "782dc79175bb4562959a3d56d258e31b"
 from {username='slave'} at 127.0.0.1:41052
I20260709 13:16:49.600189  9804 raft_consensus.cc:493] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:49.600538  9804 raft_consensus.cc:3060] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.602257 10033 consensus_queue.cc:1048] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.607489  9804 raft_consensus.cc:515] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.608649  9806 raft_consensus.cc:1240] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Rejecting Update request from peer 4f0d10ddf86a4ab496486edd77d06dbc for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:49.610765 10033 consensus_queue.cc:1059] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.611557 10006 raft_consensus.cc:3055] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:49.611924 10006 raft_consensus.cc:740] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Running, Role: LEADER
I20260709 13:16:49.612164  9804 leader_election.cc:290] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 2 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:49.612744 10006 consensus_queue.cc:260] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.613606  9878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31902f9d694417aa5061c6a3510974" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:49.613953 10006 raft_consensus.cc:3060] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.619639  9729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31902f9d694417aa5061c6a3510974" candidate_uuid: "782dc79175bb4562959a3d56d258e31b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:49.624676  9729 raft_consensus.cc:2468] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 782dc79175bb4562959a3d56d258e31b in term 2.
I20260709 13:16:49.625626  9772 leader_election.cc:304] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 782dc79175bb4562959a3d56d258e31b; no voters: 7a3efe533142484099843a45430e835e
I20260709 13:16:49.626425 10037 raft_consensus.cc:2804] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:49.626850 10037 raft_consensus.cc:697] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [term 2 LEADER]: Becoming Leader. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Running, Role: LEADER
I20260709 13:16:49.627640 10037 consensus_queue.cc:237] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.634864  9628 catalog_manager.cc:5697] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b reported cstate change: term changed from 1 to 2, leader changed from 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129) to 782dc79175bb4562959a3d56d258e31b (127.31.17.130). New cstate: current_term: 2 leader_uuid: "782dc79175bb4562959a3d56d258e31b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.688885 10037 consensus_queue.cc:1048] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.700862 10048 consensus_queue.cc:1048] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.726696 10076 consensus_queue.cc:1048] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.734021  9967 consensus_queue.cc:1048] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:49.766085 10076 consensus_queue.cc:1048] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.778538 10076 consensus_queue.cc:1048] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.787418 10037 raft_consensus.cc:993] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b: : Instructing follower 7a3efe533142484099843a45430e835e to start an election
I20260709 13:16:49.787909 10076 raft_consensus.cc:1081] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Signalling peer 7a3efe533142484099843a45430e835e to start an election
I20260709 13:16:49.789098 10076 raft_consensus.cc:993] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b: : Instructing follower 4f0d10ddf86a4ab496486edd77d06dbc to start an election
I20260709 13:16:49.789525 10037 raft_consensus.cc:1081] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Signalling peer 4f0d10ddf86a4ab496486edd77d06dbc to start an election
I20260709 13:16:49.790491  9879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bc591bd988f41949a454c3b671558d9"
dest_uuid: "7a3efe533142484099843a45430e835e"
 from {username='slave'} at 127.0.0.1:59164
I20260709 13:16:49.791082  9729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42e2c921eeea47d6a2b901b36488834d"
dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
 from {username='slave'} at 127.0.0.1:60776
I20260709 13:16:49.791118  9879 raft_consensus.cc:493] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:49.791811  9729 raft_consensus.cc:493] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:49.791819  9879 raft_consensus.cc:3060] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.792218  9729 raft_consensus.cc:3060] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.797050  9879 raft_consensus.cc:515] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.797178  9729 raft_consensus.cc:515] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.799927  9879 leader_election.cc:290] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 2 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:49.800108  9804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e2c921eeea47d6a2b901b36488834d" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:49.800340  9729 leader_election.cc:290] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 2 election: Requested vote from peers 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193), 7a3efe533142484099843a45430e835e (127.31.17.131:35267)
I20260709 13:16:49.800740  9804 raft_consensus.cc:3055] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:49.801075  9804 raft_consensus.cc:740] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Running, Role: LEADER
I20260709 13:16:49.801595  9879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e2c921eeea47d6a2b901b36488834d" candidate_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a3efe533142484099843a45430e835e"
I20260709 13:16:49.801851  9804 consensus_queue.cc:260] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.802152  9879 raft_consensus.cc:3060] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.799836  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc591bd988f41949a454c3b671558d9" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:49.802830  9731 raft_consensus.cc:3060] T 8bc591bd988f41949a454c3b671558d9 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.803015  9804 raft_consensus.cc:3060] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.805230  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc591bd988f41949a454c3b671558d9" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:49.805804  9806 raft_consensus.cc:3055] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:49.806092  9806 raft_consensus.cc:740] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Running, Role: LEADER
I20260709 13:16:49.806815  9806 consensus_queue.cc:260] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.808144  9806 raft_consensus.cc:3060] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.808952  9879 raft_consensus.cc:2468] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 2.
I20260709 13:16:49.809327  9731 raft_consensus.cc:2468] T 8bc591bd988f41949a454c3b671558d9 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 2.
I20260709 13:16:49.810297  9697 leader_election.cc:304] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 
I20260709 13:16:49.810470  9846 leader_election.cc:304] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 
I20260709 13:16:49.811128 10006 raft_consensus.cc:2804] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:49.811269 10067 raft_consensus.cc:2804] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:49.811781 10006 raft_consensus.cc:697] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 LEADER]: Becoming Leader. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Running, Role: LEADER
I20260709 13:16:49.811826 10067 raft_consensus.cc:697] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e [term 2 LEADER]: Becoming Leader. State: Replica: 7a3efe533142484099843a45430e835e, State: Running, Role: LEADER
I20260709 13:16:49.810742  9804 raft_consensus.cc:2468] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f0d10ddf86a4ab496486edd77d06dbc in term 2.
I20260709 13:16:49.812821 10006 consensus_queue.cc:237] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.812858 10067 consensus_queue.cc:237] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:49.819805  9806 raft_consensus.cc:2468] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 2.
I20260709 13:16:49.821056  9628 catalog_manager.cc:5697] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc reported cstate change: term changed from 1 to 2, leader changed from 782dc79175bb4562959a3d56d258e31b (127.31.17.130) to 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129). New cstate: current_term: 2 leader_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.821669  9626 catalog_manager.cc:5697] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e reported cstate change: term changed from 1 to 2, leader changed from 782dc79175bb4562959a3d56d258e31b (127.31.17.130) to 7a3efe533142484099843a45430e835e (127.31.17.131). New cstate: current_term: 2 leader_uuid: "7a3efe533142484099843a45430e835e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:50.071698  9806 raft_consensus.cc:1275] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Refusing update from remote peer 4f0d10ddf86a4ab496486edd77d06dbc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:50.072991 10050 consensus_queue.cc:1048] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:50.081377  9879 raft_consensus.cc:1275] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Refusing update from remote peer 4f0d10ddf86a4ab496486edd77d06dbc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:50.082970 10103 consensus_queue.cc:1048] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:50.102732  9731 raft_consensus.cc:1275] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Refusing update from remote peer 782dc79175bb4562959a3d56d258e31b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:50.103899 10037 consensus_queue.cc:1048] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:50.114538  9879 raft_consensus.cc:3060] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.122898  9879 raft_consensus.cc:1275] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Refusing update from remote peer 782dc79175bb4562959a3d56d258e31b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:50.124650 10048 consensus_queue.cc:1048] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:50.203930  9806 raft_consensus.cc:1275] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Refusing update from remote peer 4f0d10ddf86a4ab496486edd77d06dbc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:50.205452 10006 consensus_queue.cc:1048] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:50.213186  9879 raft_consensus.cc:1275] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Refusing update from remote peer 4f0d10ddf86a4ab496486edd77d06dbc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:50.215811 10050 consensus_queue.cc:1048] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:50.231326  9806 raft_consensus.cc:1275] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Refusing update from remote peer 7a3efe533142484099843a45430e835e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:50.232617 10067 consensus_queue.cc:1048] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:50.241565  9731 raft_consensus.cc:1275] T 8bc591bd988f41949a454c3b671558d9 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Refusing update from remote peer 7a3efe533142484099843a45430e835e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:50.243428 10067 consensus_queue.cc:1048] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:52.448904  9626 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58484:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:16:52.469375  9626 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58484:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:16:52.509320 31814 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:16:52.636224 10125 log.cc:927] Time spent T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:16:52.689172 10133 log.cc:927] Time spent T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:16:52.720956 10137 log.cc:927] Time spent T ae9c742a7c314b48bc814d7d040ae2cb P 782dc79175bb4562959a3d56d258e31b: Append to log took a long time: real 0.078s	user 0.000s	sys 0.004s
I20260709 13:16:52.776022 10162 tablet.cc:1724] T ae9c742a7c314b48bc814d7d040ae2cb P 7a3efe533142484099843a45430e835e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:16:52.782424 10149 log.cc:927] Time spent T 73af79b3c859459d9440158f097c5467 P 7a3efe533142484099843a45430e835e: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:16:52.787583 10142 log.cc:927] Time spent T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:16:52.792776  9772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:35267, user_credentials={real_user=slave}} blocked reactor thread for 92807.7us
I20260709 13:16:52.793740 10161 tablet.cc:1724] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:52.824636  9729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42e2c921eeea47d6a2b901b36488834d"
dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
mode: GRACEFUL
new_leader_uuid: "7a3efe533142484099843a45430e835e"
 from {username='slave'} at 127.0.0.1:50582
I20260709 13:16:52.797395 10160 tablet.cc:1724] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:52.812559 10157 tablet.cc:1724] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:52.859984 10165 tablet.cc:1724] T 8bc591bd988f41949a454c3b671558d9 P 4f0d10ddf86a4ab496486edd77d06dbc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:52.869737  9729 raft_consensus.cc:606] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 LEADER]: Received request to transfer leadership to TS 7a3efe533142484099843a45430e835e
W20260709 13:16:52.880121  9772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.129:33057, user_credentials={real_user=slave}} blocked reactor thread for 72268.6us
I20260709 13:16:52.896421 10171 tablet.cc:1724] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:16:52.901799  9757 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:8bc591bd988f41949a454c3b671558d9)
W20260709 13:16:52.902879  9757 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:8bc591bd988f41949a454c3b671558d9)
I20260709 13:16:52.874877 10167 tablet.cc:1724] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:52.920485 10170 tablet.cc:1724] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:16:52.927600  9832 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:8bc591bd988f41949a454c3b671558d9)
I20260709 13:16:52.928493 10162 tablet.cc:1724] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:52.931149 10166 raft_consensus.cc:993] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc: : Instructing follower 7a3efe533142484099843a45430e835e to start an election
I20260709 13:16:52.931705 10166 raft_consensus.cc:1081] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 LEADER]: Signalling peer 7a3efe533142484099843a45430e835e to start an election
I20260709 13:16:52.955904 10162 tablet.cc:1724] T 73af79b3c859459d9440158f097c5467 P 7a3efe533142484099843a45430e835e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:52.964540 10160 tablet.cc:1724] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:52.984308  9876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42e2c921eeea47d6a2b901b36488834d"
dest_uuid: "7a3efe533142484099843a45430e835e"
 from {username='slave'} at 127.0.0.1:59174
I20260709 13:16:52.993649 10165 tablet.cc:1724] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:52.992551  9876 raft_consensus.cc:493] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:53.000697  9876 raft_consensus.cc:3060] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:53.003186  9772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.131:35267, user_credentials={real_user=slave}} blocked reactor thread for 119192us
I20260709 13:16:52.996819 10161 tablet.cc:1724] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:53.033397 10180 tablet.cc:1724] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:53.018678 10157 tablet.cc:1724] T ce6d8a95437b47a985c300f06d17f93d P 4f0d10ddf86a4ab496486edd77d06dbc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:53.040678 10175 tablet.cc:1724] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:53.038058 10177 tablet.cc:1724] T ce6d8a95437b47a985c300f06d17f93d P 7a3efe533142484099843a45430e835e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:53.048393  9876 raft_consensus.cc:515] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:53.051702  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e2c921eeea47d6a2b901b36488834d" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:53.052394  9731 raft_consensus.cc:3055] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:53.052738  9731 raft_consensus.cc:740] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Running, Role: LEADER
I20260709 13:16:53.053859  9731 consensus_queue.cc:260] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:53.054785  9731 raft_consensus.cc:3060] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.058209  9804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e2c921eeea47d6a2b901b36488834d" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:53.058933  9804 raft_consensus.cc:3060] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.052605 10170 tablet.cc:1724] T fa927fad65bb4a70bedffcdc70d420a7 P 4f0d10ddf86a4ab496486edd77d06dbc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:53.033421 10162 tablet.cc:1724] T 72363ee58e5a45ee90362406408513fe P 7a3efe533142484099843a45430e835e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:53.051532 10182 tablet.cc:1724] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:53.087304  9805 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa927fad65bb4a70bedffcdc70d420a7"
dest_uuid: "782dc79175bb4562959a3d56d258e31b"
mode: GRACEFUL
new_leader_uuid: "7a3efe533142484099843a45430e835e"
 from {username='slave'} at 127.0.0.1:47030
I20260709 13:16:53.064908 10171 tablet.cc:1724] T 73af79b3c859459d9440158f097c5467 P 782dc79175bb4562959a3d56d258e31b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:53.088142  9805 raft_consensus.cc:606] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Received request to transfer leadership to TS 7a3efe533142484099843a45430e835e
I20260709 13:16:53.087630 10180 tablet.cc:1724] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:53.064241 10160 tablet.cc:1724] T ae9c742a7c314b48bc814d7d040ae2cb P 782dc79175bb4562959a3d56d258e31b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:53.090708 10157 tablet.cc:1724] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:53.092711 31814 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:16:53.097246 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:53.070479  9731 raft_consensus.cc:2468] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 3.
I20260709 13:16:53.100040  9846 leader_election.cc:304] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 
I20260709 13:16:53.101279 10106 raft_consensus.cc:2804] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:53.101759 10106 raft_consensus.cc:697] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 3 LEADER]: Becoming Leader. State: Replica: 7a3efe533142484099843a45430e835e, State: Running, Role: LEADER
I20260709 13:16:53.102540 10106 consensus_queue.cc:237] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:53.072598  9804 raft_consensus.cc:2468] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 3.
I20260709 13:16:53.092108 10167 tablet.cc:1724] T 72363ee58e5a45ee90362406408513fe P 4f0d10ddf86a4ab496486edd77d06dbc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:53.073123  9876 leader_election.cc:290] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 3 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:53.118789  9628 catalog_manager.cc:5697] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e reported cstate change: term changed from 2 to 3, leader changed from 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129) to 7a3efe533142484099843a45430e835e (127.31.17.131). New cstate: current_term: 3 leader_uuid: "7a3efe533142484099843a45430e835e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.122372 10171 tablet.cc:1724] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:53.131203  9731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04ad5f6dd66f44c3a0f495033d4b5784"
dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
mode: GRACEFUL
new_leader_uuid: "7a3efe533142484099843a45430e835e"
 from {username='slave'} at 127.0.0.1:50582
I20260709 13:16:53.131934  9731 raft_consensus.cc:606] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 LEADER]: Received request to transfer leadership to TS 7a3efe533142484099843a45430e835e
I20260709 13:16:53.139950  9804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "386daa82c32e4e47a1651d86e52acbf6"
dest_uuid: "782dc79175bb4562959a3d56d258e31b"
mode: GRACEFUL
new_leader_uuid: "7a3efe533142484099843a45430e835e"
 from {username='slave'} at 127.0.0.1:47030
I20260709 13:16:53.140640  9804 raft_consensus.cc:606] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Received request to transfer leadership to TS 7a3efe533142484099843a45430e835e
I20260709 13:16:53.142197 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:53.142902 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:53.153411  9627 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf: soft_deleted_table [id=69c424945efa4686a1daa205caf173f2] alter complete (version 1)
I20260709 13:16:53.249823 10174 raft_consensus.cc:993] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b: : Instructing follower 7a3efe533142484099843a45430e835e to start an election
I20260709 13:16:53.250525 10109 raft_consensus.cc:1081] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Signalling peer 7a3efe533142484099843a45430e835e to start an election
I20260709 13:16:53.252130  9876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "386daa82c32e4e47a1651d86e52acbf6"
dest_uuid: "7a3efe533142484099843a45430e835e"
 from {username='slave'} at 127.0.0.1:59164
I20260709 13:16:53.252652  9876 raft_consensus.cc:493] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:53.252992  9876 raft_consensus.cc:3060] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:53.258136  9876 raft_consensus.cc:515] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:53.260227  9876 leader_election.cc:290] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 2 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:53.261101  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386daa82c32e4e47a1651d86e52acbf6" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:53.261420  9804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386daa82c32e4e47a1651d86e52acbf6" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:53.261715  9731 raft_consensus.cc:3060] T 386daa82c32e4e47a1651d86e52acbf6 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:53.262020  9804 raft_consensus.cc:3055] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:53.262372  9804 raft_consensus.cc:740] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Running, Role: LEADER
I20260709 13:16:53.263113  9804 consensus_queue.cc:260] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:53.264156  9804 raft_consensus.cc:3060] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:53.267138  9731 raft_consensus.cc:2468] T 386daa82c32e4e47a1651d86e52acbf6 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 2.
I20260709 13:16:53.268417  9846 leader_election.cc:304] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 
I20260709 13:16:53.269141  9804 raft_consensus.cc:2468] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 2.
I20260709 13:16:53.269199 10106 raft_consensus.cc:2804] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:53.269831 10106 raft_consensus.cc:697] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e [term 2 LEADER]: Becoming Leader. State: Replica: 7a3efe533142484099843a45430e835e, State: Running, Role: LEADER
I20260709 13:16:53.270623 10106 consensus_queue.cc:237] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:53.279103  9626 catalog_manager.cc:5697] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e reported cstate change: term changed from 1 to 2, leader changed from 782dc79175bb4562959a3d56d258e31b (127.31.17.130) to 7a3efe533142484099843a45430e835e (127.31.17.131). New cstate: current_term: 2 leader_uuid: "7a3efe533142484099843a45430e835e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.319845 10174 raft_consensus.cc:993] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b: : Instructing follower 7a3efe533142484099843a45430e835e to start an election
I20260709 13:16:53.320261 10109 raft_consensus.cc:1081] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Signalling peer 7a3efe533142484099843a45430e835e to start an election
I20260709 13:16:53.321579  9876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa927fad65bb4a70bedffcdc70d420a7"
dest_uuid: "7a3efe533142484099843a45430e835e"
 from {username='slave'} at 127.0.0.1:59164
I20260709 13:16:53.322055  9876 raft_consensus.cc:493] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:53.322348  9876 raft_consensus.cc:3060] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:53.327222  9876 raft_consensus.cc:515] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:53.328737  9876 leader_election.cc:290] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 2 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:53.329571  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa927fad65bb4a70bedffcdc70d420a7" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:53.329890  9804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa927fad65bb4a70bedffcdc70d420a7" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:53.330188  9731 raft_consensus.cc:3060] T fa927fad65bb4a70bedffcdc70d420a7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:53.330507  9804 raft_consensus.cc:3055] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:53.330799  9804 raft_consensus.cc:740] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 782dc79175bb4562959a3d56d258e31b, State: Running, Role: LEADER
I20260709 13:16:53.331501  9804 consensus_queue.cc:260] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:53.332435  9804 raft_consensus.cc:3060] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:53.335224  9731 raft_consensus.cc:2468] T fa927fad65bb4a70bedffcdc70d420a7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 2.
I20260709 13:16:53.336411  9846 leader_election.cc:304] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f0d10ddf86a4ab496486edd77d06dbc, 7a3efe533142484099843a45430e835e; no voters: 
I20260709 13:16:53.337428 10150 raft_consensus.cc:2804] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:53.337881 10150 raft_consensus.cc:697] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e [term 2 LEADER]: Becoming Leader. State: Replica: 7a3efe533142484099843a45430e835e, State: Running, Role: LEADER
I20260709 13:16:53.338697 10150 consensus_queue.cc:237] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } }
I20260709 13:16:53.339094  9804 raft_consensus.cc:2468] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 2.
I20260709 13:16:53.345657  9626 catalog_manager.cc:5697] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e reported cstate change: term changed from 1 to 2, leader changed from 782dc79175bb4562959a3d56d258e31b (127.31.17.130) to 7a3efe533142484099843a45430e835e (127.31.17.131). New cstate: current_term: 2 leader_uuid: "7a3efe533142484099843a45430e835e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.367565 10166 raft_consensus.cc:993] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc: : Instructing follower 7a3efe533142484099843a45430e835e to start an election
I20260709 13:16:53.368099 10164 raft_consensus.cc:1081] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 LEADER]: Signalling peer 7a3efe533142484099843a45430e835e to start an election
I20260709 13:16:53.369659  9876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04ad5f6dd66f44c3a0f495033d4b5784"
dest_uuid: "7a3efe533142484099843a45430e835e"
 from {username='slave'} at 127.0.0.1:59174
I20260709 13:16:53.370219  9876 raft_consensus.cc:493] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:53.370545  9876 raft_consensus.cc:3060] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.376215  9876 raft_consensus.cc:515] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } }
I20260709 13:16:53.378111  9876 leader_election.cc:290] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 3 election: Requested vote from peers 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057), 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193)
I20260709 13:16:53.378836  9731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ad5f6dd66f44c3a0f495033d4b5784" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f0d10ddf86a4ab496486edd77d06dbc"
I20260709 13:16:53.379066  9804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ad5f6dd66f44c3a0f495033d4b5784" candidate_uuid: "7a3efe533142484099843a45430e835e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "782dc79175bb4562959a3d56d258e31b"
I20260709 13:16:53.379477  9731 raft_consensus.cc:3055] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:53.379788  9804 raft_consensus.cc:3060] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.379812  9731 raft_consensus.cc:740] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f0d10ddf86a4ab496486edd77d06dbc, State: Running, Role: LEADER
I20260709 13:16:53.380613  9731 consensus_queue.cc:260] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } }
I20260709 13:16:53.381556  9731 raft_consensus.cc:3060] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.385368  9804 raft_consensus.cc:2468] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 3.
I20260709 13:16:53.386299  9731 raft_consensus.cc:2468] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3efe533142484099843a45430e835e in term 3.
I20260709 13:16:53.386411  9843 leader_election.cc:304] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 782dc79175bb4562959a3d56d258e31b, 7a3efe533142484099843a45430e835e; no voters: 
I20260709 13:16:53.387372 10150 raft_consensus.cc:2804] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:53.387785 10150 raft_consensus.cc:697] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 3 LEADER]: Becoming Leader. State: Replica: 7a3efe533142484099843a45430e835e, State: Running, Role: LEADER
I20260709 13:16:53.388486 10150 consensus_queue.cc:237] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } }
I20260709 13:16:53.395889  9626 catalog_manager.cc:5697] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e reported cstate change: term changed from 2 to 3, leader changed from 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129) to 7a3efe533142484099843a45430e835e (127.31.17.131). New cstate: current_term: 3 leader_uuid: "7a3efe533142484099843a45430e835e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3efe533142484099843a45430e835e" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 35267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.540066  9731 raft_consensus.cc:1275] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 3 FOLLOWER]: Refusing update from remote peer 7a3efe533142484099843a45430e835e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:53.541217 10150 consensus_queue.cc:1048] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:53.550905  9804 raft_consensus.cc:1275] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 3 FOLLOWER]: Refusing update from remote peer 7a3efe533142484099843a45430e835e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:53.553265 10106 consensus_queue.cc:1048] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:53.558247 10160 tablet.cc:1724] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:53.566397  9627 catalog_manager.cc:5789] TS 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193) does not have the latest schema for tablet 42e2c921eeea47d6a2b901b36488834d (table soft_deleted_table [id=69c424945efa4686a1daa205caf173f2]). Expected version 1 got 0
I20260709 13:16:53.694782  9804 raft_consensus.cc:1275] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Refusing update from remote peer 7a3efe533142484099843a45430e835e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:53.695996 10106 consensus_queue.cc:1048] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:53.705269  9731 raft_consensus.cc:1275] T 386daa82c32e4e47a1651d86e52acbf6 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Refusing update from remote peer 7a3efe533142484099843a45430e835e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:53.706509 10150 consensus_queue.cc:1048] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:53.781808  9731 raft_consensus.cc:1275] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 3 FOLLOWER]: Refusing update from remote peer 7a3efe533142484099843a45430e835e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:53.783174 10150 consensus_queue.cc:1048] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:53.791940  9804 raft_consensus.cc:1275] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b [term 3 FOLLOWER]: Refusing update from remote peer 7a3efe533142484099843a45430e835e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:53.793913 10190 consensus_queue.cc:1048] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:53.937799  9731 raft_consensus.cc:1275] T fa927fad65bb4a70bedffcdc70d420a7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Refusing update from remote peer 7a3efe533142484099843a45430e835e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:16:53.938930 10190 consensus_queue.cc:1048] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f0d10ddf86a4ab496486edd77d06dbc" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:53.946449  9804 raft_consensus.cc:1275] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Refusing update from remote peer 7a3efe533142484099843a45430e835e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:16:53.948316 10150 consensus_queue.cc:1048] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e [LEADER]: Connected to new peer: Peer: permanent_uuid: "782dc79175bb4562959a3d56d258e31b" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 45193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:54.201328 31814 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:16:54.208364 31814 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:16:54.208911 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:54.215737 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:16:54.216142 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:55.249406 31814 tablet_server.cc:179] TabletServer@127.31.17.129:0 shutting down...
W20260709 13:16:55.263477  9846 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:16:55.269532  9846 consensus_peers.cc:597] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e -> Peer 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057): Couldn't send request to peer 4f0d10ddf86a4ab496486edd77d06dbc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.283375 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:55.284216 31814 tablet_replica.cc:333] T 72363ee58e5a45ee90362406408513fe P 4f0d10ddf86a4ab496486edd77d06dbc: stopping tablet replica
I20260709 13:16:55.285194 31814 raft_consensus.cc:2243] T 72363ee58e5a45ee90362406408513fe P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.285926 31814 raft_consensus.cc:2272] T 72363ee58e5a45ee90362406408513fe P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.288616 31814 tablet_replica.cc:333] T fa927fad65bb4a70bedffcdc70d420a7 P 4f0d10ddf86a4ab496486edd77d06dbc: stopping tablet replica
I20260709 13:16:55.289659 31814 raft_consensus.cc:2243] T fa927fad65bb4a70bedffcdc70d420a7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.290483 31814 raft_consensus.cc:2272] T fa927fad65bb4a70bedffcdc70d420a7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.293653 31814 tablet_replica.cc:333] T 8bc591bd988f41949a454c3b671558d9 P 4f0d10ddf86a4ab496486edd77d06dbc: stopping tablet replica
I20260709 13:16:55.294652 31814 raft_consensus.cc:2243] T 8bc591bd988f41949a454c3b671558d9 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.295614 31814 raft_consensus.cc:2272] T 8bc591bd988f41949a454c3b671558d9 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.298152 31814 tablet_replica.cc:333] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc: stopping tablet replica
I20260709 13:16:55.298897 31814 raft_consensus.cc:2243] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.300227 31814 raft_consensus.cc:2272] T 66ac3544fa5b45fcb02476c11f0e68e7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.303226 31814 tablet_replica.cc:333] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc: stopping tablet replica
I20260709 13:16:55.303788 31814 raft_consensus.cc:2243] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.304374 31814 raft_consensus.cc:2272] T 42e2c921eeea47d6a2b901b36488834d P 4f0d10ddf86a4ab496486edd77d06dbc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.308110 31814 tablet_replica.cc:333] T ce6d8a95437b47a985c300f06d17f93d P 4f0d10ddf86a4ab496486edd77d06dbc: stopping tablet replica
I20260709 13:16:55.308897 31814 raft_consensus.cc:2243] T ce6d8a95437b47a985c300f06d17f93d P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.309785 31814 raft_consensus.cc:2272] T ce6d8a95437b47a985c300f06d17f93d P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.312285 31814 tablet_replica.cc:333] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc: stopping tablet replica
I20260709 13:16:55.312968 31814 raft_consensus.cc:2243] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.313570 31814 raft_consensus.cc:2272] T 0f31902f9d694417aa5061c6a3510974 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.316056 31814 tablet_replica.cc:333] T e0b87e57485846eb82bd1400340857d1 P 4f0d10ddf86a4ab496486edd77d06dbc: stopping tablet replica
I20260709 13:16:55.316632 31814 raft_consensus.cc:2243] T e0b87e57485846eb82bd1400340857d1 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.317183 31814 raft_consensus.cc:2272] T e0b87e57485846eb82bd1400340857d1 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.319769 31814 tablet_replica.cc:333] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc: stopping tablet replica
I20260709 13:16:55.320380 31814 raft_consensus.cc:2243] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.320895 31814 raft_consensus.cc:2272] T 9f8f95e2da4249f48fd41d41810ce4de P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.323104 31814 tablet_replica.cc:333] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc: stopping tablet replica
I20260709 13:16:55.323673 31814 raft_consensus.cc:2243] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.324216 31814 raft_consensus.cc:2272] T 04ad5f6dd66f44c3a0f495033d4b5784 P 4f0d10ddf86a4ab496486edd77d06dbc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.326481 31814 tablet_replica.cc:333] T 386daa82c32e4e47a1651d86e52acbf6 P 4f0d10ddf86a4ab496486edd77d06dbc: stopping tablet replica
I20260709 13:16:55.327010 31814 raft_consensus.cc:2243] T 386daa82c32e4e47a1651d86e52acbf6 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.327559 31814 raft_consensus.cc:2272] T 386daa82c32e4e47a1651d86e52acbf6 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.329783 31814 tablet_replica.cc:333] T cf8def47942243549659fe26a543f6ab P 4f0d10ddf86a4ab496486edd77d06dbc: stopping tablet replica
I20260709 13:16:55.330364 31814 raft_consensus.cc:2243] T cf8def47942243549659fe26a543f6ab P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.330847 31814 raft_consensus.cc:2272] T cf8def47942243549659fe26a543f6ab P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.333149 31814 tablet_replica.cc:333] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc: stopping tablet replica
I20260709 13:16:55.333694 31814 raft_consensus.cc:2243] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.334195 31814 raft_consensus.cc:2272] T 7f0058e1974a4f0db28945445d791d06 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.336454 31814 tablet_replica.cc:333] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc: stopping tablet replica
I20260709 13:16:55.336951 31814 raft_consensus.cc:2243] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.337881 31814 raft_consensus.cc:2272] T 8d64d963832242a686386ac5d061005c P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.340265 31814 tablet_replica.cc:333] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc: stopping tablet replica
I20260709 13:16:55.340832 31814 raft_consensus.cc:2243] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.341751 31814 raft_consensus.cc:2272] T 1e7160b2d69c4a57b46af60fc5ceea5a P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.344223 31814 tablet_replica.cc:333] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc: stopping tablet replica
I20260709 13:16:55.344759 31814 raft_consensus.cc:2243] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.345623 31814 raft_consensus.cc:2272] T c397e1036163454a8d0adf7fa989ebd7 P 4f0d10ddf86a4ab496486edd77d06dbc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.347958 31814 tablet_replica.cc:333] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc: stopping tablet replica
I20260709 13:16:55.348484 31814 raft_consensus.cc:2243] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.349443 31814 raft_consensus.cc:2272] T ae9c742a7c314b48bc814d7d040ae2cb P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.351979 31814 tablet_replica.cc:333] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc: stopping tablet replica
I20260709 13:16:55.352488 31814 raft_consensus.cc:2243] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.353415 31814 raft_consensus.cc:2272] T 73af79b3c859459d9440158f097c5467 P 4f0d10ddf86a4ab496486edd77d06dbc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:55.397053  9772 consensus_peers.cc:597] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b -> Peer 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057): Couldn't send request to peer 4f0d10ddf86a4ab496486edd77d06dbc. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:33057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.397485  9772 consensus_peers.cc:597] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b -> Peer 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057): Couldn't send request to peer 4f0d10ddf86a4ab496486edd77d06dbc. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:33057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.402671 31814 tablet_server.cc:196] TabletServer@127.31.17.129:0 shutdown complete.
I20260709 13:16:55.447737 31814 tablet_server.cc:179] TabletServer@127.31.17.130:0 shutting down...
W20260709 13:16:55.460724  9843 consensus_peers.cc:597] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e -> Peer 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193): Couldn't send request to peer 782dc79175bb4562959a3d56d258e31b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.476780 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:55.477698 31814 tablet_replica.cc:333] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b: stopping tablet replica
I20260709 13:16:55.478663 31814 raft_consensus.cc:2243] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.479427 31814 raft_consensus.cc:2272] T 8bc591bd988f41949a454c3b671558d9 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.481963 31814 tablet_replica.cc:333] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b: stopping tablet replica
I20260709 13:16:55.482659 31814 raft_consensus.cc:2243] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.483152 31814 raft_consensus.cc:2272] T fa927fad65bb4a70bedffcdc70d420a7 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.486117 31814 tablet_replica.cc:333] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b: stopping tablet replica
I20260709 13:16:55.486809 31814 raft_consensus.cc:2243] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:16:55.487423  9843 consensus_peers.cc:597] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e -> Peer 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193): Couldn't send request to peer 782dc79175bb4562959a3d56d258e31b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.487944 31814 raft_consensus.cc:2272] T 72363ee58e5a45ee90362406408513fe P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.490471 31814 tablet_replica.cc:333] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b: stopping tablet replica
I20260709 13:16:55.491110 31814 raft_consensus.cc:2243] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.491683 31814 raft_consensus.cc:2272] T 66ac3544fa5b45fcb02476c11f0e68e7 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.494184 31814 tablet_replica.cc:333] T 73af79b3c859459d9440158f097c5467 P 782dc79175bb4562959a3d56d258e31b: stopping tablet replica
I20260709 13:16:55.494782 31814 raft_consensus.cc:2243] T 73af79b3c859459d9440158f097c5467 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.495355 31814 raft_consensus.cc:2272] T 73af79b3c859459d9440158f097c5467 P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.497661 31814 tablet_replica.cc:333] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b: stopping tablet replica
I20260709 13:16:55.498291 31814 raft_consensus.cc:2243] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.499254 31814 raft_consensus.cc:2272] T ce6d8a95437b47a985c300f06d17f93d P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.501948 31814 tablet_replica.cc:333] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b: stopping tablet replica
I20260709 13:16:55.502955 31814 raft_consensus.cc:2243] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.504284 31814 raft_consensus.cc:2272] T 0f31902f9d694417aa5061c6a3510974 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.506834 31814 tablet_replica.cc:333] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b: stopping tablet replica
W20260709 13:16:55.506935  9846 consensus_peers.cc:597] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e -> Peer 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057): Couldn't send request to peer 4f0d10ddf86a4ab496486edd77d06dbc. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:33057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.507575 31814 raft_consensus.cc:2243] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.508580 31814 raft_consensus.cc:2272] T e0b87e57485846eb82bd1400340857d1 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.511822 31814 tablet_replica.cc:333] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b: stopping tablet replica
I20260709 13:16:55.512718 31814 raft_consensus.cc:2243] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.513994 31814 raft_consensus.cc:2272] T 7f0058e1974a4f0db28945445d791d06 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:55.514163  9846 consensus_peers.cc:597] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e -> Peer 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057): Couldn't send request to peer 4f0d10ddf86a4ab496486edd77d06dbc. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:33057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.517685 31814 tablet_replica.cc:333] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b: stopping tablet replica
I20260709 13:16:55.518374 31814 raft_consensus.cc:2243] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:55.518675  9846 consensus_peers.cc:597] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e -> Peer 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057): Couldn't send request to peer 4f0d10ddf86a4ab496486edd77d06dbc. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:33057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.519075 31814 raft_consensus.cc:2272] T 04ad5f6dd66f44c3a0f495033d4b5784 P 782dc79175bb4562959a3d56d258e31b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.521463 31814 tablet_replica.cc:333] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b: stopping tablet replica
I20260709 13:16:55.522017 31814 raft_consensus.cc:2243] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.522460 31814 raft_consensus.cc:2272] T 386daa82c32e4e47a1651d86e52acbf6 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.524865 31814 tablet_replica.cc:333] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b: stopping tablet replica
I20260709 13:16:55.525385 31814 raft_consensus.cc:2243] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.526264 31814 raft_consensus.cc:2272] T cf8def47942243549659fe26a543f6ab P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.528556 31814 tablet_replica.cc:333] T 8d64d963832242a686386ac5d061005c P 782dc79175bb4562959a3d56d258e31b: stopping tablet replica
I20260709 13:16:55.529064 31814 raft_consensus.cc:2243] T 8d64d963832242a686386ac5d061005c P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.529498 31814 raft_consensus.cc:2272] T 8d64d963832242a686386ac5d061005c P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.531796 31814 tablet_replica.cc:333] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b: stopping tablet replica
I20260709 13:16:55.532385 31814 raft_consensus.cc:2243] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.532989 31814 raft_consensus.cc:2272] T 42e2c921eeea47d6a2b901b36488834d P 782dc79175bb4562959a3d56d258e31b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.535550 31814 tablet_replica.cc:333] T c397e1036163454a8d0adf7fa989ebd7 P 782dc79175bb4562959a3d56d258e31b: stopping tablet replica
I20260709 13:16:55.536067 31814 raft_consensus.cc:2243] T c397e1036163454a8d0adf7fa989ebd7 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.536528 31814 raft_consensus.cc:2272] T c397e1036163454a8d0adf7fa989ebd7 P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.538620 31814 tablet_replica.cc:333] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b: stopping tablet replica
I20260709 13:16:55.539085 31814 raft_consensus.cc:2243] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.539677 31814 raft_consensus.cc:2272] T 1e7160b2d69c4a57b46af60fc5ceea5a P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.542774 31814 tablet_replica.cc:333] T ae9c742a7c314b48bc814d7d040ae2cb P 782dc79175bb4562959a3d56d258e31b: stopping tablet replica
I20260709 13:16:55.543583 31814 raft_consensus.cc:2243] T ae9c742a7c314b48bc814d7d040ae2cb P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.544306 31814 raft_consensus.cc:2272] T ae9c742a7c314b48bc814d7d040ae2cb P 782dc79175bb4562959a3d56d258e31b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:55.544744  9846 consensus_peers.cc:597] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e -> Peer 4f0d10ddf86a4ab496486edd77d06dbc (127.31.17.129:33057): Couldn't send request to peer 4f0d10ddf86a4ab496486edd77d06dbc. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:33057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.546744 31814 tablet_replica.cc:333] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b: stopping tablet replica
I20260709 13:16:55.547403 31814 raft_consensus.cc:2243] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.547963 31814 raft_consensus.cc:2272] T 9f8f95e2da4249f48fd41d41810ce4de P 782dc79175bb4562959a3d56d258e31b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.592888 31814 tablet_server.cc:196] TabletServer@127.31.17.130:0 shutdown complete.
I20260709 13:16:55.630570 31814 tablet_server.cc:179] TabletServer@127.31.17.131:0 shutting down...
W20260709 13:16:55.632730  9843 consensus_peers.cc:597] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e -> Peer 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193): Couldn't send request to peer 782dc79175bb4562959a3d56d258e31b. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:45193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.660005  9843 consensus_peers.cc:597] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e -> Peer 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193): Couldn't send request to peer 782dc79175bb4562959a3d56d258e31b. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:45193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.664402 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:16:55.664474  9843 consensus_peers.cc:597] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e -> Peer 782dc79175bb4562959a3d56d258e31b (127.31.17.130:45193): Couldn't send request to peer 782dc79175bb4562959a3d56d258e31b. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:45193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.665361 31814 tablet_replica.cc:333] T 72363ee58e5a45ee90362406408513fe P 7a3efe533142484099843a45430e835e: stopping tablet replica
I20260709 13:16:55.666471 31814 raft_consensus.cc:2243] T 72363ee58e5a45ee90362406408513fe P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.667359 31814 raft_consensus.cc:2272] T 72363ee58e5a45ee90362406408513fe P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.669561 31814 tablet_replica.cc:333] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e: stopping tablet replica
I20260709 13:16:55.670106 31814 raft_consensus.cc:2243] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.670922 31814 raft_consensus.cc:2272] T 8bc591bd988f41949a454c3b671558d9 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.673200 31814 tablet_replica.cc:333] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e: stopping tablet replica
I20260709 13:16:55.673753 31814 raft_consensus.cc:2243] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.674593 31814 raft_consensus.cc:2272] T fa927fad65bb4a70bedffcdc70d420a7 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.676972 31814 tablet_replica.cc:333] T ce6d8a95437b47a985c300f06d17f93d P 7a3efe533142484099843a45430e835e: stopping tablet replica
I20260709 13:16:55.677641 31814 raft_consensus.cc:2243] T ce6d8a95437b47a985c300f06d17f93d P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.678118 31814 raft_consensus.cc:2272] T ce6d8a95437b47a985c300f06d17f93d P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.680315 31814 tablet_replica.cc:333] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e: stopping tablet replica
I20260709 13:16:55.680889 31814 raft_consensus.cc:2243] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.681651 31814 raft_consensus.cc:2272] T 42e2c921eeea47d6a2b901b36488834d P 7a3efe533142484099843a45430e835e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.683974 31814 tablet_replica.cc:333] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e: stopping tablet replica
I20260709 13:16:55.684566 31814 raft_consensus.cc:2243] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.685074 31814 raft_consensus.cc:2272] T 66ac3544fa5b45fcb02476c11f0e68e7 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.687141 31814 tablet_replica.cc:333] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e: stopping tablet replica
I20260709 13:16:55.687780 31814 raft_consensus.cc:2243] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.688261 31814 raft_consensus.cc:2272] T 0f31902f9d694417aa5061c6a3510974 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.690148 31814 tablet_replica.cc:333] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e: stopping tablet replica
I20260709 13:16:55.690694 31814 raft_consensus.cc:2243] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.691181 31814 raft_consensus.cc:2272] T e0b87e57485846eb82bd1400340857d1 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.693291 31814 tablet_replica.cc:333] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e: stopping tablet replica
I20260709 13:16:55.693810 31814 raft_consensus.cc:2243] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.694617 31814 raft_consensus.cc:2272] T 386daa82c32e4e47a1651d86e52acbf6 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.696568 31814 tablet_replica.cc:333] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e: stopping tablet replica
I20260709 13:16:55.697091 31814 raft_consensus.cc:2243] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.697894 31814 raft_consensus.cc:2272] T 04ad5f6dd66f44c3a0f495033d4b5784 P 7a3efe533142484099843a45430e835e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.699887 31814 tablet_replica.cc:333] T cf8def47942243549659fe26a543f6ab P 7a3efe533142484099843a45430e835e: stopping tablet replica
I20260709 13:16:55.700425 31814 raft_consensus.cc:2243] T cf8def47942243549659fe26a543f6ab P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.700865 31814 raft_consensus.cc:2272] T cf8def47942243549659fe26a543f6ab P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.702965 31814 tablet_replica.cc:333] T 7f0058e1974a4f0db28945445d791d06 P 7a3efe533142484099843a45430e835e: stopping tablet replica
I20260709 13:16:55.703514 31814 raft_consensus.cc:2243] T 7f0058e1974a4f0db28945445d791d06 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.703966 31814 raft_consensus.cc:2272] T 7f0058e1974a4f0db28945445d791d06 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.705858 31814 tablet_replica.cc:333] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e: stopping tablet replica
I20260709 13:16:55.706348 31814 raft_consensus.cc:2243] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.707222 31814 raft_consensus.cc:2272] T 9f8f95e2da4249f48fd41d41810ce4de P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.709118 31814 tablet_replica.cc:333] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e: stopping tablet replica
I20260709 13:16:55.709594 31814 raft_consensus.cc:2243] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.710022 31814 raft_consensus.cc:2272] T 1e7160b2d69c4a57b46af60fc5ceea5a P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.712393 31814 tablet_replica.cc:333] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e: stopping tablet replica
I20260709 13:16:55.712905 31814 raft_consensus.cc:2243] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.713493 31814 raft_consensus.cc:2272] T c397e1036163454a8d0adf7fa989ebd7 P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.715725 31814 tablet_replica.cc:333] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e: stopping tablet replica
I20260709 13:16:55.716183 31814 raft_consensus.cc:2243] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.716689 31814 raft_consensus.cc:2272] T 8d64d963832242a686386ac5d061005c P 7a3efe533142484099843a45430e835e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.718853 31814 tablet_replica.cc:333] T 73af79b3c859459d9440158f097c5467 P 7a3efe533142484099843a45430e835e: stopping tablet replica
I20260709 13:16:55.719321 31814 raft_consensus.cc:2243] T 73af79b3c859459d9440158f097c5467 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.719847 31814 raft_consensus.cc:2272] T 73af79b3c859459d9440158f097c5467 P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.722028 31814 tablet_replica.cc:333] T ae9c742a7c314b48bc814d7d040ae2cb P 7a3efe533142484099843a45430e835e: stopping tablet replica
I20260709 13:16:55.722496 31814 raft_consensus.cc:2243] T ae9c742a7c314b48bc814d7d040ae2cb P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.722991 31814 raft_consensus.cc:2272] T ae9c742a7c314b48bc814d7d040ae2cb P 7a3efe533142484099843a45430e835e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.764513 31814 tablet_server.cc:196] TabletServer@127.31.17.131:0 shutdown complete.
I20260709 13:16:55.800382 31814 master.cc:562] Master@127.31.17.190:44309 shutting down...
I20260709 13:16:55.822690 31814 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.823326 31814 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.823624 31814 tablet_replica.cc:333] T 00000000000000000000000000000000 P 79aa53e96e60468d87d11cafa7229bbf: stopping tablet replica
I20260709 13:16:55.844511 31814 master.cc:584] Master@127.31.17.190:44309 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12549 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:16:55.898541 31814 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.31.17.190:33739
I20260709 13:16:55.899683 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:55.905637 10205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:55.905635 10206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:55.906095 10208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:55.907140 31814 server_base.cc:1061] running on GCE node
I20260709 13:16:55.908020 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:55.908213 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:55.908370 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783603015908340 us; error 0 us; skew 500 ppm
I20260709 13:16:55.908872 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:55.911093 31814 webserver.cc:533] Webserver started at http://127.31.17.190:38693/ using document root <none> and password file <none>
I20260709 13:16:55.911617 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:55.911795 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:55.912067 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:55.913169 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/master-0-root/instance:
uuid: "89cec2b4e7e0471894189b7ec9141303"
format_stamp: "Formatted at 2026-07-09 13:16:55 on dist-test-slave-zhw8"
I20260709 13:16:55.917763 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:16:55.921145 10213 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:55.921866 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:16:55.922173 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/master-0-root
uuid: "89cec2b4e7e0471894189b7ec9141303"
format_stamp: "Formatted at 2026-07-09 13:16:55 on dist-test-slave-zhw8"
I20260709 13:16:55.922456 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:55.947378 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:55.948717 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:55.988495 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.190:33739
I20260709 13:16:55.988601 10264 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.190:33739 every 8 connection(s)
I20260709 13:16:55.992373 10265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.003697 10265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303: Bootstrap starting.
I20260709 13:16:56.008643 10265 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.012894 10265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303: No bootstrap required, opened a new log
I20260709 13:16:56.015117 10265 raft_consensus.cc:359] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89cec2b4e7e0471894189b7ec9141303" member_type: VOTER }
I20260709 13:16:56.015578 10265 raft_consensus.cc:385] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.015753 10265 raft_consensus.cc:740] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89cec2b4e7e0471894189b7ec9141303, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.016328 10265 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89cec2b4e7e0471894189b7ec9141303" member_type: VOTER }
I20260709 13:16:56.016770 10265 raft_consensus.cc:399] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:56.016956 10265 raft_consensus.cc:493] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:56.017167 10265 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.021968 10265 raft_consensus.cc:515] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89cec2b4e7e0471894189b7ec9141303" member_type: VOTER }
I20260709 13:16:56.022445 10265 leader_election.cc:304] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 89cec2b4e7e0471894189b7ec9141303; no voters: 
I20260709 13:16:56.023520 10265 leader_election.cc:290] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:56.023834 10268 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:56.025275 10268 raft_consensus.cc:697] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [term 1 LEADER]: Becoming Leader. State: Replica: 89cec2b4e7e0471894189b7ec9141303, State: Running, Role: LEADER
I20260709 13:16:56.025974 10268 consensus_queue.cc:237] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89cec2b4e7e0471894189b7ec9141303" member_type: VOTER }
I20260709 13:16:56.026530 10265 sys_catalog.cc:565] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:56.030710 10269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "89cec2b4e7e0471894189b7ec9141303" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89cec2b4e7e0471894189b7ec9141303" member_type: VOTER } }
I20260709 13:16:56.031093 10270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89cec2b4e7e0471894189b7ec9141303. Latest consensus state: current_term: 1 leader_uuid: "89cec2b4e7e0471894189b7ec9141303" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89cec2b4e7e0471894189b7ec9141303" member_type: VOTER } }
I20260709 13:16:56.031607 10269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:56.031991 10270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:56.039103 10275 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:56.044152 10275 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:56.045174 31814 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:56.052788 10275 catalog_manager.cc:1383] Generated new cluster ID: bddb299c35544e04a70362b2e2660ac2
I20260709 13:16:56.053049 10275 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:56.071334 10275 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:56.072633 10275 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:56.085469 10275 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303: Generated new TSK 0
I20260709 13:16:56.086182 10275 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:56.111955 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:56.117909 10286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:56.119024 10287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:56.120797 10289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:56.121593 31814 server_base.cc:1061] running on GCE node
I20260709 13:16:56.122479 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:56.122679 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:56.122854 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783603016122835 us; error 0 us; skew 500 ppm
I20260709 13:16:56.123431 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:56.125679 31814 webserver.cc:533] Webserver started at http://127.31.17.129:34375/ using document root <none> and password file <none>
I20260709 13:16:56.126091 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:56.126242 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:56.126441 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:56.127553 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/ts-0-root/instance:
uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
format_stamp: "Formatted at 2026-07-09 13:16:56 on dist-test-slave-zhw8"
I20260709 13:16:56.131922 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:16:56.135133 10294 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:56.135938 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:16:56.136178 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/ts-0-root
uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
format_stamp: "Formatted at 2026-07-09 13:16:56 on dist-test-slave-zhw8"
I20260709 13:16:56.136441 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:56.159365 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:56.160609 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:56.161944 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:56.164238 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:56.164407 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:56.164683 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:56.164855 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:56.205106 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.129:46697
I20260709 13:16:56.205222 10356 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.129:46697 every 8 connection(s)
I20260709 13:16:56.210157 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:56.217231 10361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:56.220785 10362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:56.220830 10364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:56.221809 31814 server_base.cc:1061] running on GCE node
I20260709 13:16:56.223390 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:56.223650 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:56.223856 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783603016223837 us; error 0 us; skew 500 ppm
I20260709 13:16:56.224234 10357 heartbeater.cc:344] Connected to a master server at 127.31.17.190:33739
I20260709 13:16:56.224496 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:56.224644 10357 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:56.225740 10357 heartbeater.cc:507] Master 127.31.17.190:33739 requested a full tablet report, sending...
I20260709 13:16:56.226949 31814 webserver.cc:533] Webserver started at http://127.31.17.130:40037/ using document root <none> and password file <none>
I20260709 13:16:56.227618 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:56.227852 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:56.228186 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:56.228056 10230 ts_manager.cc:194] Registered new tserver with Master: ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697)
I20260709 13:16:56.229907 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/ts-1-root/instance:
uuid: "2b951bae1b2047adb22c93280654cb09"
format_stamp: "Formatted at 2026-07-09 13:16:56 on dist-test-slave-zhw8"
I20260709 13:16:56.230616 10230 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49184
I20260709 13:16:56.234992 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:16:56.238454 10369 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:56.239503 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:16:56.239789 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/ts-1-root
uuid: "2b951bae1b2047adb22c93280654cb09"
format_stamp: "Formatted at 2026-07-09 13:16:56 on dist-test-slave-zhw8"
I20260709 13:16:56.240028 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:56.254711 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:56.255975 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:56.257406 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:56.259632 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:56.259853 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:56.260083 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:56.260262 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:56.302124 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.130:38727
I20260709 13:16:56.302227 10431 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.130:38727 every 8 connection(s)
I20260709 13:16:56.307515 31814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:56.314090 10435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:56.315965 10436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:56.317731 10438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:56.318984 31814 server_base.cc:1061] running on GCE node
I20260709 13:16:56.319796 10432 heartbeater.cc:344] Connected to a master server at 127.31.17.190:33739
I20260709 13:16:56.320261 10432 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:56.320315 31814 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:56.320706 31814 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:56.320926 31814 hybrid_clock.cc:648] HybridClock initialized: now 1783603016320905 us; error 0 us; skew 500 ppm
I20260709 13:16:56.321290 10432 heartbeater.cc:507] Master 127.31.17.190:33739 requested a full tablet report, sending...
I20260709 13:16:56.321820 31814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:56.323840 10230 ts_manager.cc:194] Registered new tserver with Master: 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
I20260709 13:16:56.325066 31814 webserver.cc:533] Webserver started at http://127.31.17.131:39651/ using document root <none> and password file <none>
I20260709 13:16:56.325831 31814 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:56.325964 10230 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49188
I20260709 13:16:56.326107 31814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:56.326587 31814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:56.328325 31814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/ts-2-root/instance:
uuid: "10a6055118734434bb157c480f4c2941"
format_stamp: "Formatted at 2026-07-09 13:16:56 on dist-test-slave-zhw8"
I20260709 13:16:56.333187 31814 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:16:56.336743 10443 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:56.337577 31814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:16:56.337890 31814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/ts-2-root
uuid: "10a6055118734434bb157c480f4c2941"
format_stamp: "Formatted at 2026-07-09 13:16:56 on dist-test-slave-zhw8"
I20260709 13:16:56.338286 31814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcj8ZID/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602713491408-31814-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:56.348188 31814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:56.349412 31814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:56.350886 31814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:56.353279 31814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:56.353519 31814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:56.353776 31814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:56.353962 31814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:56.395802 31814 rpc_server.cc:307] RPC server started. Bound to: 127.31.17.131:39653
I20260709 13:16:56.395911 10505 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.17.131:39653 every 8 connection(s)
I20260709 13:16:56.416254 10506 heartbeater.cc:344] Connected to a master server at 127.31.17.190:33739
I20260709 13:16:56.416679 10506 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:56.417399 10506 heartbeater.cc:507] Master 127.31.17.190:33739 requested a full tablet report, sending...
I20260709 13:16:56.419222 10230 ts_manager.cc:194] Registered new tserver with Master: 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:56.419855 31814 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018079054s
I20260709 13:16:56.420825 10230 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49202
I20260709 13:16:56.444960 10230 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49208:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:56.447649 10230 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:56.524770 10322 tablet_service.cc:1511] Processing CreateTablet for tablet ecc607a6b08744d2b1db83b48baaf6a4 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:56.526216 10322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecc607a6b08744d2b1db83b48baaf6a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.535359 10321 tablet_service.cc:1511] Processing CreateTablet for tablet 953589d149174e3ab3faf4567854a885 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:56.536206 10320 tablet_service.cc:1511] Processing CreateTablet for tablet 53c207cb8fe44b888b5018a691f0c030 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:56.536873 10321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953589d149174e3ab3faf4567854a885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.537549 10320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c207cb8fe44b888b5018a691f0c030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.540588 10318 tablet_service.cc:1511] Processing CreateTablet for tablet a0983129c59a46b1ace98e08af095d83 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:56.541468 10314 tablet_service.cc:1511] Processing CreateTablet for tablet 918b222a69f4460b91a9eb5390ffdb02 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:56.542033 10318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0983129c59a46b1ace98e08af095d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.542876 10314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918b222a69f4460b91a9eb5390ffdb02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.542912 10471 tablet_service.cc:1511] Processing CreateTablet for tablet ecc607a6b08744d2b1db83b48baaf6a4 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:56.544777 10471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecc607a6b08744d2b1db83b48baaf6a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.544575 10316 tablet_service.cc:1511] Processing CreateTablet for tablet 063465af3760493ba233140c2c4ac428 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:56.546319 10316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063465af3760493ba233140c2c4ac428. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.548622 10315 tablet_service.cc:1511] Processing CreateTablet for tablet 2823e3cada1042b99edfca84f26ab0bc (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:56.549700 10470 tablet_service.cc:1511] Processing CreateTablet for tablet 953589d149174e3ab3faf4567854a885 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:56.550329 10315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2823e3cada1042b99edfca84f26ab0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.551535 10470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953589d149174e3ab3faf4567854a885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.552645 10317 tablet_service.cc:1511] Processing CreateTablet for tablet 950acc0587d4475ebe4afb537866b8a0 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:56.553941 10317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950acc0587d4475ebe4afb537866b8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.556391 10319 tablet_service.cc:1511] Processing CreateTablet for tablet cefdae2cca9f44d29acd98b0ebb62d78 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:56.557691 10319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cefdae2cca9f44d29acd98b0ebb62d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.566305 10397 tablet_service.cc:1511] Processing CreateTablet for tablet ecc607a6b08744d2b1db83b48baaf6a4 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:56.568239 10397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecc607a6b08744d2b1db83b48baaf6a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.572525 10396 tablet_service.cc:1511] Processing CreateTablet for tablet 953589d149174e3ab3faf4567854a885 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:56.573930 10396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953589d149174e3ab3faf4567854a885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.580830 10468 tablet_service.cc:1511] Processing CreateTablet for tablet cefdae2cca9f44d29acd98b0ebb62d78 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:56.582763 10468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cefdae2cca9f44d29acd98b0ebb62d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.584847 10467 tablet_service.cc:1511] Processing CreateTablet for tablet a0983129c59a46b1ace98e08af095d83 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:56.586722 10467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0983129c59a46b1ace98e08af095d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.588943 10466 tablet_service.cc:1511] Processing CreateTablet for tablet 950acc0587d4475ebe4afb537866b8a0 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:56.590857 10466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950acc0587d4475ebe4afb537866b8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.592720 10465 tablet_service.cc:1511] Processing CreateTablet for tablet 063465af3760493ba233140c2c4ac428 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:56.596755 10464 tablet_service.cc:1511] Processing CreateTablet for tablet 2823e3cada1042b99edfca84f26ab0bc (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:56.599140 10522 tablet_bootstrap.cc:492] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a: Bootstrap starting.
I20260709 13:16:56.598943 10469 tablet_service.cc:1511] Processing CreateTablet for tablet 53c207cb8fe44b888b5018a691f0c030 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:56.605556 10522 tablet_bootstrap.cc:654] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.610199 10394 tablet_service.cc:1511] Processing CreateTablet for tablet cefdae2cca9f44d29acd98b0ebb62d78 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:56.612818 10395 tablet_service.cc:1511] Processing CreateTablet for tablet 53c207cb8fe44b888b5018a691f0c030 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:56.614717 10395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c207cb8fe44b888b5018a691f0c030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.617376 10390 tablet_service.cc:1511] Processing CreateTablet for tablet 2823e3cada1042b99edfca84f26ab0bc (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:56.621533 10389 tablet_service.cc:1511] Processing CreateTablet for tablet 918b222a69f4460b91a9eb5390ffdb02 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:56.623661 10392 tablet_service.cc:1511] Processing CreateTablet for tablet 950acc0587d4475ebe4afb537866b8a0 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:56.625541 10391 tablet_service.cc:1511] Processing CreateTablet for tablet 063465af3760493ba233140c2c4ac428 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:56.606648 10393 tablet_service.cc:1511] Processing CreateTablet for tablet a0983129c59a46b1ace98e08af095d83 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:56.630769 10390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2823e3cada1042b99edfca84f26ab0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.639902 10394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cefdae2cca9f44d29acd98b0ebb62d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.647826 10393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0983129c59a46b1ace98e08af095d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.659759 10392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950acc0587d4475ebe4afb537866b8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.663815 10389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918b222a69f4460b91a9eb5390ffdb02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.667778 10391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063465af3760493ba233140c2c4ac428. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.677340 10463 tablet_service.cc:1511] Processing CreateTablet for tablet 918b222a69f4460b91a9eb5390ffdb02 (DEFAULT_TABLE table=test-workload [id=479c32c8d37147928dc4b54fe06e7906]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:56.680927 10464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2823e3cada1042b99edfca84f26ab0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.689141 10463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918b222a69f4460b91a9eb5390ffdb02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.695580 10469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c207cb8fe44b888b5018a691f0c030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.699590 10465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063465af3760493ba233140c2c4ac428. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.714078 10522 tablet_bootstrap.cc:492] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a: No bootstrap required, opened a new log
I20260709 13:16:56.714780 10522 ts_tablet_manager.cc:1403] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent bootstrapping tablet: real 0.116s	user 0.036s	sys 0.048s
I20260709 13:16:56.717877 10522 raft_consensus.cc:359] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.718663 10522 raft_consensus.cc:385] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.719004 10522 raft_consensus.cc:740] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.719952 10522 consensus_queue.cc:260] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.744423 10521 tablet_bootstrap.cc:492] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941: Bootstrap starting.
I20260709 13:16:56.759104 10524 tablet_bootstrap.cc:492] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09: Bootstrap starting.
I20260709 13:16:56.759528 10521 tablet_bootstrap.cc:654] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.766295 10524 tablet_bootstrap.cc:654] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.772428 10357 heartbeater.cc:499] Master 127.31.17.190:33739 was elected leader, sending a full tablet report...
I20260709 13:16:56.780900 10521 tablet_bootstrap.cc:492] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941: No bootstrap required, opened a new log
I20260709 13:16:56.781576 10521 ts_tablet_manager.cc:1403] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941: Time spent bootstrapping tablet: real 0.038s	user 0.005s	sys 0.006s
I20260709 13:16:56.784365 10522 ts_tablet_manager.cc:1434] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent starting tablet: real 0.069s	user 0.015s	sys 0.007s
I20260709 13:16:56.785590 10522 tablet_bootstrap.cc:492] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a: Bootstrap starting.
I20260709 13:16:56.798796 10522 tablet_bootstrap.cc:654] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.807080 10521 raft_consensus.cc:359] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } } peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } }
I20260709 13:16:56.808269 10521 raft_consensus.cc:385] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.808650 10521 raft_consensus.cc:740] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.809289 10524 tablet_bootstrap.cc:492] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09: No bootstrap required, opened a new log
I20260709 13:16:56.809891 10524 ts_tablet_manager.cc:1403] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.023s
I20260709 13:16:56.809792 10521 consensus_queue.cc:260] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } } peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } }
I20260709 13:16:56.814452 10522 tablet_bootstrap.cc:492] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a: No bootstrap required, opened a new log
I20260709 13:16:56.814383 10524 raft_consensus.cc:359] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.815313 10522 ts_tablet_manager.cc:1403] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.003s
I20260709 13:16:56.815325 10524 raft_consensus.cc:385] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.815925 10524 raft_consensus.cc:740] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.816633 10524 consensus_queue.cc:260] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.817620 10521 ts_tablet_manager.cc:1434] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941: Time spent starting tablet: real 0.036s	user 0.015s	sys 0.002s
I20260709 13:16:56.818403 10506 heartbeater.cc:499] Master 127.31.17.190:33739 was elected leader, sending a full tablet report...
I20260709 13:16:56.818588 10522 raft_consensus.cc:359] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.819378 10522 raft_consensus.cc:385] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.819480 10524 ts_tablet_manager.cc:1434] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:16:56.819587 10432 heartbeater.cc:499] Master 127.31.17.190:33739 was elected leader, sending a full tablet report...
I20260709 13:16:56.819821 10522 raft_consensus.cc:740] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.820770 10524 tablet_bootstrap.cc:492] T 918b222a69f4460b91a9eb5390ffdb02 P 2b951bae1b2047adb22c93280654cb09: Bootstrap starting.
I20260709 13:16:56.820873 10522 consensus_queue.cc:260] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.823203 10522 ts_tablet_manager.cc:1434] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:56.824239 10522 tablet_bootstrap.cc:492] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a: Bootstrap starting.
I20260709 13:16:56.824262 10521 tablet_bootstrap.cc:492] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941: Bootstrap starting.
I20260709 13:16:56.827667 10524 tablet_bootstrap.cc:654] T 918b222a69f4460b91a9eb5390ffdb02 P 2b951bae1b2047adb22c93280654cb09: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.835089 10521 tablet_bootstrap.cc:654] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.837059 10524 tablet_bootstrap.cc:492] T 918b222a69f4460b91a9eb5390ffdb02 P 2b951bae1b2047adb22c93280654cb09: No bootstrap required, opened a new log
I20260709 13:16:56.837639 10524 ts_tablet_manager.cc:1403] T 918b222a69f4460b91a9eb5390ffdb02 P 2b951bae1b2047adb22c93280654cb09: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.008s
I20260709 13:16:56.840674 10524 raft_consensus.cc:359] T 918b222a69f4460b91a9eb5390ffdb02 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.841262 10522 tablet_bootstrap.cc:654] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.841589 10524 raft_consensus.cc:385] T 918b222a69f4460b91a9eb5390ffdb02 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.841946 10524 raft_consensus.cc:740] T 918b222a69f4460b91a9eb5390ffdb02 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.842710 10524 consensus_queue.cc:260] T 918b222a69f4460b91a9eb5390ffdb02 P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.844976 10521 tablet_bootstrap.cc:492] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941: No bootstrap required, opened a new log
I20260709 13:16:56.845098 10524 ts_tablet_manager.cc:1434] T 918b222a69f4460b91a9eb5390ffdb02 P 2b951bae1b2047adb22c93280654cb09: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:56.845876 10521 ts_tablet_manager.cc:1403] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.000s
I20260709 13:16:56.846335 10524 tablet_bootstrap.cc:492] T ecc607a6b08744d2b1db83b48baaf6a4 P 2b951bae1b2047adb22c93280654cb09: Bootstrap starting.
I20260709 13:16:56.849922 10521 raft_consensus.cc:359] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.851004 10521 raft_consensus.cc:385] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.851416 10521 raft_consensus.cc:740] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.852563 10521 consensus_queue.cc:260] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.853462 10524 tablet_bootstrap.cc:654] T ecc607a6b08744d2b1db83b48baaf6a4 P 2b951bae1b2047adb22c93280654cb09: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.855613 10521 ts_tablet_manager.cc:1434] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:16:56.857005 10521 tablet_bootstrap.cc:492] T 953589d149174e3ab3faf4567854a885 P 10a6055118734434bb157c480f4c2941: Bootstrap starting.
I20260709 13:16:56.865839 10521 tablet_bootstrap.cc:654] T 953589d149174e3ab3faf4567854a885 P 10a6055118734434bb157c480f4c2941: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.868600 10524 tablet_bootstrap.cc:492] T ecc607a6b08744d2b1db83b48baaf6a4 P 2b951bae1b2047adb22c93280654cb09: No bootstrap required, opened a new log
I20260709 13:16:56.868917 10529 raft_consensus.cc:493] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.869197 10524 ts_tablet_manager.cc:1403] T ecc607a6b08744d2b1db83b48baaf6a4 P 2b951bae1b2047adb22c93280654cb09: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.013s
I20260709 13:16:56.869702 10529 raft_consensus.cc:515] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.872288 10522 tablet_bootstrap.cc:492] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a: No bootstrap required, opened a new log
I20260709 13:16:56.872912 10522 ts_tablet_manager.cc:1403] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.024s
I20260709 13:16:56.872653 10524 raft_consensus.cc:359] T ecc607a6b08744d2b1db83b48baaf6a4 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } } peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } }
I20260709 13:16:56.873405 10524 raft_consensus.cc:385] T ecc607a6b08744d2b1db83b48baaf6a4 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.873752 10524 raft_consensus.cc:740] T ecc607a6b08744d2b1db83b48baaf6a4 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.874661 10524 consensus_queue.cc:260] T ecc607a6b08744d2b1db83b48baaf6a4 P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } } peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } }
I20260709 13:16:56.876255 10522 raft_consensus.cc:359] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } } peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } }
I20260709 13:16:56.877045 10522 raft_consensus.cc:385] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.877422 10522 raft_consensus.cc:740] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.878239 10522 consensus_queue.cc:260] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } } peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } }
I20260709 13:16:56.880541 10522 ts_tablet_manager.cc:1434] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:56.881569 10522 tablet_bootstrap.cc:492] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a: Bootstrap starting.
I20260709 13:16:56.883574 10524 ts_tablet_manager.cc:1434] T ecc607a6b08744d2b1db83b48baaf6a4 P 2b951bae1b2047adb22c93280654cb09: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:16:56.888320 10522 tablet_bootstrap.cc:654] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.891686 10524 tablet_bootstrap.cc:492] T 53c207cb8fe44b888b5018a691f0c030 P 2b951bae1b2047adb22c93280654cb09: Bootstrap starting.
I20260709 13:16:56.878842 10529 leader_election.cc:290] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
I20260709 13:16:56.898761 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0983129c59a46b1ace98e08af095d83" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
I20260709 13:16:56.900216 10521 tablet_bootstrap.cc:492] T 953589d149174e3ab3faf4567854a885 P 10a6055118734434bb157c480f4c2941: No bootstrap required, opened a new log
I20260709 13:16:56.901312 10524 tablet_bootstrap.cc:654] T 53c207cb8fe44b888b5018a691f0c030 P 2b951bae1b2047adb22c93280654cb09: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.901320 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0983129c59a46b1ace98e08af095d83" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" is_pre_election: true
I20260709 13:16:56.900789 10521 ts_tablet_manager.cc:1403] T 953589d149174e3ab3faf4567854a885 P 10a6055118734434bb157c480f4c2941: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.000s
I20260709 13:16:56.904194 10522 tablet_bootstrap.cc:492] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a: No bootstrap required, opened a new log
I20260709 13:16:56.904868 10522 ts_tablet_manager.cc:1403] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.009s
W20260709 13:16:56.901357 10444 leader_election.cc:343] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:56.906378 10444 leader_election.cc:343] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.906162 10521 raft_consensus.cc:359] T 953589d149174e3ab3faf4567854a885 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.906947 10521 raft_consensus.cc:385] T 953589d149174e3ab3faf4567854a885 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.906818 10444 leader_election.cc:304] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10a6055118734434bb157c480f4c2941; no voters: 2b951bae1b2047adb22c93280654cb09, ac4ddcfd355b436aa151140f76a1ef2a
I20260709 13:16:56.907277 10521 raft_consensus.cc:740] T 953589d149174e3ab3faf4567854a885 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.907485 10524 tablet_bootstrap.cc:492] T 53c207cb8fe44b888b5018a691f0c030 P 2b951bae1b2047adb22c93280654cb09: No bootstrap required, opened a new log
I20260709 13:16:56.907662 10529 raft_consensus.cc:2749] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:56.907941 10522 raft_consensus.cc:359] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.908243 10524 ts_tablet_manager.cc:1403] T 53c207cb8fe44b888b5018a691f0c030 P 2b951bae1b2047adb22c93280654cb09: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:16:56.908787 10522 raft_consensus.cc:385] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.908193 10521 consensus_queue.cc:260] T 953589d149174e3ab3faf4567854a885 P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.909145 10522 raft_consensus.cc:740] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.910008 10522 consensus_queue.cc:260] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.912209 10522 ts_tablet_manager.cc:1434] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:16:56.911861 10524 raft_consensus.cc:359] T 53c207cb8fe44b888b5018a691f0c030 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.912621 10524 raft_consensus.cc:385] T 53c207cb8fe44b888b5018a691f0c030 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.912905 10524 raft_consensus.cc:740] T 53c207cb8fe44b888b5018a691f0c030 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.912989 10521 ts_tablet_manager.cc:1434] T 953589d149174e3ab3faf4567854a885 P 10a6055118734434bb157c480f4c2941: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:16:56.913270 10522 tablet_bootstrap.cc:492] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a: Bootstrap starting.
I20260709 13:16:56.914073 10521 tablet_bootstrap.cc:492] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941: Bootstrap starting.
I20260709 13:16:56.913823 10524 consensus_queue.cc:260] T 53c207cb8fe44b888b5018a691f0c030 P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.919000 10524 ts_tablet_manager.cc:1434] T 53c207cb8fe44b888b5018a691f0c030 P 2b951bae1b2047adb22c93280654cb09: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:16:56.920045 10524 tablet_bootstrap.cc:492] T 953589d149174e3ab3faf4567854a885 P 2b951bae1b2047adb22c93280654cb09: Bootstrap starting.
I20260709 13:16:56.920347 10522 tablet_bootstrap.cc:654] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.928193 10521 tablet_bootstrap.cc:654] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.930812 10525 raft_consensus.cc:493] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.931880 10524 tablet_bootstrap.cc:654] T 953589d149174e3ab3faf4567854a885 P 2b951bae1b2047adb22c93280654cb09: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.932294 10525 raft_consensus.cc:515] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.935797 10525 leader_election.cc:290] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:56.939512 10524 tablet_bootstrap.cc:492] T 953589d149174e3ab3faf4567854a885 P 2b951bae1b2047adb22c93280654cb09: No bootstrap required, opened a new log
I20260709 13:16:56.940233 10524 ts_tablet_manager.cc:1403] T 953589d149174e3ab3faf4567854a885 P 2b951bae1b2047adb22c93280654cb09: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.005s
I20260709 13:16:56.943846 10524 raft_consensus.cc:359] T 953589d149174e3ab3faf4567854a885 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.944645 10522 tablet_bootstrap.cc:492] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a: No bootstrap required, opened a new log
I20260709 13:16:56.945025 10525 raft_consensus.cc:493] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.945178 10522 ts_tablet_manager.cc:1403] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.010s
I20260709 13:16:56.945551 10525 raft_consensus.cc:515] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.946954 10521 tablet_bootstrap.cc:492] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941: No bootstrap required, opened a new log
I20260709 13:16:56.944579 10524 raft_consensus.cc:385] T 953589d149174e3ab3faf4567854a885 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.947628 10524 raft_consensus.cc:740] T 953589d149174e3ab3faf4567854a885 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.947734 10525 leader_election.cc:290] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:56.947846 10521 ts_tablet_manager.cc:1403] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.003s
I20260709 13:16:56.948436 10524 consensus_queue.cc:260] T 953589d149174e3ab3faf4567854a885 P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.949908 10522 raft_consensus.cc:359] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.950636 10522 raft_consensus.cc:385] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.950907 10522 raft_consensus.cc:740] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.951277 10521 raft_consensus.cc:359] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.952054 10521 raft_consensus.cc:385] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.951683 10522 consensus_queue.cc:260] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.952376 10521 raft_consensus.cc:740] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.953341 10521 consensus_queue.cc:260] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.955849 10524 ts_tablet_manager.cc:1434] T 953589d149174e3ab3faf4567854a885 P 2b951bae1b2047adb22c93280654cb09: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:16:56.956950 10524 tablet_bootstrap.cc:492] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09: Bootstrap starting.
I20260709 13:16:56.957224 10521 ts_tablet_manager.cc:1434] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:16:56.958241 10521 tablet_bootstrap.cc:492] T cefdae2cca9f44d29acd98b0ebb62d78 P 10a6055118734434bb157c480f4c2941: Bootstrap starting.
I20260709 13:16:56.964607 10521 tablet_bootstrap.cc:654] T cefdae2cca9f44d29acd98b0ebb62d78 P 10a6055118734434bb157c480f4c2941: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.965243 10524 tablet_bootstrap.cc:654] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.954058 10522 ts_tablet_manager.cc:1434] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:16:56.968125 10522 tablet_bootstrap.cc:492] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a: Bootstrap starting.
I20260709 13:16:56.975335 10522 tablet_bootstrap.cc:654] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.979784 10524 tablet_bootstrap.cc:492] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09: No bootstrap required, opened a new log
I20260709 13:16:56.980211 10521 tablet_bootstrap.cc:492] T cefdae2cca9f44d29acd98b0ebb62d78 P 10a6055118734434bb157c480f4c2941: No bootstrap required, opened a new log
I20260709 13:16:56.980309 10524 ts_tablet_manager.cc:1403] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.005s
I20260709 13:16:56.981062 10521 ts_tablet_manager.cc:1403] T cefdae2cca9f44d29acd98b0ebb62d78 P 10a6055118734434bb157c480f4c2941: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.004s
I20260709 13:16:56.983748 10524 raft_consensus.cc:359] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.984589 10524 raft_consensus.cc:385] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.984696 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953589d149174e3ab3faf4567854a885" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
I20260709 13:16:56.984918 10524 raft_consensus.cc:740] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.985419 10407 raft_consensus.cc:2468] T 953589d149174e3ab3faf4567854a885 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 0.
I20260709 13:16:56.985321 10521 raft_consensus.cc:359] T cefdae2cca9f44d29acd98b0ebb62d78 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.986217 10521 raft_consensus.cc:385] T cefdae2cca9f44d29acd98b0ebb62d78 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.985858 10524 consensus_queue.cc:260] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.986563 10521 raft_consensus.cc:740] T cefdae2cca9f44d29acd98b0ebb62d78 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.987449 10521 consensus_queue.cc:260] T cefdae2cca9f44d29acd98b0ebb62d78 P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:56.988178 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c207cb8fe44b888b5018a691f0c030" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
I20260709 13:16:56.988811 10407 raft_consensus.cc:2468] T 53c207cb8fe44b888b5018a691f0c030 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 0.
I20260709 13:16:56.990144 10521 ts_tablet_manager.cc:1434] T cefdae2cca9f44d29acd98b0ebb62d78 P 10a6055118734434bb157c480f4c2941: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:16:56.991535 10521 tablet_bootstrap.cc:492] T 2823e3cada1042b99edfca84f26ab0bc P 10a6055118734434bb157c480f4c2941: Bootstrap starting.
I20260709 13:16:56.991930 10524 ts_tablet_manager.cc:1434] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:16:56.993017 10295 leader_election.cc:304] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b951bae1b2047adb22c93280654cb09, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:16:56.993217 10524 tablet_bootstrap.cc:492] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09: Bootstrap starting.
I20260709 13:16:56.994565 10522 tablet_bootstrap.cc:492] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a: No bootstrap required, opened a new log
I20260709 13:16:56.995112 10522 ts_tablet_manager.cc:1403] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.002s
I20260709 13:16:57.000155 10522 raft_consensus.cc:359] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.000888 10522 raft_consensus.cc:385] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.001166 10522 raft_consensus.cc:740] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.002029 10525 raft_consensus.cc:2804] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.002480 10525 raft_consensus.cc:493] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.002828 10525 raft_consensus.cc:3060] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.005086 10524 tablet_bootstrap.cc:654] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.006096 10521 tablet_bootstrap.cc:654] T 2823e3cada1042b99edfca84f26ab0bc P 10a6055118734434bb157c480f4c2941: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.011590 10295 leader_election.cc:304] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b951bae1b2047adb22c93280654cb09, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:16:57.011089 10525 raft_consensus.cc:515] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.014662 10525 leader_election.cc:290] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 election: Requested vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:57.015195 10525 raft_consensus.cc:2804] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.015570 10525 raft_consensus.cc:493] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.015898 10525 raft_consensus.cc:3060] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.017513 10524 tablet_bootstrap.cc:492] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09: No bootstrap required, opened a new log
I20260709 13:16:57.018289 10524 ts_tablet_manager.cc:1403] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 13:16:57.020861 10522 consensus_queue.cc:260] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.021826 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953589d149174e3ab3faf4567854a885" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
I20260709 13:16:57.022500 10481 raft_consensus.cc:2468] T 953589d149174e3ab3faf4567854a885 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 0.
I20260709 13:16:57.022701 10524 raft_consensus.cc:359] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.021561 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c207cb8fe44b888b5018a691f0c030" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
I20260709 13:16:57.023833 10524 raft_consensus.cc:385] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.024222 10524 raft_consensus.cc:740] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.019904 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953589d149174e3ab3faf4567854a885" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:16:57.025113 10407 raft_consensus.cc:3060] T 953589d149174e3ab3faf4567854a885 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.025779 10522 ts_tablet_manager.cc:1434] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:16:57.025247 10524 consensus_queue.cc:260] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.026873 10522 tablet_bootstrap.cc:492] T 063465af3760493ba233140c2c4ac428 P ac4ddcfd355b436aa151140f76a1ef2a: Bootstrap starting.
I20260709 13:16:57.031497 10529 raft_consensus.cc:493] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.032934 10529 raft_consensus.cc:515] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } } peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } }
I20260709 13:16:57.035948 10529 leader_election.cc:290] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
I20260709 13:16:57.036669 10522 tablet_bootstrap.cc:654] T 063465af3760493ba233140c2c4ac428 P ac4ddcfd355b436aa151140f76a1ef2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.037915 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc607a6b08744d2b1db83b48baaf6a4" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" is_pre_election: true
W20260709 13:16:57.038551 10278 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:57.038619 10332 raft_consensus.cc:2468] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 0.
I20260709 13:16:57.040294 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc607a6b08744d2b1db83b48baaf6a4" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
I20260709 13:16:57.040987 10406 raft_consensus.cc:2468] T ecc607a6b08744d2b1db83b48baaf6a4 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 0.
W20260709 13:16:57.041144 10295 leader_election.cc:343] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.042382 10444 leader_election.cc:304] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09; no voters: 
I20260709 13:16:57.043434 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953589d149174e3ab3faf4567854a885" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:16:57.044039 10480 raft_consensus.cc:3060] T 953589d149174e3ab3faf4567854a885 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.044713 10407 raft_consensus.cc:2468] T 953589d149174e3ab3faf4567854a885 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 1.
I20260709 13:16:57.047386 10295 leader_election.cc:304] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b951bae1b2047adb22c93280654cb09, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:16:57.048027 10529 raft_consensus.cc:2804] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.049141 10529 raft_consensus.cc:493] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.049540 10529 raft_consensus.cc:3060] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.049780 10524 ts_tablet_manager.cc:1434] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.001s
I20260709 13:16:57.050896 10524 tablet_bootstrap.cc:492] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09: Bootstrap starting.
I20260709 13:16:57.054127 10521 tablet_bootstrap.cc:492] T 2823e3cada1042b99edfca84f26ab0bc P 10a6055118734434bb157c480f4c2941: No bootstrap required, opened a new log
I20260709 13:16:57.054716 10521 ts_tablet_manager.cc:1403] T 2823e3cada1042b99edfca84f26ab0bc P 10a6055118734434bb157c480f4c2941: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.023s
I20260709 13:16:57.055289 10549 raft_consensus.cc:2804] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.057384 10524 tablet_bootstrap.cc:654] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.058533 10522 tablet_bootstrap.cc:492] T 063465af3760493ba233140c2c4ac428 P ac4ddcfd355b436aa151140f76a1ef2a: No bootstrap required, opened a new log
I20260709 13:16:57.059059 10522 ts_tablet_manager.cc:1403] T 063465af3760493ba233140c2c4ac428 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.001s
I20260709 13:16:57.064589 10525 raft_consensus.cc:515] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.064669 10480 raft_consensus.cc:2468] T 953589d149174e3ab3faf4567854a885 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 1.
I20260709 13:16:57.068559 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c207cb8fe44b888b5018a691f0c030" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:16:57.069154 10407 raft_consensus.cc:3060] T 53c207cb8fe44b888b5018a691f0c030 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.068701 10521 raft_consensus.cc:359] T 2823e3cada1042b99edfca84f26ab0bc P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.069813 10521 raft_consensus.cc:385] T 2823e3cada1042b99edfca84f26ab0bc P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.070205 10521 raft_consensus.cc:740] T 2823e3cada1042b99edfca84f26ab0bc P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.071833 10530 raft_consensus.cc:493] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.072222 10530 raft_consensus.cc:515] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.072536 10522 raft_consensus.cc:359] T 063465af3760493ba233140c2c4ac428 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.073547 10522 raft_consensus.cc:385] T 063465af3760493ba233140c2c4ac428 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.073907 10522 raft_consensus.cc:740] T 063465af3760493ba233140c2c4ac428 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.074216 10530 leader_election.cc:290] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:57.074859 10522 consensus_queue.cc:260] T 063465af3760493ba233140c2c4ac428 P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.078123 10522 ts_tablet_manager.cc:1434] T 063465af3760493ba233140c2c4ac428 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:16:57.079640 10521 consensus_queue.cc:260] T 2823e3cada1042b99edfca84f26ab0bc P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.082008 10525 leader_election.cc:290] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 election: Requested vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:57.082979 10522 tablet_bootstrap.cc:492] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a: Bootstrap starting.
I20260709 13:16:57.083462 10549 raft_consensus.cc:697] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Becoming Leader. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Running, Role: LEADER
I20260709 13:16:57.084798 10549 consensus_queue.cc:237] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.090533 10530 raft_consensus.cc:493] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.090691 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c207cb8fe44b888b5018a691f0c030" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:16:57.091081 10530 raft_consensus.cc:515] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.092427 10521 ts_tablet_manager.cc:1434] T 2823e3cada1042b99edfca84f26ab0bc P 10a6055118734434bb157c480f4c2941: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.006s
I20260709 13:16:57.093146 10530 leader_election.cc:290] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:57.093807 10521 tablet_bootstrap.cc:492] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941: Bootstrap starting.
I20260709 13:16:57.096354 10529 raft_consensus.cc:515] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } } peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } }
I20260709 13:16:57.101409 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc607a6b08744d2b1db83b48baaf6a4" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
I20260709 13:16:57.101991 10332 raft_consensus.cc:3060] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.103135 10554 raft_consensus.cc:493] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.104200 10554 raft_consensus.cc:515] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.107179 10331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950acc0587d4475ebe4afb537866b8a0" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" is_pre_election: true
W20260709 13:16:57.108848 10444 leader_election.cc:343] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.112480 10522 tablet_bootstrap.cc:654] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.113986 10332 raft_consensus.cc:2468] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 1.
I20260709 13:16:57.114419 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950acc0587d4475ebe4afb537866b8a0" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
I20260709 13:16:57.115088 10406 raft_consensus.cc:2468] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 0.
I20260709 13:16:57.115365 10444 leader_election.cc:304] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:16:57.116410 10444 leader_election.cc:304] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09; no voters: ac4ddcfd355b436aa151140f76a1ef2a
I20260709 13:16:57.116618 10554 leader_election.cc:290] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
W20260709 13:16:57.098660 10295 leader_election.cc:343] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.090020 10407 raft_consensus.cc:2468] T 53c207cb8fe44b888b5018a691f0c030 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 1.
I20260709 13:16:57.120235 10554 raft_consensus.cc:2804] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.120375 10521 tablet_bootstrap.cc:654] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.121194 10295 leader_election.cc:304] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b951bae1b2047adb22c93280654cb09, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 10a6055118734434bb157c480f4c2941
I20260709 13:16:57.124042 10554 raft_consensus.cc:697] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Becoming Leader. State: Replica: 10a6055118734434bb157c480f4c2941, State: Running, Role: LEADER
I20260709 13:16:57.125268 10525 raft_consensus.cc:2804] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.125775 10525 raft_consensus.cc:697] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Becoming Leader. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Running, Role: LEADER
I20260709 13:16:57.126566 10525 consensus_queue.cc:237] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.125156 10554 consensus_queue.cc:237] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } } peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } }
I20260709 13:16:57.136842 10522 tablet_bootstrap.cc:492] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a: No bootstrap required, opened a new log
I20260709 13:16:57.137593 10522 ts_tablet_manager.cc:1403] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.001s
I20260709 13:16:57.139070 10551 raft_consensus.cc:493] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.139853 10551 raft_consensus.cc:515] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.140293 10529 leader_election.cc:290] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 election: Requested vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
I20260709 13:16:57.141042 10529 raft_consensus.cc:2804] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.159587 10529 raft_consensus.cc:493] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.160990 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063465af3760493ba233140c2c4ac428" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
I20260709 13:16:57.161388 10529 raft_consensus.cc:3060] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.161968 10230 catalog_manager.cc:5697] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a reported cstate change: term changed from 0 to 1, leader changed from <none> to ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:57.162851 10370 leader_election.cc:343] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.163705 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefdae2cca9f44d29acd98b0ebb62d78" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
I20260709 13:16:57.164448 10479 raft_consensus.cc:2468] T cefdae2cca9f44d29acd98b0ebb62d78 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 0.
I20260709 13:16:57.143661 10551 leader_election.cc:290] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:57.144402 10521 tablet_bootstrap.cc:492] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941: No bootstrap required, opened a new log
I20260709 13:16:57.146639 10331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefdae2cca9f44d29acd98b0ebb62d78" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" is_pre_election: true
I20260709 13:16:57.165465 10370 leader_election.cc:304] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09; no voters: 
I20260709 13:16:57.165863 10524 tablet_bootstrap.cc:492] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09: No bootstrap required, opened a new log
I20260709 13:16:57.150383 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063465af3760493ba233140c2c4ac428" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" is_pre_election: true
I20260709 13:16:57.155881 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefdae2cca9f44d29acd98b0ebb62d78" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
I20260709 13:16:57.157519 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefdae2cca9f44d29acd98b0ebb62d78" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
I20260709 13:16:57.158507 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc607a6b08744d2b1db83b48baaf6a4" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:16:57.167363 10480 raft_consensus.cc:2468] T cefdae2cca9f44d29acd98b0ebb62d78 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 0.
I20260709 13:16:57.165752 10331 raft_consensus.cc:2468] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 0.
I20260709 13:16:57.166366 10332 raft_consensus.cc:2468] T 063465af3760493ba233140c2c4ac428 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 0.
I20260709 13:16:57.166414 10530 raft_consensus.cc:2804] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.169021 10524 ts_tablet_manager.cc:1403] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09: Time spent bootstrapping tablet: real 0.118s	user 0.056s	sys 0.057s
I20260709 13:16:57.167367 10406 raft_consensus.cc:3060] T ecc607a6b08744d2b1db83b48baaf6a4 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.170164 10370 leader_election.cc:304] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b951bae1b2047adb22c93280654cb09, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 10a6055118734434bb157c480f4c2941
I20260709 13:16:57.170357 10529 raft_consensus.cc:515] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.166365 10521 ts_tablet_manager.cc:1403] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.003s
I20260709 13:16:57.170226 10295 leader_election.cc:304] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:16:57.172842 10529 leader_election.cc:290] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 election: Requested vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
I20260709 13:16:57.173468 10551 raft_consensus.cc:2804] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.173887 10551 raft_consensus.cc:493] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.174219 10551 raft_consensus.cc:3060] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.174532 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950acc0587d4475ebe4afb537866b8a0" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
I20260709 13:16:57.175372 10521 raft_consensus.cc:359] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.176824 10521 raft_consensus.cc:385] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.168972 10530 raft_consensus.cc:493] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.149076 10522 raft_consensus.cc:359] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.177717 10530 raft_consensus.cc:3060] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.177798 10522 raft_consensus.cc:385] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.178256 10522 raft_consensus.cc:740] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.178993 10521 raft_consensus.cc:740] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Initialized, Role: FOLLOWER
W20260709 13:16:57.181092 10444 leader_election.cc:343] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.179663 10522 consensus_queue.cc:260] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.180312 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950acc0587d4475ebe4afb537866b8a0" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:16:57.182543 10564 raft_consensus.cc:2804] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.182896 10405 raft_consensus.cc:3060] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.183197 10564 raft_consensus.cc:493] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.183765 10564 raft_consensus.cc:3060] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.189666 10530 raft_consensus.cc:515] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.191511 10405 raft_consensus.cc:2468] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 1.
I20260709 13:16:57.191946 10564 raft_consensus.cc:515] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.193094 10407 raft_consensus.cc:2393] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac4ddcfd355b436aa151140f76a1ef2a in current term 1: Already voted for candidate 2b951bae1b2047adb22c93280654cb09 in this term.
I20260709 13:16:57.192071 10228 catalog_manager.cc:5697] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10a6055118734434bb157c480f4c2941 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "10a6055118734434bb157c480f4c2941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.193765 10444 leader_election.cc:304] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09; no voters: ac4ddcfd355b436aa151140f76a1ef2a
I20260709 13:16:57.194468 10564 leader_election.cc:290] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 election: Requested vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:57.177094 10406 raft_consensus.cc:2468] T ecc607a6b08744d2b1db83b48baaf6a4 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 1.
I20260709 13:16:57.181691 10551 raft_consensus.cc:515] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.196714 10554 raft_consensus.cc:2804] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.197321 10554 raft_consensus.cc:697] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Becoming Leader. State: Replica: 10a6055118734434bb157c480f4c2941, State: Running, Role: LEADER
I20260709 13:16:57.197427 10551 leader_election.cc:290] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 election: Requested vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:57.197563 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063465af3760493ba233140c2c4ac428" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:16:57.198347 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063465af3760493ba233140c2c4ac428" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
W20260709 13:16:57.199162 10370 leader_election.cc:343] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.199312 10332 raft_consensus.cc:3060] T 063465af3760493ba233140c2c4ac428 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.200243 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefdae2cca9f44d29acd98b0ebb62d78" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:16:57.200958 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefdae2cca9f44d29acd98b0ebb62d78" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:16:57.200928 10524 raft_consensus.cc:359] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.201716 10480 raft_consensus.cc:3060] T cefdae2cca9f44d29acd98b0ebb62d78 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.198451 10554 consensus_queue.cc:237] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.203610 10522 ts_tablet_manager.cc:1434] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a: Time spent starting tablet: real 0.066s	user 0.010s	sys 0.000s
I20260709 13:16:57.204519 10522 tablet_bootstrap.cc:492] T 950acc0587d4475ebe4afb537866b8a0 P ac4ddcfd355b436aa151140f76a1ef2a: Bootstrap starting.
I20260709 13:16:57.201807 10524 raft_consensus.cc:385] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.205017 10524 raft_consensus.cc:740] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.205870 10525 raft_consensus.cc:493] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.206357 10525 raft_consensus.cc:515] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.206646 10524 consensus_queue.cc:260] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.207091 10332 raft_consensus.cc:2468] T 063465af3760493ba233140c2c4ac428 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 1.
I20260709 13:16:57.208467 10525 leader_election.cc:290] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:57.208432 10370 leader_election.cc:304] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b951bae1b2047adb22c93280654cb09, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 10a6055118734434bb157c480f4c2941
I20260709 13:16:57.209540 10564 raft_consensus.cc:2804] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.181351 10521 consensus_queue.cc:260] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.210398 10524 ts_tablet_manager.cc:1434] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:16:57.211928 10524 tablet_bootstrap.cc:492] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09: Bootstrap starting.
I20260709 13:16:57.214797 10530 leader_election.cc:290] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 election: Requested vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:57.212489 10521 ts_tablet_manager.cc:1434] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:16:57.219216 10521 tablet_bootstrap.cc:492] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941: Bootstrap starting.
I20260709 13:16:57.220376 10524 tablet_bootstrap.cc:654] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.222208 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefdae2cca9f44d29acd98b0ebb62d78" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
I20260709 13:16:57.223054 10332 raft_consensus.cc:2393] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b951bae1b2047adb22c93280654cb09 in current term 1: Already voted for candidate ac4ddcfd355b436aa151140f76a1ef2a in this term.
I20260709 13:16:57.224439 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cefdae2cca9f44d29acd98b0ebb62d78" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:16:57.226615 10370 leader_election.cc:304] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b951bae1b2047adb22c93280654cb09; no voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a
I20260709 13:16:57.229606 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918b222a69f4460b91a9eb5390ffdb02" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
I20260709 13:16:57.229833 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918b222a69f4460b91a9eb5390ffdb02" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
I20260709 13:16:57.230523 10407 raft_consensus.cc:2468] T 918b222a69f4460b91a9eb5390ffdb02 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 0.
I20260709 13:16:57.230746 10479 raft_consensus.cc:2468] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 0.
I20260709 13:16:57.233875 10295 leader_election.cc:304] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:16:57.235136 10551 raft_consensus.cc:2804] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.235651 10551 raft_consensus.cc:493] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.236088 10551 raft_consensus.cc:3060] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.236627 10480 raft_consensus.cc:2468] T cefdae2cca9f44d29acd98b0ebb62d78 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 1.
I20260709 13:16:57.237659 10530 raft_consensus.cc:2749] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:57.239379 10525 raft_consensus.cc:493] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.240062 10525 raft_consensus.cc:515] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.241379 10564 raft_consensus.cc:697] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 1 LEADER]: Becoming Leader. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Running, Role: LEADER
I20260709 13:16:57.242252 10564 consensus_queue.cc:237] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.239705 10295 leader_election.cc:304] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 2b951bae1b2047adb22c93280654cb09
I20260709 13:16:57.242892 10525 leader_election.cc:290] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:57.243870 10549 raft_consensus.cc:2804] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.244383 10549 raft_consensus.cc:697] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Becoming Leader. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Running, Role: LEADER
I20260709 13:16:57.245503 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2823e3cada1042b99edfca84f26ab0bc" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
I20260709 13:16:57.247253 10405 raft_consensus.cc:2468] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 0.
I20260709 13:16:57.245707 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2823e3cada1042b99edfca84f26ab0bc" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
I20260709 13:16:57.245208 10549 consensus_queue.cc:237] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.249339 10480 raft_consensus.cc:2468] T 2823e3cada1042b99edfca84f26ab0bc P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 0.
I20260709 13:16:57.250844 10522 tablet_bootstrap.cc:654] T 950acc0587d4475ebe4afb537866b8a0 P ac4ddcfd355b436aa151140f76a1ef2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.251044 10295 leader_election.cc:304] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:16:57.256196 10525 raft_consensus.cc:2804] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.256584 10525 raft_consensus.cc:493] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.258270 10525 raft_consensus.cc:3060] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.258759 10521 tablet_bootstrap.cc:654] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.259375 10524 tablet_bootstrap.cc:492] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09: No bootstrap required, opened a new log
I20260709 13:16:57.259871 10524 ts_tablet_manager.cc:1403] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.020s
I20260709 13:16:57.268929 10524 raft_consensus.cc:359] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.272110 10524 raft_consensus.cc:385] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.273562 10524 raft_consensus.cc:740] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.270861 10525 raft_consensus.cc:515] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.276203 10524 consensus_queue.cc:260] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.278967 10524 ts_tablet_manager.cc:1434] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:16:57.279121 10228 catalog_manager.cc:5697] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10a6055118734434bb157c480f4c2941 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "10a6055118734434bb157c480f4c2941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:57.285632 10551 raft_consensus.cc:515] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.287802 10551 leader_election.cc:290] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 election: Requested vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:57.290884 10525 leader_election.cc:290] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 election: Requested vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:57.291992 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918b222a69f4460b91a9eb5390ffdb02" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:16:57.292388 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2823e3cada1042b99edfca84f26ab0bc" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:16:57.292666 10480 raft_consensus.cc:3060] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.293002 10479 raft_consensus.cc:3060] T 2823e3cada1042b99edfca84f26ab0bc P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.296962 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918b222a69f4460b91a9eb5390ffdb02" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:16:57.297884 10405 raft_consensus.cc:3060] T 918b222a69f4460b91a9eb5390ffdb02 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.300446 10480 raft_consensus.cc:2468] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 1.
I20260709 13:16:57.300482 10479 raft_consensus.cc:2468] T 2823e3cada1042b99edfca84f26ab0bc P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 1.
I20260709 13:16:57.302309 10295 leader_election.cc:304] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:16:57.303010 10525 raft_consensus.cc:2804] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.303161 10295 leader_election.cc:304] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:16:57.303603 10525 raft_consensus.cc:697] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Becoming Leader. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Running, Role: LEADER
I20260709 13:16:57.303751 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2823e3cada1042b99edfca84f26ab0bc" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:16:57.304145 10549 raft_consensus.cc:2804] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.304633 10407 raft_consensus.cc:3060] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.304837 10525 consensus_queue.cc:237] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.304656 10549 raft_consensus.cc:697] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Becoming Leader. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Running, Role: LEADER
I20260709 13:16:57.308082 10549 consensus_queue.cc:237] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.315177 10405 raft_consensus.cc:2468] T 918b222a69f4460b91a9eb5390ffdb02 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 1.
I20260709 13:16:57.320588 10407 raft_consensus.cc:2468] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 1.
I20260709 13:16:57.321609 10521 tablet_bootstrap.cc:492] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941: No bootstrap required, opened a new log
I20260709 13:16:57.322261 10521 ts_tablet_manager.cc:1403] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941: Time spent bootstrapping tablet: real 0.103s	user 0.018s	sys 0.002s
I20260709 13:16:57.320065 10230 catalog_manager.cc:5697] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a reported cstate change: term changed from 0 to 1, leader changed from <none> to ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.328750 10521 raft_consensus.cc:359] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.329427 10521 raft_consensus.cc:385] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.329777 10521 raft_consensus.cc:740] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.328924 10230 catalog_manager.cc:5697] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a reported cstate change: term changed from 0 to 1, leader changed from <none> to ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.331552 10521 consensus_queue.cc:260] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.332652 10522 tablet_bootstrap.cc:492] T 950acc0587d4475ebe4afb537866b8a0 P ac4ddcfd355b436aa151140f76a1ef2a: No bootstrap required, opened a new log
I20260709 13:16:57.333181 10522 ts_tablet_manager.cc:1403] T 950acc0587d4475ebe4afb537866b8a0 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent bootstrapping tablet: real 0.129s	user 0.014s	sys 0.000s
I20260709 13:16:57.334293 10521 ts_tablet_manager.cc:1434] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:16:57.335878 10522 raft_consensus.cc:359] T 950acc0587d4475ebe4afb537866b8a0 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.336561 10521 tablet_bootstrap.cc:492] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941: Bootstrap starting.
I20260709 13:16:57.336572 10522 raft_consensus.cc:385] T 950acc0587d4475ebe4afb537866b8a0 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.337074 10522 raft_consensus.cc:740] T 950acc0587d4475ebe4afb537866b8a0 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.337724 10522 consensus_queue.cc:260] T 950acc0587d4475ebe4afb537866b8a0 P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.339638 10522 ts_tablet_manager.cc:1434] T 950acc0587d4475ebe4afb537866b8a0 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:16:57.339596 10227 catalog_manager.cc:5697] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b951bae1b2047adb22c93280654cb09 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "2b951bae1b2047adb22c93280654cb09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.343051 10521 tablet_bootstrap.cc:654] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.347259 10521 tablet_bootstrap.cc:492] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941: No bootstrap required, opened a new log
I20260709 13:16:57.347728 10521 ts_tablet_manager.cc:1403] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 13:16:57.349889 10521 raft_consensus.cc:359] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.350358 10521 raft_consensus.cc:385] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.350569 10521 raft_consensus.cc:740] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.351056 10521 consensus_queue.cc:260] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.352955 10521 ts_tablet_manager.cc:1434] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:57.354070 10230 catalog_manager.cc:5697] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a reported cstate change: term changed from 0 to 1, leader changed from <none> to ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.356336 10230 catalog_manager.cc:5697] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a reported cstate change: term changed from 0 to 1, leader changed from <none> to ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.468768 10549 raft_consensus.cc:493] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.469323 10549 raft_consensus.cc:515] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.470928 10549 leader_election.cc:290] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:57.471822 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0983129c59a46b1ace98e08af095d83" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
I20260709 13:16:57.472088 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0983129c59a46b1ace98e08af095d83" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
I20260709 13:16:57.472430 10407 raft_consensus.cc:2468] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 0.
I20260709 13:16:57.472736 10479 raft_consensus.cc:2468] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 0.
I20260709 13:16:57.473392 10295 leader_election.cc:304] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b951bae1b2047adb22c93280654cb09, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:16:57.474159 10549 raft_consensus.cc:2804] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.474498 10549 raft_consensus.cc:493] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.474768 10549 raft_consensus.cc:3060] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.480206 10549 raft_consensus.cc:515] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.481738 10549 leader_election.cc:290] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 election: Requested vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:57.482581 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0983129c59a46b1ace98e08af095d83" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:16:57.482776 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0983129c59a46b1ace98e08af095d83" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:16:57.483126 10407 raft_consensus.cc:3060] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.483352 10479 raft_consensus.cc:3060] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.488253 10479 raft_consensus.cc:2468] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 1.
I20260709 13:16:57.488351 10407 raft_consensus.cc:2468] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 1.
I20260709 13:16:57.489322 10295 leader_election.cc:304] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:16:57.490082 10549 raft_consensus.cc:2804] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.490607 10549 raft_consensus.cc:697] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Becoming Leader. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Running, Role: LEADER
I20260709 13:16:57.491465 10549 consensus_queue.cc:237] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.499136 10230 catalog_manager.cc:5697] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a reported cstate change: term changed from 0 to 1, leader changed from <none> to ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.522636 10554 raft_consensus.cc:493] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.523185 10554 raft_consensus.cc:515] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.525060 10554 leader_election.cc:290] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
I20260709 13:16:57.525967 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063465af3760493ba233140c2c4ac428" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" is_pre_election: true
I20260709 13:16:57.526324 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063465af3760493ba233140c2c4ac428" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
I20260709 13:16:57.526664 10332 raft_consensus.cc:2393] T 063465af3760493ba233140c2c4ac428 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10a6055118734434bb157c480f4c2941 in current term 1: Already voted for candidate 2b951bae1b2047adb22c93280654cb09 in this term.
I20260709 13:16:57.528067 10444 leader_election.cc:304] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10a6055118734434bb157c480f4c2941; no voters: 2b951bae1b2047adb22c93280654cb09, ac4ddcfd355b436aa151140f76a1ef2a
I20260709 13:16:57.528805 10554 raft_consensus.cc:3060] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.534046 10554 raft_consensus.cc:2749] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:57.543870 10549 consensus_queue.cc:1048] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.553213 10479 raft_consensus.cc:3060] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.562331 10525 consensus_queue.cc:1048] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.609820 10332 raft_consensus.cc:3060] T 950acc0587d4475ebe4afb537866b8a0 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.616305 10554 consensus_queue.cc:1048] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.626623 10529 consensus_queue.cc:1048] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.634516 10529 consensus_queue.cc:1048] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.637473 10525 consensus_queue.cc:1048] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.654202 10556 consensus_queue.cc:1048] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:57.658079 10551 consensus_queue.cc:1048] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.711826 10551 consensus_queue.cc:1048] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:57.723714 10479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecc607a6b08744d2b1db83b48baaf6a4"
dest_uuid: "10a6055118734434bb157c480f4c2941"
mode: GRACEFUL
new_leader_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
 from {username='slave'} at 127.0.0.1:47282
I20260709 13:16:57.724673 10479 raft_consensus.cc:606] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Received request to transfer leadership to TS ac4ddcfd355b436aa151140f76a1ef2a
I20260709 13:16:57.728790 10525 consensus_queue.cc:1048] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.750918 10332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0983129c59a46b1ace98e08af095d83"
dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
mode: GRACEFUL
new_leader_uuid: "2b951bae1b2047adb22c93280654cb09"
 from {username='slave'} at 127.0.0.1:50884
I20260709 13:16:57.751554 10332 raft_consensus.cc:606] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Received request to transfer leadership to TS 2b951bae1b2047adb22c93280654cb09
I20260709 13:16:57.757164 10480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "950acc0587d4475ebe4afb537866b8a0"
dest_uuid: "10a6055118734434bb157c480f4c2941"
mode: GRACEFUL
new_leader_uuid: "2b951bae1b2047adb22c93280654cb09"
 from {username='slave'} at 127.0.0.1:47282
I20260709 13:16:57.757742 10480 raft_consensus.cc:606] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Received request to transfer leadership to TS 2b951bae1b2047adb22c93280654cb09
I20260709 13:16:57.764397 10525 consensus_queue.cc:1048] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:57.765511 10332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2823e3cada1042b99edfca84f26ab0bc"
dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
mode: GRACEFUL
new_leader_uuid: "2b951bae1b2047adb22c93280654cb09"
 from {username='slave'} at 127.0.0.1:50884
I20260709 13:16:57.766105 10332 raft_consensus.cc:606] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Received request to transfer leadership to TS 2b951bae1b2047adb22c93280654cb09
I20260709 13:16:57.771783 10332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "918b222a69f4460b91a9eb5390ffdb02"
dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
mode: GRACEFUL
new_leader_uuid: "10a6055118734434bb157c480f4c2941"
 from {username='slave'} at 127.0.0.1:50884
I20260709 13:16:57.772382 10332 raft_consensus.cc:606] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Received request to transfer leadership to TS 10a6055118734434bb157c480f4c2941
I20260709 13:16:57.779697 10549 consensus_queue.cc:1048] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:57.782064 10564 consensus_queue.cc:1048] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:57.797508 10599 consensus_queue.cc:1048] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.915723 10549 consensus_queue.cc:1048] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.926535 10551 consensus_queue.cc:1048] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.934127 10525 raft_consensus.cc:993] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a: : Instructing follower 2b951bae1b2047adb22c93280654cb09 to start an election
I20260709 13:16:57.934585 10551 raft_consensus.cc:1081] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Signalling peer 2b951bae1b2047adb22c93280654cb09 to start an election
I20260709 13:16:57.936059 10406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2823e3cada1042b99edfca84f26ab0bc"
dest_uuid: "2b951bae1b2047adb22c93280654cb09"
 from {username='slave'} at 127.0.0.1:54622
I20260709 13:16:57.936677 10406 raft_consensus.cc:493] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:57.937037 10406 raft_consensus.cc:3060] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:57.942148 10406 raft_consensus.cc:515] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.944022 10406 leader_election.cc:290] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 2 election: Requested vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:57.944854 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2823e3cada1042b99edfca84f26ab0bc" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
I20260709 13:16:57.945425 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2823e3cada1042b99edfca84f26ab0bc" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:16:57.945600 10332 raft_consensus.cc:3055] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:57.945976 10332 raft_consensus.cc:740] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Running, Role: LEADER
I20260709 13:16:57.946033 10480 raft_consensus.cc:3060] T 2823e3cada1042b99edfca84f26ab0bc P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:57.946883 10332 consensus_queue.cc:260] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.948208 10332 raft_consensus.cc:3060] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:57.953399 10480 raft_consensus.cc:2468] T 2823e3cada1042b99edfca84f26ab0bc P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 2.
I20260709 13:16:57.954496 10370 leader_election.cc:304] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09; no voters: 
I20260709 13:16:57.954944 10332 raft_consensus.cc:2468] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 2.
I20260709 13:16:57.955175 10599 raft_consensus.cc:2804] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:57.955735 10599 raft_consensus.cc:697] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 [term 2 LEADER]: Becoming Leader. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Running, Role: LEADER
I20260709 13:16:57.956514 10599 consensus_queue.cc:237] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:57.962715 10229 catalog_manager.cc:5697] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 reported cstate change: term changed from 1 to 2, leader changed from ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129) to 2b951bae1b2047adb22c93280654cb09 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "2b951bae1b2047adb22c93280654cb09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.037739 10554 raft_consensus.cc:993] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941: : Instructing follower 2b951bae1b2047adb22c93280654cb09 to start an election
I20260709 13:16:58.038295 10556 raft_consensus.cc:1081] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Signalling peer 2b951bae1b2047adb22c93280654cb09 to start an election
I20260709 13:16:58.039964 10406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "950acc0587d4475ebe4afb537866b8a0"
dest_uuid: "2b951bae1b2047adb22c93280654cb09"
 from {username='slave'} at 127.0.0.1:54618
I20260709 13:16:58.040557 10406 raft_consensus.cc:493] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:58.040933 10406 raft_consensus.cc:3060] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.046952 10406 raft_consensus.cc:515] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:58.050341 10331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950acc0587d4475ebe4afb537866b8a0" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
I20260709 13:16:58.050550 10406 leader_election.cc:290] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 2 election: Requested vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:58.050966 10331 raft_consensus.cc:3060] T 950acc0587d4475ebe4afb537866b8a0 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.052160 10554 raft_consensus.cc:993] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941: : Instructing follower ac4ddcfd355b436aa151140f76a1ef2a to start an election
I20260709 13:16:58.051569 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950acc0587d4475ebe4afb537866b8a0" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:16:58.052642 10556 raft_consensus.cc:1081] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Signalling peer ac4ddcfd355b436aa151140f76a1ef2a to start an election
I20260709 13:16:58.052963 10480 raft_consensus.cc:3055] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:58.053295 10480 raft_consensus.cc:740] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Running, Role: LEADER
I20260709 13:16:58.054526 10332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecc607a6b08744d2b1db83b48baaf6a4"
dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
 from {username='slave'} at 127.0.0.1:50860
I20260709 13:16:58.054246 10480 consensus_queue.cc:260] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:58.055212 10332 raft_consensus.cc:493] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:58.055670 10332 raft_consensus.cc:3060] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.055774 10480 raft_consensus.cc:3060] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.058040 10331 raft_consensus.cc:2468] T 950acc0587d4475ebe4afb537866b8a0 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 2.
I20260709 13:16:58.059154 10370 leader_election.cc:304] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b951bae1b2047adb22c93280654cb09, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:16:58.059955 10599 raft_consensus.cc:2804] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:58.060369 10599 raft_consensus.cc:697] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 [term 2 LEADER]: Becoming Leader. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Running, Role: LEADER
I20260709 13:16:58.061172 10599 consensus_queue.cc:237] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:58.062675 10480 raft_consensus.cc:2468] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 2.
I20260709 13:16:58.062716 10332 raft_consensus.cc:515] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } } peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } }
I20260709 13:16:58.064965 10332 leader_election.cc:290] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 2 election: Requested vote from peers 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653), 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
I20260709 13:16:58.066211 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc607a6b08744d2b1db83b48baaf6a4" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:16:58.066672 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc607a6b08744d2b1db83b48baaf6a4" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:16:58.066895 10406 raft_consensus.cc:3060] T ecc607a6b08744d2b1db83b48baaf6a4 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.067296 10480 raft_consensus.cc:3055] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:58.068001 10480 raft_consensus.cc:740] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Running, Role: LEADER
I20260709 13:16:58.068059 10551 consensus_queue.cc:1048] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.069016 10480 consensus_queue.cc:260] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } } peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } }
I20260709 13:16:58.069315 10229 catalog_manager.cc:5697] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 reported cstate change: term changed from 1 to 2, leader changed from 10a6055118734434bb157c480f4c2941 (127.31.17.131) to 2b951bae1b2047adb22c93280654cb09 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "2b951bae1b2047adb22c93280654cb09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.070369 10480 raft_consensus.cc:3060] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.079030 10406 raft_consensus.cc:2468] T ecc607a6b08744d2b1db83b48baaf6a4 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 2.
I20260709 13:16:58.080220 10480 raft_consensus.cc:2468] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 2.
I20260709 13:16:58.080577 10295 leader_election.cc:304] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b951bae1b2047adb22c93280654cb09, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:16:58.081419 10551 raft_consensus.cc:2804] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:58.081869 10551 raft_consensus.cc:697] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 LEADER]: Becoming Leader. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Running, Role: LEADER
I20260709 13:16:58.082669 10551 consensus_queue.cc:237] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } } peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } }
I20260709 13:16:58.089402 10230 catalog_manager.cc:5697] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a reported cstate change: term changed from 1 to 2, leader changed from 10a6055118734434bb157c480f4c2941 (127.31.17.131) to ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129). New cstate: current_term: 2 leader_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.090008 10551 consensus_queue.cc:1048] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.100677 10525 raft_consensus.cc:993] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a: : Instructing follower 2b951bae1b2047adb22c93280654cb09 to start an election
I20260709 13:16:58.101157 10525 raft_consensus.cc:1081] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Signalling peer 2b951bae1b2047adb22c93280654cb09 to start an election
I20260709 13:16:58.103108 10406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0983129c59a46b1ace98e08af095d83"
dest_uuid: "2b951bae1b2047adb22c93280654cb09"
 from {username='slave'} at 127.0.0.1:54622
I20260709 13:16:58.103740 10406 raft_consensus.cc:493] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:58.104072 10406 raft_consensus.cc:3060] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.109433 10549 raft_consensus.cc:993] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a: : Instructing follower 10a6055118734434bb157c480f4c2941 to start an election
I20260709 13:16:58.110029 10551 raft_consensus.cc:1081] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Signalling peer 10a6055118734434bb157c480f4c2941 to start an election
I20260709 13:16:58.111094 10406 raft_consensus.cc:515] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:58.111835 10479 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "918b222a69f4460b91a9eb5390ffdb02"
dest_uuid: "10a6055118734434bb157c480f4c2941"
 from {username='slave'} at 127.0.0.1:47274
I20260709 13:16:58.112764 10479 raft_consensus.cc:493] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:58.113345 10406 leader_election.cc:290] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 2 election: Requested vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:16:58.114331 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0983129c59a46b1ace98e08af095d83" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
I20260709 13:16:58.114457 10479 raft_consensus.cc:3060] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.114333 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0983129c59a46b1ace98e08af095d83" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:16:58.115190 10332 raft_consensus.cc:3055] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:58.115453 10480 raft_consensus.cc:3060] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.115597 10332 raft_consensus.cc:740] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Running, Role: LEADER
I20260709 13:16:58.116541 10332 consensus_queue.cc:260] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:58.117678 10332 raft_consensus.cc:3060] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.121533 10480 raft_consensus.cc:2468] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 2.
I20260709 13:16:58.122973 10370 leader_election.cc:304] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09; no voters: 
I20260709 13:16:58.122421 10479 raft_consensus.cc:515] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:58.123929 10599 raft_consensus.cc:2804] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:58.124444 10599 raft_consensus.cc:697] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 [term 2 LEADER]: Becoming Leader. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Running, Role: LEADER
I20260709 13:16:58.125123 10332 raft_consensus.cc:2468] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 2.
I20260709 13:16:58.125289 10599 consensus_queue.cc:237] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:58.126371 10479 leader_election.cc:290] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 2 election: Requested vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
I20260709 13:16:58.127094 10331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918b222a69f4460b91a9eb5390ffdb02" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
I20260709 13:16:58.127733 10331 raft_consensus.cc:3055] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:58.128051 10331 raft_consensus.cc:740] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Running, Role: LEADER
I20260709 13:16:58.128298 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918b222a69f4460b91a9eb5390ffdb02" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:16:58.128991 10406 raft_consensus.cc:3060] T 918b222a69f4460b91a9eb5390ffdb02 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.128885 10331 consensus_queue.cc:260] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:58.130020 10331 raft_consensus.cc:3060] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.133402 10229 catalog_manager.cc:5697] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 reported cstate change: term changed from 1 to 2, leader changed from ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129) to 2b951bae1b2047adb22c93280654cb09 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "2b951bae1b2047adb22c93280654cb09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.136503 10406 raft_consensus.cc:2468] T 918b222a69f4460b91a9eb5390ffdb02 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 2.
I20260709 13:16:58.137800 10444 leader_election.cc:304] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09; no voters: 
I20260709 13:16:58.138653 10556 raft_consensus.cc:2804] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:58.138944 10331 raft_consensus.cc:2468] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 2.
I20260709 13:16:58.139147 10556 raft_consensus.cc:697] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 [term 2 LEADER]: Becoming Leader. State: Replica: 10a6055118734434bb157c480f4c2941, State: Running, Role: LEADER
I20260709 13:16:58.140195 10556 consensus_queue.cc:237] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:16:58.146804 10230 catalog_manager.cc:5697] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 reported cstate change: term changed from 1 to 2, leader changed from ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129) to 10a6055118734434bb157c480f4c2941 (127.31.17.131). New cstate: current_term: 2 leader_uuid: "10a6055118734434bb157c480f4c2941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:58.357168 10331 raft_consensus.cc:1275] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Refusing update from remote peer 2b951bae1b2047adb22c93280654cb09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:58.358279 10605 consensus_queue.cc:1048] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:58.365783 10479 raft_consensus.cc:1275] T 2823e3cada1042b99edfca84f26ab0bc P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Refusing update from remote peer 2b951bae1b2047adb22c93280654cb09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:58.367529 10598 consensus_queue.cc:1048] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:58.461807 10331 raft_consensus.cc:1275] T 950acc0587d4475ebe4afb537866b8a0 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Refusing update from remote peer 2b951bae1b2047adb22c93280654cb09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:58.463095 10598 consensus_queue.cc:1048] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:58.470252 10479 raft_consensus.cc:1275] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Refusing update from remote peer 2b951bae1b2047adb22c93280654cb09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:58.472273 10599 consensus_queue.cc:1048] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:58.532101 10331 raft_consensus.cc:1275] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Refusing update from remote peer 2b951bae1b2047adb22c93280654cb09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:58.533450 10599 consensus_queue.cc:1048] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:58.542274 10479 raft_consensus.cc:1275] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Refusing update from remote peer 2b951bae1b2047adb22c93280654cb09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:58.544149 10598 consensus_queue.cc:1048] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:58.624027 10331 raft_consensus.cc:1275] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Refusing update from remote peer 10a6055118734434bb157c480f4c2941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:58.625334 10556 consensus_queue.cc:1048] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:58.632828 10406 raft_consensus.cc:1275] T 918b222a69f4460b91a9eb5390ffdb02 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Refusing update from remote peer 10a6055118734434bb157c480f4c2941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:58.635188 10556 consensus_queue.cc:1048] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:58.697688 10406 raft_consensus.cc:1275] T ecc607a6b08744d2b1db83b48baaf6a4 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Refusing update from remote peer ac4ddcfd355b436aa151140f76a1ef2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:58.698887 10551 consensus_queue.cc:1048] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:58.701682 10479 raft_consensus.cc:1275] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Refusing update from remote peer ac4ddcfd355b436aa151140f76a1ef2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:58.703053 10525 consensus_queue.cc:1048] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:00.501438 10502 debug-util.cc:398] Leaking SignalData structure 0x7b08002509e0 after lost signal to thread 31817
W20260709 13:17:00.502503 10502 debug-util.cc:398] Leaking SignalData structure 0x7b0800210be0 after lost signal to thread 10264
W20260709 13:17:00.503711 10502 debug-util.cc:398] Leaking SignalData structure 0x7b08001685c0 after lost signal to thread 10356
W20260709 13:17:00.504705 10502 debug-util.cc:398] Leaking SignalData structure 0x7b08003fcda0 after lost signal to thread 10431
W20260709 13:17:00.505682 10502 debug-util.cc:398] Leaking SignalData structure 0x7b0800162620 after lost signal to thread 10505
I20260709 13:17:00.843037 10228 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41682:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:00.846491 10228 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:00.904152 10317 tablet_service.cc:1511] Processing CreateTablet for tablet c5fa5e7b7725429299cf99eace72a54b (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:00.905656 10317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5fa5e7b7725429299cf99eace72a54b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.910637 10469 tablet_service.cc:1511] Processing CreateTablet for tablet 627686b1121340d3998606b2427dd677 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:00.911154 10315 tablet_service.cc:1511] Processing CreateTablet for tablet 627686b1121340d3998606b2427dd677 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:00.912004 10469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 627686b1121340d3998606b2427dd677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.912858 10315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 627686b1121340d3998606b2427dd677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.906666 10465 tablet_service.cc:1511] Processing CreateTablet for tablet c5fa5e7b7725429299cf99eace72a54b (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:00.916715 10392 tablet_service.cc:1511] Processing CreateTablet for tablet 627686b1121340d3998606b2427dd677 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:00.918437 10392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 627686b1121340d3998606b2427dd677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.920338 10468 tablet_service.cc:1511] Processing CreateTablet for tablet 84a120b131fc4a4b98f620be2d6b4034 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:00.922351 10393 tablet_service.cc:1511] Processing CreateTablet for tablet c5fa5e7b7725429299cf99eace72a54b (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:00.922746 10390 tablet_service.cc:1511] Processing CreateTablet for tablet 84a120b131fc4a4b98f620be2d6b4034 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:00.923986 10393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5fa5e7b7725429299cf99eace72a54b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.930557 10320 tablet_service.cc:1511] Processing CreateTablet for tablet 84a120b131fc4a4b98f620be2d6b4034 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:00.931671 10319 tablet_service.cc:1511] Processing CreateTablet for tablet 7bd9b52bffde4dd488a4ae6a1747b207 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:00.932636 10390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a120b131fc4a4b98f620be2d6b4034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.933043 10320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a120b131fc4a4b98f620be2d6b4034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.936333 10391 tablet_service.cc:1511] Processing CreateTablet for tablet 7bd9b52bffde4dd488a4ae6a1747b207 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:00.937837 10319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd9b52bffde4dd488a4ae6a1747b207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.938182 10391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd9b52bffde4dd488a4ae6a1747b207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.930542 10463 tablet_service.cc:1511] Processing CreateTablet for tablet 7bd9b52bffde4dd488a4ae6a1747b207 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:00.917331 10465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5fa5e7b7725429299cf99eace72a54b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.940462 10468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a120b131fc4a4b98f620be2d6b4034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.941439 10463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd9b52bffde4dd488a4ae6a1747b207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.957845 10316 tablet_service.cc:1511] Processing CreateTablet for tablet c94d9434a48f40a58e4ce29b60cbc196 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:00.959863 10316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94d9434a48f40a58e4ce29b60cbc196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.964403 10464 tablet_service.cc:1511] Processing CreateTablet for tablet c94d9434a48f40a58e4ce29b60cbc196 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:00.964833 10318 tablet_service.cc:1511] Processing CreateTablet for tablet 31f50adae4f042668ee6fd360fba0b26 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:00.965938 10464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94d9434a48f40a58e4ce29b60cbc196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.966125 10318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31f50adae4f042668ee6fd360fba0b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.972759 10466 tablet_service.cc:1511] Processing CreateTablet for tablet 31f50adae4f042668ee6fd360fba0b26 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:00.974347 10466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31f50adae4f042668ee6fd360fba0b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.980351 10396 tablet_service.cc:1511] Processing CreateTablet for tablet c94d9434a48f40a58e4ce29b60cbc196 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:00.981829 10396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94d9434a48f40a58e4ce29b60cbc196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.988479 10395 tablet_service.cc:1511] Processing CreateTablet for tablet 31f50adae4f042668ee6fd360fba0b26 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:00.988758 10389 tablet_service.cc:1511] Processing CreateTablet for tablet d8eddcc368b243b9b14d4866b62a1ac4 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:00.989955 10395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31f50adae4f042668ee6fd360fba0b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.991321 10397 tablet_service.cc:1511] Processing CreateTablet for tablet fc0579e86d9c4badb5993661bde5ad0e (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:00.992233 10394 tablet_service.cc:1511] Processing CreateTablet for tablet 3c3af7d4c51b4ac7b5648de76b0a1629 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:00.992761 10397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0579e86d9c4badb5993661bde5ad0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.992579 10470 tablet_service.cc:1511] Processing CreateTablet for tablet d8eddcc368b243b9b14d4866b62a1ac4 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:00.993521 10394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3af7d4c51b4ac7b5648de76b0a1629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.993813 10470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8eddcc368b243b9b14d4866b62a1ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.997677 10467 tablet_service.cc:1511] Processing CreateTablet for tablet 3c3af7d4c51b4ac7b5648de76b0a1629 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:00.999174 10467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3af7d4c51b4ac7b5648de76b0a1629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:01.000345 10389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8eddcc368b243b9b14d4866b62a1ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:01.002919 10322 tablet_service.cc:1511] Processing CreateTablet for tablet d8eddcc368b243b9b14d4866b62a1ac4 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:01.004776 10322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8eddcc368b243b9b14d4866b62a1ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:01.009119 10314 tablet_service.cc:1511] Processing CreateTablet for tablet fc0579e86d9c4badb5993661bde5ad0e (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:01.009385 10321 tablet_service.cc:1511] Processing CreateTablet for tablet 3c3af7d4c51b4ac7b5648de76b0a1629 (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:01.010533 10314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0579e86d9c4badb5993661bde5ad0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:01.011446 10321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3af7d4c51b4ac7b5648de76b0a1629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:01.018363 10471 tablet_service.cc:1511] Processing CreateTablet for tablet fc0579e86d9c4badb5993661bde5ad0e (DEFAULT_TABLE table=soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:01.020370 10471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0579e86d9c4badb5993661bde5ad0e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:01.083276 10278 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:01.086133 10622 tablet_bootstrap.cc:492] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09: Bootstrap starting.
I20260709 13:17:01.136482 10624 tablet_bootstrap.cc:492] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a: Bootstrap starting.
I20260709 13:17:01.137383 10623 tablet_bootstrap.cc:492] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941: Bootstrap starting.
I20260709 13:17:01.142306 10622 tablet_bootstrap.cc:654] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.149163 10623 tablet_bootstrap.cc:654] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.151106 10624 tablet_bootstrap.cc:654] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.170010 10622 tablet_bootstrap.cc:492] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09: No bootstrap required, opened a new log
I20260709 13:17:01.170523 10622 ts_tablet_manager.cc:1403] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09: Time spent bootstrapping tablet: real 0.085s	user 0.008s	sys 0.005s
I20260709 13:17:01.174461 10622 raft_consensus.cc:359] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.175254 10623 tablet_bootstrap.cc:492] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941: No bootstrap required, opened a new log
I20260709 13:17:01.175565 10622 raft_consensus.cc:385] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.175999 10623 ts_tablet_manager.cc:1403] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.008s
I20260709 13:17:01.176046 10622 raft_consensus.cc:740] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.177098 10622 consensus_queue.cc:260] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.179447 10623 raft_consensus.cc:359] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.180197 10623 raft_consensus.cc:385] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.180549 10623 raft_consensus.cc:740] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.181480 10623 consensus_queue.cc:260] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.185017 10624 tablet_bootstrap.cc:492] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a: No bootstrap required, opened a new log
I20260709 13:17:01.185596 10624 ts_tablet_manager.cc:1403] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a: Time spent bootstrapping tablet: real 0.049s	user 0.023s	sys 0.000s
I20260709 13:17:01.188630 10624 raft_consensus.cc:359] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.189348 10624 raft_consensus.cc:385] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.189631 10624 raft_consensus.cc:740] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.190292 10624 consensus_queue.cc:260] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.199524 10624 ts_tablet_manager.cc:1434] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:17:01.200695 10624 tablet_bootstrap.cc:492] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a: Bootstrap starting.
I20260709 13:17:01.194242 10623 ts_tablet_manager.cc:1434] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:17:01.204569 10623 tablet_bootstrap.cc:492] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941: Bootstrap starting.
I20260709 13:17:01.207115 10624 tablet_bootstrap.cc:654] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.211594 10623 tablet_bootstrap.cc:654] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:01.219033 10507 tablet.cc:2406] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:17:01.219678 10622 ts_tablet_manager.cc:1434] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.004s
I20260709 13:17:01.224092 10622 tablet_bootstrap.cc:492] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09: Bootstrap starting.
I20260709 13:17:01.230487 10623 tablet_bootstrap.cc:492] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941: No bootstrap required, opened a new log
I20260709 13:17:01.231400 10623 ts_tablet_manager.cc:1403] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.015s
I20260709 13:17:01.234454 10624 tablet_bootstrap.cc:492] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a: No bootstrap required, opened a new log
I20260709 13:17:01.235828 10624 ts_tablet_manager.cc:1403] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.004s
I20260709 13:17:01.238931 10624 raft_consensus.cc:359] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.234651 10623 raft_consensus.cc:359] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.239741 10622 tablet_bootstrap.cc:654] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.239764 10624 raft_consensus.cc:385] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.240247 10623 raft_consensus.cc:385] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.240437 10624 raft_consensus.cc:740] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.240733 10623 raft_consensus.cc:740] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.241351 10624 consensus_queue.cc:260] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.241645 10623 consensus_queue.cc:260] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.244290 10624 ts_tablet_manager.cc:1434] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:01.245432 10624 tablet_bootstrap.cc:492] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a: Bootstrap starting.
I20260709 13:17:01.244338 10623 ts_tablet_manager.cc:1434] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:17:01.248175 10623 tablet_bootstrap.cc:492] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941: Bootstrap starting.
I20260709 13:17:01.258574 10624 tablet_bootstrap.cc:654] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.261399 10623 tablet_bootstrap.cc:654] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.278301 10622 tablet_bootstrap.cc:492] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09: No bootstrap required, opened a new log
I20260709 13:17:01.278990 10622 ts_tablet_manager.cc:1403] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09: Time spent bootstrapping tablet: real 0.055s	user 0.022s	sys 0.012s
I20260709 13:17:01.282238 10622 raft_consensus.cc:359] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.283115 10622 raft_consensus.cc:385] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.283527 10622 raft_consensus.cc:740] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.284438 10622 consensus_queue.cc:260] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.289139 10599 raft_consensus.cc:493] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.289721 10599 raft_consensus.cc:515] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.291303 10623 tablet_bootstrap.cc:492] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941: No bootstrap required, opened a new log
I20260709 13:17:01.294486 10623 ts_tablet_manager.cc:1403] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.005s
I20260709 13:17:01.295428 10599 leader_election.cc:290] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:01.296893 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd9b52bffde4dd488a4ae6a1747b207" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
I20260709 13:17:01.293087 10624 tablet_bootstrap.cc:492] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a: No bootstrap required, opened a new log
I20260709 13:17:01.297986 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd9b52bffde4dd488a4ae6a1747b207" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" is_pre_election: true
I20260709 13:17:01.297677 10623 raft_consensus.cc:359] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.297621 10622 ts_tablet_manager.cc:1434] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:17:01.298542 10623 raft_consensus.cc:385] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.297595 10479 raft_consensus.cc:2468] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 0.
I20260709 13:17:01.299032 10623 raft_consensus.cc:740] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.298164 10624 ts_tablet_manager.cc:1403] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.015s
I20260709 13:17:01.299510 10622 tablet_bootstrap.cc:492] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09: Bootstrap starting.
I20260709 13:17:01.298620 10332 raft_consensus.cc:2468] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 0.
I20260709 13:17:01.302541 10624 raft_consensus.cc:359] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.303086 10370 leader_election.cc:304] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b951bae1b2047adb22c93280654cb09, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:17:01.305155 10624 raft_consensus.cc:385] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.305533 10624 raft_consensus.cc:740] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.305621 10599 raft_consensus.cc:2804] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:01.303776 10623 consensus_queue.cc:260] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.306044 10599 raft_consensus.cc:493] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.306407 10599 raft_consensus.cc:3060] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.307423 10622 tablet_bootstrap.cc:654] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.308190 10623 ts_tablet_manager.cc:1434] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:17:01.310230 10623 tablet_bootstrap.cc:492] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941: Bootstrap starting.
I20260709 13:17:01.308713 10624 consensus_queue.cc:260] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.316785 10624 ts_tablet_manager.cc:1434] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.001s
I20260709 13:17:01.317987 10624 tablet_bootstrap.cc:492] T fc0579e86d9c4badb5993661bde5ad0e P ac4ddcfd355b436aa151140f76a1ef2a: Bootstrap starting.
I20260709 13:17:01.321410 10623 tablet_bootstrap.cc:654] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.327708 10624 tablet_bootstrap.cc:654] T fc0579e86d9c4badb5993661bde5ad0e P ac4ddcfd355b436aa151140f76a1ef2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.331561 10599 raft_consensus.cc:515] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.345249 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd9b52bffde4dd488a4ae6a1747b207" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
I20260709 13:17:01.345557 10622 tablet_bootstrap.cc:492] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09: No bootstrap required, opened a new log
I20260709 13:17:01.345928 10332 raft_consensus.cc:3060] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.350827 10611 raft_consensus.cc:493] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.346118 10622 ts_tablet_manager.cc:1403] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.012s
I20260709 13:17:01.351534 10611 raft_consensus.cc:515] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.354064 10611 leader_election.cc:290] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
I20260709 13:17:01.354117 10332 raft_consensus.cc:2468] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 1.
I20260709 13:17:01.354914 10622 raft_consensus.cc:359] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.355710 10622 raft_consensus.cc:385] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.355989 10622 raft_consensus.cc:740] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.356598 10331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94d9434a48f40a58e4ce29b60cbc196" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" is_pre_election: true
I20260709 13:17:01.356803 10622 consensus_queue.cc:260] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.357304 10370 leader_election.cc:304] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b951bae1b2047adb22c93280654cb09, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:17:01.358273 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94d9434a48f40a58e4ce29b60cbc196" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
I20260709 13:17:01.359066 10406 raft_consensus.cc:2468] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 0.
I20260709 13:17:01.361212 10444 leader_election.cc:304] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09; no voters: 
W20260709 13:17:01.362139 10444 leader_election.cc:343] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:01.356648 10599 leader_election.cc:290] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 election: Requested vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:01.363739 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd9b52bffde4dd488a4ae6a1747b207" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:17:01.364360 10479 raft_consensus.cc:3060] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.367676 10611 raft_consensus.cc:2804] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:01.374356 10611 raft_consensus.cc:493] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.374882 10611 raft_consensus.cc:3060] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.373301 10599 raft_consensus.cc:2804] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:01.376099 10599 raft_consensus.cc:697] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 1 LEADER]: Becoming Leader. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Running, Role: LEADER
I20260709 13:17:01.378162 10599 consensus_queue.cc:237] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.373754 10479 raft_consensus.cc:2468] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 1.
I20260709 13:17:01.383635 10611 raft_consensus.cc:515] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.386773 10623 tablet_bootstrap.cc:492] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941: No bootstrap required, opened a new log
I20260709 13:17:01.398748 10623 ts_tablet_manager.cc:1403] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941: Time spent bootstrapping tablet: real 0.089s	user 0.016s	sys 0.005s
I20260709 13:17:01.402398 10622 ts_tablet_manager.cc:1434] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09: Time spent starting tablet: real 0.050s	user 0.019s	sys 0.029s
I20260709 13:17:01.402202 10623 raft_consensus.cc:359] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.403882 10622 tablet_bootstrap.cc:492] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09: Bootstrap starting.
I20260709 13:17:01.406421 10623 raft_consensus.cc:385] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.406733 10623 raft_consensus.cc:740] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.406747 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94d9434a48f40a58e4ce29b60cbc196" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:17:01.407757 10406 raft_consensus.cc:3060] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.407567 10623 consensus_queue.cc:260] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.405016 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94d9434a48f40a58e4ce29b60cbc196" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
I20260709 13:17:01.405941 10611 leader_election.cc:290] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 election: Requested vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
W20260709 13:17:01.412761 10444 leader_election.cc:343] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:01.421432 10622 tablet_bootstrap.cc:654] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.429728 10624 tablet_bootstrap.cc:492] T fc0579e86d9c4badb5993661bde5ad0e P ac4ddcfd355b436aa151140f76a1ef2a: No bootstrap required, opened a new log
I20260709 13:17:01.434994 10624 ts_tablet_manager.cc:1403] T fc0579e86d9c4badb5993661bde5ad0e P ac4ddcfd355b436aa151140f76a1ef2a: Time spent bootstrapping tablet: real 0.117s	user 0.014s	sys 0.016s
I20260709 13:17:01.427997 10406 raft_consensus.cc:2468] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 1.
I20260709 13:17:01.435770 10611 raft_consensus.cc:493] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.436398 10611 raft_consensus.cc:515] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.438566 10611 leader_election.cc:290] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
I20260709 13:17:01.439450 10624 raft_consensus.cc:359] T fc0579e86d9c4badb5993661bde5ad0e P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.440270 10444 leader_election.cc:304] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09; no voters: ac4ddcfd355b436aa151140f76a1ef2a
I20260709 13:17:01.440291 10624 raft_consensus.cc:385] T fc0579e86d9c4badb5993661bde5ad0e P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.441337 10624 raft_consensus.cc:740] T fc0579e86d9c4badb5993661bde5ad0e P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.442230 10623 ts_tablet_manager.cc:1434] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941: Time spent starting tablet: real 0.043s	user 0.024s	sys 0.010s
I20260709 13:17:01.442909 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0579e86d9c4badb5993661bde5ad0e" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" is_pre_election: true
I20260709 13:17:01.443571 10623 tablet_bootstrap.cc:492] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941: Bootstrap starting.
I20260709 13:17:01.444766 10227 catalog_manager.cc:5697] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b951bae1b2047adb22c93280654cb09 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "2b951bae1b2047adb22c93280654cb09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:01.442904 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0579e86d9c4badb5993661bde5ad0e" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
W20260709 13:17:01.447679 10444 leader_election.cc:343] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:01.442062 10624 consensus_queue.cc:260] T fc0579e86d9c4badb5993661bde5ad0e P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.451282 10332 raft_consensus.cc:2468] T fc0579e86d9c4badb5993661bde5ad0e P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 0.
I20260709 13:17:01.452538 10551 raft_consensus.cc:493] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.453087 10551 raft_consensus.cc:515] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.454563 10444 leader_election.cc:304] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 2b951bae1b2047adb22c93280654cb09
I20260709 13:17:01.455207 10551 leader_election.cc:290] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:01.455920 10611 raft_consensus.cc:2804] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:01.457543 10624 ts_tablet_manager.cc:1434] T fc0579e86d9c4badb5993661bde5ad0e P ac4ddcfd355b436aa151140f76a1ef2a: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:17:01.459220 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fa5e7b7725429299cf99eace72a54b" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
I20260709 13:17:01.461863 10622 tablet_bootstrap.cc:492] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09: No bootstrap required, opened a new log
I20260709 13:17:01.462432 10622 ts_tablet_manager.cc:1403] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.004s
I20260709 13:17:01.464685 10624 tablet_bootstrap.cc:492] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a: Bootstrap starting.
W20260709 13:17:01.463225 10295 leader_election.cc:343] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:01.457985 10623 tablet_bootstrap.cc:654] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.459043 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fa5e7b7725429299cf99eace72a54b" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
I20260709 13:17:01.459137 10640 raft_consensus.cc:2804] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:01.466292 10640 raft_consensus.cc:493] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.466640 10640 raft_consensus.cc:3060] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:01.467304 10295 leader_election.cc:343] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:01.467829 10295 leader_election.cc:304] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac4ddcfd355b436aa151140f76a1ef2a; no voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09
I20260709 13:17:01.469106 10551 raft_consensus.cc:2749] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:01.476428 10622 raft_consensus.cc:359] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.477638 10622 raft_consensus.cc:385] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.478032 10622 raft_consensus.cc:740] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.488934 10622 consensus_queue.cc:260] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.493577 10622 ts_tablet_manager.cc:1434] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:17:01.494197 10623 tablet_bootstrap.cc:492] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941: No bootstrap required, opened a new log
I20260709 13:17:01.494894 10622 tablet_bootstrap.cc:492] T fc0579e86d9c4badb5993661bde5ad0e P 2b951bae1b2047adb22c93280654cb09: Bootstrap starting.
I20260709 13:17:01.494921 10623 ts_tablet_manager.cc:1403] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.008s
I20260709 13:17:01.489765 10611 raft_consensus.cc:697] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Becoming Leader. State: Replica: 10a6055118734434bb157c480f4c2941, State: Running, Role: LEADER
I20260709 13:17:01.498449 10623 raft_consensus.cc:359] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.499336 10623 raft_consensus.cc:385] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.499925 10623 raft_consensus.cc:740] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.500958 10623 consensus_queue.cc:260] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.498417 10611 consensus_queue.cc:237] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.503536 10623 ts_tablet_manager.cc:1434] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:01.504884 10623 tablet_bootstrap.cc:492] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941: Bootstrap starting.
I20260709 13:17:01.509099 10640 raft_consensus.cc:515] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.512692 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0579e86d9c4badb5993661bde5ad0e" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
I20260709 13:17:01.513325 10332 raft_consensus.cc:3060] T fc0579e86d9c4badb5993661bde5ad0e P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.516048 10623 tablet_bootstrap.cc:654] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.518679 10551 raft_consensus.cc:493] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.519254 10551 raft_consensus.cc:515] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.521592 10332 raft_consensus.cc:2468] T fc0579e86d9c4badb5993661bde5ad0e P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 1.
I20260709 13:17:01.522804 10444 leader_election.cc:304] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:17:01.508421 10622 tablet_bootstrap.cc:654] T fc0579e86d9c4badb5993661bde5ad0e P 2b951bae1b2047adb22c93280654cb09: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.503607 10624 tablet_bootstrap.cc:654] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.523605 10643 raft_consensus.cc:2804] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:01.524472 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f50adae4f042668ee6fd360fba0b26" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
W20260709 13:17:01.526789 10295 leader_election.cc:343] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:01.529233 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0579e86d9c4badb5993661bde5ad0e" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:17:01.530509 10640 leader_election.cc:290] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 election: Requested vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
W20260709 13:17:01.536382 10444 leader_election.cc:343] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:01.542207 10623 tablet_bootstrap.cc:492] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941: No bootstrap required, opened a new log
I20260709 13:17:01.542899 10623 ts_tablet_manager.cc:1403] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941: Time spent bootstrapping tablet: real 0.038s	user 0.025s	sys 0.005s
I20260709 13:17:01.521663 10551 leader_election.cc:290] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:01.530594 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f50adae4f042668ee6fd360fba0b26" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
W20260709 13:17:01.545714 10295 leader_election.cc:343] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:01.546375 10295 leader_election.cc:304] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac4ddcfd355b436aa151140f76a1ef2a; no voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09
I20260709 13:17:01.546662 10623 raft_consensus.cc:359] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.547721 10623 raft_consensus.cc:385] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.548110 10623 raft_consensus.cc:740] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.548475 10551 raft_consensus.cc:2749] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:01.541657 10228 catalog_manager.cc:5697] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10a6055118734434bb157c480f4c2941 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "10a6055118734434bb157c480f4c2941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:01.549122 10623 consensus_queue.cc:260] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.557297 10624 tablet_bootstrap.cc:492] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a: No bootstrap required, opened a new log
I20260709 13:17:01.557991 10624 ts_tablet_manager.cc:1403] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent bootstrapping tablet: real 0.094s	user 0.002s	sys 0.025s
I20260709 13:17:01.558139 10622 tablet_bootstrap.cc:492] T fc0579e86d9c4badb5993661bde5ad0e P 2b951bae1b2047adb22c93280654cb09: No bootstrap required, opened a new log
I20260709 13:17:01.558743 10622 ts_tablet_manager.cc:1403] T fc0579e86d9c4badb5993661bde5ad0e P 2b951bae1b2047adb22c93280654cb09: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.006s
I20260709 13:17:01.561380 10624 raft_consensus.cc:359] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.561868 10622 raft_consensus.cc:359] T fc0579e86d9c4badb5993661bde5ad0e P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.562278 10624 raft_consensus.cc:385] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.562676 10622 raft_consensus.cc:385] T fc0579e86d9c4badb5993661bde5ad0e P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.562742 10624 raft_consensus.cc:740] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.563030 10623 ts_tablet_manager.cc:1434] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:17:01.563108 10622 raft_consensus.cc:740] T fc0579e86d9c4badb5993661bde5ad0e P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.563941 10624 consensus_queue.cc:260] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.565054 10611 raft_consensus.cc:493] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.565081 10622 consensus_queue.cc:260] T fc0579e86d9c4badb5993661bde5ad0e P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.565738 10611 raft_consensus.cc:515] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.566838 10624 ts_tablet_manager.cc:1434] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:01.567584 10622 ts_tablet_manager.cc:1434] T fc0579e86d9c4badb5993661bde5ad0e P 2b951bae1b2047adb22c93280654cb09: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:01.567909 10624 tablet_bootstrap.cc:492] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a: Bootstrap starting.
I20260709 13:17:01.568630 10622 tablet_bootstrap.cc:492] T 84a120b131fc4a4b98f620be2d6b4034 P 2b951bae1b2047adb22c93280654cb09: Bootstrap starting.
I20260709 13:17:01.572149 10623 tablet_bootstrap.cc:492] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941: Bootstrap starting.
I20260709 13:17:01.577340 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627686b1121340d3998606b2427dd677" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" is_pre_election: true
I20260709 13:17:01.577840 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627686b1121340d3998606b2427dd677" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
W20260709 13:17:01.579020 10444 leader_election.cc:343] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:01.579635 10643 raft_consensus.cc:697] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Becoming Leader. State: Replica: 10a6055118734434bb157c480f4c2941, State: Running, Role: LEADER
W20260709 13:17:01.579864 10444 leader_election.cc:343] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:01.580403 10444 leader_election.cc:304] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10a6055118734434bb157c480f4c2941; no voters: 2b951bae1b2047adb22c93280654cb09, ac4ddcfd355b436aa151140f76a1ef2a
I20260709 13:17:01.580562 10643 consensus_queue.cc:237] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.581388 10624 tablet_bootstrap.cc:654] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.584925 10651 raft_consensus.cc:2749] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:01.588193 10623 tablet_bootstrap.cc:654] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.592111 10624 tablet_bootstrap.cc:492] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a: No bootstrap required, opened a new log
I20260709 13:17:01.592752 10624 ts_tablet_manager.cc:1403] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.000s
I20260709 13:17:01.567907 10611 leader_election.cc:290] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
I20260709 13:17:01.595271 10622 tablet_bootstrap.cc:654] T 84a120b131fc4a4b98f620be2d6b4034 P 2b951bae1b2047adb22c93280654cb09: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.596051 10624 raft_consensus.cc:359] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.597054 10624 raft_consensus.cc:385] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.597462 10624 raft_consensus.cc:740] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.598758 10624 consensus_queue.cc:260] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.600941 10624 ts_tablet_manager.cc:1434] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:17:01.601918 10624 tablet_bootstrap.cc:492] T 3c3af7d4c51b4ac7b5648de76b0a1629 P ac4ddcfd355b436aa151140f76a1ef2a: Bootstrap starting.
I20260709 13:17:01.602501 10599 raft_consensus.cc:493] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.603024 10599 raft_consensus.cc:515] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.605221 10599 leader_election.cc:290] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:01.606637 10227 catalog_manager.cc:5697] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10a6055118734434bb157c480f4c2941 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "10a6055118734434bb157c480f4c2941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:01.608024 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8eddcc368b243b9b14d4866b62a1ac4" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
I20260709 13:17:01.608695 10479 raft_consensus.cc:2468] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 0.
I20260709 13:17:01.607101 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8eddcc368b243b9b14d4866b62a1ac4" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" is_pre_election: true
I20260709 13:17:01.611215 10370 leader_election.cc:304] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09; no voters: 
I20260709 13:17:01.612040 10599 raft_consensus.cc:2804] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:01.612640 10599 raft_consensus.cc:493] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.613063 10599 raft_consensus.cc:3060] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.616473 10624 tablet_bootstrap.cc:654] T 3c3af7d4c51b4ac7b5648de76b0a1629 P ac4ddcfd355b436aa151140f76a1ef2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.616698 10622 tablet_bootstrap.cc:492] T 84a120b131fc4a4b98f620be2d6b4034 P 2b951bae1b2047adb22c93280654cb09: No bootstrap required, opened a new log
I20260709 13:17:01.617568 10622 ts_tablet_manager.cc:1403] T 84a120b131fc4a4b98f620be2d6b4034 P 2b951bae1b2047adb22c93280654cb09: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.003s
W20260709 13:17:01.612139 10370 leader_election.cc:343] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:01.620821 10622 raft_consensus.cc:359] T 84a120b131fc4a4b98f620be2d6b4034 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.622253 10643 raft_consensus.cc:493] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.622745 10643 raft_consensus.cc:515] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.626093 10643 leader_election.cc:290] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
I20260709 13:17:01.626542 10623 tablet_bootstrap.cc:492] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941: No bootstrap required, opened a new log
I20260709 13:17:01.621665 10622 raft_consensus.cc:385] T 84a120b131fc4a4b98f620be2d6b4034 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.627108 10623 ts_tablet_manager.cc:1403] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.010s
I20260709 13:17:01.627017 10622 raft_consensus.cc:740] T 84a120b131fc4a4b98f620be2d6b4034 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.628123 10622 consensus_queue.cc:260] T 84a120b131fc4a4b98f620be2d6b4034 P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.629323 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a120b131fc4a4b98f620be2d6b4034" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" is_pre_election: true
I20260709 13:17:01.630034 10332 raft_consensus.cc:2468] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 0.
I20260709 13:17:01.630388 10599 raft_consensus.cc:515] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.630961 10622 ts_tablet_manager.cc:1434] T 84a120b131fc4a4b98f620be2d6b4034 P 2b951bae1b2047adb22c93280654cb09: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:17:01.632192 10444 leader_election.cc:304] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:17:01.633527 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a120b131fc4a4b98f620be2d6b4034" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
I20260709 13:17:01.634560 10406 raft_consensus.cc:2468] T 84a120b131fc4a4b98f620be2d6b4034 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 0.
I20260709 13:17:01.635449 10643 raft_consensus.cc:2804] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:01.635746 10622 tablet_bootstrap.cc:492] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09: Bootstrap starting.
I20260709 13:17:01.635855 10643 raft_consensus.cc:493] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.637356 10643 raft_consensus.cc:3060] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.644842 10623 raft_consensus.cc:359] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.645758 10623 raft_consensus.cc:385] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.646103 10623 raft_consensus.cc:740] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.647012 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8eddcc368b243b9b14d4866b62a1ac4" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
I20260709 13:17:01.646915 10623 consensus_queue.cc:260] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.649606 10623 ts_tablet_manager.cc:1434] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
W20260709 13:17:01.650313 10370 leader_election.cc:343] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:01.650691 10623 tablet_bootstrap.cc:492] T 31f50adae4f042668ee6fd360fba0b26 P 10a6055118734434bb157c480f4c2941: Bootstrap starting.
I20260709 13:17:01.646981 10643 raft_consensus.cc:515] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.653342 10643 leader_election.cc:290] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 election: Requested vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
I20260709 13:17:01.653525 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a120b131fc4a4b98f620be2d6b4034" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
I20260709 13:17:01.654177 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8eddcc368b243b9b14d4866b62a1ac4" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:17:01.654809 10479 raft_consensus.cc:3060] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.656391 10624 tablet_bootstrap.cc:492] T 3c3af7d4c51b4ac7b5648de76b0a1629 P ac4ddcfd355b436aa151140f76a1ef2a: No bootstrap required, opened a new log
I20260709 13:17:01.656939 10624 ts_tablet_manager.cc:1403] T 3c3af7d4c51b4ac7b5648de76b0a1629 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent bootstrapping tablet: real 0.055s	user 0.004s	sys 0.010s
I20260709 13:17:01.657905 10623 tablet_bootstrap.cc:654] T 31f50adae4f042668ee6fd360fba0b26 P 10a6055118734434bb157c480f4c2941: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.660118 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a120b131fc4a4b98f620be2d6b4034" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:17:01.660606 10479 raft_consensus.cc:2468] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 1.
I20260709 13:17:01.660820 10406 raft_consensus.cc:3060] T 84a120b131fc4a4b98f620be2d6b4034 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.661063 10624 raft_consensus.cc:359] T 3c3af7d4c51b4ac7b5648de76b0a1629 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.661886 10624 raft_consensus.cc:385] T 3c3af7d4c51b4ac7b5648de76b0a1629 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.662184 10624 raft_consensus.cc:740] T 3c3af7d4c51b4ac7b5648de76b0a1629 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.662784 10637 raft_consensus.cc:493] T fc0579e86d9c4badb5993661bde5ad0e P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.663307 10637 raft_consensus.cc:515] T fc0579e86d9c4badb5993661bde5ad0e P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.664163 10370 leader_election.cc:304] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09; no voters: ac4ddcfd355b436aa151140f76a1ef2a
I20260709 13:17:01.654242 10332 raft_consensus.cc:3060] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.668927 10638 raft_consensus.cc:2804] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:01.669502 10638 raft_consensus.cc:697] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [term 1 LEADER]: Becoming Leader. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Running, Role: LEADER
I20260709 13:17:01.670632 10406 raft_consensus.cc:2468] T 84a120b131fc4a4b98f620be2d6b4034 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 1.
I20260709 13:17:01.670383 10638 consensus_queue.cc:237] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.672158 10444 leader_election.cc:304] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09; no voters: 
I20260709 13:17:01.665378 10637 leader_election.cc:290] T fc0579e86d9c4badb5993661bde5ad0e P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:01.673327 10643 raft_consensus.cc:2804] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:01.673682 10637 raft_consensus.cc:493] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.674274 10643 raft_consensus.cc:697] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Becoming Leader. State: Replica: 10a6055118734434bb157c480f4c2941, State: Running, Role: LEADER
I20260709 13:17:01.674307 10637 raft_consensus.cc:515] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.675444 10643 consensus_queue.cc:237] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.676349 10623 tablet_bootstrap.cc:492] T 31f50adae4f042668ee6fd360fba0b26 P 10a6055118734434bb157c480f4c2941: No bootstrap required, opened a new log
I20260709 13:17:01.676883 10623 ts_tablet_manager.cc:1403] T 31f50adae4f042668ee6fd360fba0b26 P 10a6055118734434bb157c480f4c2941: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 13:17:01.678850 10637 leader_election.cc:290] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:01.679790 10623 raft_consensus.cc:359] T 31f50adae4f042668ee6fd360fba0b26 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.680608 10623 raft_consensus.cc:385] T 31f50adae4f042668ee6fd360fba0b26 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.680877 10623 raft_consensus.cc:740] T 31f50adae4f042668ee6fd360fba0b26 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.681622 10623 consensus_queue.cc:260] T 31f50adae4f042668ee6fd360fba0b26 P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.679874 10624 consensus_queue.cc:260] T 3c3af7d4c51b4ac7b5648de76b0a1629 P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.685173 10622 tablet_bootstrap.cc:654] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.690742 10331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0579e86d9c4badb5993661bde5ad0e" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" is_pre_election: true
I20260709 13:17:01.690934 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3af7d4c51b4ac7b5648de76b0a1629" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
I20260709 13:17:01.691622 10331 raft_consensus.cc:2393] T fc0579e86d9c4badb5993661bde5ad0e P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b951bae1b2047adb22c93280654cb09 in current term 1: Already voted for candidate 10a6055118734434bb157c480f4c2941 in this term.
I20260709 13:17:01.692943 10329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3af7d4c51b4ac7b5648de76b0a1629" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" is_pre_election: true
I20260709 13:17:01.693657 10329 raft_consensus.cc:2468] T 3c3af7d4c51b4ac7b5648de76b0a1629 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 0.
W20260709 13:17:01.694275 10370 leader_election.cc:343] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:01.686198 10332 raft_consensus.cc:2468] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 1.
I20260709 13:17:01.686645 10599 leader_election.cc:290] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 election: Requested vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:01.687301 10624 ts_tablet_manager.cc:1434] T 3c3af7d4c51b4ac7b5648de76b0a1629 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:17:01.696035 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0579e86d9c4badb5993661bde5ad0e" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
I20260709 13:17:01.697173 10624 tablet_bootstrap.cc:492] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a: Bootstrap starting.
I20260709 13:17:01.699352 10623 ts_tablet_manager.cc:1434] T 31f50adae4f042668ee6fd360fba0b26 P 10a6055118734434bb157c480f4c2941: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:17:01.701802 10623 tablet_bootstrap.cc:492] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 10a6055118734434bb157c480f4c2941: Bootstrap starting.
I20260709 13:17:01.703301 10370 leader_election.cc:304] T fc0579e86d9c4badb5993661bde5ad0e P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b951bae1b2047adb22c93280654cb09; no voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a
I20260709 13:17:01.704064 10227 catalog_manager.cc:5697] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10a6055118734434bb157c480f4c2941 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "10a6055118734434bb157c480f4c2941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:01.704978 10658 raft_consensus.cc:3060] T fc0579e86d9c4badb5993661bde5ad0e P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.705271 10228 catalog_manager.cc:5697] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b951bae1b2047adb22c93280654cb09 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "2b951bae1b2047adb22c93280654cb09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:01.707530 10623 tablet_bootstrap.cc:654] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 10a6055118734434bb157c480f4c2941: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.705896 10370 leader_election.cc:304] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b951bae1b2047adb22c93280654cb09, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 10a6055118734434bb157c480f4c2941
I20260709 13:17:01.712742 10624 tablet_bootstrap.cc:654] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.714079 10599 raft_consensus.cc:2804] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:01.714306 10658 raft_consensus.cc:2749] T fc0579e86d9c4badb5993661bde5ad0e P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:01.714566 10599 raft_consensus.cc:493] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.715175 10599 raft_consensus.cc:3060] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.726042 10599 raft_consensus.cc:515] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.728835 10599 leader_election.cc:290] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 election: Requested vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:01.730702 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3af7d4c51b4ac7b5648de76b0a1629" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
I20260709 13:17:01.731331 10623 tablet_bootstrap.cc:492] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 10a6055118734434bb157c480f4c2941: No bootstrap required, opened a new log
I20260709 13:17:01.733517 10332 raft_consensus.cc:3060] T 3c3af7d4c51b4ac7b5648de76b0a1629 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.733652 10623 ts_tablet_manager.cc:1403] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 10a6055118734434bb157c480f4c2941: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 13:17:01.734306 10622 tablet_bootstrap.cc:492] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09: No bootstrap required, opened a new log
I20260709 13:17:01.734798 10622 ts_tablet_manager.cc:1403] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.004s
I20260709 13:17:01.736524 10623 raft_consensus.cc:359] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.737246 10623 raft_consensus.cc:385] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.737425 10623 raft_consensus.cc:740] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.732623 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3af7d4c51b4ac7b5648de76b0a1629" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:17:01.737738 10622 raft_consensus.cc:359] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.737996 10623 consensus_queue.cc:260] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.738554 10622 raft_consensus.cc:385] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.738842 10479 raft_consensus.cc:3060] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.738933 10622 raft_consensus.cc:740] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.739915 10623 ts_tablet_manager.cc:1434] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 10a6055118734434bb157c480f4c2941: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:17:01.744171 10624 tablet_bootstrap.cc:492] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a: No bootstrap required, opened a new log
I20260709 13:17:01.744246 10332 raft_consensus.cc:2468] T 3c3af7d4c51b4ac7b5648de76b0a1629 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 1.
I20260709 13:17:01.745007 10624 ts_tablet_manager.cc:1403] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.003s
I20260709 13:17:01.746078 10370 leader_election.cc:304] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b951bae1b2047adb22c93280654cb09, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:17:01.739773 10622 consensus_queue.cc:260] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.746282 10479 raft_consensus.cc:2468] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 1.
I20260709 13:17:01.748129 10658 raft_consensus.cc:2804] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:01.748656 10658 raft_consensus.cc:697] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [term 1 LEADER]: Becoming Leader. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Running, Role: LEADER
I20260709 13:17:01.749470 10658 consensus_queue.cc:237] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.755177 10622 ts_tablet_manager.cc:1434] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:17:01.757561 10622 tablet_bootstrap.cc:492] T 627686b1121340d3998606b2427dd677 P 2b951bae1b2047adb22c93280654cb09: Bootstrap starting.
I20260709 13:17:01.764454 10622 tablet_bootstrap.cc:654] T 627686b1121340d3998606b2427dd677 P 2b951bae1b2047adb22c93280654cb09: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.766721 10227 catalog_manager.cc:5697] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b951bae1b2047adb22c93280654cb09 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "2b951bae1b2047adb22c93280654cb09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:01.769866 10624 raft_consensus.cc:359] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.771016 10624 raft_consensus.cc:385] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.771453 10624 raft_consensus.cc:740] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.772713 10658 raft_consensus.cc:493] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.772403 10624 consensus_queue.cc:260] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.775651 10624 ts_tablet_manager.cc:1434] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:17:01.776748 10624 tablet_bootstrap.cc:492] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a: Bootstrap starting.
I20260709 13:17:01.774150 10658 raft_consensus.cc:515] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.781625 10658 leader_election.cc:290] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:01.782594 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f50adae4f042668ee6fd360fba0b26" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" is_pre_election: true
I20260709 13:17:01.783339 10332 raft_consensus.cc:2468] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 0.
I20260709 13:17:01.784154 10624 tablet_bootstrap.cc:654] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.784730 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f50adae4f042668ee6fd360fba0b26" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
I20260709 13:17:01.785406 10479 raft_consensus.cc:2468] T 31f50adae4f042668ee6fd360fba0b26 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 0.
I20260709 13:17:01.787266 10370 leader_election.cc:304] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b951bae1b2047adb22c93280654cb09, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:17:01.788829 10658 raft_consensus.cc:2804] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:01.789733 10658 raft_consensus.cc:493] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.790234 10658 raft_consensus.cc:3060] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.788857 10622 tablet_bootstrap.cc:492] T 627686b1121340d3998606b2427dd677 P 2b951bae1b2047adb22c93280654cb09: No bootstrap required, opened a new log
I20260709 13:17:01.791589 10622 ts_tablet_manager.cc:1403] T 627686b1121340d3998606b2427dd677 P 2b951bae1b2047adb22c93280654cb09: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.004s
I20260709 13:17:01.795120 10628 raft_consensus.cc:493] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.795025 10622 raft_consensus.cc:359] T 627686b1121340d3998606b2427dd677 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.795809 10628 raft_consensus.cc:515] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.798161 10628 leader_election.cc:290] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:01.801524 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627686b1121340d3998606b2427dd677" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
I20260709 13:17:01.802475 10479 raft_consensus.cc:2468] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 0.
I20260709 13:17:01.802487 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627686b1121340d3998606b2427dd677" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
I20260709 13:17:01.805037 10295 leader_election.cc:304] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:17:01.808420 10551 raft_consensus.cc:2804] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:01.808915 10551 raft_consensus.cc:493] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.809340 10551 raft_consensus.cc:3060] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.795828 10622 raft_consensus.cc:385] T 627686b1121340d3998606b2427dd677 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.813946 10622 raft_consensus.cc:740] T 627686b1121340d3998606b2427dd677 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.814774 10622 consensus_queue.cc:260] T 627686b1121340d3998606b2427dd677 P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.816709 10637 consensus_queue.cc:1048] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:01.817682 10622 ts_tablet_manager.cc:1434] T 627686b1121340d3998606b2427dd677 P 2b951bae1b2047adb22c93280654cb09: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:17:01.818823 10622 tablet_bootstrap.cc:492] T c5fa5e7b7725429299cf99eace72a54b P 2b951bae1b2047adb22c93280654cb09: Bootstrap starting.
I20260709 13:17:01.819931 10406 raft_consensus.cc:2468] T 627686b1121340d3998606b2427dd677 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 0.
I20260709 13:17:01.825938 10622 tablet_bootstrap.cc:654] T c5fa5e7b7725429299cf99eace72a54b P 2b951bae1b2047adb22c93280654cb09: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.825927 10599 consensus_queue.cc:1048] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:17:01.828305 10624 tablet_bootstrap.cc:492] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a: No bootstrap required, opened a new log
I20260709 13:17:01.828794 10624 ts_tablet_manager.cc:1403] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.022s
I20260709 13:17:01.831610 10624 raft_consensus.cc:359] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.832885 10624 raft_consensus.cc:385] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.833253 10624 raft_consensus.cc:740] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.834137 10624 consensus_queue.cc:260] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.826452 10658 raft_consensus.cc:515] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.837282 10658 leader_election.cc:290] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 election: Requested vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:01.838546 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f50adae4f042668ee6fd360fba0b26" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:17:01.839249 10480 raft_consensus.cc:3060] T 31f50adae4f042668ee6fd360fba0b26 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.839726 10624 ts_tablet_manager.cc:1434] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:17:01.843689 10329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f50adae4f042668ee6fd360fba0b26" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
I20260709 13:17:01.844354 10329 raft_consensus.cc:3060] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.846836 10622 tablet_bootstrap.cc:492] T c5fa5e7b7725429299cf99eace72a54b P 2b951bae1b2047adb22c93280654cb09: No bootstrap required, opened a new log
I20260709 13:17:01.847442 10622 ts_tablet_manager.cc:1403] T c5fa5e7b7725429299cf99eace72a54b P 2b951bae1b2047adb22c93280654cb09: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.011s
I20260709 13:17:01.853730 10622 raft_consensus.cc:359] T c5fa5e7b7725429299cf99eace72a54b P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.854673 10622 raft_consensus.cc:385] T c5fa5e7b7725429299cf99eace72a54b P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.855000 10622 raft_consensus.cc:740] T c5fa5e7b7725429299cf99eace72a54b P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.855866 10622 consensus_queue.cc:260] T c5fa5e7b7725429299cf99eace72a54b P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.860266 10622 ts_tablet_manager.cc:1434] T c5fa5e7b7725429299cf99eace72a54b P 2b951bae1b2047adb22c93280654cb09: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:17:01.867091 10480 raft_consensus.cc:2468] T 31f50adae4f042668ee6fd360fba0b26 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 1.
I20260709 13:17:01.873417 10329 raft_consensus.cc:2468] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 1.
I20260709 13:17:01.874017 10551 raft_consensus.cc:515] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.877816 10370 leader_election.cc:304] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09; no voters: 
I20260709 13:17:01.879470 10658 raft_consensus.cc:2804] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:01.883167 10658 raft_consensus.cc:697] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [term 1 LEADER]: Becoming Leader. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Running, Role: LEADER
I20260709 13:17:01.884162 10658 consensus_queue.cc:237] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.879521 10551 leader_election.cc:290] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 election: Requested vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:01.880932 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627686b1121340d3998606b2427dd677" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:17:01.887387 10406 raft_consensus.cc:3060] T 627686b1121340d3998606b2427dd677 P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.882455 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627686b1121340d3998606b2427dd677" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:17:01.891716 10481 raft_consensus.cc:3060] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.912019 10481 raft_consensus.cc:2468] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 1.
I20260709 13:17:01.904307 10406 raft_consensus.cc:2468] T 627686b1121340d3998606b2427dd677 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 1.
I20260709 13:17:01.915516 10295 leader_election.cc:304] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b951bae1b2047adb22c93280654cb09, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:17:01.916729 10551 raft_consensus.cc:2804] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:01.917456 10551 raft_consensus.cc:697] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Becoming Leader. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Running, Role: LEADER
I20260709 13:17:01.919083 10551 consensus_queue.cc:237] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.938177 10228 catalog_manager.cc:5697] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b951bae1b2047adb22c93280654cb09 (127.31.17.130). New cstate: current_term: 1 leader_uuid: "2b951bae1b2047adb22c93280654cb09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:01.939230 10227 catalog_manager.cc:5697] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a reported cstate change: term changed from 0 to 1, leader changed from <none> to ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129). New cstate: current_term: 1 leader_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:01.940872 10332 raft_consensus.cc:3060] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.949153 10551 raft_consensus.cc:493] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.949419 10643 consensus_queue.cc:1048] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:01.949702 10551 raft_consensus.cc:515] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.951931 10551 leader_election.cc:290] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:01.952947 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94d9434a48f40a58e4ce29b60cbc196" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
I20260709 13:17:01.953583 10406 raft_consensus.cc:2468] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 1.
I20260709 13:17:01.954984 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94d9434a48f40a58e4ce29b60cbc196" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
I20260709 13:17:01.955029 10295 leader_election.cc:304] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b951bae1b2047adb22c93280654cb09, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:17:01.960851 10551 raft_consensus.cc:2804] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:01.963038 10551 raft_consensus.cc:493] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10a6055118734434bb157c480f4c2941)
I20260709 13:17:01.963492 10551 raft_consensus.cc:3060] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.973384 10611 raft_consensus.cc:493] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.972746 10551 raft_consensus.cc:515] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.973963 10611 raft_consensus.cc:515] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.974779 10640 consensus_queue.cc:1048] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:01.975869 10551 leader_election.cc:290] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 2 election: Requested vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:01.976049 10611 leader_election.cc:290] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
I20260709 13:17:01.976696 10332 raft_consensus.cc:1240] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Rejecting Update request from peer 10a6055118734434bb157c480f4c2941 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:01.978163 10329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fa5e7b7725429299cf99eace72a54b" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" is_pre_election: true
I20260709 13:17:01.978837 10329 raft_consensus.cc:2468] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 0.
I20260709 13:17:01.979858 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94d9434a48f40a58e4ce29b60cbc196" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:17:01.979984 10444 leader_election.cc:304] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:17:01.981616 10611 raft_consensus.cc:2804] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:01.981962 10611 raft_consensus.cc:493] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.982259 10611 raft_consensus.cc:3060] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.982910 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fa5e7b7725429299cf99eace72a54b" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
I20260709 13:17:01.983601 10405 raft_consensus.cc:2468] T c5fa5e7b7725429299cf99eace72a54b P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 0.
I20260709 13:17:01.984927 10651 consensus_queue.cc:1059] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:01.985735 10651 raft_consensus.cc:3055] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:01.986038 10651 raft_consensus.cc:740] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Running, Role: LEADER
I20260709 13:17:01.990046 10611 raft_consensus.cc:515] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.991690 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94d9434a48f40a58e4ce29b60cbc196" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:17:01.992254 10611 leader_election.cc:290] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 election: Requested vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
I20260709 13:17:01.986886 10651 consensus_queue.cc:260] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:01.993775 10651 raft_consensus.cc:3060] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.994683 10295 leader_election.cc:304] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac4ddcfd355b436aa151140f76a1ef2a; no voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09
I20260709 13:17:01.996030 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fa5e7b7725429299cf99eace72a54b" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:17:01.996656 10551 raft_consensus.cc:2749] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:01.996707 10407 raft_consensus.cc:3060] T c5fa5e7b7725429299cf99eace72a54b P 2b951bae1b2047adb22c93280654cb09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.994812 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fa5e7b7725429299cf99eace72a54b" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
I20260709 13:17:02.002027 10332 raft_consensus.cc:3060] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:02.005894 10407 raft_consensus.cc:2468] T c5fa5e7b7725429299cf99eace72a54b P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 1.
I20260709 13:17:02.007108 10444 leader_election.cc:304] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09; no voters: 
I20260709 13:17:02.008167 10651 raft_consensus.cc:2804] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:02.008641 10332 raft_consensus.cc:2468] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 1.
I20260709 13:17:02.010058 10651 raft_consensus.cc:697] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Becoming Leader. State: Replica: 10a6055118734434bb157c480f4c2941, State: Running, Role: LEADER
I20260709 13:17:02.011077 10651 consensus_queue.cc:237] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:02.026788 10228 catalog_manager.cc:5697] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10a6055118734434bb157c480f4c2941 (127.31.17.131). New cstate: current_term: 1 leader_uuid: "10a6055118734434bb157c480f4c2941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:02.049654 10651 consensus_queue.cc:1048] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:02.066766 10611 consensus_queue.cc:1048] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:02.068151 10611 consensus_queue.cc:1048] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:02.072276 10480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5fa5e7b7725429299cf99eace72a54b"
dest_uuid: "10a6055118734434bb157c480f4c2941"
mode: GRACEFUL
new_leader_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
 from {username='slave'} at 127.0.0.1:47282
I20260709 13:17:02.074247 10480 raft_consensus.cc:606] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Received request to transfer leadership to TS ac4ddcfd355b436aa151140f76a1ef2a
I20260709 13:17:02.085444 10480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84a120b131fc4a4b98f620be2d6b4034"
dest_uuid: "10a6055118734434bb157c480f4c2941"
mode: GRACEFUL
new_leader_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
 from {username='slave'} at 127.0.0.1:47282
I20260709 13:17:02.086033 10480 raft_consensus.cc:606] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Received request to transfer leadership to TS ac4ddcfd355b436aa151140f76a1ef2a
I20260709 13:17:02.097402 10651 raft_consensus.cc:993] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941: : Instructing follower ac4ddcfd355b436aa151140f76a1ef2a to start an election
I20260709 13:17:02.097867 10651 raft_consensus.cc:1081] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Signalling peer ac4ddcfd355b436aa151140f76a1ef2a to start an election
I20260709 13:17:02.106340 10329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84a120b131fc4a4b98f620be2d6b4034"
dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
 from {username='slave'} at 127.0.0.1:50860
I20260709 13:17:02.107101 10329 raft_consensus.cc:493] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:02.107635 10329 raft_consensus.cc:3060] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.129666 10329 raft_consensus.cc:515] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:02.131155 10651 consensus_queue.cc:1048] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:02.141754 10407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bd9b52bffde4dd488a4ae6a1747b207"
dest_uuid: "2b951bae1b2047adb22c93280654cb09"
mode: GRACEFUL
new_leader_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
 from {username='slave'} at 127.0.0.1:50492
I20260709 13:17:02.144116 10407 raft_consensus.cc:606] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 1 LEADER]: Received request to transfer leadership to TS ac4ddcfd355b436aa151140f76a1ef2a
I20260709 13:17:02.146651 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a120b131fc4a4b98f620be2d6b4034" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:17:02.147229 10480 raft_consensus.cc:3055] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:02.147322 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a120b131fc4a4b98f620be2d6b4034" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:17:02.147625 10480 raft_consensus.cc:740] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Running, Role: LEADER
I20260709 13:17:02.148561 10480 consensus_queue.cc:260] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:02.149483 10480 raft_consensus.cc:3060] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.155450 10659 consensus_queue.cc:1048] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:02.156323 10329 leader_election.cc:290] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 2 election: Requested vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:02.158211 10480 raft_consensus.cc:2468] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 2.
I20260709 13:17:02.159444 10295 leader_election.cc:304] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 2b951bae1b2047adb22c93280654cb09
I20260709 13:17:02.160480 10551 raft_consensus.cc:2804] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:02.160926 10551 raft_consensus.cc:697] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 LEADER]: Becoming Leader. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Running, Role: LEADER
I20260709 13:17:02.161895 10551 consensus_queue.cc:237] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:02.164287 10480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c94d9434a48f40a58e4ce29b60cbc196"
dest_uuid: "10a6055118734434bb157c480f4c2941"
mode: GRACEFUL
new_leader_uuid: "2b951bae1b2047adb22c93280654cb09"
 from {username='slave'} at 127.0.0.1:47282
I20260709 13:17:02.164953 10480 raft_consensus.cc:606] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Received request to transfer leadership to TS 2b951bae1b2047adb22c93280654cb09
I20260709 13:17:02.165326 10480 raft_consensus.cc:614] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:02.180146 10332 raft_consensus.cc:3060] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:02.189870 10227 catalog_manager.cc:5697] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a reported cstate change: term changed from 1 to 2, leader changed from 10a6055118734434bb157c480f4c2941 (127.31.17.131) to ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129). New cstate: current_term: 2 leader_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:02.191267 10637 consensus_queue.cc:1048] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:02.196552 10628 raft_consensus.cc:493] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.197091 10628 raft_consensus.cc:515] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:02.200014 10637 consensus_queue.cc:1048] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:02.200716 10628 leader_election.cc:290] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:02.202837 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8eddcc368b243b9b14d4866b62a1ac4" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
I20260709 13:17:02.203557 10481 raft_consensus.cc:2468] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 1.
I20260709 13:17:02.204365 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8eddcc368b243b9b14d4866b62a1ac4" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
I20260709 13:17:02.204810 10295 leader_election.cc:304] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:17:02.205600 10628 raft_consensus.cc:2804] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:02.205927 10628 raft_consensus.cc:493] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.206218 10628 raft_consensus.cc:3060] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.214533 10628 raft_consensus.cc:515] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:02.215602 10332 raft_consensus.cc:1240] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Rejecting Update request from peer 2b951bae1b2047adb22c93280654cb09 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:17:02.218089 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8eddcc368b243b9b14d4866b62a1ac4" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:17:02.220690 10628 leader_election.cc:290] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 2 election: Requested vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:02.221377 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8eddcc368b243b9b14d4866b62a1ac4" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:17:02.222025 10481 raft_consensus.cc:3060] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.224313 10637 consensus_queue.cc:1059] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:02.225136 10599 raft_consensus.cc:3055] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:02.225492 10599 raft_consensus.cc:740] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Running, Role: LEADER
I20260709 13:17:02.226487 10599 consensus_queue.cc:260] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:02.227835 10599 raft_consensus.cc:3060] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.235301 10481 raft_consensus.cc:2468] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 2.
I20260709 13:17:02.237212 10295 leader_election.cc:304] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 2b951bae1b2047adb22c93280654cb09
I20260709 13:17:02.237892 10628 raft_consensus.cc:2804] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:02.238495 10628 raft_consensus.cc:697] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 LEADER]: Becoming Leader. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Running, Role: LEADER
I20260709 13:17:02.239475 10628 consensus_queue.cc:237] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:02.249452 10227 catalog_manager.cc:5697] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a reported cstate change: term changed from 1 to 2, leader changed from 2b951bae1b2047adb22c93280654cb09 (127.31.17.130) to ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129). New cstate: current_term: 2 leader_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:02.309556 10599 consensus_queue.cc:1048] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:02.324878 10659 consensus_queue.cc:1048] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:02.374334 10637 raft_consensus.cc:993] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09: : Instructing follower ac4ddcfd355b436aa151140f76a1ef2a to start an election
I20260709 13:17:02.374826 10659 raft_consensus.cc:1081] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 1 LEADER]: Signalling peer ac4ddcfd355b436aa151140f76a1ef2a to start an election
I20260709 13:17:02.376426 10332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bd9b52bffde4dd488a4ae6a1747b207"
dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
 from {username='slave'} at 127.0.0.1:50868
I20260709 13:17:02.376906 10332 raft_consensus.cc:493] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:02.377182 10332 raft_consensus.cc:3060] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.381809 10332 raft_consensus.cc:515] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:02.383415 10332 leader_election.cc:290] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 2 election: Requested vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:02.384548 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd9b52bffde4dd488a4ae6a1747b207" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:17:02.385251 10407 raft_consensus.cc:3055] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:02.385593 10407 raft_consensus.cc:740] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Running, Role: LEADER
I20260709 13:17:02.385665 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd9b52bffde4dd488a4ae6a1747b207" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:17:02.386606 10480 raft_consensus.cc:3060] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.386703 10407 consensus_queue.cc:260] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:02.388274 10407 raft_consensus.cc:3060] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.395071 10480 raft_consensus.cc:2468] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 2.
I20260709 13:17:02.396279 10407 raft_consensus.cc:2468] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 2.
I20260709 13:17:02.397264 10295 leader_election.cc:304] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:17:02.398519 10628 raft_consensus.cc:2804] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:02.399055 10628 raft_consensus.cc:697] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 LEADER]: Becoming Leader. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Running, Role: LEADER
I20260709 13:17:02.399987 10628 consensus_queue.cc:237] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:02.411994 10227 catalog_manager.cc:5697] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a reported cstate change: term changed from 1 to 2, leader changed from 2b951bae1b2047adb22c93280654cb09 (127.31.17.130) to ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129). New cstate: current_term: 2 leader_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:02.453259 10628 consensus_queue.cc:1048] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:02.464071 10628 consensus_queue.cc:1048] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:02.555501 10651 consensus_queue.cc:1048] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:02.569670 10611 consensus_queue.cc:1048] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:02.581595 10611 raft_consensus.cc:993] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941: : Instructing follower ac4ddcfd355b436aa151140f76a1ef2a to start an election
I20260709 13:17:02.582154 10611 raft_consensus.cc:1081] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Signalling peer ac4ddcfd355b436aa151140f76a1ef2a to start an election
I20260709 13:17:02.584128 10332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5fa5e7b7725429299cf99eace72a54b"
dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
 from {username='slave'} at 127.0.0.1:50860
I20260709 13:17:02.584661 10332 raft_consensus.cc:493] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:02.584956 10332 raft_consensus.cc:3060] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.593183 10332 raft_consensus.cc:515] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:02.595960 10332 leader_election.cc:290] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 2 election: Requested vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:02.597886 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fa5e7b7725429299cf99eace72a54b" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:17:02.598552 10480 raft_consensus.cc:3055] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:02.598922 10480 raft_consensus.cc:740] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10a6055118734434bb157c480f4c2941, State: Running, Role: LEADER
I20260709 13:17:02.599814 10480 consensus_queue.cc:260] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:02.601321 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fa5e7b7725429299cf99eace72a54b" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:17:02.602933 10480 raft_consensus.cc:3060] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.602425 10407 raft_consensus.cc:3060] T c5fa5e7b7725429299cf99eace72a54b P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.608122 10480 raft_consensus.cc:2468] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 2.
I20260709 13:17:02.609206 10295 leader_election.cc:304] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:17:02.609845 10551 raft_consensus.cc:2804] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:02.610239 10551 raft_consensus.cc:697] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [term 2 LEADER]: Becoming Leader. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Running, Role: LEADER
I20260709 13:17:02.611021 10551 consensus_queue.cc:237] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:02.611212 10407 raft_consensus.cc:2468] T c5fa5e7b7725429299cf99eace72a54b P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 2.
I20260709 13:17:02.618809 10227 catalog_manager.cc:5697] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a reported cstate change: term changed from 1 to 2, leader changed from 10a6055118734434bb157c480f4c2941 (127.31.17.131) to ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129). New cstate: current_term: 2 leader_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:02.648257 10480 raft_consensus.cc:1275] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Refusing update from remote peer ac4ddcfd355b436aa151140f76a1ef2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:02.649508 10551 consensus_queue.cc:1048] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:02.667825 10407 raft_consensus.cc:3060] T 84a120b131fc4a4b98f620be2d6b4034 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.673519 10407 raft_consensus.cc:1275] T 84a120b131fc4a4b98f620be2d6b4034 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Refusing update from remote peer ac4ddcfd355b436aa151140f76a1ef2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:02.674793 10551 consensus_queue.cc:1048] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:02.801779 10481 raft_consensus.cc:1275] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Refusing update from remote peer ac4ddcfd355b436aa151140f76a1ef2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:02.803030 10551 consensus_queue.cc:1048] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:02.818460 10407 raft_consensus.cc:1275] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Refusing update from remote peer ac4ddcfd355b436aa151140f76a1ef2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:17:02.818892 10407 pending_rounds.cc:85] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09: Aborting all ops after (but not including) 0
I20260709 13:17:02.819142 10407 pending_rounds.cc:107] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:17:02.819518 10407 raft_consensus.cc:2889] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:02.821651 10691 consensus_queue.cc:1048] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:02.953927 10407 raft_consensus.cc:1275] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Refusing update from remote peer ac4ddcfd355b436aa151140f76a1ef2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:02.955411 10691 consensus_queue.cc:1048] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:02.964578 10481 raft_consensus.cc:1275] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Refusing update from remote peer ac4ddcfd355b436aa151140f76a1ef2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:02.968194 10691 consensus_queue.cc:1048] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:02.997665 10407 raft_consensus.cc:1275] T c5fa5e7b7725429299cf99eace72a54b P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Refusing update from remote peer ac4ddcfd355b436aa151140f76a1ef2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:02.999025 10551 consensus_queue.cc:1048] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:03.008901 10481 raft_consensus.cc:1275] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Refusing update from remote peer ac4ddcfd355b436aa151140f76a1ef2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:03.012311 10551 consensus_queue.cc:1048] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:03.489930 10637 raft_consensus.cc:493] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10a6055118734434bb157c480f4c2941)
I20260709 13:17:03.490423 10637 raft_consensus.cc:515] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:03.492201 10637 leader_election.cc:290] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:03.493067 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94d9434a48f40a58e4ce29b60cbc196" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" is_pre_election: true
I20260709 13:17:03.493384 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94d9434a48f40a58e4ce29b60cbc196" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
I20260709 13:17:03.493907 10332 raft_consensus.cc:2393] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b951bae1b2047adb22c93280654cb09 in current term 2: Already voted for candidate ac4ddcfd355b436aa151140f76a1ef2a in this term.
I20260709 13:17:03.493988 10480 raft_consensus.cc:2468] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 2.
I20260709 13:17:03.495200 10370 leader_election.cc:304] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09; no voters: ac4ddcfd355b436aa151140f76a1ef2a
I20260709 13:17:03.495888 10637 raft_consensus.cc:2804] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:03.496245 10637 raft_consensus.cc:493] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10a6055118734434bb157c480f4c2941)
I20260709 13:17:03.496528 10637 raft_consensus.cc:3060] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:03.502547 10637 raft_consensus.cc:515] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:03.504262 10637 leader_election.cc:290] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 2 election: Requested vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:03.505163 10480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94d9434a48f40a58e4ce29b60cbc196" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:17:03.504997 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94d9434a48f40a58e4ce29b60cbc196" candidate_uuid: "2b951bae1b2047adb22c93280654cb09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
I20260709 13:17:03.505978 10332 raft_consensus.cc:2393] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b951bae1b2047adb22c93280654cb09 in current term 2: Already voted for candidate ac4ddcfd355b436aa151140f76a1ef2a in this term.
I20260709 13:17:03.511490 10480 raft_consensus.cc:2468] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b951bae1b2047adb22c93280654cb09 in term 2.
I20260709 13:17:03.513414 10370 leader_election.cc:304] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09; no voters: ac4ddcfd355b436aa151140f76a1ef2a
I20260709 13:17:03.514560 10637 raft_consensus.cc:2804] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:03.526129 10637 raft_consensus.cc:697] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 2 LEADER]: Becoming Leader. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Running, Role: LEADER
I20260709 13:17:03.527103 10637 consensus_queue.cc:237] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:03.535643 10227 catalog_manager.cc:5697] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 reported cstate change: term changed from 1 to 2, leader changed from 10a6055118734434bb157c480f4c2941 (127.31.17.131) to 2b951bae1b2047adb22c93280654cb09 (127.31.17.130). New cstate: current_term: 2 leader_uuid: "2b951bae1b2047adb22c93280654cb09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.712208 10551 raft_consensus.cc:493] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.712661 10551 raft_consensus.cc:515] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:03.714290 10551 leader_election.cc:290] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:03.715296 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94d9434a48f40a58e4ce29b60cbc196" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941" is_pre_election: true
I20260709 13:17:03.715193 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94d9434a48f40a58e4ce29b60cbc196" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09" is_pre_election: true
I20260709 13:17:03.716140 10481 raft_consensus.cc:2468] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 2.
I20260709 13:17:03.717337 10295 leader_election.cc:304] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 2b951bae1b2047adb22c93280654cb09
I20260709 13:17:03.718086 10691 raft_consensus.cc:2804] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:03.718477 10691 raft_consensus.cc:493] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.718856 10691 raft_consensus.cc:3060] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.724805 10691 raft_consensus.cc:515] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:03.726557 10691 leader_election.cc:290] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 3 election: Requested vote from peers 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727), 10a6055118734434bb157c480f4c2941 (127.31.17.131:39653)
I20260709 13:17:03.727198 10407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94d9434a48f40a58e4ce29b60cbc196" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:17:03.728257 10481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94d9434a48f40a58e4ce29b60cbc196" candidate_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10a6055118734434bb157c480f4c2941"
I20260709 13:17:03.728962 10481 raft_consensus.cc:3060] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.737970 10481 raft_consensus.cc:2468] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4ddcfd355b436aa151140f76a1ef2a in term 3.
I20260709 13:17:03.739394 10295 leader_election.cc:304] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 2b951bae1b2047adb22c93280654cb09
I20260709 13:17:03.740063 10691 raft_consensus.cc:2804] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:03.740568 10691 raft_consensus.cc:697] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 3 LEADER]: Becoming Leader. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Running, Role: LEADER
I20260709 13:17:03.741324 10691 consensus_queue.cc:237] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:03.750150 10227 catalog_manager.cc:5697] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a reported cstate change: term changed from 2 to 3, leader changed from 2b951bae1b2047adb22c93280654cb09 (127.31.17.130) to ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129). New cstate: current_term: 3 leader_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.917069 10481 raft_consensus.cc:1240] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 3 FOLLOWER]: Rejecting Update request from peer 2b951bae1b2047adb22c93280654cb09 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:03.918812 10700 consensus_queue.cc:1059] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:03.919325 10332 raft_consensus.cc:1240] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 3 LEADER]: Rejecting Update request from peer 2b951bae1b2047adb22c93280654cb09 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:03.919652 10637 raft_consensus.cc:3055] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:03.920083 10637 raft_consensus.cc:740] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Running, Role: LEADER
I20260709 13:17:03.920745 10700 consensus_queue.cc:1059] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:03.921324 10700 consensus_queue.cc:1243] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [LEADER]: Peer ac4ddcfd355b436aa151140f76a1ef2a log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:17:03.921837 10637 consensus_queue.cc:260] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:03.924157 10637 raft_consensus.cc:3060] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:04.292236 10481 raft_consensus.cc:1275] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 3 FOLLOWER]: Refusing update from remote peer ac4ddcfd355b436aa151140f76a1ef2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:04.294241 10551 consensus_queue.cc:1048] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:04.302342 10406 raft_consensus.cc:1275] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 3 FOLLOWER]: Refusing update from remote peer ac4ddcfd355b436aa151140f76a1ef2a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:17:04.302731 10406 pending_rounds.cc:85] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09: Aborting all ops after (but not including) 1
I20260709 13:17:04.302984 10406 pending_rounds.cc:107] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:17:04.303378 10406 raft_consensus.cc:2889] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:04.305070 10551 consensus_queue.cc:1048] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:05.189358 10229 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41682:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:17:05.216048 10229 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41682:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:17:05.240792 31814 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:05.526643 10743 log.cc:927] Time spent T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941: Append to log took a long time: real 0.093s	user 0.001s	sys 0.002s
W20260709 13:17:05.519121 10748 log.cc:927] Time spent T 3c3af7d4c51b4ac7b5648de76b0a1629 P 10a6055118734434bb157c480f4c2941: Append to log took a long time: real 0.084s	user 0.003s	sys 0.000s
I20260709 13:17:05.619323 10769 tablet.cc:1724] T 31f50adae4f042668ee6fd360fba0b26 P 10a6055118734434bb157c480f4c2941: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:17:05.626122 10755 log.cc:927] Time spent T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:17:05.548098 10759 tablet.cc:1724] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.671200 10404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "063465af3760493ba233140c2c4ac428"
dest_uuid: "2b951bae1b2047adb22c93280654cb09"
mode: GRACEFUL
new_leader_uuid: "10a6055118734434bb157c480f4c2941"
 from {username='slave'} at 127.0.0.1:50508
I20260709 13:17:05.672523 10404 raft_consensus.cc:606] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 1 LEADER]: Received request to transfer leadership to TS 10a6055118734434bb157c480f4c2941
I20260709 13:17:05.622002 10760 tablet.cc:1724] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.713212 10776 tablet.cc:1724] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.713405 10780 tablet.cc:1724] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.713419 10779 tablet.cc:1724] T 3c3af7d4c51b4ac7b5648de76b0a1629 P ac4ddcfd355b436aa151140f76a1ef2a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.715746 10765 tablet.cc:1724] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.716078 10781 tablet.cc:1724] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:17:05.744230 10444 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.17.130:38727, user_credentials={real_user=slave}} blocked reactor thread for 88776.8us
I20260709 13:17:05.766381 10776 tablet.cc:1724] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:17:05.774991 10772 log.cc:927] Time spent T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 13:17:05.792050 10775 log.cc:927] Time spent T 627686b1121340d3998606b2427dd677 P 2b951bae1b2047adb22c93280654cb09: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:17:05.819043 10777 tablet.cc:1724] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.821231 10760 tablet.cc:1724] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.825593 10781 tablet.cc:1724] T c5fa5e7b7725429299cf99eace72a54b P 2b951bae1b2047adb22c93280654cb09: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.827795 10784 tablet.cc:1724] T fc0579e86d9c4badb5993661bde5ad0e P 2b951bae1b2047adb22c93280654cb09: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.831353 10328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53c207cb8fe44b888b5018a691f0c030"
dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
mode: GRACEFUL
new_leader_uuid: "10a6055118734434bb157c480f4c2941"
 from {username='slave'} at 127.0.0.1:56964
I20260709 13:17:05.832113 10328 raft_consensus.cc:606] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Received request to transfer leadership to TS 10a6055118734434bb157c480f4c2941
I20260709 13:17:05.838430 10769 tablet.cc:1724] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.842144 10783 tablet.cc:1724] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.848879 10765 tablet.cc:1724] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.851007 10786 tablet.cc:1724] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.852562 31814 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:05.868119 31814 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:05.842397 10780 tablet.cc:1724] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.855950 10759 tablet.cc:1724] T 84a120b131fc4a4b98f620be2d6b4034 P 2b951bae1b2047adb22c93280654cb09: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.859805 10777 tablet.cc:1724] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.854875 10779 tablet.cc:1724] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.867774 10760 tablet.cc:1724] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.880523 10781 tablet.cc:1724] T 627686b1121340d3998606b2427dd677 P 2b951bae1b2047adb22c93280654cb09: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.882617 10776 tablet.cc:1724] T fc0579e86d9c4badb5993661bde5ad0e P ac4ddcfd355b436aa151140f76a1ef2a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.894028 10769 tablet.cc:1724] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.903923 10783 tablet.cc:1724] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 10a6055118734434bb157c480f4c2941: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.919026 10783 tablet.cc:1724] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:05.941144 10229 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303: soft_deleted_table [id=e3e5619f44484f1d9b0a0b08806a3f26] alter complete (version 1)
I20260709 13:17:06.023258 10742 raft_consensus.cc:993] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a: : Instructing follower 10a6055118734434bb157c480f4c2941 to start an election
I20260709 13:17:06.023859 10744 raft_consensus.cc:1081] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Signalling peer 10a6055118734434bb157c480f4c2941 to start an election
I20260709 13:17:06.025530 10475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53c207cb8fe44b888b5018a691f0c030"
dest_uuid: "10a6055118734434bb157c480f4c2941"
 from {username='slave'} at 127.0.0.1:47274
I20260709 13:17:06.026059 10475 raft_consensus.cc:493] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:06.026391 10475 raft_consensus.cc:3060] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:06.032469 10475 raft_consensus.cc:515] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:06.034623 10475 leader_election.cc:290] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 2 election: Requested vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
I20260709 13:17:06.035413 10328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c207cb8fe44b888b5018a691f0c030" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
I20260709 13:17:06.035802 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c207cb8fe44b888b5018a691f0c030" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:17:06.036306 10328 raft_consensus.cc:3055] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:06.036422 10406 raft_consensus.cc:3060] T 53c207cb8fe44b888b5018a691f0c030 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:06.036662 10328 raft_consensus.cc:740] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac4ddcfd355b436aa151140f76a1ef2a, State: Running, Role: LEADER
I20260709 13:17:06.037614 10328 consensus_queue.cc:260] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:06.038803 10328 raft_consensus.cc:3060] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:06.042351 10406 raft_consensus.cc:2468] T 53c207cb8fe44b888b5018a691f0c030 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 2.
I20260709 13:17:06.043648 10444 leader_election.cc:304] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, 2b951bae1b2047adb22c93280654cb09; no voters: 
I20260709 13:17:06.044548 10782 raft_consensus.cc:2804] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:06.045015 10782 raft_consensus.cc:697] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941 [term 2 LEADER]: Becoming Leader. State: Replica: 10a6055118734434bb157c480f4c2941, State: Running, Role: LEADER
I20260709 13:17:06.045146 10328 raft_consensus.cc:2468] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 2.
I20260709 13:17:06.046033 10782 consensus_queue.cc:237] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:06.054567 10229 catalog_manager.cc:5697] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941 reported cstate change: term changed from 1 to 2, leader changed from ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129) to 10a6055118734434bb157c480f4c2941 (127.31.17.131). New cstate: current_term: 2 leader_uuid: "10a6055118734434bb157c480f4c2941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.066290 10762 raft_consensus.cc:993] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09: : Instructing follower 10a6055118734434bb157c480f4c2941 to start an election
I20260709 13:17:06.066896 10637 raft_consensus.cc:1081] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 1 LEADER]: Signalling peer 10a6055118734434bb157c480f4c2941 to start an election
I20260709 13:17:06.068341 10475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "063465af3760493ba233140c2c4ac428"
dest_uuid: "10a6055118734434bb157c480f4c2941"
 from {username='slave'} at 127.0.0.1:47276
I20260709 13:17:06.068794 10475 raft_consensus.cc:493] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:06.069088 10475 raft_consensus.cc:3060] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:06.074539 10475 raft_consensus.cc:515] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:06.076426 10475 leader_election.cc:290] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 2 election: Requested vote from peers ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697), 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727)
I20260709 13:17:06.077128 10328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063465af3760493ba233140c2c4ac428" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac4ddcfd355b436aa151140f76a1ef2a"
I20260709 13:17:06.077468 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063465af3760493ba233140c2c4ac428" candidate_uuid: "10a6055118734434bb157c480f4c2941" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b951bae1b2047adb22c93280654cb09"
I20260709 13:17:06.077767 10328 raft_consensus.cc:3060] T 063465af3760493ba233140c2c4ac428 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:06.078111 10406 raft_consensus.cc:3055] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:06.078406 10406 raft_consensus.cc:740] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b951bae1b2047adb22c93280654cb09, State: Running, Role: LEADER
I20260709 13:17:06.079146 10406 consensus_queue.cc:260] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:06.080204 10406 raft_consensus.cc:3060] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:06.083452 10328 raft_consensus.cc:2468] T 063465af3760493ba233140c2c4ac428 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 2.
I20260709 13:17:06.084661 10444 leader_election.cc:304] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a6055118734434bb157c480f4c2941, ac4ddcfd355b436aa151140f76a1ef2a; no voters: 
I20260709 13:17:06.085371 10782 raft_consensus.cc:2804] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:06.085770 10782 raft_consensus.cc:697] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [term 2 LEADER]: Becoming Leader. State: Replica: 10a6055118734434bb157c480f4c2941, State: Running, Role: LEADER
I20260709 13:17:06.085942 10406 raft_consensus.cc:2468] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a6055118734434bb157c480f4c2941 in term 2.
I20260709 13:17:06.086650 10782 consensus_queue.cc:237] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } }
I20260709 13:17:06.093834 10229 catalog_manager.cc:5697] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 reported cstate change: term changed from 1 to 2, leader changed from 2b951bae1b2047adb22c93280654cb09 (127.31.17.130) to 10a6055118734434bb157c480f4c2941 (127.31.17.131). New cstate: current_term: 2 leader_uuid: "10a6055118734434bb157c480f4c2941" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a6055118734434bb157c480f4c2941" member_type: VOTER last_known_addr { host: "127.31.17.131" port: 39653 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.438650 10328 raft_consensus.cc:1275] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Refusing update from remote peer 10a6055118734434bb157c480f4c2941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:06.440068 10782 consensus_queue.cc:1048] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:06.450555 10406 raft_consensus.cc:1275] T 53c207cb8fe44b888b5018a691f0c030 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Refusing update from remote peer 10a6055118734434bb157c480f4c2941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:06.452081 10782 consensus_queue.cc:1048] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:06.531726 10402 raft_consensus.cc:1275] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Refusing update from remote peer 10a6055118734434bb157c480f4c2941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:06.532987 10782 consensus_queue.cc:1048] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b951bae1b2047adb22c93280654cb09" member_type: VOTER last_known_addr { host: "127.31.17.130" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:06.543563 10328 raft_consensus.cc:1275] T 063465af3760493ba233140c2c4ac428 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Refusing update from remote peer 10a6055118734434bb157c480f4c2941: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:06.545220 10798 consensus_queue.cc:1048] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4ddcfd355b436aa151140f76a1ef2a" member_type: VOTER last_known_addr { host: "127.31.17.129" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:06.924541 31814 tablet_server.cc:179] TabletServer@127.31.17.129:0 shutting down...
W20260709 13:17:06.939879 10370 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
W20260709 13:17:06.946545 10370 consensus_peers.cc:597] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 -> Peer ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697): Couldn't send request to peer ac4ddcfd355b436aa151140f76a1ef2a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.959195 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:06.961145 31814 tablet_replica.cc:333] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a: stopping tablet replica
I20260709 13:17:06.962282 31814 raft_consensus.cc:2243] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.963377 31814 raft_consensus.cc:2272] T d8eddcc368b243b9b14d4866b62a1ac4 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.966333 31814 tablet_replica.cc:333] T 3c3af7d4c51b4ac7b5648de76b0a1629 P ac4ddcfd355b436aa151140f76a1ef2a: stopping tablet replica
I20260709 13:17:06.966899 31814 raft_consensus.cc:2243] T 3c3af7d4c51b4ac7b5648de76b0a1629 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.967379 31814 raft_consensus.cc:2272] T 3c3af7d4c51b4ac7b5648de76b0a1629 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.969226 31814 tablet_replica.cc:333] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a: stopping tablet replica
I20260709 13:17:06.969796 31814 raft_consensus.cc:2243] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.970533 31814 raft_consensus.cc:2272] T 84a120b131fc4a4b98f620be2d6b4034 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.972628 31814 tablet_replica.cc:333] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a: stopping tablet replica
I20260709 13:17:06.973130 31814 raft_consensus.cc:2243] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.973958 31814 raft_consensus.cc:2272] T c94d9434a48f40a58e4ce29b60cbc196 P ac4ddcfd355b436aa151140f76a1ef2a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.975973 31814 tablet_replica.cc:333] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a: stopping tablet replica
I20260709 13:17:06.976511 31814 raft_consensus.cc:2243] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.977298 31814 raft_consensus.cc:2272] T c5fa5e7b7725429299cf99eace72a54b P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.979177 31814 tablet_replica.cc:333] T 950acc0587d4475ebe4afb537866b8a0 P ac4ddcfd355b436aa151140f76a1ef2a: stopping tablet replica
I20260709 13:17:06.979943 31814 raft_consensus.cc:2243] T 950acc0587d4475ebe4afb537866b8a0 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.980479 31814 raft_consensus.cc:2272] T 950acc0587d4475ebe4afb537866b8a0 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.983080 31814 tablet_replica.cc:333] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a: stopping tablet replica
I20260709 13:17:06.983613 31814 raft_consensus.cc:2243] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.984318 31814 raft_consensus.cc:2272] T 953589d149174e3ab3faf4567854a885 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.986455 31814 tablet_replica.cc:333] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a: stopping tablet replica
I20260709 13:17:06.987020 31814 raft_consensus.cc:2243] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.987524 31814 raft_consensus.cc:2272] T 2823e3cada1042b99edfca84f26ab0bc P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.989620 31814 tablet_replica.cc:333] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a: stopping tablet replica
I20260709 13:17:06.990235 31814 raft_consensus.cc:2243] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.991127 31814 raft_consensus.cc:2272] T 7bd9b52bffde4dd488a4ae6a1747b207 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.993139 31814 tablet_replica.cc:333] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a: stopping tablet replica
I20260709 13:17:06.993695 31814 raft_consensus.cc:2243] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.994427 31814 raft_consensus.cc:2272] T 627686b1121340d3998606b2427dd677 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.996385 31814 tablet_replica.cc:333] T fc0579e86d9c4badb5993661bde5ad0e P ac4ddcfd355b436aa151140f76a1ef2a: stopping tablet replica
I20260709 13:17:06.996922 31814 raft_consensus.cc:2243] T fc0579e86d9c4badb5993661bde5ad0e P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.997304 31814 raft_consensus.cc:2272] T fc0579e86d9c4badb5993661bde5ad0e P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.999087 31814 tablet_replica.cc:333] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a: stopping tablet replica
I20260709 13:17:06.999631 31814 raft_consensus.cc:2243] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.000444 31814 raft_consensus.cc:2272] T ecc607a6b08744d2b1db83b48baaf6a4 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.002542 31814 tablet_replica.cc:333] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a: stopping tablet replica
I20260709 13:17:07.003079 31814 raft_consensus.cc:2243] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.003554 31814 raft_consensus.cc:2272] T a0983129c59a46b1ace98e08af095d83 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.006516 31814 tablet_replica.cc:333] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a: stopping tablet replica
I20260709 13:17:07.007449 31814 raft_consensus.cc:2243] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.008462 31814 raft_consensus.cc:2272] T cefdae2cca9f44d29acd98b0ebb62d78 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:07.009912 10444 consensus_peers.cc:597] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 -> Peer ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697): Couldn't send request to peer ac4ddcfd355b436aa151140f76a1ef2a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:07.011128 31814 tablet_replica.cc:333] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a: stopping tablet replica
I20260709 13:17:07.011796 31814 raft_consensus.cc:2243] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.012383 31814 raft_consensus.cc:2272] T 918b222a69f4460b91a9eb5390ffdb02 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.015082 31814 tablet_replica.cc:333] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a: stopping tablet replica
I20260709 13:17:07.015654 31814 raft_consensus.cc:2243] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.016145 31814 raft_consensus.cc:2272] T 31f50adae4f042668ee6fd360fba0b26 P ac4ddcfd355b436aa151140f76a1ef2a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:07.017727 10444 consensus_peers.cc:597] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941 -> Peer ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697): Couldn't send request to peer ac4ddcfd355b436aa151140f76a1ef2a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:07.018635 31814 tablet_replica.cc:333] T 063465af3760493ba233140c2c4ac428 P ac4ddcfd355b436aa151140f76a1ef2a: stopping tablet replica
I20260709 13:17:07.019476 31814 raft_consensus.cc:2243] T 063465af3760493ba233140c2c4ac428 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.019860 31814 raft_consensus.cc:2272] T 063465af3760493ba233140c2c4ac428 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.022341 31814 tablet_replica.cc:333] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a: stopping tablet replica
I20260709 13:17:07.022792 31814 raft_consensus.cc:2243] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.023162 31814 raft_consensus.cc:2272] T 53c207cb8fe44b888b5018a691f0c030 P ac4ddcfd355b436aa151140f76a1ef2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.064208 31814 tablet_server.cc:196] TabletServer@127.31.17.129:0 shutdown complete.
I20260709 13:17:07.099733 31814 tablet_server.cc:179] TabletServer@127.31.17.130:0 shutting down...
W20260709 13:17:07.121855 10444 consensus_peers.cc:597] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 -> Peer ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697): Couldn't send request to peer ac4ddcfd355b436aa151140f76a1ef2a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:46697: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:07.132928 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:07.133805 31814 tablet_replica.cc:333] T c5fa5e7b7725429299cf99eace72a54b P 2b951bae1b2047adb22c93280654cb09: stopping tablet replica
I20260709 13:17:07.134588 31814 raft_consensus.cc:2243] T c5fa5e7b7725429299cf99eace72a54b P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.135073 31814 raft_consensus.cc:2272] T c5fa5e7b7725429299cf99eace72a54b P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.137370 31814 tablet_replica.cc:333] T 84a120b131fc4a4b98f620be2d6b4034 P 2b951bae1b2047adb22c93280654cb09: stopping tablet replica
I20260709 13:17:07.138629 31814 raft_consensus.cc:2243] T 84a120b131fc4a4b98f620be2d6b4034 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.139180 31814 raft_consensus.cc:2272] T 84a120b131fc4a4b98f620be2d6b4034 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.142150 31814 tablet_replica.cc:333] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09: stopping tablet replica
I20260709 13:17:07.142858 31814 raft_consensus.cc:2243] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.143661 31814 raft_consensus.cc:2272] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.145603 31814 tablet_replica.cc:333] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09: stopping tablet replica
I20260709 13:17:07.146107 31814 raft_consensus.cc:2243] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.146497 31814 raft_consensus.cc:2272] T c94d9434a48f40a58e4ce29b60cbc196 P 2b951bae1b2047adb22c93280654cb09 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.148442 31814 tablet_replica.cc:333] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09: stopping tablet replica
I20260709 13:17:07.149008 31814 raft_consensus.cc:2243] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.149478 31814 raft_consensus.cc:2272] T d8eddcc368b243b9b14d4866b62a1ac4 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.151448 31814 tablet_replica.cc:333] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09: stopping tablet replica
I20260709 13:17:07.152015 31814 raft_consensus.cc:2243] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.152494 31814 raft_consensus.cc:2272] T 7bd9b52bffde4dd488a4ae6a1747b207 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.154368 31814 tablet_replica.cc:333] T 627686b1121340d3998606b2427dd677 P 2b951bae1b2047adb22c93280654cb09: stopping tablet replica
I20260709 13:17:07.154918 31814 raft_consensus.cc:2243] T 627686b1121340d3998606b2427dd677 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.155357 31814 raft_consensus.cc:2272] T 627686b1121340d3998606b2427dd677 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.157150 31814 tablet_replica.cc:333] T fc0579e86d9c4badb5993661bde5ad0e P 2b951bae1b2047adb22c93280654cb09: stopping tablet replica
I20260709 13:17:07.157791 31814 raft_consensus.cc:2243] T fc0579e86d9c4badb5993661bde5ad0e P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.158238 31814 raft_consensus.cc:2272] T fc0579e86d9c4badb5993661bde5ad0e P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.160202 31814 tablet_replica.cc:333] T ecc607a6b08744d2b1db83b48baaf6a4 P 2b951bae1b2047adb22c93280654cb09: stopping tablet replica
I20260709 13:17:07.160741 31814 raft_consensus.cc:2243] T ecc607a6b08744d2b1db83b48baaf6a4 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.161211 31814 raft_consensus.cc:2272] T ecc607a6b08744d2b1db83b48baaf6a4 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.163254 31814 tablet_replica.cc:333] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09: stopping tablet replica
I20260709 13:17:07.163780 31814 raft_consensus.cc:2243] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.164577 31814 raft_consensus.cc:2272] T a0983129c59a46b1ace98e08af095d83 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.166548 31814 tablet_replica.cc:333] T 953589d149174e3ab3faf4567854a885 P 2b951bae1b2047adb22c93280654cb09: stopping tablet replica
I20260709 13:17:07.167078 31814 raft_consensus.cc:2243] T 953589d149174e3ab3faf4567854a885 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.167533 31814 raft_consensus.cc:2272] T 953589d149174e3ab3faf4567854a885 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.169466 31814 tablet_replica.cc:333] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09: stopping tablet replica
I20260709 13:17:07.169988 31814 raft_consensus.cc:2243] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.170775 31814 raft_consensus.cc:2272] T 2823e3cada1042b99edfca84f26ab0bc P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.172801 31814 tablet_replica.cc:333] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09: stopping tablet replica
I20260709 13:17:07.173277 31814 raft_consensus.cc:2243] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.174027 31814 raft_consensus.cc:2272] T 950acc0587d4475ebe4afb537866b8a0 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.176121 31814 tablet_replica.cc:333] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09: stopping tablet replica
I20260709 13:17:07.176635 31814 raft_consensus.cc:2243] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.177359 31814 raft_consensus.cc:2272] T 31f50adae4f042668ee6fd360fba0b26 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.179337 31814 tablet_replica.cc:333] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09: stopping tablet replica
I20260709 13:17:07.179805 31814 raft_consensus.cc:2243] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.180152 31814 raft_consensus.cc:2272] T 063465af3760493ba233140c2c4ac428 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.183339 31814 tablet_replica.cc:333] T 53c207cb8fe44b888b5018a691f0c030 P 2b951bae1b2047adb22c93280654cb09: stopping tablet replica
I20260709 13:17:07.183800 31814 raft_consensus.cc:2243] T 53c207cb8fe44b888b5018a691f0c030 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.184336 31814 raft_consensus.cc:2272] T 53c207cb8fe44b888b5018a691f0c030 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:07.187783 10444 consensus_peers.cc:597] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 -> Peer 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727): Couldn't send request to peer 2b951bae1b2047adb22c93280654cb09. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:07.187904 31814 tablet_replica.cc:333] T 918b222a69f4460b91a9eb5390ffdb02 P 2b951bae1b2047adb22c93280654cb09: stopping tablet replica
I20260709 13:17:07.188556 31814 raft_consensus.cc:2243] T 918b222a69f4460b91a9eb5390ffdb02 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.189042 31814 raft_consensus.cc:2272] T 918b222a69f4460b91a9eb5390ffdb02 P 2b951bae1b2047adb22c93280654cb09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.191035 31814 tablet_replica.cc:333] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09: stopping tablet replica
I20260709 13:17:07.191550 31814 raft_consensus.cc:2243] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.191994 31814 raft_consensus.cc:2272] T cefdae2cca9f44d29acd98b0ebb62d78 P 2b951bae1b2047adb22c93280654cb09 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:07.223147 10444 consensus_peers.cc:597] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 -> Peer 2b951bae1b2047adb22c93280654cb09 (127.31.17.130:38727): Couldn't send request to peer 2b951bae1b2047adb22c93280654cb09. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.130:38727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:07.223966 31814 tablet_server.cc:196] TabletServer@127.31.17.130:0 shutdown complete.
W20260709 13:17:07.232340 10444 consensus_peers.cc:597] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 -> Peer ac4ddcfd355b436aa151140f76a1ef2a (127.31.17.129:46697): Couldn't send request to peer ac4ddcfd355b436aa151140f76a1ef2a. Status: Network error: Client connection negotiation failed: client connection to 127.31.17.129:46697: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:07.261718 31814 tablet_server.cc:179] TabletServer@127.31.17.131:0 shutting down...
I20260709 13:17:07.291123 31814 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:07.291909 31814 tablet_replica.cc:333] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 10a6055118734434bb157c480f4c2941: stopping tablet replica
I20260709 13:17:07.292650 31814 raft_consensus.cc:2243] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.293141 31814 raft_consensus.cc:2272] T 3c3af7d4c51b4ac7b5648de76b0a1629 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.295120 31814 tablet_replica.cc:333] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941: stopping tablet replica
I20260709 13:17:07.295784 31814 raft_consensus.cc:2243] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.296263 31814 raft_consensus.cc:2272] T c5fa5e7b7725429299cf99eace72a54b P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.298172 31814 tablet_replica.cc:333] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941: stopping tablet replica
I20260709 13:17:07.298705 31814 raft_consensus.cc:2243] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.299144 31814 raft_consensus.cc:2272] T 84a120b131fc4a4b98f620be2d6b4034 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.300987 31814 tablet_replica.cc:333] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941: stopping tablet replica
I20260709 13:17:07.301545 31814 raft_consensus.cc:2243] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.301982 31814 raft_consensus.cc:2272] T d8eddcc368b243b9b14d4866b62a1ac4 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.303857 31814 tablet_replica.cc:333] T 31f50adae4f042668ee6fd360fba0b26 P 10a6055118734434bb157c480f4c2941: stopping tablet replica
I20260709 13:17:07.304383 31814 raft_consensus.cc:2243] T 31f50adae4f042668ee6fd360fba0b26 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.304823 31814 raft_consensus.cc:2272] T 31f50adae4f042668ee6fd360fba0b26 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.306512 31814 tablet_replica.cc:333] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941: stopping tablet replica
I20260709 13:17:07.307062 31814 raft_consensus.cc:2243] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.307838 31814 raft_consensus.cc:2272] T 063465af3760493ba233140c2c4ac428 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.309973 31814 tablet_replica.cc:333] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941: stopping tablet replica
I20260709 13:17:07.310505 31814 raft_consensus.cc:2243] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.311214 31814 raft_consensus.cc:2272] T 53c207cb8fe44b888b5018a691f0c030 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.313942 31814 tablet_replica.cc:333] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941: stopping tablet replica
I20260709 13:17:07.314491 31814 raft_consensus.cc:2243] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.315307 31814 raft_consensus.cc:2272] T 918b222a69f4460b91a9eb5390ffdb02 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.317260 31814 tablet_replica.cc:333] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941: stopping tablet replica
I20260709 13:17:07.317811 31814 raft_consensus.cc:2243] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.318246 31814 raft_consensus.cc:2272] T c94d9434a48f40a58e4ce29b60cbc196 P 10a6055118734434bb157c480f4c2941 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.320250 31814 tablet_replica.cc:333] T 953589d149174e3ab3faf4567854a885 P 10a6055118734434bb157c480f4c2941: stopping tablet replica
I20260709 13:17:07.320763 31814 raft_consensus.cc:2243] T 953589d149174e3ab3faf4567854a885 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.321171 31814 raft_consensus.cc:2272] T 953589d149174e3ab3faf4567854a885 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.323539 31814 tablet_replica.cc:333] T 2823e3cada1042b99edfca84f26ab0bc P 10a6055118734434bb157c480f4c2941: stopping tablet replica
I20260709 13:17:07.324062 31814 raft_consensus.cc:2243] T 2823e3cada1042b99edfca84f26ab0bc P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.324487 31814 raft_consensus.cc:2272] T 2823e3cada1042b99edfca84f26ab0bc P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.326349 31814 tablet_replica.cc:333] T cefdae2cca9f44d29acd98b0ebb62d78 P 10a6055118734434bb157c480f4c2941: stopping tablet replica
I20260709 13:17:07.326858 31814 raft_consensus.cc:2243] T cefdae2cca9f44d29acd98b0ebb62d78 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.327332 31814 raft_consensus.cc:2272] T cefdae2cca9f44d29acd98b0ebb62d78 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.329418 31814 tablet_replica.cc:333] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941: stopping tablet replica
I20260709 13:17:07.329946 31814 raft_consensus.cc:2243] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.330382 31814 raft_consensus.cc:2272] T 950acc0587d4475ebe4afb537866b8a0 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.332298 31814 tablet_replica.cc:333] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941: stopping tablet replica
I20260709 13:17:07.332811 31814 raft_consensus.cc:2243] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.333233 31814 raft_consensus.cc:2272] T 627686b1121340d3998606b2427dd677 P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.335074 31814 tablet_replica.cc:333] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941: stopping tablet replica
I20260709 13:17:07.335573 31814 raft_consensus.cc:2243] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.336369 31814 raft_consensus.cc:2272] T fc0579e86d9c4badb5993661bde5ad0e P 10a6055118734434bb157c480f4c2941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.338421 31814 tablet_replica.cc:333] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941: stopping tablet replica
I20260709 13:17:07.338963 31814 raft_consensus.cc:2243] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.339417 31814 raft_consensus.cc:2272] T a0983129c59a46b1ace98e08af095d83 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.341370 31814 tablet_replica.cc:333] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941: stopping tablet replica
I20260709 13:17:07.341848 31814 raft_consensus.cc:2243] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.342278 31814 raft_consensus.cc:2272] T ecc607a6b08744d2b1db83b48baaf6a4 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.344161 31814 tablet_replica.cc:333] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941: stopping tablet replica
I20260709 13:17:07.344592 31814 raft_consensus.cc:2243] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:07.345012 31814 raft_consensus.cc:2272] T 7bd9b52bffde4dd488a4ae6a1747b207 P 10a6055118734434bb157c480f4c2941 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.400585 31814 tablet_server.cc:196] TabletServer@127.31.17.131:0 shutdown complete.
I20260709 13:17:07.435192 31814 master.cc:562] Master@127.31.17.190:33739 shutting down...
I20260709 13:17:07.461011 31814 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:07.461583 31814 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:07.461935 31814 tablet_replica.cc:333] T 00000000000000000000000000000000 P 89cec2b4e7e0471894189b7ec9141303: stopping tablet replica
I20260709 13:17:07.483754 31814 master.cc:584] Master@127.31.17.190:33739 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11639 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24189 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (313881 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:17:07.542511 31814 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 390 messages since previous log ~14 seconds ago
I20260709 13:17:07.542732 31814 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 394 messages since previous log ~14 seconds ago
I20260709 13:17:07.542886 31814 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 394 messages since previous log ~14 seconds ago
I20260709 13:17:07.543049 31814 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:17:07.543202 31814 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:17:07.543702 31814 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~149 seconds ago
I20260709 13:17:07.543879 31814 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 7 messages since previous log ~246 seconds ago
I20260709 13:17:07.544040 31814 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 7 messages since previous log ~247 seconds ago
I20260709 13:17:07.544250 31814 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 6 messages since previous log ~0 seconds ago
I20260709 13:17:07.544616 31814 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
